Orbiter History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 3.922627022s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:17:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.922661006s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 4.101365714s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:16:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.101385853s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [......X.XXX...X........X..X.............XX....X.......X.....] duration: 7.434940734s trace: https://jaeger.dev.storj.io/trace/3042782e35f6925b FAIL (2026-05-26 01:16:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.434963967s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 4.116698038s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:15:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.116715241s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [.......X.XXX...X........X..X.............XX....X.......X....] duration: 6.435273335s trace: https://jaeger.dev.storj.io/trace/3042782e35f6925b FAIL (2026-05-26 01:15:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.435293904s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [X.......X.XXX...X........X..X.............XX....X.......X...] duration: 9.604260469s trace: https://jaeger.dev.storj.io/trace/3042782e35f6925b FAIL (2026-05-26 01:15:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.604289093s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 3.905869872s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:15:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.905891372s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [.X.......X.XXX...X........X..X.............XX....X.......X..] duration: 6.361558764s trace: https://jaeger.dev.storj.io/trace/3042782e35f6925b FAIL (2026-05-26 01:14:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.361578523s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 3.889381318s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:14:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.889402829s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [..X.......X.XXX...X........X..X.............XX....X.......X.] duration: 7.536453855s trace: https://jaeger.dev.storj.io/trace/3042782e35f6925b FAIL (2026-05-26 01:13:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.536467802s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [...X.......X.XXX...X........X..X.............XX....X.......X] duration: 1m0.00127676s trace: https://jaeger.dev.storj.io/trace/3042782e35f6925b FAIL (2026-05-26 01:13:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001296467s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 4.588657749s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:13:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.588667568s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m1.633988091s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:12:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m1.634003802s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [....X.......X.XXX...X........X..X.............XX....X.......] duration: 6.713330038s trace: https://jaeger.dev.storj.io/trace/c603624a20816c8 FAIL (2026-05-26 01:11:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.713346019s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [.....X.......X.XXX...X........X..X.............XX....X......] duration: 32.429386349s trace: https://jaeger.dev.storj.io/trace/c603624a20816c8 FAIL (2026-05-26 01:10:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 32.429407368s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [......X.......X.XXX...X........X..X.............XX....X.....] duration: 6.452806039s trace: https://jaeger.dev.storj.io/trace/c603624a20816c8 FAIL (2026-05-26 01:09:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.452825737s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [.......X.......X.XXX...X........X..X.............XX....X....] duration: 6.826257609s trace: https://jaeger.dev.storj.io/trace/c603624a20816c8 FAIL (2026-05-26 01:08:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.826277295s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [........X.......X.XXX...X........X..X.............XX....X...] duration: 6.804404581s trace: https://jaeger.dev.storj.io/trace/c603624a20816c8 FAIL (2026-05-26 01:07:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.804448193s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [.........X.......X.XXX...X........X..X.............XX....X..] duration: 6.508005263s trace: https://jaeger.dev.storj.io/trace/c603624a20816c8 FAIL (2026-05-26 01:06:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.508050439s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [..........X.......X.XXX...X........X..X.............XX....X.] duration: 6.664690684s trace: https://jaeger.dev.storj.io/trace/c603624a20816c8 FAIL (2026-05-26 01:06:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.664700342s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [...........X.......X.XXX...X........X..X.............XX....X] duration: 1m0.001161908s trace: https://jaeger.dev.storj.io/trace/c603624a20816c8 FAIL (2026-05-26 01:06:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001196213s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [............X.......X.XXX...X........X..X.............XX....] duration: 31.660653203s trace: https://jaeger.dev.storj.io/trace/3f402cdaf22e5c FAIL (2026-05-26 01:05:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 31.660672811s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [.............X.......X.XXX...X........X..X.............XX...] duration: 6.547802945s trace: https://jaeger.dev.storj.io/trace/3f402cdaf22e5c FAIL (2026-05-26 01:03:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.547819468s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [..............X.......X.XXX...X........X..X.............XX..] duration: 6.48203948s trace: https://jaeger.dev.storj.io/trace/3f402cdaf22e5c FAIL (2026-05-26 01:02:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.482085427s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [...............X.......X.XXX...X........X..X.............XX.] duration: 31.584271405s trace: https://jaeger.dev.storj.io/trace/3f402cdaf22e5c FAIL (2026-05-26 01:02:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 31.584280712s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [................X.......X.XXX...X........X..X.............XX] duration: 1m0.000946552s trace: https://jaeger.dev.storj.io/trace/3f402cdaf22e5c FAIL (2026-05-26 01:02:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000955299s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [.................X.......X.XXX...X........X..X.............X] duration: 1m0.001273966s trace: https://jaeger.dev.storj.io/trace/1bdd134e80798125 FAIL (2026-05-26 01:01:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.00129281s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [..................X.......X.XXX...X........X..X.............] duration: 6.420095213s trace: https://jaeger.dev.storj.io/trace/5b59e7787af4eb57 FAIL (2026-05-26 00:59:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.420115912s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [...................X.......X.XXX...X........X..X............] duration: 6.720450189s trace: https://jaeger.dev.storj.io/trace/5b59e7787af4eb57 FAIL (2026-05-26 00:58:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.720518851s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [X...................X.......X.XXX...X........X..X...........] duration: 6.705344841s trace: https://jaeger.dev.storj.io/trace/5b59e7787af4eb57 FAIL (2026-05-26 00:57:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.705366543s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 4.207263583s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:56:53 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 4.207284873s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [.X...................X.......X.XXX...X........X..X..........] duration: 7.653247081s trace: https://jaeger.dev.storj.io/trace/5b59e7787af4eb57 FAIL (2026-05-26 00:56:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.653265798s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 4.034266888s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:55:52 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 4.034285042s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [..X...................X.......X.XXX...X........X..X.........] duration: 6.7272778s trace: https://jaeger.dev.storj.io/trace/5b59e7787af4eb57 FAIL (2026-05-26 00:55:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.727298259s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [...X...................X.......X.XXX...X........X..X........] duration: 6.432809995s trace: https://jaeger.dev.storj.io/trace/5b59e7787af4eb57 FAIL (2026-05-26 00:55:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.432835885s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 4.023495709s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:55:13 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 4.023518943s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [....X...................X.......X.XXX...X........X..X.......] duration: 6.581172827s trace: https://jaeger.dev.storj.io/trace/5b59e7787af4eb57 FAIL (2026-05-26 00:54:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.581230106s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [X..X........................................................] duration: 7.988389931s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:54:17 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 7.988416991s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [.....X...................X.......X.XXX...X........X..X......] duration: 23.225508262s trace: https://jaeger.dev.storj.io/trace/5b59e7787af4eb57 FAIL (2026-05-26 00:54:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 23.225525124s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.X..X.......................................................] duration: 4.076656139s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:53:49 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 4.076676988s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..X..X......................................................] duration: 4.807341466s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:53:20 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 4.807366364s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [......X...................X.......X.XXX...X........X..X.....] duration: 15.567787472s trace: https://jaeger.dev.storj.io/trace/5b59e7787af4eb57 FAIL (2026-05-26 00:52:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 15.567808844s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...X..X.....................................................] duration: 4.273168293s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:52:48 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 4.273193992s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [.......X...................X.......X.XXX...X........X..X....] duration: 6.66378779s trace: https://jaeger.dev.storj.io/trace/5b59e7787af4eb57 FAIL (2026-05-26 00:52:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.663813269s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [....X..X....................................................] duration: 6.448549979s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:51:38 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 6.448573173s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [........X...................X.......X.XXX...X........X..X...] duration: 7.728548062s trace: https://jaeger.dev.storj.io/trace/5b59e7787af4eb57 FAIL (2026-05-26 00:51:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.72857269s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [.........X...................X.......X.XXX...X........X..X..] duration: 6.747320498s trace: https://jaeger.dev.storj.io/trace/5b59e7787af4eb57 FAIL (2026-05-26 00:51:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.747335597s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [..........X...................X.......X.XXX...X........X..X.] duration: 30.469557466s trace: https://jaeger.dev.storj.io/trace/5b59e7787af4eb57 FAIL (2026-05-26 00:50:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.469569139s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.....X..X...................................................] duration: 3.908222131s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:50:33 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 3.908244625s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [...........X...................X.......X.XXX...X........X..X] duration: 1m0.000775117s trace: https://jaeger.dev.storj.io/trace/5b59e7787af4eb57 FAIL (2026-05-26 00:50:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000786308s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)