Orbiter History

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [.............X.] duration: 289.776019ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/18859c3ce835707 FAIL (2025-11-10 05:15:39 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:60490->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 289.804663ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [..............X] duration: 231.093046ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/18859c3ce835707 FAIL (2025-11-10 05:14:44 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:60490->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 231.120589ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [X..............] duration: 361.499003ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/185383dc6ff403ae FAIL (2025-11-10 04:23:13 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57986->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 361.532308ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.X.............] duration: 322.559355ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/185383dc6ff403ae FAIL (2025-11-10 04:22:44 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57986->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 322.58857ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [..X............] duration: 344.853786ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/185383dc6ff403ae FAIL (2025-11-10 04:22:00 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57986->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 344.932136ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [...X...........] duration: 369.714686ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/185383dc6ff403ae FAIL (2025-11-10 04:21:05 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57986->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 369.823543ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [....X..........] duration: 325.249898ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/185383dc6ff403ae FAIL (2025-11-10 04:20:36 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57986->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 325.279516ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.....X.........] duration: 322.891347ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/185383dc6ff403ae FAIL (2025-11-10 04:19:52 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57986->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 322.921916ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [......X........] duration: 342.857727ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/185383dc6ff403ae FAIL (2025-11-10 04:19:33 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57986->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 342.884627ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.......X.......] duration: 394.74485ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/185383dc6ff403ae FAIL (2025-11-10 04:18:36 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57986->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 394.777953ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [........X......] duration: 344.411535ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/185383dc6ff403ae FAIL (2025-11-10 04:17:49 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57986->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 344.440069ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.........X.....] duration: 325.681619ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/185383dc6ff403ae FAIL (2025-11-10 04:17:34 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57986->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 325.715886ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [..........X....] duration: 616.006575ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/185383dc6ff403ae FAIL (2025-11-10 04:17:00 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57986->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 616.033916ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [...........X...] duration: 322.608089ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/185383dc6ff403ae FAIL (2025-11-10 04:15:51 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57986->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 322.641782ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [............X..] duration: 348.860958ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/185383dc6ff403ae FAIL (2025-11-10 04:14:43 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57986->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 348.882309ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.............X.] duration: 325.212076ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/185383dc6ff403ae FAIL (2025-11-10 04:13:48 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57986->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 325.231594ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [..............X] duration: 222.433866ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/185383dc6ff403ae FAIL (2025-11-10 04:13:29 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57986->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 222.462932ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [X..............] duration: 337.10999ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/33687996d11ee673 FAIL (2025-11-10 04:03:53 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55216->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 337.138827ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.X.............] duration: 340.700557ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/33687996d11ee673 FAIL (2025-11-10 04:02:57 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55216->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 340.731287ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [..X............] duration: 375.784996ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/33687996d11ee673 FAIL (2025-11-10 04:02:03 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55216->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 375.816806ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [...X...........] duration: 374.19622ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/33687996d11ee673 FAIL (2025-11-10 04:01:45 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55216->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 374.213032ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [....X..........] duration: 349.129399ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/33687996d11ee673 FAIL (2025-11-10 04:01:05 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55216->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 349.161801ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.....X.........] duration: 345.740986ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/33687996d11ee673 FAIL (2025-11-10 04:00:43 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55216->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 345.775543ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [......X........] duration: 340.140403ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/33687996d11ee673 FAIL (2025-11-10 04:00:00 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55216->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 340.171892ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.......X.......] duration: 332.840601ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/33687996d11ee673 FAIL (2025-11-10 03:59:15 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55216->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 332.884484ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [........X......] duration: 328.068814ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/33687996d11ee673 FAIL (2025-11-10 03:58:57 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55216->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 328.155039ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.........X.....] duration: 346.455476ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/33687996d11ee673 FAIL (2025-11-10 03:58:03 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55216->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 346.487987ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [..........X....] duration: 388.925667ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/33687996d11ee673 FAIL (2025-11-10 03:56:49 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55216->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 388.958931ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [...........X...] duration: 327.76198ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/33687996d11ee673 FAIL (2025-11-10 03:56:08 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55216->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 327.781987ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [............X..] duration: 372.023653ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/33687996d11ee673 FAIL (2025-11-10 03:55:50 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55216->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 372.077977ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.............X.] duration: 333.642488ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/33687996d11ee673 FAIL (2025-11-10 03:54:40 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55216->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 333.668327ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [..............X] duration: 658.806884ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/33687996d11ee673 FAIL (2025-11-10 03:54:00 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55216->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 658.821481ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.820014403s trace: https://jaeger.dev.storj.io/trace/75df214bddf49b6c FAIL (2025-11-10 03:42:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== , upload=16656]: Uploading piece... Nov 10 02:57:07.902523564 (18h53m6.453994016s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.902896285 (18h53m6.454366746s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903057381 (18h53m6.454527842s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903221083 (18h53m6.454691544s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903750420 (18h53m6.455220881s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904221027 (18h53m6.455691478s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904538802 (18h53m6.456009263s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904837540 (18h53m6.456308001s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.905108617 (18h53m6.456579088s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906363115 (18h53m6.457833576s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906725125 (18h53m6.458195616s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:09.614029177 (18h53m8.165499638s) [upload=16656]: Next returned nil segment Nov 10 02:57:09.614047832 (18h53m8.165518303s) [upload=16656]: Waiting for error group managing segments... Nov 10 02:57:09.946613505 (18h53m8.498083967s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:09.963197294 (18h53m8.514667756s) [noise=true , address=45.91.116.8:4048 , piece_id=OJABWCFJN4RG7ONOAXUQZ6YJHLKDVHLPP7A52QO6NULHOF67HJIA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.002783744 (18h53m8.554254215s) [noise=true , address=45.91.116.12:4227 , piece_id=XNCUCK5GHYGN47RWCEZRR457FFT2OCFELRWRNAO4PI3Q3TAQOMAQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.016620001 (18h53m8.568090462s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.025388127 (18h53m8.576858588s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.049947742 (18h53m8.601418193s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.100717507 (18h53m8.652187968s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:36.931729840 (18h53m35.483200301s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection Nov 10 02:57:36.931908921 (18h53m35.483379382s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection Nov 10 02:57:36.932058757 (18h53m35.483529218s) [noise=true , address=145.79.227.25:4619 , piece_id=5UCTYB4LJ5CYQEOOFRLRJWDUAAUPTOHZ7SWDMJNWSQUK2OOEAQLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU, address:145.79.227.25:4619): protocol: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection Nov 10 02:57:36.932196429 (18h53m35.48366689s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:123ib1A8nmVmR272odjhVsUgADYbaMRMiPahSLoZ5eamaV6Qbb1, address:145.79.227.24:4581): protocol: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection Nov 10 02:57:36.932321106 (18h53m35.483791567s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection Nov 10 02:57:36.932454640 (18h53m35.483925102s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection Nov 10 02:57:36.932598614 (18h53m35.484069076s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection Nov 10 02:57:36.932746786 (18h53m35.484217257s) [noise=true , address=145.79.227.31:4798 , piece_id=OFHBBUULKRRN5AGTSVCTYLMOLTD3LXRZV5TE2EEUVWWFI6QLP45Q, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:17Ski7oMzbGroPGgWRrbUiqC1NiLPBBsvYuU4pCZ53xhNKkeBZ, address:145.79.227.31:4798): protocol: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection Nov 10 02:57:36.932891542 (18h53m35.484362013s) [noise=true , address=145.79.227.11:4730 , piece_id=O7D5GZGMKLBKWWH325VVDWPRWWA2GPBTRXSNPW62A5SGOLHUCKAA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection Nov 10 02:57:36.932956786 (18h53m35.484427247s) [seg_pos={0 0}, upload=16656]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Nov 10 02:57:37.186654542 (18h53m35.738125003s) [upload=16656]: Done uploading segments... Nov 10 02:57:37.186695660 (18h53m35.738166121s) [upload=16656]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 5.82003359s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.816858112s trace: https://jaeger.dev.storj.io/trace/75df214bddf49b6c FAIL (2025-11-10 03:41:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== , upload=16656]: Uploading piece... Nov 10 02:57:07.902523564 (18h53m6.453994016s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.902896285 (18h53m6.454366746s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903057381 (18h53m6.454527842s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903221083 (18h53m6.454691544s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903750420 (18h53m6.455220881s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904221027 (18h53m6.455691478s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904538802 (18h53m6.456009263s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904837540 (18h53m6.456308001s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.905108617 (18h53m6.456579088s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906363115 (18h53m6.457833576s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906725125 (18h53m6.458195616s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:09.614029177 (18h53m8.165499638s) [upload=16656]: Next returned nil segment Nov 10 02:57:09.614047832 (18h53m8.165518303s) [upload=16656]: Waiting for error group managing segments... Nov 10 02:57:09.946613505 (18h53m8.498083967s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:09.963197294 (18h53m8.514667756s) [noise=true , address=45.91.116.8:4048 , piece_id=OJABWCFJN4RG7ONOAXUQZ6YJHLKDVHLPP7A52QO6NULHOF67HJIA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.002783744 (18h53m8.554254215s) [noise=true , address=45.91.116.12:4227 , piece_id=XNCUCK5GHYGN47RWCEZRR457FFT2OCFELRWRNAO4PI3Q3TAQOMAQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.016620001 (18h53m8.568090462s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.025388127 (18h53m8.576858588s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.049947742 (18h53m8.601418193s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.100717507 (18h53m8.652187968s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:36.931729840 (18h53m35.483200301s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection Nov 10 02:57:36.931908921 (18h53m35.483379382s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection Nov 10 02:57:36.932058757 (18h53m35.483529218s) [noise=true , address=145.79.227.25:4619 , piece_id=5UCTYB4LJ5CYQEOOFRLRJWDUAAUPTOHZ7SWDMJNWSQUK2OOEAQLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU, address:145.79.227.25:4619): protocol: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection Nov 10 02:57:36.932196429 (18h53m35.48366689s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:123ib1A8nmVmR272odjhVsUgADYbaMRMiPahSLoZ5eamaV6Qbb1, address:145.79.227.24:4581): protocol: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection Nov 10 02:57:36.932321106 (18h53m35.483791567s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection Nov 10 02:57:36.932454640 (18h53m35.483925102s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection Nov 10 02:57:36.932598614 (18h53m35.484069076s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection Nov 10 02:57:36.932746786 (18h53m35.484217257s) [noise=true , address=145.79.227.31:4798 , piece_id=OFHBBUULKRRN5AGTSVCTYLMOLTD3LXRZV5TE2EEUVWWFI6QLP45Q, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:17Ski7oMzbGroPGgWRrbUiqC1NiLPBBsvYuU4pCZ53xhNKkeBZ, address:145.79.227.31:4798): protocol: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection Nov 10 02:57:36.932891542 (18h53m35.484362013s) [noise=true , address=145.79.227.11:4730 , piece_id=O7D5GZGMKLBKWWH325VVDWPRWWA2GPBTRXSNPW62A5SGOLHUCKAA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection Nov 10 02:57:36.932956786 (18h53m35.484427247s) [seg_pos={0 0}, upload=16656]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Nov 10 02:57:37.186654542 (18h53m35.738125003s) [upload=16656]: Done uploading segments... Nov 10 02:57:37.186695660 (18h53m35.738166121s) [upload=16656]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 5.816890764s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.872480207s trace: https://jaeger.dev.storj.io/trace/75df214bddf49b6c FAIL (2025-11-10 03:41:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== , upload=16656]: Uploading piece... Nov 10 02:57:07.902523564 (18h53m6.453994016s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.902896285 (18h53m6.454366746s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903057381 (18h53m6.454527842s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903221083 (18h53m6.454691544s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903750420 (18h53m6.455220881s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904221027 (18h53m6.455691478s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904538802 (18h53m6.456009263s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904837540 (18h53m6.456308001s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.905108617 (18h53m6.456579088s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906363115 (18h53m6.457833576s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906725125 (18h53m6.458195616s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:09.614029177 (18h53m8.165499638s) [upload=16656]: Next returned nil segment Nov 10 02:57:09.614047832 (18h53m8.165518303s) [upload=16656]: Waiting for error group managing segments... Nov 10 02:57:09.946613505 (18h53m8.498083967s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:09.963197294 (18h53m8.514667756s) [noise=true , address=45.91.116.8:4048 , piece_id=OJABWCFJN4RG7ONOAXUQZ6YJHLKDVHLPP7A52QO6NULHOF67HJIA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.002783744 (18h53m8.554254215s) [noise=true , address=45.91.116.12:4227 , piece_id=XNCUCK5GHYGN47RWCEZRR457FFT2OCFELRWRNAO4PI3Q3TAQOMAQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.016620001 (18h53m8.568090462s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.025388127 (18h53m8.576858588s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.049947742 (18h53m8.601418193s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.100717507 (18h53m8.652187968s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:36.931729840 (18h53m35.483200301s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection Nov 10 02:57:36.931908921 (18h53m35.483379382s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection Nov 10 02:57:36.932058757 (18h53m35.483529218s) [noise=true , address=145.79.227.25:4619 , piece_id=5UCTYB4LJ5CYQEOOFRLRJWDUAAUPTOHZ7SWDMJNWSQUK2OOEAQLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU, address:145.79.227.25:4619): protocol: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection Nov 10 02:57:36.932196429 (18h53m35.48366689s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:123ib1A8nmVmR272odjhVsUgADYbaMRMiPahSLoZ5eamaV6Qbb1, address:145.79.227.24:4581): protocol: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection Nov 10 02:57:36.932321106 (18h53m35.483791567s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection Nov 10 02:57:36.932454640 (18h53m35.483925102s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection Nov 10 02:57:36.932598614 (18h53m35.484069076s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection Nov 10 02:57:36.932746786 (18h53m35.484217257s) [noise=true , address=145.79.227.31:4798 , piece_id=OFHBBUULKRRN5AGTSVCTYLMOLTD3LXRZV5TE2EEUVWWFI6QLP45Q, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:17Ski7oMzbGroPGgWRrbUiqC1NiLPBBsvYuU4pCZ53xhNKkeBZ, address:145.79.227.31:4798): protocol: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection Nov 10 02:57:36.932891542 (18h53m35.484362013s) [noise=true , address=145.79.227.11:4730 , piece_id=O7D5GZGMKLBKWWH325VVDWPRWWA2GPBTRXSNPW62A5SGOLHUCKAA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection Nov 10 02:57:36.932956786 (18h53m35.484427247s) [seg_pos={0 0}, upload=16656]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Nov 10 02:57:37.186654542 (18h53m35.738125003s) [upload=16656]: Done uploading segments... Nov 10 02:57:37.186695660 (18h53m35.738166121s) [upload=16656]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 5.872509142s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.901692568s trace: https://jaeger.dev.storj.io/trace/75df214bddf49b6c FAIL (2025-11-10 03:40:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== , upload=16656]: Uploading piece... Nov 10 02:57:07.902523564 (18h53m6.453994016s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.902896285 (18h53m6.454366746s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903057381 (18h53m6.454527842s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903221083 (18h53m6.454691544s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903750420 (18h53m6.455220881s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904221027 (18h53m6.455691478s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904538802 (18h53m6.456009263s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904837540 (18h53m6.456308001s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.905108617 (18h53m6.456579088s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906363115 (18h53m6.457833576s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906725125 (18h53m6.458195616s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:09.614029177 (18h53m8.165499638s) [upload=16656]: Next returned nil segment Nov 10 02:57:09.614047832 (18h53m8.165518303s) [upload=16656]: Waiting for error group managing segments... Nov 10 02:57:09.946613505 (18h53m8.498083967s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:09.963197294 (18h53m8.514667756s) [noise=true , address=45.91.116.8:4048 , piece_id=OJABWCFJN4RG7ONOAXUQZ6YJHLKDVHLPP7A52QO6NULHOF67HJIA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.002783744 (18h53m8.554254215s) [noise=true , address=45.91.116.12:4227 , piece_id=XNCUCK5GHYGN47RWCEZRR457FFT2OCFELRWRNAO4PI3Q3TAQOMAQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.016620001 (18h53m8.568090462s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.025388127 (18h53m8.576858588s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.049947742 (18h53m8.601418193s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.100717507 (18h53m8.652187968s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:36.931729840 (18h53m35.483200301s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection Nov 10 02:57:36.931908921 (18h53m35.483379382s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection Nov 10 02:57:36.932058757 (18h53m35.483529218s) [noise=true , address=145.79.227.25:4619 , piece_id=5UCTYB4LJ5CYQEOOFRLRJWDUAAUPTOHZ7SWDMJNWSQUK2OOEAQLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU, address:145.79.227.25:4619): protocol: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection Nov 10 02:57:36.932196429 (18h53m35.48366689s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:123ib1A8nmVmR272odjhVsUgADYbaMRMiPahSLoZ5eamaV6Qbb1, address:145.79.227.24:4581): protocol: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection Nov 10 02:57:36.932321106 (18h53m35.483791567s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection Nov 10 02:57:36.932454640 (18h53m35.483925102s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection Nov 10 02:57:36.932598614 (18h53m35.484069076s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection Nov 10 02:57:36.932746786 (18h53m35.484217257s) [noise=true , address=145.79.227.31:4798 , piece_id=OFHBBUULKRRN5AGTSVCTYLMOLTD3LXRZV5TE2EEUVWWFI6QLP45Q, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:17Ski7oMzbGroPGgWRrbUiqC1NiLPBBsvYuU4pCZ53xhNKkeBZ, address:145.79.227.31:4798): protocol: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection Nov 10 02:57:36.932891542 (18h53m35.484362013s) [noise=true , address=145.79.227.11:4730 , piece_id=O7D5GZGMKLBKWWH325VVDWPRWWA2GPBTRXSNPW62A5SGOLHUCKAA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection Nov 10 02:57:36.932956786 (18h53m35.484427247s) [seg_pos={0 0}, upload=16656]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Nov 10 02:57:37.186654542 (18h53m35.738125003s) [upload=16656]: Done uploading segments... Nov 10 02:57:37.186695660 (18h53m35.738166121s) [upload=16656]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 5.901716233s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.996112856s trace: https://jaeger.dev.storj.io/trace/75df214bddf49b6c FAIL (2025-11-10 03:39:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== , upload=16656]: Uploading piece... Nov 10 02:57:07.902523564 (18h53m6.453994016s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.902896285 (18h53m6.454366746s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903057381 (18h53m6.454527842s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903221083 (18h53m6.454691544s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903750420 (18h53m6.455220881s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904221027 (18h53m6.455691478s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904538802 (18h53m6.456009263s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904837540 (18h53m6.456308001s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.905108617 (18h53m6.456579088s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906363115 (18h53m6.457833576s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906725125 (18h53m6.458195616s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:09.614029177 (18h53m8.165499638s) [upload=16656]: Next returned nil segment Nov 10 02:57:09.614047832 (18h53m8.165518303s) [upload=16656]: Waiting for error group managing segments... Nov 10 02:57:09.946613505 (18h53m8.498083967s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:09.963197294 (18h53m8.514667756s) [noise=true , address=45.91.116.8:4048 , piece_id=OJABWCFJN4RG7ONOAXUQZ6YJHLKDVHLPP7A52QO6NULHOF67HJIA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.002783744 (18h53m8.554254215s) [noise=true , address=45.91.116.12:4227 , piece_id=XNCUCK5GHYGN47RWCEZRR457FFT2OCFELRWRNAO4PI3Q3TAQOMAQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.016620001 (18h53m8.568090462s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.025388127 (18h53m8.576858588s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.049947742 (18h53m8.601418193s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.100717507 (18h53m8.652187968s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:36.931729840 (18h53m35.483200301s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection Nov 10 02:57:36.931908921 (18h53m35.483379382s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection Nov 10 02:57:36.932058757 (18h53m35.483529218s) [noise=true , address=145.79.227.25:4619 , piece_id=5UCTYB4LJ5CYQEOOFRLRJWDUAAUPTOHZ7SWDMJNWSQUK2OOEAQLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU, address:145.79.227.25:4619): protocol: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection Nov 10 02:57:36.932196429 (18h53m35.48366689s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:123ib1A8nmVmR272odjhVsUgADYbaMRMiPahSLoZ5eamaV6Qbb1, address:145.79.227.24:4581): protocol: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection Nov 10 02:57:36.932321106 (18h53m35.483791567s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection Nov 10 02:57:36.932454640 (18h53m35.483925102s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection Nov 10 02:57:36.932598614 (18h53m35.484069076s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection Nov 10 02:57:36.932746786 (18h53m35.484217257s) [noise=true , address=145.79.227.31:4798 , piece_id=OFHBBUULKRRN5AGTSVCTYLMOLTD3LXRZV5TE2EEUVWWFI6QLP45Q, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:17Ski7oMzbGroPGgWRrbUiqC1NiLPBBsvYuU4pCZ53xhNKkeBZ, address:145.79.227.31:4798): protocol: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection Nov 10 02:57:36.932891542 (18h53m35.484362013s) [noise=true , address=145.79.227.11:4730 , piece_id=O7D5GZGMKLBKWWH325VVDWPRWWA2GPBTRXSNPW62A5SGOLHUCKAA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection Nov 10 02:57:36.932956786 (18h53m35.484427247s) [seg_pos={0 0}, upload=16656]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Nov 10 02:57:37.186654542 (18h53m35.738125003s) [upload=16656]: Done uploading segments... Nov 10 02:57:37.186695660 (18h53m35.738166121s) [upload=16656]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 5.996154685s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.84447089s trace: https://jaeger.dev.storj.io/trace/75df214bddf49b6c FAIL (2025-11-10 03:38:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== , upload=16656]: Uploading piece... Nov 10 02:57:07.902523564 (18h53m6.453994016s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.902896285 (18h53m6.454366746s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903057381 (18h53m6.454527842s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903221083 (18h53m6.454691544s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903750420 (18h53m6.455220881s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904221027 (18h53m6.455691478s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904538802 (18h53m6.456009263s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904837540 (18h53m6.456308001s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.905108617 (18h53m6.456579088s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906363115 (18h53m6.457833576s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906725125 (18h53m6.458195616s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:09.614029177 (18h53m8.165499638s) [upload=16656]: Next returned nil segment Nov 10 02:57:09.614047832 (18h53m8.165518303s) [upload=16656]: Waiting for error group managing segments... Nov 10 02:57:09.946613505 (18h53m8.498083967s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:09.963197294 (18h53m8.514667756s) [noise=true , address=45.91.116.8:4048 , piece_id=OJABWCFJN4RG7ONOAXUQZ6YJHLKDVHLPP7A52QO6NULHOF67HJIA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.002783744 (18h53m8.554254215s) [noise=true , address=45.91.116.12:4227 , piece_id=XNCUCK5GHYGN47RWCEZRR457FFT2OCFELRWRNAO4PI3Q3TAQOMAQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.016620001 (18h53m8.568090462s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.025388127 (18h53m8.576858588s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.049947742 (18h53m8.601418193s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.100717507 (18h53m8.652187968s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:36.931729840 (18h53m35.483200301s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection Nov 10 02:57:36.931908921 (18h53m35.483379382s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection Nov 10 02:57:36.932058757 (18h53m35.483529218s) [noise=true , address=145.79.227.25:4619 , piece_id=5UCTYB4LJ5CYQEOOFRLRJWDUAAUPTOHZ7SWDMJNWSQUK2OOEAQLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU, address:145.79.227.25:4619): protocol: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection Nov 10 02:57:36.932196429 (18h53m35.48366689s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:123ib1A8nmVmR272odjhVsUgADYbaMRMiPahSLoZ5eamaV6Qbb1, address:145.79.227.24:4581): protocol: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection Nov 10 02:57:36.932321106 (18h53m35.483791567s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection Nov 10 02:57:36.932454640 (18h53m35.483925102s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection Nov 10 02:57:36.932598614 (18h53m35.484069076s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection Nov 10 02:57:36.932746786 (18h53m35.484217257s) [noise=true , address=145.79.227.31:4798 , piece_id=OFHBBUULKRRN5AGTSVCTYLMOLTD3LXRZV5TE2EEUVWWFI6QLP45Q, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:17Ski7oMzbGroPGgWRrbUiqC1NiLPBBsvYuU4pCZ53xhNKkeBZ, address:145.79.227.31:4798): protocol: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection Nov 10 02:57:36.932891542 (18h53m35.484362013s) [noise=true , address=145.79.227.11:4730 , piece_id=O7D5GZGMKLBKWWH325VVDWPRWWA2GPBTRXSNPW62A5SGOLHUCKAA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection Nov 10 02:57:36.932956786 (18h53m35.484427247s) [seg_pos={0 0}, upload=16656]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Nov 10 02:57:37.186654542 (18h53m35.738125003s) [upload=16656]: Done uploading segments... Nov 10 02:57:37.186695660 (18h53m35.738166121s) [upload=16656]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 5.844501689s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.955734428s trace: https://jaeger.dev.storj.io/trace/75df214bddf49b6c FAIL (2025-11-10 03:37:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== , upload=16656]: Uploading piece... Nov 10 02:57:07.902523564 (18h53m6.453994016s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.902896285 (18h53m6.454366746s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903057381 (18h53m6.454527842s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903221083 (18h53m6.454691544s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903750420 (18h53m6.455220881s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904221027 (18h53m6.455691478s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904538802 (18h53m6.456009263s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904837540 (18h53m6.456308001s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.905108617 (18h53m6.456579088s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906363115 (18h53m6.457833576s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906725125 (18h53m6.458195616s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:09.614029177 (18h53m8.165499638s) [upload=16656]: Next returned nil segment Nov 10 02:57:09.614047832 (18h53m8.165518303s) [upload=16656]: Waiting for error group managing segments... Nov 10 02:57:09.946613505 (18h53m8.498083967s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:09.963197294 (18h53m8.514667756s) [noise=true , address=45.91.116.8:4048 , piece_id=OJABWCFJN4RG7ONOAXUQZ6YJHLKDVHLPP7A52QO6NULHOF67HJIA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.002783744 (18h53m8.554254215s) [noise=true , address=45.91.116.12:4227 , piece_id=XNCUCK5GHYGN47RWCEZRR457FFT2OCFELRWRNAO4PI3Q3TAQOMAQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.016620001 (18h53m8.568090462s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.025388127 (18h53m8.576858588s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.049947742 (18h53m8.601418193s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.100717507 (18h53m8.652187968s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:36.931729840 (18h53m35.483200301s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection Nov 10 02:57:36.931908921 (18h53m35.483379382s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection Nov 10 02:57:36.932058757 (18h53m35.483529218s) [noise=true , address=145.79.227.25:4619 , piece_id=5UCTYB4LJ5CYQEOOFRLRJWDUAAUPTOHZ7SWDMJNWSQUK2OOEAQLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU, address:145.79.227.25:4619): protocol: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection Nov 10 02:57:36.932196429 (18h53m35.48366689s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:123ib1A8nmVmR272odjhVsUgADYbaMRMiPahSLoZ5eamaV6Qbb1, address:145.79.227.24:4581): protocol: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection Nov 10 02:57:36.932321106 (18h53m35.483791567s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection Nov 10 02:57:36.932454640 (18h53m35.483925102s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection Nov 10 02:57:36.932598614 (18h53m35.484069076s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection Nov 10 02:57:36.932746786 (18h53m35.484217257s) [noise=true , address=145.79.227.31:4798 , piece_id=OFHBBUULKRRN5AGTSVCTYLMOLTD3LXRZV5TE2EEUVWWFI6QLP45Q, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:17Ski7oMzbGroPGgWRrbUiqC1NiLPBBsvYuU4pCZ53xhNKkeBZ, address:145.79.227.31:4798): protocol: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection Nov 10 02:57:36.932891542 (18h53m35.484362013s) [noise=true , address=145.79.227.11:4730 , piece_id=O7D5GZGMKLBKWWH325VVDWPRWWA2GPBTRXSNPW62A5SGOLHUCKAA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection Nov 10 02:57:36.932956786 (18h53m35.484427247s) [seg_pos={0 0}, upload=16656]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Nov 10 02:57:37.186654542 (18h53m35.738125003s) [upload=16656]: Done uploading segments... Nov 10 02:57:37.186695660 (18h53m35.738166121s) [upload=16656]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 5.955764767s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.689554972s trace: https://jaeger.dev.storj.io/trace/3549d25e06814a89 FAIL (2025-11-10 03:36:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== =true , address=77.90.31.15:4729 , piece_id=PEGSLMGDM2MGDJBIMRDI4RFWPNL2YP6DVKRPNLNFZGFUOQ2TTKRQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.660891599 (18h44m32.21236206s) [noise=true , address=77.90.31.13:4638 , piece_id=CU246YAEDHRCRV42CC3CONL4VSOLZJGBMWWV6QQZQX3EFETZ3GTQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.661346796 (18h44m32.212817257s) [noise=true , address=45.91.116.9:4287 , piece_id=SXKQE4JXCW2IF3L2SHBWGGEVKZARNRVRNEW4EKTGG4F56O3VV74Q, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.661950416 (18h44m32.213420877s) [noise=true , address=145.79.227.52:4458 , piece_id=DINKDXOKRZDCMFPPBGV53AXPW4JXGZDIBSYKQ6UMSXTKFKXMQQPA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.662428906 (18h44m32.213899367s) [noise=true , address=77.90.31.18:4823 , piece_id=SG5MP5BSSLYGKAKR7S3LLFYRD5BIVPXLBX3QG6HGXQID75ZTVA2A, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.662926414 (18h44m32.214396866s) [noise=true , address=5.231.73.4:4016 , piece_id=O4SKTUGCKOFFRRPOACGCSIZQT5UJFNSSQT24Z3F4Y6ILMYQLTDVA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.663484687 (18h44m32.214955149s) [noise=true , address=45.91.116.5:4302 , piece_id=46SNKQMGG2BJFM3W3SUEKWBRFOJYW3DN2EGIRHF5R3RBUHEXL2LQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.664867019 (18h44m32.21633748s) [noise=true , address=145.79.227.23:4556 , piece_id=U5BQUOLGMECWROVTWMRCOC4G4RXY4EQWPQXDIPZRHKUY4VWSZRCA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.665313670 (18h44m32.216784131s) [noise=true , address=64.49.13.140:4506 , piece_id=GIG6KBRWC6347MKHWUP6Y5SRFAHAIC75NENYNSXJ3HWVP27ET7BA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.666575854 (18h44m32.218046315s) [noise=true , address=77.90.31.16:4754 , piece_id=6I3JRELSBPBG4Z3Q26WOWMJYQQRMRKH56647VV33JOBCVY3PDJXQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.667056288 (18h44m32.218526759s) [noise=true , address=145.79.227.37:4583 , piece_id=TF5IAGVJBJX4UFTNW7SGD5BV2WIT2U2QUQ2CDAPJGDZ3FVJ3ZI4Q, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.668506800 (18h44m32.219977261s) [noise=true , address=45.91.116.14:4199 , piece_id=M5ZEEPVVHOPXQ4VAIZQLLAHW5UNPRJ6KRPX4TC3XNAFELV2NJHPQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.668888778 (18h44m32.220359239s) [noise=true , address=5.231.73.2:4009 , piece_id=EFQG7FJP6XDHD7QS25XOACZRIOCDR3ZQIJ3SD4X6ZZBZUTMBFPHA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.673830457 (18h44m32.225300918s) [noise=true , address=145.79.227.44:4197 , piece_id=YIL6O2KW4M46ARDLTPCDTEFCV4RKUNUYBPSIWXWILDX245NWE3DA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.675567365 (18h44m32.227037826s) [noise=true , address=145.79.227.33:4877 , piece_id=E6O7TZGFY3CQAADT2AJ37HEU3XQG6OBULFAJKNHJOKZJN4H6FRSQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:35.018943312 (18h44m33.570413763s) [upload=16524]: Next returned nil segment Nov 10 02:48:35.018998397 (18h44m33.570468848s) [upload=16524]: Waiting for error group managing segments... Nov 10 02:48:35.374141893 (18h44m33.925612355s) [noise=true , address=64.49.13.140:4506 , piece_id=GIG6KBRWC6347MKHWUP6Y5SRFAHAIC75NENYNSXJ3HWVP27ET7BA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.460757926 (18h44m34.012228387s) [noise=true , address=5.231.73.4:4016 , piece_id=O4SKTUGCKOFFRRPOACGCSIZQT5UJFNSSQT24Z3F4Y6ILMYQLTDVA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.515755341 (18h44m34.067225802s) [noise=true , address=5.231.73.2:4009 , piece_id=EFQG7FJP6XDHD7QS25XOACZRIOCDR3ZQIJ3SD4X6ZZBZUTMBFPHA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.650926070 (18h44m34.202396521s) [noise=true , address=77.90.31.15:4729 , piece_id=PEGSLMGDM2MGDJBIMRDI4RFWPNL2YP6DVKRPNLNFZGFUOQ2TTKRQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.651707047 (18h44m34.203177498s) [noise=true , address=45.91.116.8:4049 , piece_id=7YP2WON7KCXFWVHEVQPF5MG3PUR44ANPA5NIZOVE2ARA3MI7R2XA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.676407551 (18h44m34.227878012s) [noise=true , address=45.91.116.14:4199 , piece_id=M5ZEEPVVHOPXQ4VAIZQLLAHW5UNPRJ6KRPX4TC3XNAFELV2NJHPQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.680319410 (18h44m34.231789871s) [noise=true , address=45.91.116.9:4287 , piece_id=SXKQE4JXCW2IF3L2SHBWGGEVKZARNRVRNEW4EKTGG4F56O3VV74Q, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.687109680 (18h44m34.238580141s) [noise=true , address=77.90.31.16:4754 , piece_id=6I3JRELSBPBG4Z3Q26WOWMJYQQRMRKH56647VV33JOBCVY3PDJXQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.696693820 (18h44m34.248164291s) [noise=true , address=77.90.31.18:4823 , piece_id=SG5MP5BSSLYGKAKR7S3LLFYRD5BIVPXLBX3QG6HGXQID75ZTVA2A, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.722143340 (18h44m34.273613801s) [noise=true , address=45.91.116.5:4302 , piece_id=46SNKQMGG2BJFM3W3SUEKWBRFOJYW3DN2EGIRHF5R3RBUHEXL2LQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.758302945 (18h44m34.309773416s) [noise=true , address=77.90.31.13:4638 , piece_id=CU246YAEDHRCRV42CC3CONL4VSOLZJGBMWWV6QQZQX3EFETZ3GTQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:49:32.681760451 (18h45m31.233230912s) [noise=true , address=145.79.227.37:4583 , piece_id=TF5IAGVJBJX4UFTNW7SGD5BV2WIT2U2QUQ2CDAPJGDZ3FVJ3ZI4Q, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:1Zy3MLWBv2MCN8Tdb8BTCM8P5AMPDQCSJ8faTsmjLPurvs3ba6, address:145.79.227.37:4583): protocol: write tcp 188.166.225.170:34686->145.79.227.37:4583: use of closed network connection; write tcp 188.166.225.170:34686->145.79.227.37:4583: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34686->145.79.227.37:4583: use of closed network connection Nov 10 02:49:32.681935615 (18h45m31.233406076s) [noise=true , address=145.79.227.22:4518 , piece_id=JWZUNOBH3YTTKD7UZKZHYFJAZVFJQZEX6Q4RKE2LLXQ53DS5AIJA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:1ozLDHDa9ankBimUBjpM91VrraKMptSCQPoDS9yWu2tjVErasU, address:145.79.227.22:4518): protocol: write tcp 188.166.225.170:32942->145.79.227.22:4518: use of closed network connection; write tcp 188.166.225.170:32942->145.79.227.22:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32942->145.79.227.22:4518: use of closed network connection Nov 10 02:49:32.682092233 (18h45m31.233562695s) [noise=true , address=145.79.227.43:4186 , piece_id=2XRO33G32TSZTLRORQEQISDJZT6CW7E2FCEY23UPSZ3UN6IXV2DA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:12Gu3vXy2JUkKDaF4MkMCgVmYspW4Ez8EAfv6e4GeCkrwYTe5T, address:145.79.227.43:4186): protocol: write tcp 188.166.225.170:56786->145.79.227.43:4186: use of closed network connection; write tcp 188.166.225.170:56786->145.79.227.43:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56786->145.79.227.43:4186: use of closed network connection Nov 10 02:49:32.682114004 (18h45m31.233584475s) [noise=true , address=145.79.227.33:4877 , piece_id=E6O7TZGFY3CQAADT2AJ37HEU3XQG6OBULFAJKNHJOKZJN4H6FRSQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:17TuauVrjKmehRpXqmK7bemU9V33GDZu9RGBs6fanXvJkV1gdH, address:145.79.227.33:4877): protocol: expected piece hash; context deadline exceeded; EOF Nov 10 02:49:32.682210849 (18h45m31.23368131s) [noise=true , address=145.79.227.52:4458 , piece_id=DINKDXOKRZDCMFPPBGV53AXPW4JXGZDIBSYKQ6UMSXTKFKXMQQPA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb, address:145.79.227.52:4458): protocol: write tcp 188.166.225.170:41982->145.79.227.52:4458: use of closed network connection; write tcp 188.166.225.170:41982->145.79.227.52:4458: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41982->145.79.227.52:4458: use of closed network connection Nov 10 02:49:32.682569782 (18h45m31.234040243s) [noise=true , address=145.79.227.23:4556 , piece_id=U5BQUOLGMECWROVTWMRCOC4G4RXY4EQWPQXDIPZRHKUY4VWSZRCA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:1i62GRFASf7UPVGhUofmRkz3zZSyhq4fDycgyYtfD7pHR3w91v, address:145.79.227.23:4556): protocol: write tcp 188.166.225.170:58706->145.79.227.23:4556: use of closed network connection; write tcp 188.166.225.170:58706->145.79.227.23:4556: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58706->145.79.227.23:4556: use of closed network connection Nov 10 02:49:32.682721071 (18h45m31.234191522s) [noise=true , address=145.79.227.44:4197 , piece_id=YIL6O2KW4M46ARDLTPCDTEFCV4RKUNUYBPSIWXWILDX245NWE3DA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:12niHLkT5pbmYSbarHZGeeCRtwjZRXtvEtHMGAb7ja4a7Xuuvfi, address:145.79.227.44:4197): protocol: read tcp 188.166.225.170:46490->145.79.227.44:4197: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 02:49:32.682759744 (18h45m31.234230205s) [seg_pos={0 0}, upload=16524]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Nov 10 02:49:32.932751323 (18h45m31.484221774s) [upload=16524]: Done uploading segments... Nov 10 02:49:32.932798863 (18h45m31.484269334s) [upload=16524]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 5.68958474s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 6.083952621s trace: https://jaeger.dev.storj.io/trace/75df214bddf49b6c FAIL (2025-11-10 03:36:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== , upload=16656]: Uploading piece... Nov 10 02:57:07.902523564 (18h53m6.453994016s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.902896285 (18h53m6.454366746s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903057381 (18h53m6.454527842s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903221083 (18h53m6.454691544s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903750420 (18h53m6.455220881s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904221027 (18h53m6.455691478s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904538802 (18h53m6.456009263s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904837540 (18h53m6.456308001s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.905108617 (18h53m6.456579088s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906363115 (18h53m6.457833576s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906725125 (18h53m6.458195616s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:09.614029177 (18h53m8.165499638s) [upload=16656]: Next returned nil segment Nov 10 02:57:09.614047832 (18h53m8.165518303s) [upload=16656]: Waiting for error group managing segments... Nov 10 02:57:09.946613505 (18h53m8.498083967s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:09.963197294 (18h53m8.514667756s) [noise=true , address=45.91.116.8:4048 , piece_id=OJABWCFJN4RG7ONOAXUQZ6YJHLKDVHLPP7A52QO6NULHOF67HJIA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.002783744 (18h53m8.554254215s) [noise=true , address=45.91.116.12:4227 , piece_id=XNCUCK5GHYGN47RWCEZRR457FFT2OCFELRWRNAO4PI3Q3TAQOMAQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.016620001 (18h53m8.568090462s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.025388127 (18h53m8.576858588s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.049947742 (18h53m8.601418193s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.100717507 (18h53m8.652187968s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:36.931729840 (18h53m35.483200301s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection Nov 10 02:57:36.931908921 (18h53m35.483379382s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection Nov 10 02:57:36.932058757 (18h53m35.483529218s) [noise=true , address=145.79.227.25:4619 , piece_id=5UCTYB4LJ5CYQEOOFRLRJWDUAAUPTOHZ7SWDMJNWSQUK2OOEAQLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU, address:145.79.227.25:4619): protocol: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection Nov 10 02:57:36.932196429 (18h53m35.48366689s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:123ib1A8nmVmR272odjhVsUgADYbaMRMiPahSLoZ5eamaV6Qbb1, address:145.79.227.24:4581): protocol: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection Nov 10 02:57:36.932321106 (18h53m35.483791567s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection Nov 10 02:57:36.932454640 (18h53m35.483925102s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection Nov 10 02:57:36.932598614 (18h53m35.484069076s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection Nov 10 02:57:36.932746786 (18h53m35.484217257s) [noise=true , address=145.79.227.31:4798 , piece_id=OFHBBUULKRRN5AGTSVCTYLMOLTD3LXRZV5TE2EEUVWWFI6QLP45Q, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:17Ski7oMzbGroPGgWRrbUiqC1NiLPBBsvYuU4pCZ53xhNKkeBZ, address:145.79.227.31:4798): protocol: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection Nov 10 02:57:36.932891542 (18h53m35.484362013s) [noise=true , address=145.79.227.11:4730 , piece_id=O7D5GZGMKLBKWWH325VVDWPRWWA2GPBTRXSNPW62A5SGOLHUCKAA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection Nov 10 02:57:36.932956786 (18h53m35.484427247s) [seg_pos={0 0}, upload=16656]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Nov 10 02:57:37.186654542 (18h53m35.738125003s) [upload=16656]: Done uploading segments... Nov 10 02:57:37.186695660 (18h53m35.738166121s) [upload=16656]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 6.083977779s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.726380244s trace: https://jaeger.dev.storj.io/trace/3549d25e06814a89 FAIL (2025-11-10 03:36:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== =true , address=77.90.31.15:4729 , piece_id=PEGSLMGDM2MGDJBIMRDI4RFWPNL2YP6DVKRPNLNFZGFUOQ2TTKRQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.660891599 (18h44m32.21236206s) [noise=true , address=77.90.31.13:4638 , piece_id=CU246YAEDHRCRV42CC3CONL4VSOLZJGBMWWV6QQZQX3EFETZ3GTQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.661346796 (18h44m32.212817257s) [noise=true , address=45.91.116.9:4287 , piece_id=SXKQE4JXCW2IF3L2SHBWGGEVKZARNRVRNEW4EKTGG4F56O3VV74Q, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.661950416 (18h44m32.213420877s) [noise=true , address=145.79.227.52:4458 , piece_id=DINKDXOKRZDCMFPPBGV53AXPW4JXGZDIBSYKQ6UMSXTKFKXMQQPA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.662428906 (18h44m32.213899367s) [noise=true , address=77.90.31.18:4823 , piece_id=SG5MP5BSSLYGKAKR7S3LLFYRD5BIVPXLBX3QG6HGXQID75ZTVA2A, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.662926414 (18h44m32.214396866s) [noise=true , address=5.231.73.4:4016 , piece_id=O4SKTUGCKOFFRRPOACGCSIZQT5UJFNSSQT24Z3F4Y6ILMYQLTDVA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.663484687 (18h44m32.214955149s) [noise=true , address=45.91.116.5:4302 , piece_id=46SNKQMGG2BJFM3W3SUEKWBRFOJYW3DN2EGIRHF5R3RBUHEXL2LQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.664867019 (18h44m32.21633748s) [noise=true , address=145.79.227.23:4556 , piece_id=U5BQUOLGMECWROVTWMRCOC4G4RXY4EQWPQXDIPZRHKUY4VWSZRCA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.665313670 (18h44m32.216784131s) [noise=true , address=64.49.13.140:4506 , piece_id=GIG6KBRWC6347MKHWUP6Y5SRFAHAIC75NENYNSXJ3HWVP27ET7BA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.666575854 (18h44m32.218046315s) [noise=true , address=77.90.31.16:4754 , piece_id=6I3JRELSBPBG4Z3Q26WOWMJYQQRMRKH56647VV33JOBCVY3PDJXQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.667056288 (18h44m32.218526759s) [noise=true , address=145.79.227.37:4583 , piece_id=TF5IAGVJBJX4UFTNW7SGD5BV2WIT2U2QUQ2CDAPJGDZ3FVJ3ZI4Q, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.668506800 (18h44m32.219977261s) [noise=true , address=45.91.116.14:4199 , piece_id=M5ZEEPVVHOPXQ4VAIZQLLAHW5UNPRJ6KRPX4TC3XNAFELV2NJHPQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.668888778 (18h44m32.220359239s) [noise=true , address=5.231.73.2:4009 , piece_id=EFQG7FJP6XDHD7QS25XOACZRIOCDR3ZQIJ3SD4X6ZZBZUTMBFPHA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.673830457 (18h44m32.225300918s) [noise=true , address=145.79.227.44:4197 , piece_id=YIL6O2KW4M46ARDLTPCDTEFCV4RKUNUYBPSIWXWILDX245NWE3DA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.675567365 (18h44m32.227037826s) [noise=true , address=145.79.227.33:4877 , piece_id=E6O7TZGFY3CQAADT2AJ37HEU3XQG6OBULFAJKNHJOKZJN4H6FRSQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:35.018943312 (18h44m33.570413763s) [upload=16524]: Next returned nil segment Nov 10 02:48:35.018998397 (18h44m33.570468848s) [upload=16524]: Waiting for error group managing segments... Nov 10 02:48:35.374141893 (18h44m33.925612355s) [noise=true , address=64.49.13.140:4506 , piece_id=GIG6KBRWC6347MKHWUP6Y5SRFAHAIC75NENYNSXJ3HWVP27ET7BA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.460757926 (18h44m34.012228387s) [noise=true , address=5.231.73.4:4016 , piece_id=O4SKTUGCKOFFRRPOACGCSIZQT5UJFNSSQT24Z3F4Y6ILMYQLTDVA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.515755341 (18h44m34.067225802s) [noise=true , address=5.231.73.2:4009 , piece_id=EFQG7FJP6XDHD7QS25XOACZRIOCDR3ZQIJ3SD4X6ZZBZUTMBFPHA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.650926070 (18h44m34.202396521s) [noise=true , address=77.90.31.15:4729 , piece_id=PEGSLMGDM2MGDJBIMRDI4RFWPNL2YP6DVKRPNLNFZGFUOQ2TTKRQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.651707047 (18h44m34.203177498s) [noise=true , address=45.91.116.8:4049 , piece_id=7YP2WON7KCXFWVHEVQPF5MG3PUR44ANPA5NIZOVE2ARA3MI7R2XA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.676407551 (18h44m34.227878012s) [noise=true , address=45.91.116.14:4199 , piece_id=M5ZEEPVVHOPXQ4VAIZQLLAHW5UNPRJ6KRPX4TC3XNAFELV2NJHPQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.680319410 (18h44m34.231789871s) [noise=true , address=45.91.116.9:4287 , piece_id=SXKQE4JXCW2IF3L2SHBWGGEVKZARNRVRNEW4EKTGG4F56O3VV74Q, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.687109680 (18h44m34.238580141s) [noise=true , address=77.90.31.16:4754 , piece_id=6I3JRELSBPBG4Z3Q26WOWMJYQQRMRKH56647VV33JOBCVY3PDJXQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.696693820 (18h44m34.248164291s) [noise=true , address=77.90.31.18:4823 , piece_id=SG5MP5BSSLYGKAKR7S3LLFYRD5BIVPXLBX3QG6HGXQID75ZTVA2A, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.722143340 (18h44m34.273613801s) [noise=true , address=45.91.116.5:4302 , piece_id=46SNKQMGG2BJFM3W3SUEKWBRFOJYW3DN2EGIRHF5R3RBUHEXL2LQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.758302945 (18h44m34.309773416s) [noise=true , address=77.90.31.13:4638 , piece_id=CU246YAEDHRCRV42CC3CONL4VSOLZJGBMWWV6QQZQX3EFETZ3GTQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:49:32.681760451 (18h45m31.233230912s) [noise=true , address=145.79.227.37:4583 , piece_id=TF5IAGVJBJX4UFTNW7SGD5BV2WIT2U2QUQ2CDAPJGDZ3FVJ3ZI4Q, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:1Zy3MLWBv2MCN8Tdb8BTCM8P5AMPDQCSJ8faTsmjLPurvs3ba6, address:145.79.227.37:4583): protocol: write tcp 188.166.225.170:34686->145.79.227.37:4583: use of closed network connection; write tcp 188.166.225.170:34686->145.79.227.37:4583: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34686->145.79.227.37:4583: use of closed network connection Nov 10 02:49:32.681935615 (18h45m31.233406076s) [noise=true , address=145.79.227.22:4518 , piece_id=JWZUNOBH3YTTKD7UZKZHYFJAZVFJQZEX6Q4RKE2LLXQ53DS5AIJA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:1ozLDHDa9ankBimUBjpM91VrraKMptSCQPoDS9yWu2tjVErasU, address:145.79.227.22:4518): protocol: write tcp 188.166.225.170:32942->145.79.227.22:4518: use of closed network connection; write tcp 188.166.225.170:32942->145.79.227.22:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32942->145.79.227.22:4518: use of closed network connection Nov 10 02:49:32.682092233 (18h45m31.233562695s) [noise=true , address=145.79.227.43:4186 , piece_id=2XRO33G32TSZTLRORQEQISDJZT6CW7E2FCEY23UPSZ3UN6IXV2DA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:12Gu3vXy2JUkKDaF4MkMCgVmYspW4Ez8EAfv6e4GeCkrwYTe5T, address:145.79.227.43:4186): protocol: write tcp 188.166.225.170:56786->145.79.227.43:4186: use of closed network connection; write tcp 188.166.225.170:56786->145.79.227.43:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56786->145.79.227.43:4186: use of closed network connection Nov 10 02:49:32.682114004 (18h45m31.233584475s) [noise=true , address=145.79.227.33:4877 , piece_id=E6O7TZGFY3CQAADT2AJ37HEU3XQG6OBULFAJKNHJOKZJN4H6FRSQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:17TuauVrjKmehRpXqmK7bemU9V33GDZu9RGBs6fanXvJkV1gdH, address:145.79.227.33:4877): protocol: expected piece hash; context deadline exceeded; EOF Nov 10 02:49:32.682210849 (18h45m31.23368131s) [noise=true , address=145.79.227.52:4458 , piece_id=DINKDXOKRZDCMFPPBGV53AXPW4JXGZDIBSYKQ6UMSXTKFKXMQQPA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb, address:145.79.227.52:4458): protocol: write tcp 188.166.225.170:41982->145.79.227.52:4458: use of closed network connection; write tcp 188.166.225.170:41982->145.79.227.52:4458: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41982->145.79.227.52:4458: use of closed network connection Nov 10 02:49:32.682569782 (18h45m31.234040243s) [noise=true , address=145.79.227.23:4556 , piece_id=U5BQUOLGMECWROVTWMRCOC4G4RXY4EQWPQXDIPZRHKUY4VWSZRCA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:1i62GRFASf7UPVGhUofmRkz3zZSyhq4fDycgyYtfD7pHR3w91v, address:145.79.227.23:4556): protocol: write tcp 188.166.225.170:58706->145.79.227.23:4556: use of closed network connection; write tcp 188.166.225.170:58706->145.79.227.23:4556: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58706->145.79.227.23:4556: use of closed network connection Nov 10 02:49:32.682721071 (18h45m31.234191522s) [noise=true , address=145.79.227.44:4197 , piece_id=YIL6O2KW4M46ARDLTPCDTEFCV4RKUNUYBPSIWXWILDX245NWE3DA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:12niHLkT5pbmYSbarHZGeeCRtwjZRXtvEtHMGAb7ja4a7Xuuvfi, address:145.79.227.44:4197): protocol: read tcp 188.166.225.170:46490->145.79.227.44:4197: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 02:49:32.682759744 (18h45m31.234230205s) [seg_pos={0 0}, upload=16524]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Nov 10 02:49:32.932751323 (18h45m31.484221774s) [upload=16524]: Done uploading segments... Nov 10 02:49:32.932798863 (18h45m31.484269334s) [upload=16524]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 5.726408978s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.919271297s trace: https://jaeger.dev.storj.io/trace/3549d25e06814a89 FAIL (2025-11-10 03:36:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== =true , address=77.90.31.15:4729 , piece_id=PEGSLMGDM2MGDJBIMRDI4RFWPNL2YP6DVKRPNLNFZGFUOQ2TTKRQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.660891599 (18h44m32.21236206s) [noise=true , address=77.90.31.13:4638 , piece_id=CU246YAEDHRCRV42CC3CONL4VSOLZJGBMWWV6QQZQX3EFETZ3GTQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.661346796 (18h44m32.212817257s) [noise=true , address=45.91.116.9:4287 , piece_id=SXKQE4JXCW2IF3L2SHBWGGEVKZARNRVRNEW4EKTGG4F56O3VV74Q, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.661950416 (18h44m32.213420877s) [noise=true , address=145.79.227.52:4458 , piece_id=DINKDXOKRZDCMFPPBGV53AXPW4JXGZDIBSYKQ6UMSXTKFKXMQQPA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.662428906 (18h44m32.213899367s) [noise=true , address=77.90.31.18:4823 , piece_id=SG5MP5BSSLYGKAKR7S3LLFYRD5BIVPXLBX3QG6HGXQID75ZTVA2A, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.662926414 (18h44m32.214396866s) [noise=true , address=5.231.73.4:4016 , piece_id=O4SKTUGCKOFFRRPOACGCSIZQT5UJFNSSQT24Z3F4Y6ILMYQLTDVA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.663484687 (18h44m32.214955149s) [noise=true , address=45.91.116.5:4302 , piece_id=46SNKQMGG2BJFM3W3SUEKWBRFOJYW3DN2EGIRHF5R3RBUHEXL2LQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.664867019 (18h44m32.21633748s) [noise=true , address=145.79.227.23:4556 , piece_id=U5BQUOLGMECWROVTWMRCOC4G4RXY4EQWPQXDIPZRHKUY4VWSZRCA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.665313670 (18h44m32.216784131s) [noise=true , address=64.49.13.140:4506 , piece_id=GIG6KBRWC6347MKHWUP6Y5SRFAHAIC75NENYNSXJ3HWVP27ET7BA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.666575854 (18h44m32.218046315s) [noise=true , address=77.90.31.16:4754 , piece_id=6I3JRELSBPBG4Z3Q26WOWMJYQQRMRKH56647VV33JOBCVY3PDJXQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.667056288 (18h44m32.218526759s) [noise=true , address=145.79.227.37:4583 , piece_id=TF5IAGVJBJX4UFTNW7SGD5BV2WIT2U2QUQ2CDAPJGDZ3FVJ3ZI4Q, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.668506800 (18h44m32.219977261s) [noise=true , address=45.91.116.14:4199 , piece_id=M5ZEEPVVHOPXQ4VAIZQLLAHW5UNPRJ6KRPX4TC3XNAFELV2NJHPQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.668888778 (18h44m32.220359239s) [noise=true , address=5.231.73.2:4009 , piece_id=EFQG7FJP6XDHD7QS25XOACZRIOCDR3ZQIJ3SD4X6ZZBZUTMBFPHA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.673830457 (18h44m32.225300918s) [noise=true , address=145.79.227.44:4197 , piece_id=YIL6O2KW4M46ARDLTPCDTEFCV4RKUNUYBPSIWXWILDX245NWE3DA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.675567365 (18h44m32.227037826s) [noise=true , address=145.79.227.33:4877 , piece_id=E6O7TZGFY3CQAADT2AJ37HEU3XQG6OBULFAJKNHJOKZJN4H6FRSQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:35.018943312 (18h44m33.570413763s) [upload=16524]: Next returned nil segment Nov 10 02:48:35.018998397 (18h44m33.570468848s) [upload=16524]: Waiting for error group managing segments... Nov 10 02:48:35.374141893 (18h44m33.925612355s) [noise=true , address=64.49.13.140:4506 , piece_id=GIG6KBRWC6347MKHWUP6Y5SRFAHAIC75NENYNSXJ3HWVP27ET7BA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.460757926 (18h44m34.012228387s) [noise=true , address=5.231.73.4:4016 , piece_id=O4SKTUGCKOFFRRPOACGCSIZQT5UJFNSSQT24Z3F4Y6ILMYQLTDVA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.515755341 (18h44m34.067225802s) [noise=true , address=5.231.73.2:4009 , piece_id=EFQG7FJP6XDHD7QS25XOACZRIOCDR3ZQIJ3SD4X6ZZBZUTMBFPHA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.650926070 (18h44m34.202396521s) [noise=true , address=77.90.31.15:4729 , piece_id=PEGSLMGDM2MGDJBIMRDI4RFWPNL2YP6DVKRPNLNFZGFUOQ2TTKRQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.651707047 (18h44m34.203177498s) [noise=true , address=45.91.116.8:4049 , piece_id=7YP2WON7KCXFWVHEVQPF5MG3PUR44ANPA5NIZOVE2ARA3MI7R2XA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.676407551 (18h44m34.227878012s) [noise=true , address=45.91.116.14:4199 , piece_id=M5ZEEPVVHOPXQ4VAIZQLLAHW5UNPRJ6KRPX4TC3XNAFELV2NJHPQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.680319410 (18h44m34.231789871s) [noise=true , address=45.91.116.9:4287 , piece_id=SXKQE4JXCW2IF3L2SHBWGGEVKZARNRVRNEW4EKTGG4F56O3VV74Q, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.687109680 (18h44m34.238580141s) [noise=true , address=77.90.31.16:4754 , piece_id=6I3JRELSBPBG4Z3Q26WOWMJYQQRMRKH56647VV33JOBCVY3PDJXQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.696693820 (18h44m34.248164291s) [noise=true , address=77.90.31.18:4823 , piece_id=SG5MP5BSSLYGKAKR7S3LLFYRD5BIVPXLBX3QG6HGXQID75ZTVA2A, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.722143340 (18h44m34.273613801s) [noise=true , address=45.91.116.5:4302 , piece_id=46SNKQMGG2BJFM3W3SUEKWBRFOJYW3DN2EGIRHF5R3RBUHEXL2LQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.758302945 (18h44m34.309773416s) [noise=true , address=77.90.31.13:4638 , piece_id=CU246YAEDHRCRV42CC3CONL4VSOLZJGBMWWV6QQZQX3EFETZ3GTQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:49:32.681760451 (18h45m31.233230912s) [noise=true , address=145.79.227.37:4583 , piece_id=TF5IAGVJBJX4UFTNW7SGD5BV2WIT2U2QUQ2CDAPJGDZ3FVJ3ZI4Q, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:1Zy3MLWBv2MCN8Tdb8BTCM8P5AMPDQCSJ8faTsmjLPurvs3ba6, address:145.79.227.37:4583): protocol: write tcp 188.166.225.170:34686->145.79.227.37:4583: use of closed network connection; write tcp 188.166.225.170:34686->145.79.227.37:4583: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34686->145.79.227.37:4583: use of closed network connection Nov 10 02:49:32.681935615 (18h45m31.233406076s) [noise=true , address=145.79.227.22:4518 , piece_id=JWZUNOBH3YTTKD7UZKZHYFJAZVFJQZEX6Q4RKE2LLXQ53DS5AIJA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:1ozLDHDa9ankBimUBjpM91VrraKMptSCQPoDS9yWu2tjVErasU, address:145.79.227.22:4518): protocol: write tcp 188.166.225.170:32942->145.79.227.22:4518: use of closed network connection; write tcp 188.166.225.170:32942->145.79.227.22:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32942->145.79.227.22:4518: use of closed network connection Nov 10 02:49:32.682092233 (18h45m31.233562695s) [noise=true , address=145.79.227.43:4186 , piece_id=2XRO33G32TSZTLRORQEQISDJZT6CW7E2FCEY23UPSZ3UN6IXV2DA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:12Gu3vXy2JUkKDaF4MkMCgVmYspW4Ez8EAfv6e4GeCkrwYTe5T, address:145.79.227.43:4186): protocol: write tcp 188.166.225.170:56786->145.79.227.43:4186: use of closed network connection; write tcp 188.166.225.170:56786->145.79.227.43:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56786->145.79.227.43:4186: use of closed network connection Nov 10 02:49:32.682114004 (18h45m31.233584475s) [noise=true , address=145.79.227.33:4877 , piece_id=E6O7TZGFY3CQAADT2AJ37HEU3XQG6OBULFAJKNHJOKZJN4H6FRSQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:17TuauVrjKmehRpXqmK7bemU9V33GDZu9RGBs6fanXvJkV1gdH, address:145.79.227.33:4877): protocol: expected piece hash; context deadline exceeded; EOF Nov 10 02:49:32.682210849 (18h45m31.23368131s) [noise=true , address=145.79.227.52:4458 , piece_id=DINKDXOKRZDCMFPPBGV53AXPW4JXGZDIBSYKQ6UMSXTKFKXMQQPA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb, address:145.79.227.52:4458): protocol: write tcp 188.166.225.170:41982->145.79.227.52:4458: use of closed network connection; write tcp 188.166.225.170:41982->145.79.227.52:4458: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41982->145.79.227.52:4458: use of closed network connection Nov 10 02:49:32.682569782 (18h45m31.234040243s) [noise=true , address=145.79.227.23:4556 , piece_id=U5BQUOLGMECWROVTWMRCOC4G4RXY4EQWPQXDIPZRHKUY4VWSZRCA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:1i62GRFASf7UPVGhUofmRkz3zZSyhq4fDycgyYtfD7pHR3w91v, address:145.79.227.23:4556): protocol: write tcp 188.166.225.170:58706->145.79.227.23:4556: use of closed network connection; write tcp 188.166.225.170:58706->145.79.227.23:4556: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58706->145.79.227.23:4556: use of closed network connection Nov 10 02:49:32.682721071 (18h45m31.234191522s) [noise=true , address=145.79.227.44:4197 , piece_id=YIL6O2KW4M46ARDLTPCDTEFCV4RKUNUYBPSIWXWILDX245NWE3DA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:12niHLkT5pbmYSbarHZGeeCRtwjZRXtvEtHMGAb7ja4a7Xuuvfi, address:145.79.227.44:4197): protocol: read tcp 188.166.225.170:46490->145.79.227.44:4197: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 02:49:32.682759744 (18h45m31.234230205s) [seg_pos={0 0}, upload=16524]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Nov 10 02:49:32.932751323 (18h45m31.484221774s) [upload=16524]: Done uploading segments... Nov 10 02:49:32.932798863 (18h45m31.484269334s) [upload=16524]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 5.919318117s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.96056612s trace: https://jaeger.dev.storj.io/trace/75df214bddf49b6c FAIL (2025-11-10 03:35:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== , upload=16656]: Uploading piece... Nov 10 02:57:07.902523564 (18h53m6.453994016s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.902896285 (18h53m6.454366746s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903057381 (18h53m6.454527842s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903221083 (18h53m6.454691544s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903750420 (18h53m6.455220881s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904221027 (18h53m6.455691478s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904538802 (18h53m6.456009263s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904837540 (18h53m6.456308001s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.905108617 (18h53m6.456579088s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906363115 (18h53m6.457833576s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906725125 (18h53m6.458195616s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:09.614029177 (18h53m8.165499638s) [upload=16656]: Next returned nil segment Nov 10 02:57:09.614047832 (18h53m8.165518303s) [upload=16656]: Waiting for error group managing segments... Nov 10 02:57:09.946613505 (18h53m8.498083967s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:09.963197294 (18h53m8.514667756s) [noise=true , address=45.91.116.8:4048 , piece_id=OJABWCFJN4RG7ONOAXUQZ6YJHLKDVHLPP7A52QO6NULHOF67HJIA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.002783744 (18h53m8.554254215s) [noise=true , address=45.91.116.12:4227 , piece_id=XNCUCK5GHYGN47RWCEZRR457FFT2OCFELRWRNAO4PI3Q3TAQOMAQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.016620001 (18h53m8.568090462s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.025388127 (18h53m8.576858588s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.049947742 (18h53m8.601418193s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.100717507 (18h53m8.652187968s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:36.931729840 (18h53m35.483200301s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection Nov 10 02:57:36.931908921 (18h53m35.483379382s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection Nov 10 02:57:36.932058757 (18h53m35.483529218s) [noise=true , address=145.79.227.25:4619 , piece_id=5UCTYB4LJ5CYQEOOFRLRJWDUAAUPTOHZ7SWDMJNWSQUK2OOEAQLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU, address:145.79.227.25:4619): protocol: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection Nov 10 02:57:36.932196429 (18h53m35.48366689s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:123ib1A8nmVmR272odjhVsUgADYbaMRMiPahSLoZ5eamaV6Qbb1, address:145.79.227.24:4581): protocol: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection Nov 10 02:57:36.932321106 (18h53m35.483791567s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection Nov 10 02:57:36.932454640 (18h53m35.483925102s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection Nov 10 02:57:36.932598614 (18h53m35.484069076s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection Nov 10 02:57:36.932746786 (18h53m35.484217257s) [noise=true , address=145.79.227.31:4798 , piece_id=OFHBBUULKRRN5AGTSVCTYLMOLTD3LXRZV5TE2EEUVWWFI6QLP45Q, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:17Ski7oMzbGroPGgWRrbUiqC1NiLPBBsvYuU4pCZ53xhNKkeBZ, address:145.79.227.31:4798): protocol: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection Nov 10 02:57:36.932891542 (18h53m35.484362013s) [noise=true , address=145.79.227.11:4730 , piece_id=O7D5GZGMKLBKWWH325VVDWPRWWA2GPBTRXSNPW62A5SGOLHUCKAA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection Nov 10 02:57:36.932956786 (18h53m35.484427247s) [seg_pos={0 0}, upload=16656]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Nov 10 02:57:37.186654542 (18h53m35.738125003s) [upload=16656]: Done uploading segments... Nov 10 02:57:37.186695660 (18h53m35.738166121s) [upload=16656]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 5.960699813s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.929897257s trace: https://jaeger.dev.storj.io/trace/3549d25e06814a89 FAIL (2025-11-10 03:35:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== =true , address=77.90.31.15:4729 , piece_id=PEGSLMGDM2MGDJBIMRDI4RFWPNL2YP6DVKRPNLNFZGFUOQ2TTKRQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.660891599 (18h44m32.21236206s) [noise=true , address=77.90.31.13:4638 , piece_id=CU246YAEDHRCRV42CC3CONL4VSOLZJGBMWWV6QQZQX3EFETZ3GTQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.661346796 (18h44m32.212817257s) [noise=true , address=45.91.116.9:4287 , piece_id=SXKQE4JXCW2IF3L2SHBWGGEVKZARNRVRNEW4EKTGG4F56O3VV74Q, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.661950416 (18h44m32.213420877s) [noise=true , address=145.79.227.52:4458 , piece_id=DINKDXOKRZDCMFPPBGV53AXPW4JXGZDIBSYKQ6UMSXTKFKXMQQPA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.662428906 (18h44m32.213899367s) [noise=true , address=77.90.31.18:4823 , piece_id=SG5MP5BSSLYGKAKR7S3LLFYRD5BIVPXLBX3QG6HGXQID75ZTVA2A, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.662926414 (18h44m32.214396866s) [noise=true , address=5.231.73.4:4016 , piece_id=O4SKTUGCKOFFRRPOACGCSIZQT5UJFNSSQT24Z3F4Y6ILMYQLTDVA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.663484687 (18h44m32.214955149s) [noise=true , address=45.91.116.5:4302 , piece_id=46SNKQMGG2BJFM3W3SUEKWBRFOJYW3DN2EGIRHF5R3RBUHEXL2LQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.664867019 (18h44m32.21633748s) [noise=true , address=145.79.227.23:4556 , piece_id=U5BQUOLGMECWROVTWMRCOC4G4RXY4EQWPQXDIPZRHKUY4VWSZRCA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.665313670 (18h44m32.216784131s) [noise=true , address=64.49.13.140:4506 , piece_id=GIG6KBRWC6347MKHWUP6Y5SRFAHAIC75NENYNSXJ3HWVP27ET7BA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.666575854 (18h44m32.218046315s) [noise=true , address=77.90.31.16:4754 , piece_id=6I3JRELSBPBG4Z3Q26WOWMJYQQRMRKH56647VV33JOBCVY3PDJXQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.667056288 (18h44m32.218526759s) [noise=true , address=145.79.227.37:4583 , piece_id=TF5IAGVJBJX4UFTNW7SGD5BV2WIT2U2QUQ2CDAPJGDZ3FVJ3ZI4Q, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.668506800 (18h44m32.219977261s) [noise=true , address=45.91.116.14:4199 , piece_id=M5ZEEPVVHOPXQ4VAIZQLLAHW5UNPRJ6KRPX4TC3XNAFELV2NJHPQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.668888778 (18h44m32.220359239s) [noise=true , address=5.231.73.2:4009 , piece_id=EFQG7FJP6XDHD7QS25XOACZRIOCDR3ZQIJ3SD4X6ZZBZUTMBFPHA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.673830457 (18h44m32.225300918s) [noise=true , address=145.79.227.44:4197 , piece_id=YIL6O2KW4M46ARDLTPCDTEFCV4RKUNUYBPSIWXWILDX245NWE3DA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.675567365 (18h44m32.227037826s) [noise=true , address=145.79.227.33:4877 , piece_id=E6O7TZGFY3CQAADT2AJ37HEU3XQG6OBULFAJKNHJOKZJN4H6FRSQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:35.018943312 (18h44m33.570413763s) [upload=16524]: Next returned nil segment Nov 10 02:48:35.018998397 (18h44m33.570468848s) [upload=16524]: Waiting for error group managing segments... Nov 10 02:48:35.374141893 (18h44m33.925612355s) [noise=true , address=64.49.13.140:4506 , piece_id=GIG6KBRWC6347MKHWUP6Y5SRFAHAIC75NENYNSXJ3HWVP27ET7BA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.460757926 (18h44m34.012228387s) [noise=true , address=5.231.73.4:4016 , piece_id=O4SKTUGCKOFFRRPOACGCSIZQT5UJFNSSQT24Z3F4Y6ILMYQLTDVA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.515755341 (18h44m34.067225802s) [noise=true , address=5.231.73.2:4009 , piece_id=EFQG7FJP6XDHD7QS25XOACZRIOCDR3ZQIJ3SD4X6ZZBZUTMBFPHA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.650926070 (18h44m34.202396521s) [noise=true , address=77.90.31.15:4729 , piece_id=PEGSLMGDM2MGDJBIMRDI4RFWPNL2YP6DVKRPNLNFZGFUOQ2TTKRQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.651707047 (18h44m34.203177498s) [noise=true , address=45.91.116.8:4049 , piece_id=7YP2WON7KCXFWVHEVQPF5MG3PUR44ANPA5NIZOVE2ARA3MI7R2XA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.676407551 (18h44m34.227878012s) [noise=true , address=45.91.116.14:4199 , piece_id=M5ZEEPVVHOPXQ4VAIZQLLAHW5UNPRJ6KRPX4TC3XNAFELV2NJHPQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.680319410 (18h44m34.231789871s) [noise=true , address=45.91.116.9:4287 , piece_id=SXKQE4JXCW2IF3L2SHBWGGEVKZARNRVRNEW4EKTGG4F56O3VV74Q, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.687109680 (18h44m34.238580141s) [noise=true , address=77.90.31.16:4754 , piece_id=6I3JRELSBPBG4Z3Q26WOWMJYQQRMRKH56647VV33JOBCVY3PDJXQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.696693820 (18h44m34.248164291s) [noise=true , address=77.90.31.18:4823 , piece_id=SG5MP5BSSLYGKAKR7S3LLFYRD5BIVPXLBX3QG6HGXQID75ZTVA2A, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.722143340 (18h44m34.273613801s) [noise=true , address=45.91.116.5:4302 , piece_id=46SNKQMGG2BJFM3W3SUEKWBRFOJYW3DN2EGIRHF5R3RBUHEXL2LQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.758302945 (18h44m34.309773416s) [noise=true , address=77.90.31.13:4638 , piece_id=CU246YAEDHRCRV42CC3CONL4VSOLZJGBMWWV6QQZQX3EFETZ3GTQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:49:32.681760451 (18h45m31.233230912s) [noise=true , address=145.79.227.37:4583 , piece_id=TF5IAGVJBJX4UFTNW7SGD5BV2WIT2U2QUQ2CDAPJGDZ3FVJ3ZI4Q, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:1Zy3MLWBv2MCN8Tdb8BTCM8P5AMPDQCSJ8faTsmjLPurvs3ba6, address:145.79.227.37:4583): protocol: write tcp 188.166.225.170:34686->145.79.227.37:4583: use of closed network connection; write tcp 188.166.225.170:34686->145.79.227.37:4583: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34686->145.79.227.37:4583: use of closed network connection Nov 10 02:49:32.681935615 (18h45m31.233406076s) [noise=true , address=145.79.227.22:4518 , piece_id=JWZUNOBH3YTTKD7UZKZHYFJAZVFJQZEX6Q4RKE2LLXQ53DS5AIJA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:1ozLDHDa9ankBimUBjpM91VrraKMptSCQPoDS9yWu2tjVErasU, address:145.79.227.22:4518): protocol: write tcp 188.166.225.170:32942->145.79.227.22:4518: use of closed network connection; write tcp 188.166.225.170:32942->145.79.227.22:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32942->145.79.227.22:4518: use of closed network connection Nov 10 02:49:32.682092233 (18h45m31.233562695s) [noise=true , address=145.79.227.43:4186 , piece_id=2XRO33G32TSZTLRORQEQISDJZT6CW7E2FCEY23UPSZ3UN6IXV2DA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:12Gu3vXy2JUkKDaF4MkMCgVmYspW4Ez8EAfv6e4GeCkrwYTe5T, address:145.79.227.43:4186): protocol: write tcp 188.166.225.170:56786->145.79.227.43:4186: use of closed network connection; write tcp 188.166.225.170:56786->145.79.227.43:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56786->145.79.227.43:4186: use of closed network connection Nov 10 02:49:32.682114004 (18h45m31.233584475s) [noise=true , address=145.79.227.33:4877 , piece_id=E6O7TZGFY3CQAADT2AJ37HEU3XQG6OBULFAJKNHJOKZJN4H6FRSQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:17TuauVrjKmehRpXqmK7bemU9V33GDZu9RGBs6fanXvJkV1gdH, address:145.79.227.33:4877): protocol: expected piece hash; context deadline exceeded; EOF Nov 10 02:49:32.682210849 (18h45m31.23368131s) [noise=true , address=145.79.227.52:4458 , piece_id=DINKDXOKRZDCMFPPBGV53AXPW4JXGZDIBSYKQ6UMSXTKFKXMQQPA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb, address:145.79.227.52:4458): protocol: write tcp 188.166.225.170:41982->145.79.227.52:4458: use of closed network connection; write tcp 188.166.225.170:41982->145.79.227.52:4458: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41982->145.79.227.52:4458: use of closed network connection Nov 10 02:49:32.682569782 (18h45m31.234040243s) [noise=true , address=145.79.227.23:4556 , piece_id=U5BQUOLGMECWROVTWMRCOC4G4RXY4EQWPQXDIPZRHKUY4VWSZRCA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:1i62GRFASf7UPVGhUofmRkz3zZSyhq4fDycgyYtfD7pHR3w91v, address:145.79.227.23:4556): protocol: write tcp 188.166.225.170:58706->145.79.227.23:4556: use of closed network connection; write tcp 188.166.225.170:58706->145.79.227.23:4556: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58706->145.79.227.23:4556: use of closed network connection Nov 10 02:49:32.682721071 (18h45m31.234191522s) [noise=true , address=145.79.227.44:4197 , piece_id=YIL6O2KW4M46ARDLTPCDTEFCV4RKUNUYBPSIWXWILDX245NWE3DA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:12niHLkT5pbmYSbarHZGeeCRtwjZRXtvEtHMGAb7ja4a7Xuuvfi, address:145.79.227.44:4197): protocol: read tcp 188.166.225.170:46490->145.79.227.44:4197: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 02:49:32.682759744 (18h45m31.234230205s) [seg_pos={0 0}, upload=16524]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Nov 10 02:49:32.932751323 (18h45m31.484221774s) [upload=16524]: Done uploading segments... Nov 10 02:49:32.932798863 (18h45m31.484269334s) [upload=16524]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 5.929931763s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [X........X..................................................] duration: 5.809757246s trace: https://jaeger.dev.storj.io/trace/75df214bddf49b6c FAIL (2025-11-10 03:35:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== , upload=16656]: Uploading piece... Nov 10 02:57:07.902523564 (18h53m6.453994016s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.902896285 (18h53m6.454366746s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903057381 (18h53m6.454527842s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903221083 (18h53m6.454691544s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903750420 (18h53m6.455220881s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904221027 (18h53m6.455691478s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904538802 (18h53m6.456009263s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904837540 (18h53m6.456308001s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.905108617 (18h53m6.456579088s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906363115 (18h53m6.457833576s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906725125 (18h53m6.458195616s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:09.614029177 (18h53m8.165499638s) [upload=16656]: Next returned nil segment Nov 10 02:57:09.614047832 (18h53m8.165518303s) [upload=16656]: Waiting for error group managing segments... Nov 10 02:57:09.946613505 (18h53m8.498083967s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:09.963197294 (18h53m8.514667756s) [noise=true , address=45.91.116.8:4048 , piece_id=OJABWCFJN4RG7ONOAXUQZ6YJHLKDVHLPP7A52QO6NULHOF67HJIA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.002783744 (18h53m8.554254215s) [noise=true , address=45.91.116.12:4227 , piece_id=XNCUCK5GHYGN47RWCEZRR457FFT2OCFELRWRNAO4PI3Q3TAQOMAQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.016620001 (18h53m8.568090462s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.025388127 (18h53m8.576858588s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.049947742 (18h53m8.601418193s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.100717507 (18h53m8.652187968s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:36.931729840 (18h53m35.483200301s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection Nov 10 02:57:36.931908921 (18h53m35.483379382s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection Nov 10 02:57:36.932058757 (18h53m35.483529218s) [noise=true , address=145.79.227.25:4619 , piece_id=5UCTYB4LJ5CYQEOOFRLRJWDUAAUPTOHZ7SWDMJNWSQUK2OOEAQLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU, address:145.79.227.25:4619): protocol: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection Nov 10 02:57:36.932196429 (18h53m35.48366689s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:123ib1A8nmVmR272odjhVsUgADYbaMRMiPahSLoZ5eamaV6Qbb1, address:145.79.227.24:4581): protocol: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection Nov 10 02:57:36.932321106 (18h53m35.483791567s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection Nov 10 02:57:36.932454640 (18h53m35.483925102s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection Nov 10 02:57:36.932598614 (18h53m35.484069076s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection Nov 10 02:57:36.932746786 (18h53m35.484217257s) [noise=true , address=145.79.227.31:4798 , piece_id=OFHBBUULKRRN5AGTSVCTYLMOLTD3LXRZV5TE2EEUVWWFI6QLP45Q, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:17Ski7oMzbGroPGgWRrbUiqC1NiLPBBsvYuU4pCZ53xhNKkeBZ, address:145.79.227.31:4798): protocol: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection Nov 10 02:57:36.932891542 (18h53m35.484362013s) [noise=true , address=145.79.227.11:4730 , piece_id=O7D5GZGMKLBKWWH325VVDWPRWWA2GPBTRXSNPW62A5SGOLHUCKAA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection Nov 10 02:57:36.932956786 (18h53m35.484427247s) [seg_pos={0 0}, upload=16656]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Nov 10 02:57:37.186654542 (18h53m35.738125003s) [upload=16656]: Done uploading segments... Nov 10 02:57:37.186695660 (18h53m35.738166121s) [upload=16656]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 5.809783987s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X........X.................................................] duration: 6.023058214s trace: https://jaeger.dev.storj.io/trace/75df214bddf49b6c FAIL (2025-11-10 03:34:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== , upload=16656]: Uploading piece... Nov 10 02:57:07.902523564 (18h53m6.453994016s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.902896285 (18h53m6.454366746s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903057381 (18h53m6.454527842s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903221083 (18h53m6.454691544s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903750420 (18h53m6.455220881s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904221027 (18h53m6.455691478s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904538802 (18h53m6.456009263s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904837540 (18h53m6.456308001s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.905108617 (18h53m6.456579088s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906363115 (18h53m6.457833576s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906725125 (18h53m6.458195616s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:09.614029177 (18h53m8.165499638s) [upload=16656]: Next returned nil segment Nov 10 02:57:09.614047832 (18h53m8.165518303s) [upload=16656]: Waiting for error group managing segments... Nov 10 02:57:09.946613505 (18h53m8.498083967s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:09.963197294 (18h53m8.514667756s) [noise=true , address=45.91.116.8:4048 , piece_id=OJABWCFJN4RG7ONOAXUQZ6YJHLKDVHLPP7A52QO6NULHOF67HJIA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.002783744 (18h53m8.554254215s) [noise=true , address=45.91.116.12:4227 , piece_id=XNCUCK5GHYGN47RWCEZRR457FFT2OCFELRWRNAO4PI3Q3TAQOMAQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.016620001 (18h53m8.568090462s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.025388127 (18h53m8.576858588s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.049947742 (18h53m8.601418193s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.100717507 (18h53m8.652187968s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:36.931729840 (18h53m35.483200301s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection Nov 10 02:57:36.931908921 (18h53m35.483379382s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection Nov 10 02:57:36.932058757 (18h53m35.483529218s) [noise=true , address=145.79.227.25:4619 , piece_id=5UCTYB4LJ5CYQEOOFRLRJWDUAAUPTOHZ7SWDMJNWSQUK2OOEAQLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU, address:145.79.227.25:4619): protocol: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection Nov 10 02:57:36.932196429 (18h53m35.48366689s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:123ib1A8nmVmR272odjhVsUgADYbaMRMiPahSLoZ5eamaV6Qbb1, address:145.79.227.24:4581): protocol: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection Nov 10 02:57:36.932321106 (18h53m35.483791567s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection Nov 10 02:57:36.932454640 (18h53m35.483925102s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection Nov 10 02:57:36.932598614 (18h53m35.484069076s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection Nov 10 02:57:36.932746786 (18h53m35.484217257s) [noise=true , address=145.79.227.31:4798 , piece_id=OFHBBUULKRRN5AGTSVCTYLMOLTD3LXRZV5TE2EEUVWWFI6QLP45Q, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:17Ski7oMzbGroPGgWRrbUiqC1NiLPBBsvYuU4pCZ53xhNKkeBZ, address:145.79.227.31:4798): protocol: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection Nov 10 02:57:36.932891542 (18h53m35.484362013s) [noise=true , address=145.79.227.11:4730 , piece_id=O7D5GZGMKLBKWWH325VVDWPRWWA2GPBTRXSNPW62A5SGOLHUCKAA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection Nov 10 02:57:36.932956786 (18h53m35.484427247s) [seg_pos={0 0}, upload=16656]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Nov 10 02:57:37.186654542 (18h53m35.738125003s) [upload=16656]: Done uploading segments... Nov 10 02:57:37.186695660 (18h53m35.738166121s) [upload=16656]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 6.023184656s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.892764059s trace: https://jaeger.dev.storj.io/trace/3549d25e06814a89 FAIL (2025-11-10 03:34:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== =true , address=77.90.31.15:4729 , piece_id=PEGSLMGDM2MGDJBIMRDI4RFWPNL2YP6DVKRPNLNFZGFUOQ2TTKRQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.660891599 (18h44m32.21236206s) [noise=true , address=77.90.31.13:4638 , piece_id=CU246YAEDHRCRV42CC3CONL4VSOLZJGBMWWV6QQZQX3EFETZ3GTQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.661346796 (18h44m32.212817257s) [noise=true , address=45.91.116.9:4287 , piece_id=SXKQE4JXCW2IF3L2SHBWGGEVKZARNRVRNEW4EKTGG4F56O3VV74Q, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.661950416 (18h44m32.213420877s) [noise=true , address=145.79.227.52:4458 , piece_id=DINKDXOKRZDCMFPPBGV53AXPW4JXGZDIBSYKQ6UMSXTKFKXMQQPA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.662428906 (18h44m32.213899367s) [noise=true , address=77.90.31.18:4823 , piece_id=SG5MP5BSSLYGKAKR7S3LLFYRD5BIVPXLBX3QG6HGXQID75ZTVA2A, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.662926414 (18h44m32.214396866s) [noise=true , address=5.231.73.4:4016 , piece_id=O4SKTUGCKOFFRRPOACGCSIZQT5UJFNSSQT24Z3F4Y6ILMYQLTDVA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.663484687 (18h44m32.214955149s) [noise=true , address=45.91.116.5:4302 , piece_id=46SNKQMGG2BJFM3W3SUEKWBRFOJYW3DN2EGIRHF5R3RBUHEXL2LQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.664867019 (18h44m32.21633748s) [noise=true , address=145.79.227.23:4556 , piece_id=U5BQUOLGMECWROVTWMRCOC4G4RXY4EQWPQXDIPZRHKUY4VWSZRCA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.665313670 (18h44m32.216784131s) [noise=true , address=64.49.13.140:4506 , piece_id=GIG6KBRWC6347MKHWUP6Y5SRFAHAIC75NENYNSXJ3HWVP27ET7BA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.666575854 (18h44m32.218046315s) [noise=true , address=77.90.31.16:4754 , piece_id=6I3JRELSBPBG4Z3Q26WOWMJYQQRMRKH56647VV33JOBCVY3PDJXQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.667056288 (18h44m32.218526759s) [noise=true , address=145.79.227.37:4583 , piece_id=TF5IAGVJBJX4UFTNW7SGD5BV2WIT2U2QUQ2CDAPJGDZ3FVJ3ZI4Q, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.668506800 (18h44m32.219977261s) [noise=true , address=45.91.116.14:4199 , piece_id=M5ZEEPVVHOPXQ4VAIZQLLAHW5UNPRJ6KRPX4TC3XNAFELV2NJHPQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.668888778 (18h44m32.220359239s) [noise=true , address=5.231.73.2:4009 , piece_id=EFQG7FJP6XDHD7QS25XOACZRIOCDR3ZQIJ3SD4X6ZZBZUTMBFPHA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.673830457 (18h44m32.225300918s) [noise=true , address=145.79.227.44:4197 , piece_id=YIL6O2KW4M46ARDLTPCDTEFCV4RKUNUYBPSIWXWILDX245NWE3DA, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:33.675567365 (18h44m32.227037826s) [noise=true , address=145.79.227.33:4877 , piece_id=E6O7TZGFY3CQAADT2AJ37HEU3XQG6OBULFAJKNHJOKZJN4H6FRSQ, seg_pos={0 0}, upload=16524]: Uploading piece... Nov 10 02:48:35.018943312 (18h44m33.570413763s) [upload=16524]: Next returned nil segment Nov 10 02:48:35.018998397 (18h44m33.570468848s) [upload=16524]: Waiting for error group managing segments... Nov 10 02:48:35.374141893 (18h44m33.925612355s) [noise=true , address=64.49.13.140:4506 , piece_id=GIG6KBRWC6347MKHWUP6Y5SRFAHAIC75NENYNSXJ3HWVP27ET7BA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.460757926 (18h44m34.012228387s) [noise=true , address=5.231.73.4:4016 , piece_id=O4SKTUGCKOFFRRPOACGCSIZQT5UJFNSSQT24Z3F4Y6ILMYQLTDVA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.515755341 (18h44m34.067225802s) [noise=true , address=5.231.73.2:4009 , piece_id=EFQG7FJP6XDHD7QS25XOACZRIOCDR3ZQIJ3SD4X6ZZBZUTMBFPHA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.650926070 (18h44m34.202396521s) [noise=true , address=77.90.31.15:4729 , piece_id=PEGSLMGDM2MGDJBIMRDI4RFWPNL2YP6DVKRPNLNFZGFUOQ2TTKRQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.651707047 (18h44m34.203177498s) [noise=true , address=45.91.116.8:4049 , piece_id=7YP2WON7KCXFWVHEVQPF5MG3PUR44ANPA5NIZOVE2ARA3MI7R2XA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.676407551 (18h44m34.227878012s) [noise=true , address=45.91.116.14:4199 , piece_id=M5ZEEPVVHOPXQ4VAIZQLLAHW5UNPRJ6KRPX4TC3XNAFELV2NJHPQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.680319410 (18h44m34.231789871s) [noise=true , address=45.91.116.9:4287 , piece_id=SXKQE4JXCW2IF3L2SHBWGGEVKZARNRVRNEW4EKTGG4F56O3VV74Q, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.687109680 (18h44m34.238580141s) [noise=true , address=77.90.31.16:4754 , piece_id=6I3JRELSBPBG4Z3Q26WOWMJYQQRMRKH56647VV33JOBCVY3PDJXQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.696693820 (18h44m34.248164291s) [noise=true , address=77.90.31.18:4823 , piece_id=SG5MP5BSSLYGKAKR7S3LLFYRD5BIVPXLBX3QG6HGXQID75ZTVA2A, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.722143340 (18h44m34.273613801s) [noise=true , address=45.91.116.5:4302 , piece_id=46SNKQMGG2BJFM3W3SUEKWBRFOJYW3DN2EGIRHF5R3RBUHEXL2LQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:48:35.758302945 (18h44m34.309773416s) [noise=true , address=77.90.31.13:4638 , piece_id=CU246YAEDHRCRV42CC3CONL4VSOLZJGBMWWV6QQZQX3EFETZ3GTQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: <nil> Nov 10 02:49:32.681760451 (18h45m31.233230912s) [noise=true , address=145.79.227.37:4583 , piece_id=TF5IAGVJBJX4UFTNW7SGD5BV2WIT2U2QUQ2CDAPJGDZ3FVJ3ZI4Q, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:1Zy3MLWBv2MCN8Tdb8BTCM8P5AMPDQCSJ8faTsmjLPurvs3ba6, address:145.79.227.37:4583): protocol: write tcp 188.166.225.170:34686->145.79.227.37:4583: use of closed network connection; write tcp 188.166.225.170:34686->145.79.227.37:4583: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34686->145.79.227.37:4583: use of closed network connection Nov 10 02:49:32.681935615 (18h45m31.233406076s) [noise=true , address=145.79.227.22:4518 , piece_id=JWZUNOBH3YTTKD7UZKZHYFJAZVFJQZEX6Q4RKE2LLXQ53DS5AIJA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:1ozLDHDa9ankBimUBjpM91VrraKMptSCQPoDS9yWu2tjVErasU, address:145.79.227.22:4518): protocol: write tcp 188.166.225.170:32942->145.79.227.22:4518: use of closed network connection; write tcp 188.166.225.170:32942->145.79.227.22:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32942->145.79.227.22:4518: use of closed network connection Nov 10 02:49:32.682092233 (18h45m31.233562695s) [noise=true , address=145.79.227.43:4186 , piece_id=2XRO33G32TSZTLRORQEQISDJZT6CW7E2FCEY23UPSZ3UN6IXV2DA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:12Gu3vXy2JUkKDaF4MkMCgVmYspW4Ez8EAfv6e4GeCkrwYTe5T, address:145.79.227.43:4186): protocol: write tcp 188.166.225.170:56786->145.79.227.43:4186: use of closed network connection; write tcp 188.166.225.170:56786->145.79.227.43:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56786->145.79.227.43:4186: use of closed network connection Nov 10 02:49:32.682114004 (18h45m31.233584475s) [noise=true , address=145.79.227.33:4877 , piece_id=E6O7TZGFY3CQAADT2AJ37HEU3XQG6OBULFAJKNHJOKZJN4H6FRSQ, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:17TuauVrjKmehRpXqmK7bemU9V33GDZu9RGBs6fanXvJkV1gdH, address:145.79.227.33:4877): protocol: expected piece hash; context deadline exceeded; EOF Nov 10 02:49:32.682210849 (18h45m31.23368131s) [noise=true , address=145.79.227.52:4458 , piece_id=DINKDXOKRZDCMFPPBGV53AXPW4JXGZDIBSYKQ6UMSXTKFKXMQQPA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb, address:145.79.227.52:4458): protocol: write tcp 188.166.225.170:41982->145.79.227.52:4458: use of closed network connection; write tcp 188.166.225.170:41982->145.79.227.52:4458: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41982->145.79.227.52:4458: use of closed network connection Nov 10 02:49:32.682569782 (18h45m31.234040243s) [noise=true , address=145.79.227.23:4556 , piece_id=U5BQUOLGMECWROVTWMRCOC4G4RXY4EQWPQXDIPZRHKUY4VWSZRCA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:1i62GRFASf7UPVGhUofmRkz3zZSyhq4fDycgyYtfD7pHR3w91v, address:145.79.227.23:4556): protocol: write tcp 188.166.225.170:58706->145.79.227.23:4556: use of closed network connection; write tcp 188.166.225.170:58706->145.79.227.23:4556: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58706->145.79.227.23:4556: use of closed network connection Nov 10 02:49:32.682721071 (18h45m31.234191522s) [noise=true , address=145.79.227.44:4197 , piece_id=YIL6O2KW4M46ARDLTPCDTEFCV4RKUNUYBPSIWXWILDX245NWE3DA, seg_pos={0 0}, upload=16524]: Done uploading piece. err: ecclient: upload failed (node:12niHLkT5pbmYSbarHZGeeCRtwjZRXtvEtHMGAb7ja4a7Xuuvfi, address:145.79.227.44:4197): protocol: read tcp 188.166.225.170:46490->145.79.227.44:4197: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 02:49:32.682759744 (18h45m31.234230205s) [seg_pos={0 0}, upload=16524]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Nov 10 02:49:32.932751323 (18h45m31.484221774s) [upload=16524]: Done uploading segments... Nov 10 02:49:32.932798863 (18h45m31.484269334s) [upload=16524]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 5.892798875s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X........X................................................] duration: 5.746218469s trace: https://jaeger.dev.storj.io/trace/75df214bddf49b6c FAIL (2025-11-10 03:33:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== , upload=16656]: Uploading piece... Nov 10 02:57:07.902523564 (18h53m6.453994016s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.902896285 (18h53m6.454366746s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903057381 (18h53m6.454527842s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903221083 (18h53m6.454691544s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903750420 (18h53m6.455220881s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904221027 (18h53m6.455691478s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904538802 (18h53m6.456009263s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904837540 (18h53m6.456308001s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.905108617 (18h53m6.456579088s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906363115 (18h53m6.457833576s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906725125 (18h53m6.458195616s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:09.614029177 (18h53m8.165499638s) [upload=16656]: Next returned nil segment Nov 10 02:57:09.614047832 (18h53m8.165518303s) [upload=16656]: Waiting for error group managing segments... Nov 10 02:57:09.946613505 (18h53m8.498083967s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:09.963197294 (18h53m8.514667756s) [noise=true , address=45.91.116.8:4048 , piece_id=OJABWCFJN4RG7ONOAXUQZ6YJHLKDVHLPP7A52QO6NULHOF67HJIA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.002783744 (18h53m8.554254215s) [noise=true , address=45.91.116.12:4227 , piece_id=XNCUCK5GHYGN47RWCEZRR457FFT2OCFELRWRNAO4PI3Q3TAQOMAQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.016620001 (18h53m8.568090462s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.025388127 (18h53m8.576858588s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.049947742 (18h53m8.601418193s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.100717507 (18h53m8.652187968s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:36.931729840 (18h53m35.483200301s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection Nov 10 02:57:36.931908921 (18h53m35.483379382s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection Nov 10 02:57:36.932058757 (18h53m35.483529218s) [noise=true , address=145.79.227.25:4619 , piece_id=5UCTYB4LJ5CYQEOOFRLRJWDUAAUPTOHZ7SWDMJNWSQUK2OOEAQLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU, address:145.79.227.25:4619): protocol: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection Nov 10 02:57:36.932196429 (18h53m35.48366689s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:123ib1A8nmVmR272odjhVsUgADYbaMRMiPahSLoZ5eamaV6Qbb1, address:145.79.227.24:4581): protocol: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection Nov 10 02:57:36.932321106 (18h53m35.483791567s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection Nov 10 02:57:36.932454640 (18h53m35.483925102s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection Nov 10 02:57:36.932598614 (18h53m35.484069076s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection Nov 10 02:57:36.932746786 (18h53m35.484217257s) [noise=true , address=145.79.227.31:4798 , piece_id=OFHBBUULKRRN5AGTSVCTYLMOLTD3LXRZV5TE2EEUVWWFI6QLP45Q, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:17Ski7oMzbGroPGgWRrbUiqC1NiLPBBsvYuU4pCZ53xhNKkeBZ, address:145.79.227.31:4798): protocol: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection Nov 10 02:57:36.932891542 (18h53m35.484362013s) [noise=true , address=145.79.227.11:4730 , piece_id=O7D5GZGMKLBKWWH325VVDWPRWWA2GPBTRXSNPW62A5SGOLHUCKAA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection Nov 10 02:57:36.932956786 (18h53m35.484427247s) [seg_pos={0 0}, upload=16656]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Nov 10 02:57:37.186654542 (18h53m35.738125003s) [upload=16656]: Done uploading segments... Nov 10 02:57:37.186695660 (18h53m35.738166121s) [upload=16656]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 5.746250501s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X........X...............................................] duration: 5.903590517s trace: https://jaeger.dev.storj.io/trace/75df214bddf49b6c FAIL (2025-11-10 03:33:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== , upload=16656]: Uploading piece... Nov 10 02:57:07.902523564 (18h53m6.453994016s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.902896285 (18h53m6.454366746s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903057381 (18h53m6.454527842s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903221083 (18h53m6.454691544s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.903750420 (18h53m6.455220881s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904221027 (18h53m6.455691478s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904538802 (18h53m6.456009263s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.904837540 (18h53m6.456308001s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.905108617 (18h53m6.456579088s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906363115 (18h53m6.457833576s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:07.906725125 (18h53m6.458195616s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Uploading piece... Nov 10 02:57:09.614029177 (18h53m8.165499638s) [upload=16656]: Next returned nil segment Nov 10 02:57:09.614047832 (18h53m8.165518303s) [upload=16656]: Waiting for error group managing segments... Nov 10 02:57:09.946613505 (18h53m8.498083967s) [noise=true , address=45.91.116.14:4191 , piece_id=NZGGLSAWHOCW5AKD7J6VOGXKD47ARSSYSV3RRK6ZWLNNRJMFDFHQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:09.963197294 (18h53m8.514667756s) [noise=true , address=45.91.116.8:4048 , piece_id=OJABWCFJN4RG7ONOAXUQZ6YJHLKDVHLPP7A52QO6NULHOF67HJIA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.002783744 (18h53m8.554254215s) [noise=true , address=45.91.116.12:4227 , piece_id=XNCUCK5GHYGN47RWCEZRR457FFT2OCFELRWRNAO4PI3Q3TAQOMAQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.016620001 (18h53m8.568090462s) [noise=true , address=77.90.31.19:4842 , piece_id=67XIHB4HOE25ESRZJBGITLKYC5XUQWAH4TO2WKYU6I7IUHBOUPRA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.025388127 (18h53m8.576858588s) [noise=true , address=45.91.116.10:4081 , piece_id=UX23JA3VIHEMTGDHOAELOCVUWKVTJK5E2YHDEEAVICQB6LF5XXBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.049947742 (18h53m8.601418193s) [noise=true , address=45.91.116.9:4263 , piece_id=C32VJE3H7JQXDBVLKF7VNXZJAILRSCYD6RSKHNOE3ZIRFS7AQGZQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:10.100717507 (18h53m8.652187968s) [noise=true , address=77.90.31.12:4590 , piece_id=DXA3YYCCTVJJXQFQARZVHVOH33N2IKF2VV52UK3URXEV5MWV77RA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: <nil> Nov 10 02:57:36.931729840 (18h53m35.483200301s) [noise=true , address=145.79.227.13:4802 , piece_id=OV363CFBEURCGTBR5D6ZNZ3FISVZPP2NINEW2EKDTAFAZFTZQMBA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57224->145.79.227.13:4802: use of closed network connection Nov 10 02:57:36.931908921 (18h53m35.483379382s) [noise=true , address=145.79.227.17:4972 , piece_id=EU72OAX22S2CXS6GWFRHZTXSQHLX6Z7AASQW5NP5ZLO72P6GZBTA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40232->145.79.227.17:4972: use of closed network connection Nov 10 02:57:36.932058757 (18h53m35.483529218s) [noise=true , address=145.79.227.25:4619 , piece_id=5UCTYB4LJ5CYQEOOFRLRJWDUAAUPTOHZ7SWDMJNWSQUK2OOEAQLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU, address:145.79.227.25:4619): protocol: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48082->145.79.227.25:4619: use of closed network connection Nov 10 02:57:36.932196429 (18h53m35.48366689s) [noise=true , address=145.79.227.24:4581 , piece_id=C7W2DRLFYGAXAYZ4DOLU4ZVDIT2UDJ5X24BXHUDMEXI2P4TUT2DQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:123ib1A8nmVmR272odjhVsUgADYbaMRMiPahSLoZ5eamaV6Qbb1, address:145.79.227.24:4581): protocol: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54408->145.79.227.24:4581: use of closed network connection Nov 10 02:57:36.932321106 (18h53m35.483791567s) [noise=true , address=145.79.227.32:4835 , piece_id=WPG2GD7AZJIOH5SYJDCKF3LNYZMGCPFNV3DZZMX33GJS6T2R3UIQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47954->145.79.227.32:4835: use of closed network connection Nov 10 02:57:36.932454640 (18h53m35.483925102s) [noise=true , address=145.79.227.13:4803 , piece_id=4YAGBZKY3Z2SPBIGJZGUTCFBHMR2ZKJCPWTUILX7YJJQMZKPIKLQ, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53848->145.79.227.13:4803: use of closed network connection Nov 10 02:57:36.932598614 (18h53m35.484069076s) [noise=true , address=145.79.227.8:4331 , piece_id=KGU7V7767KKEOBUSSLC42KZGG7VBF4KFLWCRJYW3SRCAQGSMBNSA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60550->145.79.227.8:4331: use of closed network connection Nov 10 02:57:36.932746786 (18h53m35.484217257s) [noise=true , address=145.79.227.31:4798 , piece_id=OFHBBUULKRRN5AGTSVCTYLMOLTD3LXRZV5TE2EEUVWWFI6QLP45Q, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:17Ski7oMzbGroPGgWRrbUiqC1NiLPBBsvYuU4pCZ53xhNKkeBZ, address:145.79.227.31:4798): protocol: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52794->145.79.227.31:4798: use of closed network connection Nov 10 02:57:36.932891542 (18h53m35.484362013s) [noise=true , address=145.79.227.11:4730 , piece_id=O7D5GZGMKLBKWWH325VVDWPRWWA2GPBTRXSNPW62A5SGOLHUCKAA, seg_pos={0 0}, upload=16656]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56422->145.79.227.11:4730: use of closed network connection Nov 10 02:57:36.932956786 (18h53m35.484427247s) [seg_pos={0 0}, upload=16656]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Nov 10 02:57:37.186654542 (18h53m35.738125003s) [upload=16656]: Done uploading segments... Nov 10 02:57:37.186695660 (18h53m35.738166121s) [upload=16656]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 5.9036242s core uplink us-select-1

Orbiter Check History

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)