Orbiter History

checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 451.91819ms target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-07-05 13:20:33 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 451.938549ms edge linksharing us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [.............................................X........X.....] duration: 738.999022ms FAIL (2025-07-05 13:20:10 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 739.038237ms edge authservice http us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 468.436251ms target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-07-05 13:20:03 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 468.453233ms edge linksharing us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................................X.....X...] duration: 6.112228068s FAIL (2025-07-05 13:20:01 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 6.112253939s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.284687805s FAIL (2025-07-05 13:19:53 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.284712702s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [..............................................X........X....] duration: 727.757508ms FAIL (2025-07-05 13:19:42 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 727.783026ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [...............................................X........X...] duration: 750.022923ms FAIL (2025-07-05 13:19:05 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 750.050846ms edge authservice http us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 523.348252ms target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-07-05 13:19:04 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 523.370184ms edge linksharing us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................................X.....X..] duration: 6.248878417s FAIL (2025-07-05 13:18:48 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 6.248898165s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.641320918s FAIL (2025-07-05 13:18:43 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.64135865s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [................................................X........X..] duration: 753.31528ms FAIL (2025-07-05 13:18:23 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 753.3471ms edge authservice http us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 488.966788ms target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-07-05 13:17:54 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 488.997567ms edge linksharing us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................................X.....X.] duration: 6.319482869s FAIL (2025-07-05 13:17:45 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 6.319504821s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.352578027s FAIL (2025-07-05 13:17:35 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.352596081s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [.................................................X........X.] duration: 12.258466762s FAIL (2025-07-05 13:17:20 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 12.258485468s edge authservice http us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 7.782955393s target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-07-05 13:17:18 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 7.782975732s edge linksharing us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000927572s FAIL (2025-07-05 13:17:16 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 30.000954243s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [..................................................X........X] duration: 30.000570584s FAIL (2025-07-05 13:17:08 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 30.000588668s edge authservice http us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000919942s target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-07-05 13:17:06 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 30.000948257s edge linksharing us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................X.....X] duration: 30.000424826s FAIL (2025-07-05 13:17:04 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 30.000459983s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 762.07078ms FAIL (2025-07-05 13:16:00 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 762.100277ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 761.44822ms FAIL (2025-07-05 13:15:40 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 761.480092ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 6.298407168s FAIL (2025-07-05 13:15:37 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 6.298428018s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 738.846138ms FAIL (2025-07-05 13:15:16 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 738.874682ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 759.051915ms FAIL (2025-07-05 13:14:46 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 759.077424ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 6.321061989s FAIL (2025-07-05 13:14:38 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 6.321085063s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 726.203433ms FAIL (2025-07-05 13:14:25 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 726.241395ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.186914554s FAIL (2025-07-05 13:14:13 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 6.186936015s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 776.413109ms FAIL (2025-07-05 13:13:45 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 776.429971ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 6.38657525s FAIL (2025-07-05 13:13:26 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 6.386599306s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 743.751164ms FAIL (2025-07-05 13:13:21 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 743.774888ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 6.540471225s FAIL (2025-07-05 13:12:24 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 6.540494569s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 782.061906ms FAIL (2025-07-05 13:12:21 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 782.095079ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001255897s FAIL (2025-07-05 13:11:38 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 30.001284702s edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000136916s FAIL (2025-07-05 13:11:35 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 30.000162063s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 1.82829815s FAIL (2025-07-05 11:22:25 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== arting upload Jul 5 10:32:26.135231835 (289h22m0.90587318s) [upload=231418]: Done starting upload Jul 5 10:32:26.135287231 (289h22m0.905928576s) [upload=231418]: Uploading segments... Jul 5 10:32:26.135357005 (289h22m0.90599836s) [upload=231418]: Got next segment. Inline: true Jul 5 10:32:26.135361303 (289h22m0.906002648s) [upload=231418]: Waiting for error group managing segments... Jul 5 10:32:26.135395077 (289h22m0.906036412s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:26.135399686 (289h22m0.906041021s) [upload=231418]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:26.135402210 (289h22m0.906043545s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:26.604315758 (289h22m1.374957103s) [upload=231418]: Done uploading segments... Jul 5 10:32:26.604338061 (289h22m1.374979396s) [upload=231418]: Upload finished. err: <nil> Jul 5 10:32:49.001750729 (289h22m23.772392074s) [upload=231426]: Starting upload Jul 5 10:32:49.001851150 (289h22m23.772492495s) [upload=231426]: Done starting upload Jul 5 10:32:49.001936423 (289h22m23.772577768s) [upload=231426]: Uploading segments... Jul 5 10:32:49.001972693 (289h22m23.772614038s) [upload=231426]: Got next segment. Inline: true Jul 5 10:32:49.001979286 (289h22m23.772620611s) [upload=231426]: Waiting for error group managing segments... Jul 5 10:32:49.002017308 (289h22m23.772658653s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:49.002022378 (289h22m23.772663713s) [upload=231426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:49.002025113 (289h22m23.772666438s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:49.278891235 (289h22m24.04953257s) [upload=231426]: Done uploading segments... Jul 5 10:32:49.278909921 (289h22m24.049551256s) [upload=231426]: Upload finished. err: <nil> Jul 5 10:33:53.127222856 (289h23m27.897864191s) [upload=231440]: Starting upload Jul 5 10:33:53.127275788 (289h23m27.897917123s) [upload=231440]: Done starting upload Jul 5 10:33:53.127327166 (289h23m27.897968501s) [upload=231440]: Uploading segments... Jul 5 10:33:53.127357795 (289h23m27.89799914s) [upload=231440]: Got next segment. Inline: true Jul 5 10:33:53.127361111 (289h23m27.898002436s) [upload=231440]: Waiting for error group managing segments... Jul 5 10:33:53.127394155 (289h23m27.89803549s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:33:53.127400096 (289h23m27.898041431s) [upload=231440]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:33:53.127402581 (289h23m27.898043916s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:33:53.392164876 (289h23m28.162806211s) [upload=231440]: Done uploading segments... Jul 5 10:33:53.392207879 (289h23m28.162849214s) [upload=231440]: Upload finished. err: <nil> Jul 5 10:35:06.052008551 (289h24m40.822649887s) [upload=231453]: Starting upload Jul 5 10:35:06.052065300 (289h24m40.822706635s) [upload=231453]: Done starting upload Jul 5 10:35:06.052118371 (289h24m40.822759706s) [upload=231453]: Uploading segments... Jul 5 10:35:06.052155562 (289h24m40.822796897s) [upload=231453]: Got next segment. Inline: true Jul 5 10:35:06.052160341 (289h24m40.822801676s) [upload=231453]: Waiting for error group managing segments... Jul 5 10:35:06.052192673 (289h24m40.822834038s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:06.052198143 (289h24m40.822839478s) [upload=231453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:06.052200969 (289h24m40.822842314s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:06.318025517 (289h24m41.088666852s) [upload=231453]: Done uploading segments... Jul 5 10:35:06.318051467 (289h24m41.088692802s) [upload=231453]: Upload finished. err: <nil> Jul 5 10:35:21.489007457 (289h24m56.259648792s) [upload=231458]: Starting upload Jul 5 10:35:21.489063625 (289h24m56.25970496s) [upload=231458]: Done starting upload Jul 5 10:35:21.489125002 (289h24m56.259766337s) [upload=231458]: Uploading segments... Jul 5 10:35:21.489162603 (289h24m56.259803938s) [upload=231458]: Got next segment. Inline: true Jul 5 10:35:21.489166681 (289h24m56.259808016s) [upload=231458]: Waiting for error group managing segments... Jul 5 10:35:21.489214853 (289h24m56.259856188s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:21.489220203 (289h24m56.259861538s) [upload=231458]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:21.489222678 (289h24m56.259864003s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:21.763167602 (289h24m56.533808947s) [upload=231458]: Done uploading segments... Jul 5 10:35:21.763189083 (289h24m56.533830428s) [upload=231458]: Upload finished. err: <nil> Jul 5 10:36:36.306224814 (289h26m11.076866149s) [upload=231476]: Starting upload Jul 5 10:36:36.306277455 (289h26m11.07691879s) [upload=231476]: Done starting upload Jul 5 10:36:36.306325086 (289h26m11.076966421s) [upload=231476]: Uploading segments... Jul 5 10:36:36.306363439 (289h26m11.077004774s) [upload=231476]: Got next segment. Inline: true Jul 5 10:36:36.306366997 (289h26m11.077008332s) [upload=231476]: Waiting for error group managing segments... Jul 5 10:36:36.306397785 (289h26m11.077039121s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:36:36.306402244 (289h26m11.077043579s) [upload=231476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:36:36.306404628 (289h26m11.077045963s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:36:36.664037218 (289h26m11.434678553s) [upload=231476]: Done uploading segments... Jul 5 10:36:36.664057598 (289h26m11.434698933s) [upload=231476]: Upload finished. err: <nil> Jul 5 10:37:23.290698017 (289h26m58.061339372s) [upload=231486]: Starting upload Jul 5 10:37:23.290780535 (289h26m58.0614219s) [upload=231486]: Done starting upload Jul 5 10:37:23.290865287 (289h26m58.061506632s) [upload=231486]: Uploading segments... Jul 5 10:37:23.290900985 (289h26m58.06154233s) [upload=231486]: Got next segment. Inline: true Jul 5 10:37:23.290905033 (289h26m58.061546368s) [upload=231486]: Waiting for error group managing segments... Jul 5 10:37:23.290939269 (289h26m58.061580614s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:37:23.290943597 (289h26m58.061584932s) [upload=231486]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:37:23.290945821 (289h26m58.061587157s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:37:23.600922731 (289h26m58.371564066s) [upload=231486]: Done uploading segments... Jul 5 10:37:23.600945323 (289h26m58.371586658s) [upload=231486]: Upload finished. err: <nil> Jul 5 10:38:26.398200196 (289h28m1.168841531s) [upload=231497]: Starting upload Jul 5 10:38:26.398270981 (289h28m1.168912317s) [upload=231497]: Done starting upload Jul 5 10:38:26.398323582 (289h28m1.168964917s) [upload=231497]: Uploading segments... Jul 5 10:38:26.398359360 (289h28m1.169000695s) [upload=231497]: Got next segment. Inline: true Jul 5 10:38:26.398363538 (289h28m1.169004873s) [upload=231497]: Waiting for error group managing segments... Jul 5 10:38:26.398399979 (289h28m1.169041314s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:26.398407182 (289h28m1.169048517s) [upload=231497]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:26.398410198 (289h28m1.169051533s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:26.688536233 (289h28m1.459177578s) [upload=231497]: Done uploading segments... Jul 5 10:38:26.688559748 (289h28m1.459201133s) [upload=231497]: Upload finished. err: <nil> Jul 5 10:38:41.435615778 (289h28m16.206257113s) [upload=231499]: Starting upload Jul 5 10:38:41.435718074 (289h28m16.206359429s) [upload=231499]: Done starting upload Jul 5 10:38:41.435789621 (289h28m16.206430956s) [upload=231499]: Uploading segments... Jul 5 10:38:41.435827874 (289h28m16.206469229s) [upload=231499]: Got next segment. Inline: true Jul 5 10:38:41.435833314 (289h28m16.206474689s) [upload=231499]: Waiting for error group managing segments... Jul 5 10:38:41.435881707 (289h28m16.206523072s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:41.435887829 (289h28m16.206529194s) [upload=231499]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:41.435891646 (289h28m16.206533021s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:41.751742745 (289h28m16.52238408s) [upload=231499]: Done uploading segments... Jul 5 10:38:41.751766320 (289h28m16.522407665s) [upload=231499]: Upload finished. err: <nil> Jul 5 10:38:58.980085408 (289h28m33.750726743s) [upload=231503]: Starting upload Jul 5 10:38:58.980165591 (289h28m33.750806926s) [upload=231503]: Done starting upload Jul 5 10:38:58.980225375 (289h28m33.750866711s) [upload=231503]: Uploading segments... Jul 5 10:38:58.980261305 (289h28m33.75090264s) [upload=231503]: Got next segment. Inline: true Jul 5 10:38:58.980265443 (289h28m33.750906778s) [upload=231503]: Waiting for error group managing segments... Jul 5 10:38:58.980300379 (289h28m33.750941714s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:58.980305198 (289h28m33.750946533s) [upload=231503]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:58.980307563 (289h28m33.750948898s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:59.282057185 (289h28m34.05269852s) [upload=231503]: Done uploading segments... Jul 5 10:38:59.282076321 (289h28m34.052717656s) [upload=231503]: Upload finished. err: <nil> Duration: 1.82833448s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 1.915924066s FAIL (2025-07-05 11:21:30 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== arting upload Jul 5 10:32:26.135231835 (289h22m0.90587318s) [upload=231418]: Done starting upload Jul 5 10:32:26.135287231 (289h22m0.905928576s) [upload=231418]: Uploading segments... Jul 5 10:32:26.135357005 (289h22m0.90599836s) [upload=231418]: Got next segment. Inline: true Jul 5 10:32:26.135361303 (289h22m0.906002648s) [upload=231418]: Waiting for error group managing segments... Jul 5 10:32:26.135395077 (289h22m0.906036412s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:26.135399686 (289h22m0.906041021s) [upload=231418]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:26.135402210 (289h22m0.906043545s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:26.604315758 (289h22m1.374957103s) [upload=231418]: Done uploading segments... Jul 5 10:32:26.604338061 (289h22m1.374979396s) [upload=231418]: Upload finished. err: <nil> Jul 5 10:32:49.001750729 (289h22m23.772392074s) [upload=231426]: Starting upload Jul 5 10:32:49.001851150 (289h22m23.772492495s) [upload=231426]: Done starting upload Jul 5 10:32:49.001936423 (289h22m23.772577768s) [upload=231426]: Uploading segments... Jul 5 10:32:49.001972693 (289h22m23.772614038s) [upload=231426]: Got next segment. Inline: true Jul 5 10:32:49.001979286 (289h22m23.772620611s) [upload=231426]: Waiting for error group managing segments... Jul 5 10:32:49.002017308 (289h22m23.772658653s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:49.002022378 (289h22m23.772663713s) [upload=231426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:49.002025113 (289h22m23.772666438s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:49.278891235 (289h22m24.04953257s) [upload=231426]: Done uploading segments... Jul 5 10:32:49.278909921 (289h22m24.049551256s) [upload=231426]: Upload finished. err: <nil> Jul 5 10:33:53.127222856 (289h23m27.897864191s) [upload=231440]: Starting upload Jul 5 10:33:53.127275788 (289h23m27.897917123s) [upload=231440]: Done starting upload Jul 5 10:33:53.127327166 (289h23m27.897968501s) [upload=231440]: Uploading segments... Jul 5 10:33:53.127357795 (289h23m27.89799914s) [upload=231440]: Got next segment. Inline: true Jul 5 10:33:53.127361111 (289h23m27.898002436s) [upload=231440]: Waiting for error group managing segments... Jul 5 10:33:53.127394155 (289h23m27.89803549s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:33:53.127400096 (289h23m27.898041431s) [upload=231440]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:33:53.127402581 (289h23m27.898043916s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:33:53.392164876 (289h23m28.162806211s) [upload=231440]: Done uploading segments... Jul 5 10:33:53.392207879 (289h23m28.162849214s) [upload=231440]: Upload finished. err: <nil> Jul 5 10:35:06.052008551 (289h24m40.822649887s) [upload=231453]: Starting upload Jul 5 10:35:06.052065300 (289h24m40.822706635s) [upload=231453]: Done starting upload Jul 5 10:35:06.052118371 (289h24m40.822759706s) [upload=231453]: Uploading segments... Jul 5 10:35:06.052155562 (289h24m40.822796897s) [upload=231453]: Got next segment. Inline: true Jul 5 10:35:06.052160341 (289h24m40.822801676s) [upload=231453]: Waiting for error group managing segments... Jul 5 10:35:06.052192673 (289h24m40.822834038s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:06.052198143 (289h24m40.822839478s) [upload=231453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:06.052200969 (289h24m40.822842314s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:06.318025517 (289h24m41.088666852s) [upload=231453]: Done uploading segments... Jul 5 10:35:06.318051467 (289h24m41.088692802s) [upload=231453]: Upload finished. err: <nil> Jul 5 10:35:21.489007457 (289h24m56.259648792s) [upload=231458]: Starting upload Jul 5 10:35:21.489063625 (289h24m56.25970496s) [upload=231458]: Done starting upload Jul 5 10:35:21.489125002 (289h24m56.259766337s) [upload=231458]: Uploading segments... Jul 5 10:35:21.489162603 (289h24m56.259803938s) [upload=231458]: Got next segment. Inline: true Jul 5 10:35:21.489166681 (289h24m56.259808016s) [upload=231458]: Waiting for error group managing segments... Jul 5 10:35:21.489214853 (289h24m56.259856188s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:21.489220203 (289h24m56.259861538s) [upload=231458]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:21.489222678 (289h24m56.259864003s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:21.763167602 (289h24m56.533808947s) [upload=231458]: Done uploading segments... Jul 5 10:35:21.763189083 (289h24m56.533830428s) [upload=231458]: Upload finished. err: <nil> Jul 5 10:36:36.306224814 (289h26m11.076866149s) [upload=231476]: Starting upload Jul 5 10:36:36.306277455 (289h26m11.07691879s) [upload=231476]: Done starting upload Jul 5 10:36:36.306325086 (289h26m11.076966421s) [upload=231476]: Uploading segments... Jul 5 10:36:36.306363439 (289h26m11.077004774s) [upload=231476]: Got next segment. Inline: true Jul 5 10:36:36.306366997 (289h26m11.077008332s) [upload=231476]: Waiting for error group managing segments... Jul 5 10:36:36.306397785 (289h26m11.077039121s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:36:36.306402244 (289h26m11.077043579s) [upload=231476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:36:36.306404628 (289h26m11.077045963s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:36:36.664037218 (289h26m11.434678553s) [upload=231476]: Done uploading segments... Jul 5 10:36:36.664057598 (289h26m11.434698933s) [upload=231476]: Upload finished. err: <nil> Jul 5 10:37:23.290698017 (289h26m58.061339372s) [upload=231486]: Starting upload Jul 5 10:37:23.290780535 (289h26m58.0614219s) [upload=231486]: Done starting upload Jul 5 10:37:23.290865287 (289h26m58.061506632s) [upload=231486]: Uploading segments... Jul 5 10:37:23.290900985 (289h26m58.06154233s) [upload=231486]: Got next segment. Inline: true Jul 5 10:37:23.290905033 (289h26m58.061546368s) [upload=231486]: Waiting for error group managing segments... Jul 5 10:37:23.290939269 (289h26m58.061580614s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:37:23.290943597 (289h26m58.061584932s) [upload=231486]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:37:23.290945821 (289h26m58.061587157s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:37:23.600922731 (289h26m58.371564066s) [upload=231486]: Done uploading segments... Jul 5 10:37:23.600945323 (289h26m58.371586658s) [upload=231486]: Upload finished. err: <nil> Jul 5 10:38:26.398200196 (289h28m1.168841531s) [upload=231497]: Starting upload Jul 5 10:38:26.398270981 (289h28m1.168912317s) [upload=231497]: Done starting upload Jul 5 10:38:26.398323582 (289h28m1.168964917s) [upload=231497]: Uploading segments... Jul 5 10:38:26.398359360 (289h28m1.169000695s) [upload=231497]: Got next segment. Inline: true Jul 5 10:38:26.398363538 (289h28m1.169004873s) [upload=231497]: Waiting for error group managing segments... Jul 5 10:38:26.398399979 (289h28m1.169041314s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:26.398407182 (289h28m1.169048517s) [upload=231497]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:26.398410198 (289h28m1.169051533s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:26.688536233 (289h28m1.459177578s) [upload=231497]: Done uploading segments... Jul 5 10:38:26.688559748 (289h28m1.459201133s) [upload=231497]: Upload finished. err: <nil> Jul 5 10:38:41.435615778 (289h28m16.206257113s) [upload=231499]: Starting upload Jul 5 10:38:41.435718074 (289h28m16.206359429s) [upload=231499]: Done starting upload Jul 5 10:38:41.435789621 (289h28m16.206430956s) [upload=231499]: Uploading segments... Jul 5 10:38:41.435827874 (289h28m16.206469229s) [upload=231499]: Got next segment. Inline: true Jul 5 10:38:41.435833314 (289h28m16.206474689s) [upload=231499]: Waiting for error group managing segments... Jul 5 10:38:41.435881707 (289h28m16.206523072s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:41.435887829 (289h28m16.206529194s) [upload=231499]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:41.435891646 (289h28m16.206533021s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:41.751742745 (289h28m16.52238408s) [upload=231499]: Done uploading segments... Jul 5 10:38:41.751766320 (289h28m16.522407665s) [upload=231499]: Upload finished. err: <nil> Jul 5 10:38:58.980085408 (289h28m33.750726743s) [upload=231503]: Starting upload Jul 5 10:38:58.980165591 (289h28m33.750806926s) [upload=231503]: Done starting upload Jul 5 10:38:58.980225375 (289h28m33.750866711s) [upload=231503]: Uploading segments... Jul 5 10:38:58.980261305 (289h28m33.75090264s) [upload=231503]: Got next segment. Inline: true Jul 5 10:38:58.980265443 (289h28m33.750906778s) [upload=231503]: Waiting for error group managing segments... Jul 5 10:38:58.980300379 (289h28m33.750941714s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:58.980305198 (289h28m33.750946533s) [upload=231503]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:58.980307563 (289h28m33.750948898s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:59.282057185 (289h28m34.05269852s) [upload=231503]: Done uploading segments... Jul 5 10:38:59.282076321 (289h28m34.052717656s) [upload=231503]: Upload finished. err: <nil> Duration: 1.915953603s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 1.900541969s FAIL (2025-07-05 11:21:00 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== arting upload Jul 5 10:32:26.135231835 (289h22m0.90587318s) [upload=231418]: Done starting upload Jul 5 10:32:26.135287231 (289h22m0.905928576s) [upload=231418]: Uploading segments... Jul 5 10:32:26.135357005 (289h22m0.90599836s) [upload=231418]: Got next segment. Inline: true Jul 5 10:32:26.135361303 (289h22m0.906002648s) [upload=231418]: Waiting for error group managing segments... Jul 5 10:32:26.135395077 (289h22m0.906036412s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:26.135399686 (289h22m0.906041021s) [upload=231418]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:26.135402210 (289h22m0.906043545s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:26.604315758 (289h22m1.374957103s) [upload=231418]: Done uploading segments... Jul 5 10:32:26.604338061 (289h22m1.374979396s) [upload=231418]: Upload finished. err: <nil> Jul 5 10:32:49.001750729 (289h22m23.772392074s) [upload=231426]: Starting upload Jul 5 10:32:49.001851150 (289h22m23.772492495s) [upload=231426]: Done starting upload Jul 5 10:32:49.001936423 (289h22m23.772577768s) [upload=231426]: Uploading segments... Jul 5 10:32:49.001972693 (289h22m23.772614038s) [upload=231426]: Got next segment. Inline: true Jul 5 10:32:49.001979286 (289h22m23.772620611s) [upload=231426]: Waiting for error group managing segments... Jul 5 10:32:49.002017308 (289h22m23.772658653s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:49.002022378 (289h22m23.772663713s) [upload=231426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:49.002025113 (289h22m23.772666438s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:49.278891235 (289h22m24.04953257s) [upload=231426]: Done uploading segments... Jul 5 10:32:49.278909921 (289h22m24.049551256s) [upload=231426]: Upload finished. err: <nil> Jul 5 10:33:53.127222856 (289h23m27.897864191s) [upload=231440]: Starting upload Jul 5 10:33:53.127275788 (289h23m27.897917123s) [upload=231440]: Done starting upload Jul 5 10:33:53.127327166 (289h23m27.897968501s) [upload=231440]: Uploading segments... Jul 5 10:33:53.127357795 (289h23m27.89799914s) [upload=231440]: Got next segment. Inline: true Jul 5 10:33:53.127361111 (289h23m27.898002436s) [upload=231440]: Waiting for error group managing segments... Jul 5 10:33:53.127394155 (289h23m27.89803549s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:33:53.127400096 (289h23m27.898041431s) [upload=231440]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:33:53.127402581 (289h23m27.898043916s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:33:53.392164876 (289h23m28.162806211s) [upload=231440]: Done uploading segments... Jul 5 10:33:53.392207879 (289h23m28.162849214s) [upload=231440]: Upload finished. err: <nil> Jul 5 10:35:06.052008551 (289h24m40.822649887s) [upload=231453]: Starting upload Jul 5 10:35:06.052065300 (289h24m40.822706635s) [upload=231453]: Done starting upload Jul 5 10:35:06.052118371 (289h24m40.822759706s) [upload=231453]: Uploading segments... Jul 5 10:35:06.052155562 (289h24m40.822796897s) [upload=231453]: Got next segment. Inline: true Jul 5 10:35:06.052160341 (289h24m40.822801676s) [upload=231453]: Waiting for error group managing segments... Jul 5 10:35:06.052192673 (289h24m40.822834038s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:06.052198143 (289h24m40.822839478s) [upload=231453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:06.052200969 (289h24m40.822842314s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:06.318025517 (289h24m41.088666852s) [upload=231453]: Done uploading segments... Jul 5 10:35:06.318051467 (289h24m41.088692802s) [upload=231453]: Upload finished. err: <nil> Jul 5 10:35:21.489007457 (289h24m56.259648792s) [upload=231458]: Starting upload Jul 5 10:35:21.489063625 (289h24m56.25970496s) [upload=231458]: Done starting upload Jul 5 10:35:21.489125002 (289h24m56.259766337s) [upload=231458]: Uploading segments... Jul 5 10:35:21.489162603 (289h24m56.259803938s) [upload=231458]: Got next segment. Inline: true Jul 5 10:35:21.489166681 (289h24m56.259808016s) [upload=231458]: Waiting for error group managing segments... Jul 5 10:35:21.489214853 (289h24m56.259856188s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:21.489220203 (289h24m56.259861538s) [upload=231458]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:21.489222678 (289h24m56.259864003s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:21.763167602 (289h24m56.533808947s) [upload=231458]: Done uploading segments... Jul 5 10:35:21.763189083 (289h24m56.533830428s) [upload=231458]: Upload finished. err: <nil> Jul 5 10:36:36.306224814 (289h26m11.076866149s) [upload=231476]: Starting upload Jul 5 10:36:36.306277455 (289h26m11.07691879s) [upload=231476]: Done starting upload Jul 5 10:36:36.306325086 (289h26m11.076966421s) [upload=231476]: Uploading segments... Jul 5 10:36:36.306363439 (289h26m11.077004774s) [upload=231476]: Got next segment. Inline: true Jul 5 10:36:36.306366997 (289h26m11.077008332s) [upload=231476]: Waiting for error group managing segments... Jul 5 10:36:36.306397785 (289h26m11.077039121s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:36:36.306402244 (289h26m11.077043579s) [upload=231476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:36:36.306404628 (289h26m11.077045963s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:36:36.664037218 (289h26m11.434678553s) [upload=231476]: Done uploading segments... Jul 5 10:36:36.664057598 (289h26m11.434698933s) [upload=231476]: Upload finished. err: <nil> Jul 5 10:37:23.290698017 (289h26m58.061339372s) [upload=231486]: Starting upload Jul 5 10:37:23.290780535 (289h26m58.0614219s) [upload=231486]: Done starting upload Jul 5 10:37:23.290865287 (289h26m58.061506632s) [upload=231486]: Uploading segments... Jul 5 10:37:23.290900985 (289h26m58.06154233s) [upload=231486]: Got next segment. Inline: true Jul 5 10:37:23.290905033 (289h26m58.061546368s) [upload=231486]: Waiting for error group managing segments... Jul 5 10:37:23.290939269 (289h26m58.061580614s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:37:23.290943597 (289h26m58.061584932s) [upload=231486]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:37:23.290945821 (289h26m58.061587157s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:37:23.600922731 (289h26m58.371564066s) [upload=231486]: Done uploading segments... Jul 5 10:37:23.600945323 (289h26m58.371586658s) [upload=231486]: Upload finished. err: <nil> Jul 5 10:38:26.398200196 (289h28m1.168841531s) [upload=231497]: Starting upload Jul 5 10:38:26.398270981 (289h28m1.168912317s) [upload=231497]: Done starting upload Jul 5 10:38:26.398323582 (289h28m1.168964917s) [upload=231497]: Uploading segments... Jul 5 10:38:26.398359360 (289h28m1.169000695s) [upload=231497]: Got next segment. Inline: true Jul 5 10:38:26.398363538 (289h28m1.169004873s) [upload=231497]: Waiting for error group managing segments... Jul 5 10:38:26.398399979 (289h28m1.169041314s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:26.398407182 (289h28m1.169048517s) [upload=231497]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:26.398410198 (289h28m1.169051533s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:26.688536233 (289h28m1.459177578s) [upload=231497]: Done uploading segments... Jul 5 10:38:26.688559748 (289h28m1.459201133s) [upload=231497]: Upload finished. err: <nil> Jul 5 10:38:41.435615778 (289h28m16.206257113s) [upload=231499]: Starting upload Jul 5 10:38:41.435718074 (289h28m16.206359429s) [upload=231499]: Done starting upload Jul 5 10:38:41.435789621 (289h28m16.206430956s) [upload=231499]: Uploading segments... Jul 5 10:38:41.435827874 (289h28m16.206469229s) [upload=231499]: Got next segment. Inline: true Jul 5 10:38:41.435833314 (289h28m16.206474689s) [upload=231499]: Waiting for error group managing segments... Jul 5 10:38:41.435881707 (289h28m16.206523072s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:41.435887829 (289h28m16.206529194s) [upload=231499]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:41.435891646 (289h28m16.206533021s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:41.751742745 (289h28m16.52238408s) [upload=231499]: Done uploading segments... Jul 5 10:38:41.751766320 (289h28m16.522407665s) [upload=231499]: Upload finished. err: <nil> Jul 5 10:38:58.980085408 (289h28m33.750726743s) [upload=231503]: Starting upload Jul 5 10:38:58.980165591 (289h28m33.750806926s) [upload=231503]: Done starting upload Jul 5 10:38:58.980225375 (289h28m33.750866711s) [upload=231503]: Uploading segments... Jul 5 10:38:58.980261305 (289h28m33.75090264s) [upload=231503]: Got next segment. Inline: true Jul 5 10:38:58.980265443 (289h28m33.750906778s) [upload=231503]: Waiting for error group managing segments... Jul 5 10:38:58.980300379 (289h28m33.750941714s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:58.980305198 (289h28m33.750946533s) [upload=231503]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:58.980307563 (289h28m33.750948898s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:59.282057185 (289h28m34.05269852s) [upload=231503]: Done uploading segments... Jul 5 10:38:59.282076321 (289h28m34.052717656s) [upload=231503]: Upload finished. err: <nil> Duration: 1.900565262s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.015562544s FAIL (2025-07-05 11:19:52 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== arting upload Jul 5 10:32:26.135231835 (289h22m0.90587318s) [upload=231418]: Done starting upload Jul 5 10:32:26.135287231 (289h22m0.905928576s) [upload=231418]: Uploading segments... Jul 5 10:32:26.135357005 (289h22m0.90599836s) [upload=231418]: Got next segment. Inline: true Jul 5 10:32:26.135361303 (289h22m0.906002648s) [upload=231418]: Waiting for error group managing segments... Jul 5 10:32:26.135395077 (289h22m0.906036412s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:26.135399686 (289h22m0.906041021s) [upload=231418]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:26.135402210 (289h22m0.906043545s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:26.604315758 (289h22m1.374957103s) [upload=231418]: Done uploading segments... Jul 5 10:32:26.604338061 (289h22m1.374979396s) [upload=231418]: Upload finished. err: <nil> Jul 5 10:32:49.001750729 (289h22m23.772392074s) [upload=231426]: Starting upload Jul 5 10:32:49.001851150 (289h22m23.772492495s) [upload=231426]: Done starting upload Jul 5 10:32:49.001936423 (289h22m23.772577768s) [upload=231426]: Uploading segments... Jul 5 10:32:49.001972693 (289h22m23.772614038s) [upload=231426]: Got next segment. Inline: true Jul 5 10:32:49.001979286 (289h22m23.772620611s) [upload=231426]: Waiting for error group managing segments... Jul 5 10:32:49.002017308 (289h22m23.772658653s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:49.002022378 (289h22m23.772663713s) [upload=231426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:49.002025113 (289h22m23.772666438s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:49.278891235 (289h22m24.04953257s) [upload=231426]: Done uploading segments... Jul 5 10:32:49.278909921 (289h22m24.049551256s) [upload=231426]: Upload finished. err: <nil> Jul 5 10:33:53.127222856 (289h23m27.897864191s) [upload=231440]: Starting upload Jul 5 10:33:53.127275788 (289h23m27.897917123s) [upload=231440]: Done starting upload Jul 5 10:33:53.127327166 (289h23m27.897968501s) [upload=231440]: Uploading segments... Jul 5 10:33:53.127357795 (289h23m27.89799914s) [upload=231440]: Got next segment. Inline: true Jul 5 10:33:53.127361111 (289h23m27.898002436s) [upload=231440]: Waiting for error group managing segments... Jul 5 10:33:53.127394155 (289h23m27.89803549s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:33:53.127400096 (289h23m27.898041431s) [upload=231440]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:33:53.127402581 (289h23m27.898043916s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:33:53.392164876 (289h23m28.162806211s) [upload=231440]: Done uploading segments... Jul 5 10:33:53.392207879 (289h23m28.162849214s) [upload=231440]: Upload finished. err: <nil> Jul 5 10:35:06.052008551 (289h24m40.822649887s) [upload=231453]: Starting upload Jul 5 10:35:06.052065300 (289h24m40.822706635s) [upload=231453]: Done starting upload Jul 5 10:35:06.052118371 (289h24m40.822759706s) [upload=231453]: Uploading segments... Jul 5 10:35:06.052155562 (289h24m40.822796897s) [upload=231453]: Got next segment. Inline: true Jul 5 10:35:06.052160341 (289h24m40.822801676s) [upload=231453]: Waiting for error group managing segments... Jul 5 10:35:06.052192673 (289h24m40.822834038s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:06.052198143 (289h24m40.822839478s) [upload=231453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:06.052200969 (289h24m40.822842314s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:06.318025517 (289h24m41.088666852s) [upload=231453]: Done uploading segments... Jul 5 10:35:06.318051467 (289h24m41.088692802s) [upload=231453]: Upload finished. err: <nil> Jul 5 10:35:21.489007457 (289h24m56.259648792s) [upload=231458]: Starting upload Jul 5 10:35:21.489063625 (289h24m56.25970496s) [upload=231458]: Done starting upload Jul 5 10:35:21.489125002 (289h24m56.259766337s) [upload=231458]: Uploading segments... Jul 5 10:35:21.489162603 (289h24m56.259803938s) [upload=231458]: Got next segment. Inline: true Jul 5 10:35:21.489166681 (289h24m56.259808016s) [upload=231458]: Waiting for error group managing segments... Jul 5 10:35:21.489214853 (289h24m56.259856188s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:21.489220203 (289h24m56.259861538s) [upload=231458]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:21.489222678 (289h24m56.259864003s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:21.763167602 (289h24m56.533808947s) [upload=231458]: Done uploading segments... Jul 5 10:35:21.763189083 (289h24m56.533830428s) [upload=231458]: Upload finished. err: <nil> Jul 5 10:36:36.306224814 (289h26m11.076866149s) [upload=231476]: Starting upload Jul 5 10:36:36.306277455 (289h26m11.07691879s) [upload=231476]: Done starting upload Jul 5 10:36:36.306325086 (289h26m11.076966421s) [upload=231476]: Uploading segments... Jul 5 10:36:36.306363439 (289h26m11.077004774s) [upload=231476]: Got next segment. Inline: true Jul 5 10:36:36.306366997 (289h26m11.077008332s) [upload=231476]: Waiting for error group managing segments... Jul 5 10:36:36.306397785 (289h26m11.077039121s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:36:36.306402244 (289h26m11.077043579s) [upload=231476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:36:36.306404628 (289h26m11.077045963s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:36:36.664037218 (289h26m11.434678553s) [upload=231476]: Done uploading segments... Jul 5 10:36:36.664057598 (289h26m11.434698933s) [upload=231476]: Upload finished. err: <nil> Jul 5 10:37:23.290698017 (289h26m58.061339372s) [upload=231486]: Starting upload Jul 5 10:37:23.290780535 (289h26m58.0614219s) [upload=231486]: Done starting upload Jul 5 10:37:23.290865287 (289h26m58.061506632s) [upload=231486]: Uploading segments... Jul 5 10:37:23.290900985 (289h26m58.06154233s) [upload=231486]: Got next segment. Inline: true Jul 5 10:37:23.290905033 (289h26m58.061546368s) [upload=231486]: Waiting for error group managing segments... Jul 5 10:37:23.290939269 (289h26m58.061580614s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:37:23.290943597 (289h26m58.061584932s) [upload=231486]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:37:23.290945821 (289h26m58.061587157s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:37:23.600922731 (289h26m58.371564066s) [upload=231486]: Done uploading segments... Jul 5 10:37:23.600945323 (289h26m58.371586658s) [upload=231486]: Upload finished. err: <nil> Jul 5 10:38:26.398200196 (289h28m1.168841531s) [upload=231497]: Starting upload Jul 5 10:38:26.398270981 (289h28m1.168912317s) [upload=231497]: Done starting upload Jul 5 10:38:26.398323582 (289h28m1.168964917s) [upload=231497]: Uploading segments... Jul 5 10:38:26.398359360 (289h28m1.169000695s) [upload=231497]: Got next segment. Inline: true Jul 5 10:38:26.398363538 (289h28m1.169004873s) [upload=231497]: Waiting for error group managing segments... Jul 5 10:38:26.398399979 (289h28m1.169041314s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:26.398407182 (289h28m1.169048517s) [upload=231497]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:26.398410198 (289h28m1.169051533s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:26.688536233 (289h28m1.459177578s) [upload=231497]: Done uploading segments... Jul 5 10:38:26.688559748 (289h28m1.459201133s) [upload=231497]: Upload finished. err: <nil> Jul 5 10:38:41.435615778 (289h28m16.206257113s) [upload=231499]: Starting upload Jul 5 10:38:41.435718074 (289h28m16.206359429s) [upload=231499]: Done starting upload Jul 5 10:38:41.435789621 (289h28m16.206430956s) [upload=231499]: Uploading segments... Jul 5 10:38:41.435827874 (289h28m16.206469229s) [upload=231499]: Got next segment. Inline: true Jul 5 10:38:41.435833314 (289h28m16.206474689s) [upload=231499]: Waiting for error group managing segments... Jul 5 10:38:41.435881707 (289h28m16.206523072s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:41.435887829 (289h28m16.206529194s) [upload=231499]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:41.435891646 (289h28m16.206533021s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:41.751742745 (289h28m16.52238408s) [upload=231499]: Done uploading segments... Jul 5 10:38:41.751766320 (289h28m16.522407665s) [upload=231499]: Upload finished. err: <nil> Jul 5 10:38:58.980085408 (289h28m33.750726743s) [upload=231503]: Starting upload Jul 5 10:38:58.980165591 (289h28m33.750806926s) [upload=231503]: Done starting upload Jul 5 10:38:58.980225375 (289h28m33.750866711s) [upload=231503]: Uploading segments... Jul 5 10:38:58.980261305 (289h28m33.75090264s) [upload=231503]: Got next segment. Inline: true Jul 5 10:38:58.980265443 (289h28m33.750906778s) [upload=231503]: Waiting for error group managing segments... Jul 5 10:38:58.980300379 (289h28m33.750941714s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:58.980305198 (289h28m33.750946533s) [upload=231503]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:58.980307563 (289h28m33.750948898s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:59.282057185 (289h28m34.05269852s) [upload=231503]: Done uploading segments... Jul 5 10:38:59.282076321 (289h28m34.052717656s) [upload=231503]: Upload finished. err: <nil> Duration: 2.015588354s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 1.88130995s FAIL (2025-07-05 11:18:59 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== arting upload Jul 5 10:32:26.135231835 (289h22m0.90587318s) [upload=231418]: Done starting upload Jul 5 10:32:26.135287231 (289h22m0.905928576s) [upload=231418]: Uploading segments... Jul 5 10:32:26.135357005 (289h22m0.90599836s) [upload=231418]: Got next segment. Inline: true Jul 5 10:32:26.135361303 (289h22m0.906002648s) [upload=231418]: Waiting for error group managing segments... Jul 5 10:32:26.135395077 (289h22m0.906036412s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:26.135399686 (289h22m0.906041021s) [upload=231418]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:26.135402210 (289h22m0.906043545s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:26.604315758 (289h22m1.374957103s) [upload=231418]: Done uploading segments... Jul 5 10:32:26.604338061 (289h22m1.374979396s) [upload=231418]: Upload finished. err: <nil> Jul 5 10:32:49.001750729 (289h22m23.772392074s) [upload=231426]: Starting upload Jul 5 10:32:49.001851150 (289h22m23.772492495s) [upload=231426]: Done starting upload Jul 5 10:32:49.001936423 (289h22m23.772577768s) [upload=231426]: Uploading segments... Jul 5 10:32:49.001972693 (289h22m23.772614038s) [upload=231426]: Got next segment. Inline: true Jul 5 10:32:49.001979286 (289h22m23.772620611s) [upload=231426]: Waiting for error group managing segments... Jul 5 10:32:49.002017308 (289h22m23.772658653s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:49.002022378 (289h22m23.772663713s) [upload=231426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:49.002025113 (289h22m23.772666438s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:49.278891235 (289h22m24.04953257s) [upload=231426]: Done uploading segments... Jul 5 10:32:49.278909921 (289h22m24.049551256s) [upload=231426]: Upload finished. err: <nil> Jul 5 10:33:53.127222856 (289h23m27.897864191s) [upload=231440]: Starting upload Jul 5 10:33:53.127275788 (289h23m27.897917123s) [upload=231440]: Done starting upload Jul 5 10:33:53.127327166 (289h23m27.897968501s) [upload=231440]: Uploading segments... Jul 5 10:33:53.127357795 (289h23m27.89799914s) [upload=231440]: Got next segment. Inline: true Jul 5 10:33:53.127361111 (289h23m27.898002436s) [upload=231440]: Waiting for error group managing segments... Jul 5 10:33:53.127394155 (289h23m27.89803549s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:33:53.127400096 (289h23m27.898041431s) [upload=231440]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:33:53.127402581 (289h23m27.898043916s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:33:53.392164876 (289h23m28.162806211s) [upload=231440]: Done uploading segments... Jul 5 10:33:53.392207879 (289h23m28.162849214s) [upload=231440]: Upload finished. err: <nil> Jul 5 10:35:06.052008551 (289h24m40.822649887s) [upload=231453]: Starting upload Jul 5 10:35:06.052065300 (289h24m40.822706635s) [upload=231453]: Done starting upload Jul 5 10:35:06.052118371 (289h24m40.822759706s) [upload=231453]: Uploading segments... Jul 5 10:35:06.052155562 (289h24m40.822796897s) [upload=231453]: Got next segment. Inline: true Jul 5 10:35:06.052160341 (289h24m40.822801676s) [upload=231453]: Waiting for error group managing segments... Jul 5 10:35:06.052192673 (289h24m40.822834038s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:06.052198143 (289h24m40.822839478s) [upload=231453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:06.052200969 (289h24m40.822842314s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:06.318025517 (289h24m41.088666852s) [upload=231453]: Done uploading segments... Jul 5 10:35:06.318051467 (289h24m41.088692802s) [upload=231453]: Upload finished. err: <nil> Jul 5 10:35:21.489007457 (289h24m56.259648792s) [upload=231458]: Starting upload Jul 5 10:35:21.489063625 (289h24m56.25970496s) [upload=231458]: Done starting upload Jul 5 10:35:21.489125002 (289h24m56.259766337s) [upload=231458]: Uploading segments... Jul 5 10:35:21.489162603 (289h24m56.259803938s) [upload=231458]: Got next segment. Inline: true Jul 5 10:35:21.489166681 (289h24m56.259808016s) [upload=231458]: Waiting for error group managing segments... Jul 5 10:35:21.489214853 (289h24m56.259856188s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:21.489220203 (289h24m56.259861538s) [upload=231458]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:21.489222678 (289h24m56.259864003s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:21.763167602 (289h24m56.533808947s) [upload=231458]: Done uploading segments... Jul 5 10:35:21.763189083 (289h24m56.533830428s) [upload=231458]: Upload finished. err: <nil> Jul 5 10:36:36.306224814 (289h26m11.076866149s) [upload=231476]: Starting upload Jul 5 10:36:36.306277455 (289h26m11.07691879s) [upload=231476]: Done starting upload Jul 5 10:36:36.306325086 (289h26m11.076966421s) [upload=231476]: Uploading segments... Jul 5 10:36:36.306363439 (289h26m11.077004774s) [upload=231476]: Got next segment. Inline: true Jul 5 10:36:36.306366997 (289h26m11.077008332s) [upload=231476]: Waiting for error group managing segments... Jul 5 10:36:36.306397785 (289h26m11.077039121s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:36:36.306402244 (289h26m11.077043579s) [upload=231476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:36:36.306404628 (289h26m11.077045963s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:36:36.664037218 (289h26m11.434678553s) [upload=231476]: Done uploading segments... Jul 5 10:36:36.664057598 (289h26m11.434698933s) [upload=231476]: Upload finished. err: <nil> Jul 5 10:37:23.290698017 (289h26m58.061339372s) [upload=231486]: Starting upload Jul 5 10:37:23.290780535 (289h26m58.0614219s) [upload=231486]: Done starting upload Jul 5 10:37:23.290865287 (289h26m58.061506632s) [upload=231486]: Uploading segments... Jul 5 10:37:23.290900985 (289h26m58.06154233s) [upload=231486]: Got next segment. Inline: true Jul 5 10:37:23.290905033 (289h26m58.061546368s) [upload=231486]: Waiting for error group managing segments... Jul 5 10:37:23.290939269 (289h26m58.061580614s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:37:23.290943597 (289h26m58.061584932s) [upload=231486]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:37:23.290945821 (289h26m58.061587157s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:37:23.600922731 (289h26m58.371564066s) [upload=231486]: Done uploading segments... Jul 5 10:37:23.600945323 (289h26m58.371586658s) [upload=231486]: Upload finished. err: <nil> Jul 5 10:38:26.398200196 (289h28m1.168841531s) [upload=231497]: Starting upload Jul 5 10:38:26.398270981 (289h28m1.168912317s) [upload=231497]: Done starting upload Jul 5 10:38:26.398323582 (289h28m1.168964917s) [upload=231497]: Uploading segments... Jul 5 10:38:26.398359360 (289h28m1.169000695s) [upload=231497]: Got next segment. Inline: true Jul 5 10:38:26.398363538 (289h28m1.169004873s) [upload=231497]: Waiting for error group managing segments... Jul 5 10:38:26.398399979 (289h28m1.169041314s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:26.398407182 (289h28m1.169048517s) [upload=231497]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:26.398410198 (289h28m1.169051533s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:26.688536233 (289h28m1.459177578s) [upload=231497]: Done uploading segments... Jul 5 10:38:26.688559748 (289h28m1.459201133s) [upload=231497]: Upload finished. err: <nil> Jul 5 10:38:41.435615778 (289h28m16.206257113s) [upload=231499]: Starting upload Jul 5 10:38:41.435718074 (289h28m16.206359429s) [upload=231499]: Done starting upload Jul 5 10:38:41.435789621 (289h28m16.206430956s) [upload=231499]: Uploading segments... Jul 5 10:38:41.435827874 (289h28m16.206469229s) [upload=231499]: Got next segment. Inline: true Jul 5 10:38:41.435833314 (289h28m16.206474689s) [upload=231499]: Waiting for error group managing segments... Jul 5 10:38:41.435881707 (289h28m16.206523072s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:41.435887829 (289h28m16.206529194s) [upload=231499]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:41.435891646 (289h28m16.206533021s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:41.751742745 (289h28m16.52238408s) [upload=231499]: Done uploading segments... Jul 5 10:38:41.751766320 (289h28m16.522407665s) [upload=231499]: Upload finished. err: <nil> Jul 5 10:38:58.980085408 (289h28m33.750726743s) [upload=231503]: Starting upload Jul 5 10:38:58.980165591 (289h28m33.750806926s) [upload=231503]: Done starting upload Jul 5 10:38:58.980225375 (289h28m33.750866711s) [upload=231503]: Uploading segments... Jul 5 10:38:58.980261305 (289h28m33.75090264s) [upload=231503]: Got next segment. Inline: true Jul 5 10:38:58.980265443 (289h28m33.750906778s) [upload=231503]: Waiting for error group managing segments... Jul 5 10:38:58.980300379 (289h28m33.750941714s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:58.980305198 (289h28m33.750946533s) [upload=231503]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:58.980307563 (289h28m33.750948898s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:59.282057185 (289h28m34.05269852s) [upload=231503]: Done uploading segments... Jul 5 10:38:59.282076321 (289h28m34.052717656s) [upload=231503]: Upload finished. err: <nil> Duration: 1.881335088s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.13698962s FAIL (2025-07-05 11:18:42 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== arting upload Jul 5 10:32:26.135231835 (289h22m0.90587318s) [upload=231418]: Done starting upload Jul 5 10:32:26.135287231 (289h22m0.905928576s) [upload=231418]: Uploading segments... Jul 5 10:32:26.135357005 (289h22m0.90599836s) [upload=231418]: Got next segment. Inline: true Jul 5 10:32:26.135361303 (289h22m0.906002648s) [upload=231418]: Waiting for error group managing segments... Jul 5 10:32:26.135395077 (289h22m0.906036412s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:26.135399686 (289h22m0.906041021s) [upload=231418]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:26.135402210 (289h22m0.906043545s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:26.604315758 (289h22m1.374957103s) [upload=231418]: Done uploading segments... Jul 5 10:32:26.604338061 (289h22m1.374979396s) [upload=231418]: Upload finished. err: <nil> Jul 5 10:32:49.001750729 (289h22m23.772392074s) [upload=231426]: Starting upload Jul 5 10:32:49.001851150 (289h22m23.772492495s) [upload=231426]: Done starting upload Jul 5 10:32:49.001936423 (289h22m23.772577768s) [upload=231426]: Uploading segments... Jul 5 10:32:49.001972693 (289h22m23.772614038s) [upload=231426]: Got next segment. Inline: true Jul 5 10:32:49.001979286 (289h22m23.772620611s) [upload=231426]: Waiting for error group managing segments... Jul 5 10:32:49.002017308 (289h22m23.772658653s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:49.002022378 (289h22m23.772663713s) [upload=231426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:49.002025113 (289h22m23.772666438s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:49.278891235 (289h22m24.04953257s) [upload=231426]: Done uploading segments... Jul 5 10:32:49.278909921 (289h22m24.049551256s) [upload=231426]: Upload finished. err: <nil> Jul 5 10:33:53.127222856 (289h23m27.897864191s) [upload=231440]: Starting upload Jul 5 10:33:53.127275788 (289h23m27.897917123s) [upload=231440]: Done starting upload Jul 5 10:33:53.127327166 (289h23m27.897968501s) [upload=231440]: Uploading segments... Jul 5 10:33:53.127357795 (289h23m27.89799914s) [upload=231440]: Got next segment. Inline: true Jul 5 10:33:53.127361111 (289h23m27.898002436s) [upload=231440]: Waiting for error group managing segments... Jul 5 10:33:53.127394155 (289h23m27.89803549s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:33:53.127400096 (289h23m27.898041431s) [upload=231440]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:33:53.127402581 (289h23m27.898043916s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:33:53.392164876 (289h23m28.162806211s) [upload=231440]: Done uploading segments... Jul 5 10:33:53.392207879 (289h23m28.162849214s) [upload=231440]: Upload finished. err: <nil> Jul 5 10:35:06.052008551 (289h24m40.822649887s) [upload=231453]: Starting upload Jul 5 10:35:06.052065300 (289h24m40.822706635s) [upload=231453]: Done starting upload Jul 5 10:35:06.052118371 (289h24m40.822759706s) [upload=231453]: Uploading segments... Jul 5 10:35:06.052155562 (289h24m40.822796897s) [upload=231453]: Got next segment. Inline: true Jul 5 10:35:06.052160341 (289h24m40.822801676s) [upload=231453]: Waiting for error group managing segments... Jul 5 10:35:06.052192673 (289h24m40.822834038s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:06.052198143 (289h24m40.822839478s) [upload=231453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:06.052200969 (289h24m40.822842314s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:06.318025517 (289h24m41.088666852s) [upload=231453]: Done uploading segments... Jul 5 10:35:06.318051467 (289h24m41.088692802s) [upload=231453]: Upload finished. err: <nil> Jul 5 10:35:21.489007457 (289h24m56.259648792s) [upload=231458]: Starting upload Jul 5 10:35:21.489063625 (289h24m56.25970496s) [upload=231458]: Done starting upload Jul 5 10:35:21.489125002 (289h24m56.259766337s) [upload=231458]: Uploading segments... Jul 5 10:35:21.489162603 (289h24m56.259803938s) [upload=231458]: Got next segment. Inline: true Jul 5 10:35:21.489166681 (289h24m56.259808016s) [upload=231458]: Waiting for error group managing segments... Jul 5 10:35:21.489214853 (289h24m56.259856188s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:21.489220203 (289h24m56.259861538s) [upload=231458]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:21.489222678 (289h24m56.259864003s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:21.763167602 (289h24m56.533808947s) [upload=231458]: Done uploading segments... Jul 5 10:35:21.763189083 (289h24m56.533830428s) [upload=231458]: Upload finished. err: <nil> Jul 5 10:36:36.306224814 (289h26m11.076866149s) [upload=231476]: Starting upload Jul 5 10:36:36.306277455 (289h26m11.07691879s) [upload=231476]: Done starting upload Jul 5 10:36:36.306325086 (289h26m11.076966421s) [upload=231476]: Uploading segments... Jul 5 10:36:36.306363439 (289h26m11.077004774s) [upload=231476]: Got next segment. Inline: true Jul 5 10:36:36.306366997 (289h26m11.077008332s) [upload=231476]: Waiting for error group managing segments... Jul 5 10:36:36.306397785 (289h26m11.077039121s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:36:36.306402244 (289h26m11.077043579s) [upload=231476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:36:36.306404628 (289h26m11.077045963s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:36:36.664037218 (289h26m11.434678553s) [upload=231476]: Done uploading segments... Jul 5 10:36:36.664057598 (289h26m11.434698933s) [upload=231476]: Upload finished. err: <nil> Jul 5 10:37:23.290698017 (289h26m58.061339372s) [upload=231486]: Starting upload Jul 5 10:37:23.290780535 (289h26m58.0614219s) [upload=231486]: Done starting upload Jul 5 10:37:23.290865287 (289h26m58.061506632s) [upload=231486]: Uploading segments... Jul 5 10:37:23.290900985 (289h26m58.06154233s) [upload=231486]: Got next segment. Inline: true Jul 5 10:37:23.290905033 (289h26m58.061546368s) [upload=231486]: Waiting for error group managing segments... Jul 5 10:37:23.290939269 (289h26m58.061580614s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:37:23.290943597 (289h26m58.061584932s) [upload=231486]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:37:23.290945821 (289h26m58.061587157s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:37:23.600922731 (289h26m58.371564066s) [upload=231486]: Done uploading segments... Jul 5 10:37:23.600945323 (289h26m58.371586658s) [upload=231486]: Upload finished. err: <nil> Jul 5 10:38:26.398200196 (289h28m1.168841531s) [upload=231497]: Starting upload Jul 5 10:38:26.398270981 (289h28m1.168912317s) [upload=231497]: Done starting upload Jul 5 10:38:26.398323582 (289h28m1.168964917s) [upload=231497]: Uploading segments... Jul 5 10:38:26.398359360 (289h28m1.169000695s) [upload=231497]: Got next segment. Inline: true Jul 5 10:38:26.398363538 (289h28m1.169004873s) [upload=231497]: Waiting for error group managing segments... Jul 5 10:38:26.398399979 (289h28m1.169041314s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:26.398407182 (289h28m1.169048517s) [upload=231497]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:26.398410198 (289h28m1.169051533s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:26.688536233 (289h28m1.459177578s) [upload=231497]: Done uploading segments... Jul 5 10:38:26.688559748 (289h28m1.459201133s) [upload=231497]: Upload finished. err: <nil> Jul 5 10:38:41.435615778 (289h28m16.206257113s) [upload=231499]: Starting upload Jul 5 10:38:41.435718074 (289h28m16.206359429s) [upload=231499]: Done starting upload Jul 5 10:38:41.435789621 (289h28m16.206430956s) [upload=231499]: Uploading segments... Jul 5 10:38:41.435827874 (289h28m16.206469229s) [upload=231499]: Got next segment. Inline: true Jul 5 10:38:41.435833314 (289h28m16.206474689s) [upload=231499]: Waiting for error group managing segments... Jul 5 10:38:41.435881707 (289h28m16.206523072s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:41.435887829 (289h28m16.206529194s) [upload=231499]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:41.435891646 (289h28m16.206533021s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:41.751742745 (289h28m16.52238408s) [upload=231499]: Done uploading segments... Jul 5 10:38:41.751766320 (289h28m16.522407665s) [upload=231499]: Upload finished. err: <nil> Jul 5 10:38:58.980085408 (289h28m33.750726743s) [upload=231503]: Starting upload Jul 5 10:38:58.980165591 (289h28m33.750806926s) [upload=231503]: Done starting upload Jul 5 10:38:58.980225375 (289h28m33.750866711s) [upload=231503]: Uploading segments... Jul 5 10:38:58.980261305 (289h28m33.75090264s) [upload=231503]: Got next segment. Inline: true Jul 5 10:38:58.980265443 (289h28m33.750906778s) [upload=231503]: Waiting for error group managing segments... Jul 5 10:38:58.980300379 (289h28m33.750941714s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:58.980305198 (289h28m33.750946533s) [upload=231503]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:58.980307563 (289h28m33.750948898s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:59.282057185 (289h28m34.05269852s) [upload=231503]: Done uploading segments... Jul 5 10:38:59.282076321 (289h28m34.052717656s) [upload=231503]: Upload finished. err: <nil> Duration: 2.137016323s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 1.878905165s FAIL (2025-07-05 11:18:11 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== arting upload Jul 5 10:32:26.135231835 (289h22m0.90587318s) [upload=231418]: Done starting upload Jul 5 10:32:26.135287231 (289h22m0.905928576s) [upload=231418]: Uploading segments... Jul 5 10:32:26.135357005 (289h22m0.90599836s) [upload=231418]: Got next segment. Inline: true Jul 5 10:32:26.135361303 (289h22m0.906002648s) [upload=231418]: Waiting for error group managing segments... Jul 5 10:32:26.135395077 (289h22m0.906036412s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:26.135399686 (289h22m0.906041021s) [upload=231418]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:26.135402210 (289h22m0.906043545s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:26.604315758 (289h22m1.374957103s) [upload=231418]: Done uploading segments... Jul 5 10:32:26.604338061 (289h22m1.374979396s) [upload=231418]: Upload finished. err: <nil> Jul 5 10:32:49.001750729 (289h22m23.772392074s) [upload=231426]: Starting upload Jul 5 10:32:49.001851150 (289h22m23.772492495s) [upload=231426]: Done starting upload Jul 5 10:32:49.001936423 (289h22m23.772577768s) [upload=231426]: Uploading segments... Jul 5 10:32:49.001972693 (289h22m23.772614038s) [upload=231426]: Got next segment. Inline: true Jul 5 10:32:49.001979286 (289h22m23.772620611s) [upload=231426]: Waiting for error group managing segments... Jul 5 10:32:49.002017308 (289h22m23.772658653s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:49.002022378 (289h22m23.772663713s) [upload=231426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:49.002025113 (289h22m23.772666438s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:49.278891235 (289h22m24.04953257s) [upload=231426]: Done uploading segments... Jul 5 10:32:49.278909921 (289h22m24.049551256s) [upload=231426]: Upload finished. err: <nil> Jul 5 10:33:53.127222856 (289h23m27.897864191s) [upload=231440]: Starting upload Jul 5 10:33:53.127275788 (289h23m27.897917123s) [upload=231440]: Done starting upload Jul 5 10:33:53.127327166 (289h23m27.897968501s) [upload=231440]: Uploading segments... Jul 5 10:33:53.127357795 (289h23m27.89799914s) [upload=231440]: Got next segment. Inline: true Jul 5 10:33:53.127361111 (289h23m27.898002436s) [upload=231440]: Waiting for error group managing segments... Jul 5 10:33:53.127394155 (289h23m27.89803549s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:33:53.127400096 (289h23m27.898041431s) [upload=231440]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:33:53.127402581 (289h23m27.898043916s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:33:53.392164876 (289h23m28.162806211s) [upload=231440]: Done uploading segments... Jul 5 10:33:53.392207879 (289h23m28.162849214s) [upload=231440]: Upload finished. err: <nil> Jul 5 10:35:06.052008551 (289h24m40.822649887s) [upload=231453]: Starting upload Jul 5 10:35:06.052065300 (289h24m40.822706635s) [upload=231453]: Done starting upload Jul 5 10:35:06.052118371 (289h24m40.822759706s) [upload=231453]: Uploading segments... Jul 5 10:35:06.052155562 (289h24m40.822796897s) [upload=231453]: Got next segment. Inline: true Jul 5 10:35:06.052160341 (289h24m40.822801676s) [upload=231453]: Waiting for error group managing segments... Jul 5 10:35:06.052192673 (289h24m40.822834038s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:06.052198143 (289h24m40.822839478s) [upload=231453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:06.052200969 (289h24m40.822842314s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:06.318025517 (289h24m41.088666852s) [upload=231453]: Done uploading segments... Jul 5 10:35:06.318051467 (289h24m41.088692802s) [upload=231453]: Upload finished. err: <nil> Jul 5 10:35:21.489007457 (289h24m56.259648792s) [upload=231458]: Starting upload Jul 5 10:35:21.489063625 (289h24m56.25970496s) [upload=231458]: Done starting upload Jul 5 10:35:21.489125002 (289h24m56.259766337s) [upload=231458]: Uploading segments... Jul 5 10:35:21.489162603 (289h24m56.259803938s) [upload=231458]: Got next segment. Inline: true Jul 5 10:35:21.489166681 (289h24m56.259808016s) [upload=231458]: Waiting for error group managing segments... Jul 5 10:35:21.489214853 (289h24m56.259856188s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:21.489220203 (289h24m56.259861538s) [upload=231458]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:21.489222678 (289h24m56.259864003s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:21.763167602 (289h24m56.533808947s) [upload=231458]: Done uploading segments... Jul 5 10:35:21.763189083 (289h24m56.533830428s) [upload=231458]: Upload finished. err: <nil> Jul 5 10:36:36.306224814 (289h26m11.076866149s) [upload=231476]: Starting upload Jul 5 10:36:36.306277455 (289h26m11.07691879s) [upload=231476]: Done starting upload Jul 5 10:36:36.306325086 (289h26m11.076966421s) [upload=231476]: Uploading segments... Jul 5 10:36:36.306363439 (289h26m11.077004774s) [upload=231476]: Got next segment. Inline: true Jul 5 10:36:36.306366997 (289h26m11.077008332s) [upload=231476]: Waiting for error group managing segments... Jul 5 10:36:36.306397785 (289h26m11.077039121s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:36:36.306402244 (289h26m11.077043579s) [upload=231476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:36:36.306404628 (289h26m11.077045963s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:36:36.664037218 (289h26m11.434678553s) [upload=231476]: Done uploading segments... Jul 5 10:36:36.664057598 (289h26m11.434698933s) [upload=231476]: Upload finished. err: <nil> Jul 5 10:37:23.290698017 (289h26m58.061339372s) [upload=231486]: Starting upload Jul 5 10:37:23.290780535 (289h26m58.0614219s) [upload=231486]: Done starting upload Jul 5 10:37:23.290865287 (289h26m58.061506632s) [upload=231486]: Uploading segments... Jul 5 10:37:23.290900985 (289h26m58.06154233s) [upload=231486]: Got next segment. Inline: true Jul 5 10:37:23.290905033 (289h26m58.061546368s) [upload=231486]: Waiting for error group managing segments... Jul 5 10:37:23.290939269 (289h26m58.061580614s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:37:23.290943597 (289h26m58.061584932s) [upload=231486]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:37:23.290945821 (289h26m58.061587157s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:37:23.600922731 (289h26m58.371564066s) [upload=231486]: Done uploading segments... Jul 5 10:37:23.600945323 (289h26m58.371586658s) [upload=231486]: Upload finished. err: <nil> Jul 5 10:38:26.398200196 (289h28m1.168841531s) [upload=231497]: Starting upload Jul 5 10:38:26.398270981 (289h28m1.168912317s) [upload=231497]: Done starting upload Jul 5 10:38:26.398323582 (289h28m1.168964917s) [upload=231497]: Uploading segments... Jul 5 10:38:26.398359360 (289h28m1.169000695s) [upload=231497]: Got next segment. Inline: true Jul 5 10:38:26.398363538 (289h28m1.169004873s) [upload=231497]: Waiting for error group managing segments... Jul 5 10:38:26.398399979 (289h28m1.169041314s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:26.398407182 (289h28m1.169048517s) [upload=231497]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:26.398410198 (289h28m1.169051533s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:26.688536233 (289h28m1.459177578s) [upload=231497]: Done uploading segments... Jul 5 10:38:26.688559748 (289h28m1.459201133s) [upload=231497]: Upload finished. err: <nil> Jul 5 10:38:41.435615778 (289h28m16.206257113s) [upload=231499]: Starting upload Jul 5 10:38:41.435718074 (289h28m16.206359429s) [upload=231499]: Done starting upload Jul 5 10:38:41.435789621 (289h28m16.206430956s) [upload=231499]: Uploading segments... Jul 5 10:38:41.435827874 (289h28m16.206469229s) [upload=231499]: Got next segment. Inline: true Jul 5 10:38:41.435833314 (289h28m16.206474689s) [upload=231499]: Waiting for error group managing segments... Jul 5 10:38:41.435881707 (289h28m16.206523072s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:41.435887829 (289h28m16.206529194s) [upload=231499]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:41.435891646 (289h28m16.206533021s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:41.751742745 (289h28m16.52238408s) [upload=231499]: Done uploading segments... Jul 5 10:38:41.751766320 (289h28m16.522407665s) [upload=231499]: Upload finished. err: <nil> Jul 5 10:38:58.980085408 (289h28m33.750726743s) [upload=231503]: Starting upload Jul 5 10:38:58.980165591 (289h28m33.750806926s) [upload=231503]: Done starting upload Jul 5 10:38:58.980225375 (289h28m33.750866711s) [upload=231503]: Uploading segments... Jul 5 10:38:58.980261305 (289h28m33.75090264s) [upload=231503]: Got next segment. Inline: true Jul 5 10:38:58.980265443 (289h28m33.750906778s) [upload=231503]: Waiting for error group managing segments... Jul 5 10:38:58.980300379 (289h28m33.750941714s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:58.980305198 (289h28m33.750946533s) [upload=231503]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:58.980307563 (289h28m33.750948898s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:59.282057185 (289h28m34.05269852s) [upload=231503]: Done uploading segments... Jul 5 10:38:59.282076321 (289h28m34.052717656s) [upload=231503]: Upload finished. err: <nil> Duration: 1.878945503s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.003933929s FAIL (2025-07-05 11:17:52 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== arting upload Jul 5 10:32:26.135231835 (289h22m0.90587318s) [upload=231418]: Done starting upload Jul 5 10:32:26.135287231 (289h22m0.905928576s) [upload=231418]: Uploading segments... Jul 5 10:32:26.135357005 (289h22m0.90599836s) [upload=231418]: Got next segment. Inline: true Jul 5 10:32:26.135361303 (289h22m0.906002648s) [upload=231418]: Waiting for error group managing segments... Jul 5 10:32:26.135395077 (289h22m0.906036412s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:26.135399686 (289h22m0.906041021s) [upload=231418]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:26.135402210 (289h22m0.906043545s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:26.604315758 (289h22m1.374957103s) [upload=231418]: Done uploading segments... Jul 5 10:32:26.604338061 (289h22m1.374979396s) [upload=231418]: Upload finished. err: <nil> Jul 5 10:32:49.001750729 (289h22m23.772392074s) [upload=231426]: Starting upload Jul 5 10:32:49.001851150 (289h22m23.772492495s) [upload=231426]: Done starting upload Jul 5 10:32:49.001936423 (289h22m23.772577768s) [upload=231426]: Uploading segments... Jul 5 10:32:49.001972693 (289h22m23.772614038s) [upload=231426]: Got next segment. Inline: true Jul 5 10:32:49.001979286 (289h22m23.772620611s) [upload=231426]: Waiting for error group managing segments... Jul 5 10:32:49.002017308 (289h22m23.772658653s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:49.002022378 (289h22m23.772663713s) [upload=231426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:49.002025113 (289h22m23.772666438s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:49.278891235 (289h22m24.04953257s) [upload=231426]: Done uploading segments... Jul 5 10:32:49.278909921 (289h22m24.049551256s) [upload=231426]: Upload finished. err: <nil> Jul 5 10:33:53.127222856 (289h23m27.897864191s) [upload=231440]: Starting upload Jul 5 10:33:53.127275788 (289h23m27.897917123s) [upload=231440]: Done starting upload Jul 5 10:33:53.127327166 (289h23m27.897968501s) [upload=231440]: Uploading segments... Jul 5 10:33:53.127357795 (289h23m27.89799914s) [upload=231440]: Got next segment. Inline: true Jul 5 10:33:53.127361111 (289h23m27.898002436s) [upload=231440]: Waiting for error group managing segments... Jul 5 10:33:53.127394155 (289h23m27.89803549s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:33:53.127400096 (289h23m27.898041431s) [upload=231440]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:33:53.127402581 (289h23m27.898043916s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:33:53.392164876 (289h23m28.162806211s) [upload=231440]: Done uploading segments... Jul 5 10:33:53.392207879 (289h23m28.162849214s) [upload=231440]: Upload finished. err: <nil> Jul 5 10:35:06.052008551 (289h24m40.822649887s) [upload=231453]: Starting upload Jul 5 10:35:06.052065300 (289h24m40.822706635s) [upload=231453]: Done starting upload Jul 5 10:35:06.052118371 (289h24m40.822759706s) [upload=231453]: Uploading segments... Jul 5 10:35:06.052155562 (289h24m40.822796897s) [upload=231453]: Got next segment. Inline: true Jul 5 10:35:06.052160341 (289h24m40.822801676s) [upload=231453]: Waiting for error group managing segments... Jul 5 10:35:06.052192673 (289h24m40.822834038s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:06.052198143 (289h24m40.822839478s) [upload=231453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:06.052200969 (289h24m40.822842314s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:06.318025517 (289h24m41.088666852s) [upload=231453]: Done uploading segments... Jul 5 10:35:06.318051467 (289h24m41.088692802s) [upload=231453]: Upload finished. err: <nil> Jul 5 10:35:21.489007457 (289h24m56.259648792s) [upload=231458]: Starting upload Jul 5 10:35:21.489063625 (289h24m56.25970496s) [upload=231458]: Done starting upload Jul 5 10:35:21.489125002 (289h24m56.259766337s) [upload=231458]: Uploading segments... Jul 5 10:35:21.489162603 (289h24m56.259803938s) [upload=231458]: Got next segment. Inline: true Jul 5 10:35:21.489166681 (289h24m56.259808016s) [upload=231458]: Waiting for error group managing segments... Jul 5 10:35:21.489214853 (289h24m56.259856188s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:21.489220203 (289h24m56.259861538s) [upload=231458]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:21.489222678 (289h24m56.259864003s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:21.763167602 (289h24m56.533808947s) [upload=231458]: Done uploading segments... Jul 5 10:35:21.763189083 (289h24m56.533830428s) [upload=231458]: Upload finished. err: <nil> Jul 5 10:36:36.306224814 (289h26m11.076866149s) [upload=231476]: Starting upload Jul 5 10:36:36.306277455 (289h26m11.07691879s) [upload=231476]: Done starting upload Jul 5 10:36:36.306325086 (289h26m11.076966421s) [upload=231476]: Uploading segments... Jul 5 10:36:36.306363439 (289h26m11.077004774s) [upload=231476]: Got next segment. Inline: true Jul 5 10:36:36.306366997 (289h26m11.077008332s) [upload=231476]: Waiting for error group managing segments... Jul 5 10:36:36.306397785 (289h26m11.077039121s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:36:36.306402244 (289h26m11.077043579s) [upload=231476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:36:36.306404628 (289h26m11.077045963s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:36:36.664037218 (289h26m11.434678553s) [upload=231476]: Done uploading segments... Jul 5 10:36:36.664057598 (289h26m11.434698933s) [upload=231476]: Upload finished. err: <nil> Jul 5 10:37:23.290698017 (289h26m58.061339372s) [upload=231486]: Starting upload Jul 5 10:37:23.290780535 (289h26m58.0614219s) [upload=231486]: Done starting upload Jul 5 10:37:23.290865287 (289h26m58.061506632s) [upload=231486]: Uploading segments... Jul 5 10:37:23.290900985 (289h26m58.06154233s) [upload=231486]: Got next segment. Inline: true Jul 5 10:37:23.290905033 (289h26m58.061546368s) [upload=231486]: Waiting for error group managing segments... Jul 5 10:37:23.290939269 (289h26m58.061580614s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:37:23.290943597 (289h26m58.061584932s) [upload=231486]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:37:23.290945821 (289h26m58.061587157s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:37:23.600922731 (289h26m58.371564066s) [upload=231486]: Done uploading segments... Jul 5 10:37:23.600945323 (289h26m58.371586658s) [upload=231486]: Upload finished. err: <nil> Jul 5 10:38:26.398200196 (289h28m1.168841531s) [upload=231497]: Starting upload Jul 5 10:38:26.398270981 (289h28m1.168912317s) [upload=231497]: Done starting upload Jul 5 10:38:26.398323582 (289h28m1.168964917s) [upload=231497]: Uploading segments... Jul 5 10:38:26.398359360 (289h28m1.169000695s) [upload=231497]: Got next segment. Inline: true Jul 5 10:38:26.398363538 (289h28m1.169004873s) [upload=231497]: Waiting for error group managing segments... Jul 5 10:38:26.398399979 (289h28m1.169041314s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:26.398407182 (289h28m1.169048517s) [upload=231497]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:26.398410198 (289h28m1.169051533s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:26.688536233 (289h28m1.459177578s) [upload=231497]: Done uploading segments... Jul 5 10:38:26.688559748 (289h28m1.459201133s) [upload=231497]: Upload finished. err: <nil> Jul 5 10:38:41.435615778 (289h28m16.206257113s) [upload=231499]: Starting upload Jul 5 10:38:41.435718074 (289h28m16.206359429s) [upload=231499]: Done starting upload Jul 5 10:38:41.435789621 (289h28m16.206430956s) [upload=231499]: Uploading segments... Jul 5 10:38:41.435827874 (289h28m16.206469229s) [upload=231499]: Got next segment. Inline: true Jul 5 10:38:41.435833314 (289h28m16.206474689s) [upload=231499]: Waiting for error group managing segments... Jul 5 10:38:41.435881707 (289h28m16.206523072s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:41.435887829 (289h28m16.206529194s) [upload=231499]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:41.435891646 (289h28m16.206533021s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:41.751742745 (289h28m16.52238408s) [upload=231499]: Done uploading segments... Jul 5 10:38:41.751766320 (289h28m16.522407665s) [upload=231499]: Upload finished. err: <nil> Jul 5 10:38:58.980085408 (289h28m33.750726743s) [upload=231503]: Starting upload Jul 5 10:38:58.980165591 (289h28m33.750806926s) [upload=231503]: Done starting upload Jul 5 10:38:58.980225375 (289h28m33.750866711s) [upload=231503]: Uploading segments... Jul 5 10:38:58.980261305 (289h28m33.75090264s) [upload=231503]: Got next segment. Inline: true Jul 5 10:38:58.980265443 (289h28m33.750906778s) [upload=231503]: Waiting for error group managing segments... Jul 5 10:38:58.980300379 (289h28m33.750941714s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:58.980305198 (289h28m33.750946533s) [upload=231503]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:58.980307563 (289h28m33.750948898s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:59.282057185 (289h28m34.05269852s) [upload=231503]: Done uploading segments... Jul 5 10:38:59.282076321 (289h28m34.052717656s) [upload=231503]: Upload finished. err: <nil> Duration: 2.003966161s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 1.863902324s FAIL (2025-07-05 11:16:46 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== arting upload Jul 5 10:32:26.135231835 (289h22m0.90587318s) [upload=231418]: Done starting upload Jul 5 10:32:26.135287231 (289h22m0.905928576s) [upload=231418]: Uploading segments... Jul 5 10:32:26.135357005 (289h22m0.90599836s) [upload=231418]: Got next segment. Inline: true Jul 5 10:32:26.135361303 (289h22m0.906002648s) [upload=231418]: Waiting for error group managing segments... Jul 5 10:32:26.135395077 (289h22m0.906036412s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:26.135399686 (289h22m0.906041021s) [upload=231418]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:26.135402210 (289h22m0.906043545s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:26.604315758 (289h22m1.374957103s) [upload=231418]: Done uploading segments... Jul 5 10:32:26.604338061 (289h22m1.374979396s) [upload=231418]: Upload finished. err: <nil> Jul 5 10:32:49.001750729 (289h22m23.772392074s) [upload=231426]: Starting upload Jul 5 10:32:49.001851150 (289h22m23.772492495s) [upload=231426]: Done starting upload Jul 5 10:32:49.001936423 (289h22m23.772577768s) [upload=231426]: Uploading segments... Jul 5 10:32:49.001972693 (289h22m23.772614038s) [upload=231426]: Got next segment. Inline: true Jul 5 10:32:49.001979286 (289h22m23.772620611s) [upload=231426]: Waiting for error group managing segments... Jul 5 10:32:49.002017308 (289h22m23.772658653s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:49.002022378 (289h22m23.772663713s) [upload=231426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:49.002025113 (289h22m23.772666438s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:49.278891235 (289h22m24.04953257s) [upload=231426]: Done uploading segments... Jul 5 10:32:49.278909921 (289h22m24.049551256s) [upload=231426]: Upload finished. err: <nil> Jul 5 10:33:53.127222856 (289h23m27.897864191s) [upload=231440]: Starting upload Jul 5 10:33:53.127275788 (289h23m27.897917123s) [upload=231440]: Done starting upload Jul 5 10:33:53.127327166 (289h23m27.897968501s) [upload=231440]: Uploading segments... Jul 5 10:33:53.127357795 (289h23m27.89799914s) [upload=231440]: Got next segment. Inline: true Jul 5 10:33:53.127361111 (289h23m27.898002436s) [upload=231440]: Waiting for error group managing segments... Jul 5 10:33:53.127394155 (289h23m27.89803549s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:33:53.127400096 (289h23m27.898041431s) [upload=231440]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:33:53.127402581 (289h23m27.898043916s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:33:53.392164876 (289h23m28.162806211s) [upload=231440]: Done uploading segments... Jul 5 10:33:53.392207879 (289h23m28.162849214s) [upload=231440]: Upload finished. err: <nil> Jul 5 10:35:06.052008551 (289h24m40.822649887s) [upload=231453]: Starting upload Jul 5 10:35:06.052065300 (289h24m40.822706635s) [upload=231453]: Done starting upload Jul 5 10:35:06.052118371 (289h24m40.822759706s) [upload=231453]: Uploading segments... Jul 5 10:35:06.052155562 (289h24m40.822796897s) [upload=231453]: Got next segment. Inline: true Jul 5 10:35:06.052160341 (289h24m40.822801676s) [upload=231453]: Waiting for error group managing segments... Jul 5 10:35:06.052192673 (289h24m40.822834038s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:06.052198143 (289h24m40.822839478s) [upload=231453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:06.052200969 (289h24m40.822842314s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:06.318025517 (289h24m41.088666852s) [upload=231453]: Done uploading segments... Jul 5 10:35:06.318051467 (289h24m41.088692802s) [upload=231453]: Upload finished. err: <nil> Jul 5 10:35:21.489007457 (289h24m56.259648792s) [upload=231458]: Starting upload Jul 5 10:35:21.489063625 (289h24m56.25970496s) [upload=231458]: Done starting upload Jul 5 10:35:21.489125002 (289h24m56.259766337s) [upload=231458]: Uploading segments... Jul 5 10:35:21.489162603 (289h24m56.259803938s) [upload=231458]: Got next segment. Inline: true Jul 5 10:35:21.489166681 (289h24m56.259808016s) [upload=231458]: Waiting for error group managing segments... Jul 5 10:35:21.489214853 (289h24m56.259856188s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:21.489220203 (289h24m56.259861538s) [upload=231458]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:21.489222678 (289h24m56.259864003s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:21.763167602 (289h24m56.533808947s) [upload=231458]: Done uploading segments... Jul 5 10:35:21.763189083 (289h24m56.533830428s) [upload=231458]: Upload finished. err: <nil> Jul 5 10:36:36.306224814 (289h26m11.076866149s) [upload=231476]: Starting upload Jul 5 10:36:36.306277455 (289h26m11.07691879s) [upload=231476]: Done starting upload Jul 5 10:36:36.306325086 (289h26m11.076966421s) [upload=231476]: Uploading segments... Jul 5 10:36:36.306363439 (289h26m11.077004774s) [upload=231476]: Got next segment. Inline: true Jul 5 10:36:36.306366997 (289h26m11.077008332s) [upload=231476]: Waiting for error group managing segments... Jul 5 10:36:36.306397785 (289h26m11.077039121s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:36:36.306402244 (289h26m11.077043579s) [upload=231476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:36:36.306404628 (289h26m11.077045963s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:36:36.664037218 (289h26m11.434678553s) [upload=231476]: Done uploading segments... Jul 5 10:36:36.664057598 (289h26m11.434698933s) [upload=231476]: Upload finished. err: <nil> Jul 5 10:37:23.290698017 (289h26m58.061339372s) [upload=231486]: Starting upload Jul 5 10:37:23.290780535 (289h26m58.0614219s) [upload=231486]: Done starting upload Jul 5 10:37:23.290865287 (289h26m58.061506632s) [upload=231486]: Uploading segments... Jul 5 10:37:23.290900985 (289h26m58.06154233s) [upload=231486]: Got next segment. Inline: true Jul 5 10:37:23.290905033 (289h26m58.061546368s) [upload=231486]: Waiting for error group managing segments... Jul 5 10:37:23.290939269 (289h26m58.061580614s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:37:23.290943597 (289h26m58.061584932s) [upload=231486]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:37:23.290945821 (289h26m58.061587157s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:37:23.600922731 (289h26m58.371564066s) [upload=231486]: Done uploading segments... Jul 5 10:37:23.600945323 (289h26m58.371586658s) [upload=231486]: Upload finished. err: <nil> Jul 5 10:38:26.398200196 (289h28m1.168841531s) [upload=231497]: Starting upload Jul 5 10:38:26.398270981 (289h28m1.168912317s) [upload=231497]: Done starting upload Jul 5 10:38:26.398323582 (289h28m1.168964917s) [upload=231497]: Uploading segments... Jul 5 10:38:26.398359360 (289h28m1.169000695s) [upload=231497]: Got next segment. Inline: true Jul 5 10:38:26.398363538 (289h28m1.169004873s) [upload=231497]: Waiting for error group managing segments... Jul 5 10:38:26.398399979 (289h28m1.169041314s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:26.398407182 (289h28m1.169048517s) [upload=231497]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:26.398410198 (289h28m1.169051533s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:26.688536233 (289h28m1.459177578s) [upload=231497]: Done uploading segments... Jul 5 10:38:26.688559748 (289h28m1.459201133s) [upload=231497]: Upload finished. err: <nil> Jul 5 10:38:41.435615778 (289h28m16.206257113s) [upload=231499]: Starting upload Jul 5 10:38:41.435718074 (289h28m16.206359429s) [upload=231499]: Done starting upload Jul 5 10:38:41.435789621 (289h28m16.206430956s) [upload=231499]: Uploading segments... Jul 5 10:38:41.435827874 (289h28m16.206469229s) [upload=231499]: Got next segment. Inline: true Jul 5 10:38:41.435833314 (289h28m16.206474689s) [upload=231499]: Waiting for error group managing segments... Jul 5 10:38:41.435881707 (289h28m16.206523072s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:41.435887829 (289h28m16.206529194s) [upload=231499]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:41.435891646 (289h28m16.206533021s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:41.751742745 (289h28m16.52238408s) [upload=231499]: Done uploading segments... Jul 5 10:38:41.751766320 (289h28m16.522407665s) [upload=231499]: Upload finished. err: <nil> Jul 5 10:38:58.980085408 (289h28m33.750726743s) [upload=231503]: Starting upload Jul 5 10:38:58.980165591 (289h28m33.750806926s) [upload=231503]: Done starting upload Jul 5 10:38:58.980225375 (289h28m33.750866711s) [upload=231503]: Uploading segments... Jul 5 10:38:58.980261305 (289h28m33.75090264s) [upload=231503]: Got next segment. Inline: true Jul 5 10:38:58.980265443 (289h28m33.750906778s) [upload=231503]: Waiting for error group managing segments... Jul 5 10:38:58.980300379 (289h28m33.750941714s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:58.980305198 (289h28m33.750946533s) [upload=231503]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:58.980307563 (289h28m33.750948898s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:59.282057185 (289h28m34.05269852s) [upload=231503]: Done uploading segments... Jul 5 10:38:59.282076321 (289h28m34.052717656s) [upload=231503]: Upload finished. err: <nil> Duration: 1.863929967s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.036820646s FAIL (2025-07-05 11:15:47 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== arting upload Jul 5 10:32:26.135231835 (289h22m0.90587318s) [upload=231418]: Done starting upload Jul 5 10:32:26.135287231 (289h22m0.905928576s) [upload=231418]: Uploading segments... Jul 5 10:32:26.135357005 (289h22m0.90599836s) [upload=231418]: Got next segment. Inline: true Jul 5 10:32:26.135361303 (289h22m0.906002648s) [upload=231418]: Waiting for error group managing segments... Jul 5 10:32:26.135395077 (289h22m0.906036412s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:26.135399686 (289h22m0.906041021s) [upload=231418]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:26.135402210 (289h22m0.906043545s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:26.604315758 (289h22m1.374957103s) [upload=231418]: Done uploading segments... Jul 5 10:32:26.604338061 (289h22m1.374979396s) [upload=231418]: Upload finished. err: <nil> Jul 5 10:32:49.001750729 (289h22m23.772392074s) [upload=231426]: Starting upload Jul 5 10:32:49.001851150 (289h22m23.772492495s) [upload=231426]: Done starting upload Jul 5 10:32:49.001936423 (289h22m23.772577768s) [upload=231426]: Uploading segments... Jul 5 10:32:49.001972693 (289h22m23.772614038s) [upload=231426]: Got next segment. Inline: true Jul 5 10:32:49.001979286 (289h22m23.772620611s) [upload=231426]: Waiting for error group managing segments... Jul 5 10:32:49.002017308 (289h22m23.772658653s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:49.002022378 (289h22m23.772663713s) [upload=231426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:49.002025113 (289h22m23.772666438s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:49.278891235 (289h22m24.04953257s) [upload=231426]: Done uploading segments... Jul 5 10:32:49.278909921 (289h22m24.049551256s) [upload=231426]: Upload finished. err: <nil> Jul 5 10:33:53.127222856 (289h23m27.897864191s) [upload=231440]: Starting upload Jul 5 10:33:53.127275788 (289h23m27.897917123s) [upload=231440]: Done starting upload Jul 5 10:33:53.127327166 (289h23m27.897968501s) [upload=231440]: Uploading segments... Jul 5 10:33:53.127357795 (289h23m27.89799914s) [upload=231440]: Got next segment. Inline: true Jul 5 10:33:53.127361111 (289h23m27.898002436s) [upload=231440]: Waiting for error group managing segments... Jul 5 10:33:53.127394155 (289h23m27.89803549s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:33:53.127400096 (289h23m27.898041431s) [upload=231440]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:33:53.127402581 (289h23m27.898043916s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:33:53.392164876 (289h23m28.162806211s) [upload=231440]: Done uploading segments... Jul 5 10:33:53.392207879 (289h23m28.162849214s) [upload=231440]: Upload finished. err: <nil> Jul 5 10:35:06.052008551 (289h24m40.822649887s) [upload=231453]: Starting upload Jul 5 10:35:06.052065300 (289h24m40.822706635s) [upload=231453]: Done starting upload Jul 5 10:35:06.052118371 (289h24m40.822759706s) [upload=231453]: Uploading segments... Jul 5 10:35:06.052155562 (289h24m40.822796897s) [upload=231453]: Got next segment. Inline: true Jul 5 10:35:06.052160341 (289h24m40.822801676s) [upload=231453]: Waiting for error group managing segments... Jul 5 10:35:06.052192673 (289h24m40.822834038s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:06.052198143 (289h24m40.822839478s) [upload=231453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:06.052200969 (289h24m40.822842314s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:06.318025517 (289h24m41.088666852s) [upload=231453]: Done uploading segments... Jul 5 10:35:06.318051467 (289h24m41.088692802s) [upload=231453]: Upload finished. err: <nil> Jul 5 10:35:21.489007457 (289h24m56.259648792s) [upload=231458]: Starting upload Jul 5 10:35:21.489063625 (289h24m56.25970496s) [upload=231458]: Done starting upload Jul 5 10:35:21.489125002 (289h24m56.259766337s) [upload=231458]: Uploading segments... Jul 5 10:35:21.489162603 (289h24m56.259803938s) [upload=231458]: Got next segment. Inline: true Jul 5 10:35:21.489166681 (289h24m56.259808016s) [upload=231458]: Waiting for error group managing segments... Jul 5 10:35:21.489214853 (289h24m56.259856188s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:21.489220203 (289h24m56.259861538s) [upload=231458]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:21.489222678 (289h24m56.259864003s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:21.763167602 (289h24m56.533808947s) [upload=231458]: Done uploading segments... Jul 5 10:35:21.763189083 (289h24m56.533830428s) [upload=231458]: Upload finished. err: <nil> Jul 5 10:36:36.306224814 (289h26m11.076866149s) [upload=231476]: Starting upload Jul 5 10:36:36.306277455 (289h26m11.07691879s) [upload=231476]: Done starting upload Jul 5 10:36:36.306325086 (289h26m11.076966421s) [upload=231476]: Uploading segments... Jul 5 10:36:36.306363439 (289h26m11.077004774s) [upload=231476]: Got next segment. Inline: true Jul 5 10:36:36.306366997 (289h26m11.077008332s) [upload=231476]: Waiting for error group managing segments... Jul 5 10:36:36.306397785 (289h26m11.077039121s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:36:36.306402244 (289h26m11.077043579s) [upload=231476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:36:36.306404628 (289h26m11.077045963s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:36:36.664037218 (289h26m11.434678553s) [upload=231476]: Done uploading segments... Jul 5 10:36:36.664057598 (289h26m11.434698933s) [upload=231476]: Upload finished. err: <nil> Jul 5 10:37:23.290698017 (289h26m58.061339372s) [upload=231486]: Starting upload Jul 5 10:37:23.290780535 (289h26m58.0614219s) [upload=231486]: Done starting upload Jul 5 10:37:23.290865287 (289h26m58.061506632s) [upload=231486]: Uploading segments... Jul 5 10:37:23.290900985 (289h26m58.06154233s) [upload=231486]: Got next segment. Inline: true Jul 5 10:37:23.290905033 (289h26m58.061546368s) [upload=231486]: Waiting for error group managing segments... Jul 5 10:37:23.290939269 (289h26m58.061580614s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:37:23.290943597 (289h26m58.061584932s) [upload=231486]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:37:23.290945821 (289h26m58.061587157s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:37:23.600922731 (289h26m58.371564066s) [upload=231486]: Done uploading segments... Jul 5 10:37:23.600945323 (289h26m58.371586658s) [upload=231486]: Upload finished. err: <nil> Jul 5 10:38:26.398200196 (289h28m1.168841531s) [upload=231497]: Starting upload Jul 5 10:38:26.398270981 (289h28m1.168912317s) [upload=231497]: Done starting upload Jul 5 10:38:26.398323582 (289h28m1.168964917s) [upload=231497]: Uploading segments... Jul 5 10:38:26.398359360 (289h28m1.169000695s) [upload=231497]: Got next segment. Inline: true Jul 5 10:38:26.398363538 (289h28m1.169004873s) [upload=231497]: Waiting for error group managing segments... Jul 5 10:38:26.398399979 (289h28m1.169041314s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:26.398407182 (289h28m1.169048517s) [upload=231497]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:26.398410198 (289h28m1.169051533s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:26.688536233 (289h28m1.459177578s) [upload=231497]: Done uploading segments... Jul 5 10:38:26.688559748 (289h28m1.459201133s) [upload=231497]: Upload finished. err: <nil> Jul 5 10:38:41.435615778 (289h28m16.206257113s) [upload=231499]: Starting upload Jul 5 10:38:41.435718074 (289h28m16.206359429s) [upload=231499]: Done starting upload Jul 5 10:38:41.435789621 (289h28m16.206430956s) [upload=231499]: Uploading segments... Jul 5 10:38:41.435827874 (289h28m16.206469229s) [upload=231499]: Got next segment. Inline: true Jul 5 10:38:41.435833314 (289h28m16.206474689s) [upload=231499]: Waiting for error group managing segments... Jul 5 10:38:41.435881707 (289h28m16.206523072s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:41.435887829 (289h28m16.206529194s) [upload=231499]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:41.435891646 (289h28m16.206533021s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:41.751742745 (289h28m16.52238408s) [upload=231499]: Done uploading segments... Jul 5 10:38:41.751766320 (289h28m16.522407665s) [upload=231499]: Upload finished. err: <nil> Jul 5 10:38:58.980085408 (289h28m33.750726743s) [upload=231503]: Starting upload Jul 5 10:38:58.980165591 (289h28m33.750806926s) [upload=231503]: Done starting upload Jul 5 10:38:58.980225375 (289h28m33.750866711s) [upload=231503]: Uploading segments... Jul 5 10:38:58.980261305 (289h28m33.75090264s) [upload=231503]: Got next segment. Inline: true Jul 5 10:38:58.980265443 (289h28m33.750906778s) [upload=231503]: Waiting for error group managing segments... Jul 5 10:38:58.980300379 (289h28m33.750941714s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:58.980305198 (289h28m33.750946533s) [upload=231503]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:58.980307563 (289h28m33.750948898s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:59.282057185 (289h28m34.05269852s) [upload=231503]: Done uploading segments... Jul 5 10:38:59.282076321 (289h28m34.052717656s) [upload=231503]: Upload finished. err: <nil> Duration: 2.036852156s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.096989634s FAIL (2025-07-05 11:15:28 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== arting upload Jul 5 10:32:26.135231835 (289h22m0.90587318s) [upload=231418]: Done starting upload Jul 5 10:32:26.135287231 (289h22m0.905928576s) [upload=231418]: Uploading segments... Jul 5 10:32:26.135357005 (289h22m0.90599836s) [upload=231418]: Got next segment. Inline: true Jul 5 10:32:26.135361303 (289h22m0.906002648s) [upload=231418]: Waiting for error group managing segments... Jul 5 10:32:26.135395077 (289h22m0.906036412s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:26.135399686 (289h22m0.906041021s) [upload=231418]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:26.135402210 (289h22m0.906043545s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:26.604315758 (289h22m1.374957103s) [upload=231418]: Done uploading segments... Jul 5 10:32:26.604338061 (289h22m1.374979396s) [upload=231418]: Upload finished. err: <nil> Jul 5 10:32:49.001750729 (289h22m23.772392074s) [upload=231426]: Starting upload Jul 5 10:32:49.001851150 (289h22m23.772492495s) [upload=231426]: Done starting upload Jul 5 10:32:49.001936423 (289h22m23.772577768s) [upload=231426]: Uploading segments... Jul 5 10:32:49.001972693 (289h22m23.772614038s) [upload=231426]: Got next segment. Inline: true Jul 5 10:32:49.001979286 (289h22m23.772620611s) [upload=231426]: Waiting for error group managing segments... Jul 5 10:32:49.002017308 (289h22m23.772658653s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:49.002022378 (289h22m23.772663713s) [upload=231426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:49.002025113 (289h22m23.772666438s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:49.278891235 (289h22m24.04953257s) [upload=231426]: Done uploading segments... Jul 5 10:32:49.278909921 (289h22m24.049551256s) [upload=231426]: Upload finished. err: <nil> Jul 5 10:33:53.127222856 (289h23m27.897864191s) [upload=231440]: Starting upload Jul 5 10:33:53.127275788 (289h23m27.897917123s) [upload=231440]: Done starting upload Jul 5 10:33:53.127327166 (289h23m27.897968501s) [upload=231440]: Uploading segments... Jul 5 10:33:53.127357795 (289h23m27.89799914s) [upload=231440]: Got next segment. Inline: true Jul 5 10:33:53.127361111 (289h23m27.898002436s) [upload=231440]: Waiting for error group managing segments... Jul 5 10:33:53.127394155 (289h23m27.89803549s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:33:53.127400096 (289h23m27.898041431s) [upload=231440]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:33:53.127402581 (289h23m27.898043916s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:33:53.392164876 (289h23m28.162806211s) [upload=231440]: Done uploading segments... Jul 5 10:33:53.392207879 (289h23m28.162849214s) [upload=231440]: Upload finished. err: <nil> Jul 5 10:35:06.052008551 (289h24m40.822649887s) [upload=231453]: Starting upload Jul 5 10:35:06.052065300 (289h24m40.822706635s) [upload=231453]: Done starting upload Jul 5 10:35:06.052118371 (289h24m40.822759706s) [upload=231453]: Uploading segments... Jul 5 10:35:06.052155562 (289h24m40.822796897s) [upload=231453]: Got next segment. Inline: true Jul 5 10:35:06.052160341 (289h24m40.822801676s) [upload=231453]: Waiting for error group managing segments... Jul 5 10:35:06.052192673 (289h24m40.822834038s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:06.052198143 (289h24m40.822839478s) [upload=231453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:06.052200969 (289h24m40.822842314s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:06.318025517 (289h24m41.088666852s) [upload=231453]: Done uploading segments... Jul 5 10:35:06.318051467 (289h24m41.088692802s) [upload=231453]: Upload finished. err: <nil> Jul 5 10:35:21.489007457 (289h24m56.259648792s) [upload=231458]: Starting upload Jul 5 10:35:21.489063625 (289h24m56.25970496s) [upload=231458]: Done starting upload Jul 5 10:35:21.489125002 (289h24m56.259766337s) [upload=231458]: Uploading segments... Jul 5 10:35:21.489162603 (289h24m56.259803938s) [upload=231458]: Got next segment. Inline: true Jul 5 10:35:21.489166681 (289h24m56.259808016s) [upload=231458]: Waiting for error group managing segments... Jul 5 10:35:21.489214853 (289h24m56.259856188s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:21.489220203 (289h24m56.259861538s) [upload=231458]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:21.489222678 (289h24m56.259864003s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:21.763167602 (289h24m56.533808947s) [upload=231458]: Done uploading segments... Jul 5 10:35:21.763189083 (289h24m56.533830428s) [upload=231458]: Upload finished. err: <nil> Jul 5 10:36:36.306224814 (289h26m11.076866149s) [upload=231476]: Starting upload Jul 5 10:36:36.306277455 (289h26m11.07691879s) [upload=231476]: Done starting upload Jul 5 10:36:36.306325086 (289h26m11.076966421s) [upload=231476]: Uploading segments... Jul 5 10:36:36.306363439 (289h26m11.077004774s) [upload=231476]: Got next segment. Inline: true Jul 5 10:36:36.306366997 (289h26m11.077008332s) [upload=231476]: Waiting for error group managing segments... Jul 5 10:36:36.306397785 (289h26m11.077039121s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:36:36.306402244 (289h26m11.077043579s) [upload=231476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:36:36.306404628 (289h26m11.077045963s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:36:36.664037218 (289h26m11.434678553s) [upload=231476]: Done uploading segments... Jul 5 10:36:36.664057598 (289h26m11.434698933s) [upload=231476]: Upload finished. err: <nil> Jul 5 10:37:23.290698017 (289h26m58.061339372s) [upload=231486]: Starting upload Jul 5 10:37:23.290780535 (289h26m58.0614219s) [upload=231486]: Done starting upload Jul 5 10:37:23.290865287 (289h26m58.061506632s) [upload=231486]: Uploading segments... Jul 5 10:37:23.290900985 (289h26m58.06154233s) [upload=231486]: Got next segment. Inline: true Jul 5 10:37:23.290905033 (289h26m58.061546368s) [upload=231486]: Waiting for error group managing segments... Jul 5 10:37:23.290939269 (289h26m58.061580614s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:37:23.290943597 (289h26m58.061584932s) [upload=231486]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:37:23.290945821 (289h26m58.061587157s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:37:23.600922731 (289h26m58.371564066s) [upload=231486]: Done uploading segments... Jul 5 10:37:23.600945323 (289h26m58.371586658s) [upload=231486]: Upload finished. err: <nil> Jul 5 10:38:26.398200196 (289h28m1.168841531s) [upload=231497]: Starting upload Jul 5 10:38:26.398270981 (289h28m1.168912317s) [upload=231497]: Done starting upload Jul 5 10:38:26.398323582 (289h28m1.168964917s) [upload=231497]: Uploading segments... Jul 5 10:38:26.398359360 (289h28m1.169000695s) [upload=231497]: Got next segment. Inline: true Jul 5 10:38:26.398363538 (289h28m1.169004873s) [upload=231497]: Waiting for error group managing segments... Jul 5 10:38:26.398399979 (289h28m1.169041314s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:26.398407182 (289h28m1.169048517s) [upload=231497]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:26.398410198 (289h28m1.169051533s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:26.688536233 (289h28m1.459177578s) [upload=231497]: Done uploading segments... Jul 5 10:38:26.688559748 (289h28m1.459201133s) [upload=231497]: Upload finished. err: <nil> Jul 5 10:38:41.435615778 (289h28m16.206257113s) [upload=231499]: Starting upload Jul 5 10:38:41.435718074 (289h28m16.206359429s) [upload=231499]: Done starting upload Jul 5 10:38:41.435789621 (289h28m16.206430956s) [upload=231499]: Uploading segments... Jul 5 10:38:41.435827874 (289h28m16.206469229s) [upload=231499]: Got next segment. Inline: true Jul 5 10:38:41.435833314 (289h28m16.206474689s) [upload=231499]: Waiting for error group managing segments... Jul 5 10:38:41.435881707 (289h28m16.206523072s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:41.435887829 (289h28m16.206529194s) [upload=231499]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:41.435891646 (289h28m16.206533021s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:41.751742745 (289h28m16.52238408s) [upload=231499]: Done uploading segments... Jul 5 10:38:41.751766320 (289h28m16.522407665s) [upload=231499]: Upload finished. err: <nil> Jul 5 10:38:58.980085408 (289h28m33.750726743s) [upload=231503]: Starting upload Jul 5 10:38:58.980165591 (289h28m33.750806926s) [upload=231503]: Done starting upload Jul 5 10:38:58.980225375 (289h28m33.750866711s) [upload=231503]: Uploading segments... Jul 5 10:38:58.980261305 (289h28m33.75090264s) [upload=231503]: Got next segment. Inline: true Jul 5 10:38:58.980265443 (289h28m33.750906778s) [upload=231503]: Waiting for error group managing segments... Jul 5 10:38:58.980300379 (289h28m33.750941714s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:58.980305198 (289h28m33.750946533s) [upload=231503]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:58.980307563 (289h28m33.750948898s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:59.282057185 (289h28m34.05269852s) [upload=231503]: Done uploading segments... Jul 5 10:38:59.282076321 (289h28m34.052717656s) [upload=231503]: Upload finished. err: <nil> Duration: 2.097014231s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.036242155s FAIL (2025-07-05 11:14:27 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== arting upload Jul 5 10:32:26.135231835 (289h22m0.90587318s) [upload=231418]: Done starting upload Jul 5 10:32:26.135287231 (289h22m0.905928576s) [upload=231418]: Uploading segments... Jul 5 10:32:26.135357005 (289h22m0.90599836s) [upload=231418]: Got next segment. Inline: true Jul 5 10:32:26.135361303 (289h22m0.906002648s) [upload=231418]: Waiting for error group managing segments... Jul 5 10:32:26.135395077 (289h22m0.906036412s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:26.135399686 (289h22m0.906041021s) [upload=231418]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:26.135402210 (289h22m0.906043545s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:26.604315758 (289h22m1.374957103s) [upload=231418]: Done uploading segments... Jul 5 10:32:26.604338061 (289h22m1.374979396s) [upload=231418]: Upload finished. err: <nil> Jul 5 10:32:49.001750729 (289h22m23.772392074s) [upload=231426]: Starting upload Jul 5 10:32:49.001851150 (289h22m23.772492495s) [upload=231426]: Done starting upload Jul 5 10:32:49.001936423 (289h22m23.772577768s) [upload=231426]: Uploading segments... Jul 5 10:32:49.001972693 (289h22m23.772614038s) [upload=231426]: Got next segment. Inline: true Jul 5 10:32:49.001979286 (289h22m23.772620611s) [upload=231426]: Waiting for error group managing segments... Jul 5 10:32:49.002017308 (289h22m23.772658653s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:49.002022378 (289h22m23.772663713s) [upload=231426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:49.002025113 (289h22m23.772666438s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:49.278891235 (289h22m24.04953257s) [upload=231426]: Done uploading segments... Jul 5 10:32:49.278909921 (289h22m24.049551256s) [upload=231426]: Upload finished. err: <nil> Jul 5 10:33:53.127222856 (289h23m27.897864191s) [upload=231440]: Starting upload Jul 5 10:33:53.127275788 (289h23m27.897917123s) [upload=231440]: Done starting upload Jul 5 10:33:53.127327166 (289h23m27.897968501s) [upload=231440]: Uploading segments... Jul 5 10:33:53.127357795 (289h23m27.89799914s) [upload=231440]: Got next segment. Inline: true Jul 5 10:33:53.127361111 (289h23m27.898002436s) [upload=231440]: Waiting for error group managing segments... Jul 5 10:33:53.127394155 (289h23m27.89803549s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:33:53.127400096 (289h23m27.898041431s) [upload=231440]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:33:53.127402581 (289h23m27.898043916s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:33:53.392164876 (289h23m28.162806211s) [upload=231440]: Done uploading segments... Jul 5 10:33:53.392207879 (289h23m28.162849214s) [upload=231440]: Upload finished. err: <nil> Jul 5 10:35:06.052008551 (289h24m40.822649887s) [upload=231453]: Starting upload Jul 5 10:35:06.052065300 (289h24m40.822706635s) [upload=231453]: Done starting upload Jul 5 10:35:06.052118371 (289h24m40.822759706s) [upload=231453]: Uploading segments... Jul 5 10:35:06.052155562 (289h24m40.822796897s) [upload=231453]: Got next segment. Inline: true Jul 5 10:35:06.052160341 (289h24m40.822801676s) [upload=231453]: Waiting for error group managing segments... Jul 5 10:35:06.052192673 (289h24m40.822834038s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:06.052198143 (289h24m40.822839478s) [upload=231453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:06.052200969 (289h24m40.822842314s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:06.318025517 (289h24m41.088666852s) [upload=231453]: Done uploading segments... Jul 5 10:35:06.318051467 (289h24m41.088692802s) [upload=231453]: Upload finished. err: <nil> Jul 5 10:35:21.489007457 (289h24m56.259648792s) [upload=231458]: Starting upload Jul 5 10:35:21.489063625 (289h24m56.25970496s) [upload=231458]: Done starting upload Jul 5 10:35:21.489125002 (289h24m56.259766337s) [upload=231458]: Uploading segments... Jul 5 10:35:21.489162603 (289h24m56.259803938s) [upload=231458]: Got next segment. Inline: true Jul 5 10:35:21.489166681 (289h24m56.259808016s) [upload=231458]: Waiting for error group managing segments... Jul 5 10:35:21.489214853 (289h24m56.259856188s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:21.489220203 (289h24m56.259861538s) [upload=231458]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:21.489222678 (289h24m56.259864003s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:21.763167602 (289h24m56.533808947s) [upload=231458]: Done uploading segments... Jul 5 10:35:21.763189083 (289h24m56.533830428s) [upload=231458]: Upload finished. err: <nil> Jul 5 10:36:36.306224814 (289h26m11.076866149s) [upload=231476]: Starting upload Jul 5 10:36:36.306277455 (289h26m11.07691879s) [upload=231476]: Done starting upload Jul 5 10:36:36.306325086 (289h26m11.076966421s) [upload=231476]: Uploading segments... Jul 5 10:36:36.306363439 (289h26m11.077004774s) [upload=231476]: Got next segment. Inline: true Jul 5 10:36:36.306366997 (289h26m11.077008332s) [upload=231476]: Waiting for error group managing segments... Jul 5 10:36:36.306397785 (289h26m11.077039121s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:36:36.306402244 (289h26m11.077043579s) [upload=231476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:36:36.306404628 (289h26m11.077045963s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:36:36.664037218 (289h26m11.434678553s) [upload=231476]: Done uploading segments... Jul 5 10:36:36.664057598 (289h26m11.434698933s) [upload=231476]: Upload finished. err: <nil> Jul 5 10:37:23.290698017 (289h26m58.061339372s) [upload=231486]: Starting upload Jul 5 10:37:23.290780535 (289h26m58.0614219s) [upload=231486]: Done starting upload Jul 5 10:37:23.290865287 (289h26m58.061506632s) [upload=231486]: Uploading segments... Jul 5 10:37:23.290900985 (289h26m58.06154233s) [upload=231486]: Got next segment. Inline: true Jul 5 10:37:23.290905033 (289h26m58.061546368s) [upload=231486]: Waiting for error group managing segments... Jul 5 10:37:23.290939269 (289h26m58.061580614s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:37:23.290943597 (289h26m58.061584932s) [upload=231486]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:37:23.290945821 (289h26m58.061587157s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:37:23.600922731 (289h26m58.371564066s) [upload=231486]: Done uploading segments... Jul 5 10:37:23.600945323 (289h26m58.371586658s) [upload=231486]: Upload finished. err: <nil> Jul 5 10:38:26.398200196 (289h28m1.168841531s) [upload=231497]: Starting upload Jul 5 10:38:26.398270981 (289h28m1.168912317s) [upload=231497]: Done starting upload Jul 5 10:38:26.398323582 (289h28m1.168964917s) [upload=231497]: Uploading segments... Jul 5 10:38:26.398359360 (289h28m1.169000695s) [upload=231497]: Got next segment. Inline: true Jul 5 10:38:26.398363538 (289h28m1.169004873s) [upload=231497]: Waiting for error group managing segments... Jul 5 10:38:26.398399979 (289h28m1.169041314s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:26.398407182 (289h28m1.169048517s) [upload=231497]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:26.398410198 (289h28m1.169051533s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:26.688536233 (289h28m1.459177578s) [upload=231497]: Done uploading segments... Jul 5 10:38:26.688559748 (289h28m1.459201133s) [upload=231497]: Upload finished. err: <nil> Jul 5 10:38:41.435615778 (289h28m16.206257113s) [upload=231499]: Starting upload Jul 5 10:38:41.435718074 (289h28m16.206359429s) [upload=231499]: Done starting upload Jul 5 10:38:41.435789621 (289h28m16.206430956s) [upload=231499]: Uploading segments... Jul 5 10:38:41.435827874 (289h28m16.206469229s) [upload=231499]: Got next segment. Inline: true Jul 5 10:38:41.435833314 (289h28m16.206474689s) [upload=231499]: Waiting for error group managing segments... Jul 5 10:38:41.435881707 (289h28m16.206523072s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:41.435887829 (289h28m16.206529194s) [upload=231499]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:41.435891646 (289h28m16.206533021s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:41.751742745 (289h28m16.52238408s) [upload=231499]: Done uploading segments... Jul 5 10:38:41.751766320 (289h28m16.522407665s) [upload=231499]: Upload finished. err: <nil> Jul 5 10:38:58.980085408 (289h28m33.750726743s) [upload=231503]: Starting upload Jul 5 10:38:58.980165591 (289h28m33.750806926s) [upload=231503]: Done starting upload Jul 5 10:38:58.980225375 (289h28m33.750866711s) [upload=231503]: Uploading segments... Jul 5 10:38:58.980261305 (289h28m33.75090264s) [upload=231503]: Got next segment. Inline: true Jul 5 10:38:58.980265443 (289h28m33.750906778s) [upload=231503]: Waiting for error group managing segments... Jul 5 10:38:58.980300379 (289h28m33.750941714s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:58.980305198 (289h28m33.750946533s) [upload=231503]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:58.980307563 (289h28m33.750948898s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:59.282057185 (289h28m34.05269852s) [upload=231503]: Done uploading segments... Jul 5 10:38:59.282076321 (289h28m34.052717656s) [upload=231503]: Upload finished. err: <nil> Duration: 2.036267342s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 1.919370632s FAIL (2025-07-05 11:13:50 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== arting upload Jul 5 10:32:26.135231835 (289h22m0.90587318s) [upload=231418]: Done starting upload Jul 5 10:32:26.135287231 (289h22m0.905928576s) [upload=231418]: Uploading segments... Jul 5 10:32:26.135357005 (289h22m0.90599836s) [upload=231418]: Got next segment. Inline: true Jul 5 10:32:26.135361303 (289h22m0.906002648s) [upload=231418]: Waiting for error group managing segments... Jul 5 10:32:26.135395077 (289h22m0.906036412s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:26.135399686 (289h22m0.906041021s) [upload=231418]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:26.135402210 (289h22m0.906043545s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:26.604315758 (289h22m1.374957103s) [upload=231418]: Done uploading segments... Jul 5 10:32:26.604338061 (289h22m1.374979396s) [upload=231418]: Upload finished. err: <nil> Jul 5 10:32:49.001750729 (289h22m23.772392074s) [upload=231426]: Starting upload Jul 5 10:32:49.001851150 (289h22m23.772492495s) [upload=231426]: Done starting upload Jul 5 10:32:49.001936423 (289h22m23.772577768s) [upload=231426]: Uploading segments... Jul 5 10:32:49.001972693 (289h22m23.772614038s) [upload=231426]: Got next segment. Inline: true Jul 5 10:32:49.001979286 (289h22m23.772620611s) [upload=231426]: Waiting for error group managing segments... Jul 5 10:32:49.002017308 (289h22m23.772658653s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:49.002022378 (289h22m23.772663713s) [upload=231426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:49.002025113 (289h22m23.772666438s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:49.278891235 (289h22m24.04953257s) [upload=231426]: Done uploading segments... Jul 5 10:32:49.278909921 (289h22m24.049551256s) [upload=231426]: Upload finished. err: <nil> Jul 5 10:33:53.127222856 (289h23m27.897864191s) [upload=231440]: Starting upload Jul 5 10:33:53.127275788 (289h23m27.897917123s) [upload=231440]: Done starting upload Jul 5 10:33:53.127327166 (289h23m27.897968501s) [upload=231440]: Uploading segments... Jul 5 10:33:53.127357795 (289h23m27.89799914s) [upload=231440]: Got next segment. Inline: true Jul 5 10:33:53.127361111 (289h23m27.898002436s) [upload=231440]: Waiting for error group managing segments... Jul 5 10:33:53.127394155 (289h23m27.89803549s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:33:53.127400096 (289h23m27.898041431s) [upload=231440]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:33:53.127402581 (289h23m27.898043916s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:33:53.392164876 (289h23m28.162806211s) [upload=231440]: Done uploading segments... Jul 5 10:33:53.392207879 (289h23m28.162849214s) [upload=231440]: Upload finished. err: <nil> Jul 5 10:35:06.052008551 (289h24m40.822649887s) [upload=231453]: Starting upload Jul 5 10:35:06.052065300 (289h24m40.822706635s) [upload=231453]: Done starting upload Jul 5 10:35:06.052118371 (289h24m40.822759706s) [upload=231453]: Uploading segments... Jul 5 10:35:06.052155562 (289h24m40.822796897s) [upload=231453]: Got next segment. Inline: true Jul 5 10:35:06.052160341 (289h24m40.822801676s) [upload=231453]: Waiting for error group managing segments... Jul 5 10:35:06.052192673 (289h24m40.822834038s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:06.052198143 (289h24m40.822839478s) [upload=231453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:06.052200969 (289h24m40.822842314s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:06.318025517 (289h24m41.088666852s) [upload=231453]: Done uploading segments... Jul 5 10:35:06.318051467 (289h24m41.088692802s) [upload=231453]: Upload finished. err: <nil> Jul 5 10:35:21.489007457 (289h24m56.259648792s) [upload=231458]: Starting upload Jul 5 10:35:21.489063625 (289h24m56.25970496s) [upload=231458]: Done starting upload Jul 5 10:35:21.489125002 (289h24m56.259766337s) [upload=231458]: Uploading segments... Jul 5 10:35:21.489162603 (289h24m56.259803938s) [upload=231458]: Got next segment. Inline: true Jul 5 10:35:21.489166681 (289h24m56.259808016s) [upload=231458]: Waiting for error group managing segments... Jul 5 10:35:21.489214853 (289h24m56.259856188s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:21.489220203 (289h24m56.259861538s) [upload=231458]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:21.489222678 (289h24m56.259864003s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:21.763167602 (289h24m56.533808947s) [upload=231458]: Done uploading segments... Jul 5 10:35:21.763189083 (289h24m56.533830428s) [upload=231458]: Upload finished. err: <nil> Jul 5 10:36:36.306224814 (289h26m11.076866149s) [upload=231476]: Starting upload Jul 5 10:36:36.306277455 (289h26m11.07691879s) [upload=231476]: Done starting upload Jul 5 10:36:36.306325086 (289h26m11.076966421s) [upload=231476]: Uploading segments... Jul 5 10:36:36.306363439 (289h26m11.077004774s) [upload=231476]: Got next segment. Inline: true Jul 5 10:36:36.306366997 (289h26m11.077008332s) [upload=231476]: Waiting for error group managing segments... Jul 5 10:36:36.306397785 (289h26m11.077039121s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:36:36.306402244 (289h26m11.077043579s) [upload=231476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:36:36.306404628 (289h26m11.077045963s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:36:36.664037218 (289h26m11.434678553s) [upload=231476]: Done uploading segments... Jul 5 10:36:36.664057598 (289h26m11.434698933s) [upload=231476]: Upload finished. err: <nil> Jul 5 10:37:23.290698017 (289h26m58.061339372s) [upload=231486]: Starting upload Jul 5 10:37:23.290780535 (289h26m58.0614219s) [upload=231486]: Done starting upload Jul 5 10:37:23.290865287 (289h26m58.061506632s) [upload=231486]: Uploading segments... Jul 5 10:37:23.290900985 (289h26m58.06154233s) [upload=231486]: Got next segment. Inline: true Jul 5 10:37:23.290905033 (289h26m58.061546368s) [upload=231486]: Waiting for error group managing segments... Jul 5 10:37:23.290939269 (289h26m58.061580614s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:37:23.290943597 (289h26m58.061584932s) [upload=231486]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:37:23.290945821 (289h26m58.061587157s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:37:23.600922731 (289h26m58.371564066s) [upload=231486]: Done uploading segments... Jul 5 10:37:23.600945323 (289h26m58.371586658s) [upload=231486]: Upload finished. err: <nil> Jul 5 10:38:26.398200196 (289h28m1.168841531s) [upload=231497]: Starting upload Jul 5 10:38:26.398270981 (289h28m1.168912317s) [upload=231497]: Done starting upload Jul 5 10:38:26.398323582 (289h28m1.168964917s) [upload=231497]: Uploading segments... Jul 5 10:38:26.398359360 (289h28m1.169000695s) [upload=231497]: Got next segment. Inline: true Jul 5 10:38:26.398363538 (289h28m1.169004873s) [upload=231497]: Waiting for error group managing segments... Jul 5 10:38:26.398399979 (289h28m1.169041314s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:26.398407182 (289h28m1.169048517s) [upload=231497]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:26.398410198 (289h28m1.169051533s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:26.688536233 (289h28m1.459177578s) [upload=231497]: Done uploading segments... Jul 5 10:38:26.688559748 (289h28m1.459201133s) [upload=231497]: Upload finished. err: <nil> Jul 5 10:38:41.435615778 (289h28m16.206257113s) [upload=231499]: Starting upload Jul 5 10:38:41.435718074 (289h28m16.206359429s) [upload=231499]: Done starting upload Jul 5 10:38:41.435789621 (289h28m16.206430956s) [upload=231499]: Uploading segments... Jul 5 10:38:41.435827874 (289h28m16.206469229s) [upload=231499]: Got next segment. Inline: true Jul 5 10:38:41.435833314 (289h28m16.206474689s) [upload=231499]: Waiting for error group managing segments... Jul 5 10:38:41.435881707 (289h28m16.206523072s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:41.435887829 (289h28m16.206529194s) [upload=231499]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:41.435891646 (289h28m16.206533021s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:41.751742745 (289h28m16.52238408s) [upload=231499]: Done uploading segments... Jul 5 10:38:41.751766320 (289h28m16.522407665s) [upload=231499]: Upload finished. err: <nil> Jul 5 10:38:58.980085408 (289h28m33.750726743s) [upload=231503]: Starting upload Jul 5 10:38:58.980165591 (289h28m33.750806926s) [upload=231503]: Done starting upload Jul 5 10:38:58.980225375 (289h28m33.750866711s) [upload=231503]: Uploading segments... Jul 5 10:38:58.980261305 (289h28m33.75090264s) [upload=231503]: Got next segment. Inline: true Jul 5 10:38:58.980265443 (289h28m33.750906778s) [upload=231503]: Waiting for error group managing segments... Jul 5 10:38:58.980300379 (289h28m33.750941714s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:58.980305198 (289h28m33.750946533s) [upload=231503]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:58.980307563 (289h28m33.750948898s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:59.282057185 (289h28m34.05269852s) [upload=231503]: Done uploading segments... Jul 5 10:38:59.282076321 (289h28m34.052717656s) [upload=231503]: Upload finished. err: <nil> Duration: 1.919407191s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 1.886812041s FAIL (2025-07-05 11:12:51 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== arting upload Jul 5 10:32:26.135231835 (289h22m0.90587318s) [upload=231418]: Done starting upload Jul 5 10:32:26.135287231 (289h22m0.905928576s) [upload=231418]: Uploading segments... Jul 5 10:32:26.135357005 (289h22m0.90599836s) [upload=231418]: Got next segment. Inline: true Jul 5 10:32:26.135361303 (289h22m0.906002648s) [upload=231418]: Waiting for error group managing segments... Jul 5 10:32:26.135395077 (289h22m0.906036412s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:26.135399686 (289h22m0.906041021s) [upload=231418]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:26.135402210 (289h22m0.906043545s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:26.604315758 (289h22m1.374957103s) [upload=231418]: Done uploading segments... Jul 5 10:32:26.604338061 (289h22m1.374979396s) [upload=231418]: Upload finished. err: <nil> Jul 5 10:32:49.001750729 (289h22m23.772392074s) [upload=231426]: Starting upload Jul 5 10:32:49.001851150 (289h22m23.772492495s) [upload=231426]: Done starting upload Jul 5 10:32:49.001936423 (289h22m23.772577768s) [upload=231426]: Uploading segments... Jul 5 10:32:49.001972693 (289h22m23.772614038s) [upload=231426]: Got next segment. Inline: true Jul 5 10:32:49.001979286 (289h22m23.772620611s) [upload=231426]: Waiting for error group managing segments... Jul 5 10:32:49.002017308 (289h22m23.772658653s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:49.002022378 (289h22m23.772663713s) [upload=231426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:49.002025113 (289h22m23.772666438s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:49.278891235 (289h22m24.04953257s) [upload=231426]: Done uploading segments... Jul 5 10:32:49.278909921 (289h22m24.049551256s) [upload=231426]: Upload finished. err: <nil> Jul 5 10:33:53.127222856 (289h23m27.897864191s) [upload=231440]: Starting upload Jul 5 10:33:53.127275788 (289h23m27.897917123s) [upload=231440]: Done starting upload Jul 5 10:33:53.127327166 (289h23m27.897968501s) [upload=231440]: Uploading segments... Jul 5 10:33:53.127357795 (289h23m27.89799914s) [upload=231440]: Got next segment. Inline: true Jul 5 10:33:53.127361111 (289h23m27.898002436s) [upload=231440]: Waiting for error group managing segments... Jul 5 10:33:53.127394155 (289h23m27.89803549s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:33:53.127400096 (289h23m27.898041431s) [upload=231440]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:33:53.127402581 (289h23m27.898043916s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:33:53.392164876 (289h23m28.162806211s) [upload=231440]: Done uploading segments... Jul 5 10:33:53.392207879 (289h23m28.162849214s) [upload=231440]: Upload finished. err: <nil> Jul 5 10:35:06.052008551 (289h24m40.822649887s) [upload=231453]: Starting upload Jul 5 10:35:06.052065300 (289h24m40.822706635s) [upload=231453]: Done starting upload Jul 5 10:35:06.052118371 (289h24m40.822759706s) [upload=231453]: Uploading segments... Jul 5 10:35:06.052155562 (289h24m40.822796897s) [upload=231453]: Got next segment. Inline: true Jul 5 10:35:06.052160341 (289h24m40.822801676s) [upload=231453]: Waiting for error group managing segments... Jul 5 10:35:06.052192673 (289h24m40.822834038s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:06.052198143 (289h24m40.822839478s) [upload=231453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:06.052200969 (289h24m40.822842314s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:06.318025517 (289h24m41.088666852s) [upload=231453]: Done uploading segments... Jul 5 10:35:06.318051467 (289h24m41.088692802s) [upload=231453]: Upload finished. err: <nil> Jul 5 10:35:21.489007457 (289h24m56.259648792s) [upload=231458]: Starting upload Jul 5 10:35:21.489063625 (289h24m56.25970496s) [upload=231458]: Done starting upload Jul 5 10:35:21.489125002 (289h24m56.259766337s) [upload=231458]: Uploading segments... Jul 5 10:35:21.489162603 (289h24m56.259803938s) [upload=231458]: Got next segment. Inline: true Jul 5 10:35:21.489166681 (289h24m56.259808016s) [upload=231458]: Waiting for error group managing segments... Jul 5 10:35:21.489214853 (289h24m56.259856188s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:21.489220203 (289h24m56.259861538s) [upload=231458]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:21.489222678 (289h24m56.259864003s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:21.763167602 (289h24m56.533808947s) [upload=231458]: Done uploading segments... Jul 5 10:35:21.763189083 (289h24m56.533830428s) [upload=231458]: Upload finished. err: <nil> Jul 5 10:36:36.306224814 (289h26m11.076866149s) [upload=231476]: Starting upload Jul 5 10:36:36.306277455 (289h26m11.07691879s) [upload=231476]: Done starting upload Jul 5 10:36:36.306325086 (289h26m11.076966421s) [upload=231476]: Uploading segments... Jul 5 10:36:36.306363439 (289h26m11.077004774s) [upload=231476]: Got next segment. Inline: true Jul 5 10:36:36.306366997 (289h26m11.077008332s) [upload=231476]: Waiting for error group managing segments... Jul 5 10:36:36.306397785 (289h26m11.077039121s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:36:36.306402244 (289h26m11.077043579s) [upload=231476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:36:36.306404628 (289h26m11.077045963s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:36:36.664037218 (289h26m11.434678553s) [upload=231476]: Done uploading segments... Jul 5 10:36:36.664057598 (289h26m11.434698933s) [upload=231476]: Upload finished. err: <nil> Jul 5 10:37:23.290698017 (289h26m58.061339372s) [upload=231486]: Starting upload Jul 5 10:37:23.290780535 (289h26m58.0614219s) [upload=231486]: Done starting upload Jul 5 10:37:23.290865287 (289h26m58.061506632s) [upload=231486]: Uploading segments... Jul 5 10:37:23.290900985 (289h26m58.06154233s) [upload=231486]: Got next segment. Inline: true Jul 5 10:37:23.290905033 (289h26m58.061546368s) [upload=231486]: Waiting for error group managing segments... Jul 5 10:37:23.290939269 (289h26m58.061580614s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:37:23.290943597 (289h26m58.061584932s) [upload=231486]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:37:23.290945821 (289h26m58.061587157s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:37:23.600922731 (289h26m58.371564066s) [upload=231486]: Done uploading segments... Jul 5 10:37:23.600945323 (289h26m58.371586658s) [upload=231486]: Upload finished. err: <nil> Jul 5 10:38:26.398200196 (289h28m1.168841531s) [upload=231497]: Starting upload Jul 5 10:38:26.398270981 (289h28m1.168912317s) [upload=231497]: Done starting upload Jul 5 10:38:26.398323582 (289h28m1.168964917s) [upload=231497]: Uploading segments... Jul 5 10:38:26.398359360 (289h28m1.169000695s) [upload=231497]: Got next segment. Inline: true Jul 5 10:38:26.398363538 (289h28m1.169004873s) [upload=231497]: Waiting for error group managing segments... Jul 5 10:38:26.398399979 (289h28m1.169041314s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:26.398407182 (289h28m1.169048517s) [upload=231497]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:26.398410198 (289h28m1.169051533s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:26.688536233 (289h28m1.459177578s) [upload=231497]: Done uploading segments... Jul 5 10:38:26.688559748 (289h28m1.459201133s) [upload=231497]: Upload finished. err: <nil> Jul 5 10:38:41.435615778 (289h28m16.206257113s) [upload=231499]: Starting upload Jul 5 10:38:41.435718074 (289h28m16.206359429s) [upload=231499]: Done starting upload Jul 5 10:38:41.435789621 (289h28m16.206430956s) [upload=231499]: Uploading segments... Jul 5 10:38:41.435827874 (289h28m16.206469229s) [upload=231499]: Got next segment. Inline: true Jul 5 10:38:41.435833314 (289h28m16.206474689s) [upload=231499]: Waiting for error group managing segments... Jul 5 10:38:41.435881707 (289h28m16.206523072s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:41.435887829 (289h28m16.206529194s) [upload=231499]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:41.435891646 (289h28m16.206533021s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:41.751742745 (289h28m16.52238408s) [upload=231499]: Done uploading segments... Jul 5 10:38:41.751766320 (289h28m16.522407665s) [upload=231499]: Upload finished. err: <nil> Jul 5 10:38:58.980085408 (289h28m33.750726743s) [upload=231503]: Starting upload Jul 5 10:38:58.980165591 (289h28m33.750806926s) [upload=231503]: Done starting upload Jul 5 10:38:58.980225375 (289h28m33.750866711s) [upload=231503]: Uploading segments... Jul 5 10:38:58.980261305 (289h28m33.75090264s) [upload=231503]: Got next segment. Inline: true Jul 5 10:38:58.980265443 (289h28m33.750906778s) [upload=231503]: Waiting for error group managing segments... Jul 5 10:38:58.980300379 (289h28m33.750941714s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:58.980305198 (289h28m33.750946533s) [upload=231503]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:58.980307563 (289h28m33.750948898s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:59.282057185 (289h28m34.05269852s) [upload=231503]: Done uploading segments... Jul 5 10:38:59.282076321 (289h28m34.052717656s) [upload=231503]: Upload finished. err: <nil> Duration: 1.886838332s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 1.840426163s FAIL (2025-07-05 11:11:59 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== arting upload Jul 5 10:32:26.135231835 (289h22m0.90587318s) [upload=231418]: Done starting upload Jul 5 10:32:26.135287231 (289h22m0.905928576s) [upload=231418]: Uploading segments... Jul 5 10:32:26.135357005 (289h22m0.90599836s) [upload=231418]: Got next segment. Inline: true Jul 5 10:32:26.135361303 (289h22m0.906002648s) [upload=231418]: Waiting for error group managing segments... Jul 5 10:32:26.135395077 (289h22m0.906036412s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:26.135399686 (289h22m0.906041021s) [upload=231418]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:26.135402210 (289h22m0.906043545s) [upload=231418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:26.604315758 (289h22m1.374957103s) [upload=231418]: Done uploading segments... Jul 5 10:32:26.604338061 (289h22m1.374979396s) [upload=231418]: Upload finished. err: <nil> Jul 5 10:32:49.001750729 (289h22m23.772392074s) [upload=231426]: Starting upload Jul 5 10:32:49.001851150 (289h22m23.772492495s) [upload=231426]: Done starting upload Jul 5 10:32:49.001936423 (289h22m23.772577768s) [upload=231426]: Uploading segments... Jul 5 10:32:49.001972693 (289h22m23.772614038s) [upload=231426]: Got next segment. Inline: true Jul 5 10:32:49.001979286 (289h22m23.772620611s) [upload=231426]: Waiting for error group managing segments... Jul 5 10:32:49.002017308 (289h22m23.772658653s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:32:49.002022378 (289h22m23.772663713s) [upload=231426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:32:49.002025113 (289h22m23.772666438s) [upload=231426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:32:49.278891235 (289h22m24.04953257s) [upload=231426]: Done uploading segments... Jul 5 10:32:49.278909921 (289h22m24.049551256s) [upload=231426]: Upload finished. err: <nil> Jul 5 10:33:53.127222856 (289h23m27.897864191s) [upload=231440]: Starting upload Jul 5 10:33:53.127275788 (289h23m27.897917123s) [upload=231440]: Done starting upload Jul 5 10:33:53.127327166 (289h23m27.897968501s) [upload=231440]: Uploading segments... Jul 5 10:33:53.127357795 (289h23m27.89799914s) [upload=231440]: Got next segment. Inline: true Jul 5 10:33:53.127361111 (289h23m27.898002436s) [upload=231440]: Waiting for error group managing segments... Jul 5 10:33:53.127394155 (289h23m27.89803549s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:33:53.127400096 (289h23m27.898041431s) [upload=231440]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:33:53.127402581 (289h23m27.898043916s) [upload=231440]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:33:53.392164876 (289h23m28.162806211s) [upload=231440]: Done uploading segments... Jul 5 10:33:53.392207879 (289h23m28.162849214s) [upload=231440]: Upload finished. err: <nil> Jul 5 10:35:06.052008551 (289h24m40.822649887s) [upload=231453]: Starting upload Jul 5 10:35:06.052065300 (289h24m40.822706635s) [upload=231453]: Done starting upload Jul 5 10:35:06.052118371 (289h24m40.822759706s) [upload=231453]: Uploading segments... Jul 5 10:35:06.052155562 (289h24m40.822796897s) [upload=231453]: Got next segment. Inline: true Jul 5 10:35:06.052160341 (289h24m40.822801676s) [upload=231453]: Waiting for error group managing segments... Jul 5 10:35:06.052192673 (289h24m40.822834038s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:06.052198143 (289h24m40.822839478s) [upload=231453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:06.052200969 (289h24m40.822842314s) [upload=231453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:06.318025517 (289h24m41.088666852s) [upload=231453]: Done uploading segments... Jul 5 10:35:06.318051467 (289h24m41.088692802s) [upload=231453]: Upload finished. err: <nil> Jul 5 10:35:21.489007457 (289h24m56.259648792s) [upload=231458]: Starting upload Jul 5 10:35:21.489063625 (289h24m56.25970496s) [upload=231458]: Done starting upload Jul 5 10:35:21.489125002 (289h24m56.259766337s) [upload=231458]: Uploading segments... Jul 5 10:35:21.489162603 (289h24m56.259803938s) [upload=231458]: Got next segment. Inline: true Jul 5 10:35:21.489166681 (289h24m56.259808016s) [upload=231458]: Waiting for error group managing segments... Jul 5 10:35:21.489214853 (289h24m56.259856188s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:35:21.489220203 (289h24m56.259861538s) [upload=231458]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:35:21.489222678 (289h24m56.259864003s) [upload=231458]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:35:21.763167602 (289h24m56.533808947s) [upload=231458]: Done uploading segments... Jul 5 10:35:21.763189083 (289h24m56.533830428s) [upload=231458]: Upload finished. err: <nil> Jul 5 10:36:36.306224814 (289h26m11.076866149s) [upload=231476]: Starting upload Jul 5 10:36:36.306277455 (289h26m11.07691879s) [upload=231476]: Done starting upload Jul 5 10:36:36.306325086 (289h26m11.076966421s) [upload=231476]: Uploading segments... Jul 5 10:36:36.306363439 (289h26m11.077004774s) [upload=231476]: Got next segment. Inline: true Jul 5 10:36:36.306366997 (289h26m11.077008332s) [upload=231476]: Waiting for error group managing segments... Jul 5 10:36:36.306397785 (289h26m11.077039121s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:36:36.306402244 (289h26m11.077043579s) [upload=231476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:36:36.306404628 (289h26m11.077045963s) [upload=231476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:36:36.664037218 (289h26m11.434678553s) [upload=231476]: Done uploading segments... Jul 5 10:36:36.664057598 (289h26m11.434698933s) [upload=231476]: Upload finished. err: <nil> Jul 5 10:37:23.290698017 (289h26m58.061339372s) [upload=231486]: Starting upload Jul 5 10:37:23.290780535 (289h26m58.0614219s) [upload=231486]: Done starting upload Jul 5 10:37:23.290865287 (289h26m58.061506632s) [upload=231486]: Uploading segments... Jul 5 10:37:23.290900985 (289h26m58.06154233s) [upload=231486]: Got next segment. Inline: true Jul 5 10:37:23.290905033 (289h26m58.061546368s) [upload=231486]: Waiting for error group managing segments... Jul 5 10:37:23.290939269 (289h26m58.061580614s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:37:23.290943597 (289h26m58.061584932s) [upload=231486]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:37:23.290945821 (289h26m58.061587157s) [upload=231486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:37:23.600922731 (289h26m58.371564066s) [upload=231486]: Done uploading segments... Jul 5 10:37:23.600945323 (289h26m58.371586658s) [upload=231486]: Upload finished. err: <nil> Jul 5 10:38:26.398200196 (289h28m1.168841531s) [upload=231497]: Starting upload Jul 5 10:38:26.398270981 (289h28m1.168912317s) [upload=231497]: Done starting upload Jul 5 10:38:26.398323582 (289h28m1.168964917s) [upload=231497]: Uploading segments... Jul 5 10:38:26.398359360 (289h28m1.169000695s) [upload=231497]: Got next segment. Inline: true Jul 5 10:38:26.398363538 (289h28m1.169004873s) [upload=231497]: Waiting for error group managing segments... Jul 5 10:38:26.398399979 (289h28m1.169041314s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:26.398407182 (289h28m1.169048517s) [upload=231497]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:26.398410198 (289h28m1.169051533s) [upload=231497]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:26.688536233 (289h28m1.459177578s) [upload=231497]: Done uploading segments... Jul 5 10:38:26.688559748 (289h28m1.459201133s) [upload=231497]: Upload finished. err: <nil> Jul 5 10:38:41.435615778 (289h28m16.206257113s) [upload=231499]: Starting upload Jul 5 10:38:41.435718074 (289h28m16.206359429s) [upload=231499]: Done starting upload Jul 5 10:38:41.435789621 (289h28m16.206430956s) [upload=231499]: Uploading segments... Jul 5 10:38:41.435827874 (289h28m16.206469229s) [upload=231499]: Got next segment. Inline: true Jul 5 10:38:41.435833314 (289h28m16.206474689s) [upload=231499]: Waiting for error group managing segments... Jul 5 10:38:41.435881707 (289h28m16.206523072s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:41.435887829 (289h28m16.206529194s) [upload=231499]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:41.435891646 (289h28m16.206533021s) [upload=231499]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:41.751742745 (289h28m16.52238408s) [upload=231499]: Done uploading segments... Jul 5 10:38:41.751766320 (289h28m16.522407665s) [upload=231499]: Upload finished. err: <nil> Jul 5 10:38:58.980085408 (289h28m33.750726743s) [upload=231503]: Starting upload Jul 5 10:38:58.980165591 (289h28m33.750806926s) [upload=231503]: Done starting upload Jul 5 10:38:58.980225375 (289h28m33.750866711s) [upload=231503]: Uploading segments... Jul 5 10:38:58.980261305 (289h28m33.75090264s) [upload=231503]: Got next segment. Inline: true Jul 5 10:38:58.980265443 (289h28m33.750906778s) [upload=231503]: Waiting for error group managing segments... Jul 5 10:38:58.980300379 (289h28m33.750941714s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 10:38:58.980305198 (289h28m33.750946533s) [upload=231503]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 5 10:38:58.980307563 (289h28m33.750948898s) [upload=231503]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 10:38:59.282057185 (289h28m34.05269852s) [upload=231503]: Done uploading segments... Jul 5 10:38:59.282076321 (289h28m34.052717656s) [upload=231503]: Upload finished. err: <nil> Duration: 1.84044557s core uplink us-select-1

Orbiter Check History

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)