Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X........X....] duration:
5.931425821s
FAIL (2025-06-25 14:00:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.931441431s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X........X...] duration:
5.911202561s
FAIL (2025-06-25 13:59:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.911221458s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.363233005s
FAIL (2025-06-25 13:59:46 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.363253975s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................................X........X..] duration:
6.086332105s
FAIL (2025-06-25 13:58:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.08635515s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.250140465s
FAIL (2025-06-25 13:58:35 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.250153932s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X........X.] duration:
5.904744669s
FAIL (2025-06-25 13:58:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.904780879s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.310115081s
FAIL (2025-06-25 13:58:18 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.310130952s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X........X] duration:
30.00116588s
FAIL (2025-06-25 13:57:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001181651s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.447114123s
FAIL (2025-06-25 13:57:25 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.447126949s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.371891675s
FAIL (2025-06-25 13:56:53 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.371913027s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
8.843317684s
FAIL (2025-06-25 13:56:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 8.843338956s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
5.970112268s
FAIL (2025-06-25 13:56:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.970157215s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.421715513s
FAIL (2025-06-25 13:55:42 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.422117171s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.326980983s
FAIL (2025-06-25 13:55:24 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.326996675s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
5.911765967s
FAIL (2025-06-25 13:55:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.911789563s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
6.08480557s
FAIL (2025-06-25 13:54:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.084826862s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.261398478s
FAIL (2025-06-25 13:54:28 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.261421482s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
5.83824779s
FAIL (2025-06-25 13:53:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.838270385s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.491122256s
FAIL (2025-06-25 13:53:18 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.491145019s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
6.102959882s
FAIL (2025-06-25 13:53:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.102982907s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.335533504s
FAIL (2025-06-25 13:52:20 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.335554875s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
5.959481727s
FAIL (2025-06-25 13:52:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.959503558s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.23931882s
FAIL (2025-06-25 13:51:59 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.239356552s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.243493762s
FAIL (2025-06-25 13:51:37 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.243514743s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.320583869s
FAIL (2025-06-25 13:51:07 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.320606383s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
5.961542478s
FAIL (2025-06-25 13:51:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.961564241s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.00040118s
FAIL (2025-06-25 13:50:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.00042181s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.266423585s
FAIL (2025-06-25 13:50:50 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.266440598s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
3.745156947s
FAIL (2025-06-25 13:50:35 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 3.745182106s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.255093019s
FAIL (2025-06-25 13:49:56 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.255115282s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.252812101s
FAIL (2025-06-25 13:49:14 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.252831188s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.3084921s
FAIL (2025-06-25 13:48:29 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.308511697s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.342612601s
FAIL (2025-06-25 13:48:13 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.342633351s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.294288903s
FAIL (2025-06-25 13:47:32 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.294309744s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
5.629463706s
FAIL (2025-06-25 13:47:24 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 2)
======LOGS======
e_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941388971 (51h50m56.712030306s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941623656 (51h50m56.712264991s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941854513 (51h50m56.712495848s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942064570 (51h50m56.712705905s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942282010 (51h50m56.712923335s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942496205 (51h50m56.71313754s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942703717 (51h50m56.713345052s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942880470 (51h50m56.713521805s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943056550 (51h50m56.713697885s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943230217 (51h50m56.713871552s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943408452 (51h50m56.714049787s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943621615 (51h50m56.71426295s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943804579 (51h50m56.714445914s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:23.625961904 (51h50m58.396603239s) [upload=41394]: Next returned nil segment
Jun 25 13:01:23.625993946 (51h50m58.396635281s) [upload=41394]: Waiting for error group managing segments...
Jun 25 13:01:23.927659351 (51h50m58.698300676s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:23.945179161 (51h50m58.715820496s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:51.053961520 (51h51m25.824602846s) [noise=true , address=45.91.116.12:5226 , piece_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:5226): protocol: rpc: dial tcp 45.91.116.12:5226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054009372 (51h51m25.824650707s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: rpc: dial tcp 77.90.31.17:4772: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054041034 (51h51m25.824682369s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: rpc: dial tcp 77.90.31.21:4878: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054078988 (51h51m25.824720323s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: rpc: dial tcp 77.90.31.18:4806: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054109858 (51h51m25.824751193s) [noise=true , address=45.91.116.5:5298 , piece_id=2BSJEDM3GKA7GXK2HJSYY3PGO5YORAEKKOAKI2SXS3CRLEJJSQBA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:5298): protocol: rpc: dial tcp 45.91.116.5:5298: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054146298 (51h51m25.824787623s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054174773 (51h51m25.824816108s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:5261): protocol: write tcp 188.166.225.170:48522->45.91.116.9:5261: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054198679 (51h51m25.824840004s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054214630 (51h51m25.824855965s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054242735 (51h51m25.82488407s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054252153 (51h51m25.824893488s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: rpc: dial tcp 77.90.31.10:4520: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054273424 (51h51m25.824914749s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: rpc: dial tcp 77.90.31.16:4733: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054287702 (51h51m25.824929037s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054292161 (51h51m25.824933486s) [noise=true , address=77.90.31.13:4626 , piece_id=LVPEQZCSQTLIZAKLZGDTR5JTCL2VEEXWNKG7LLEZVLEIUP2L4XUQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: rpc: dial tcp 77.90.31.13:4626: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054325435 (51h51m25.82496676s) [seg_pos={0 0}, upload=41394]: Done waiting for segment. successful: 2 optimal: 13 errs: <nil>
Jun 25 13:01:51.285654058 (51h51m26.056295383s) [upload=41394]: Done uploading segments...
Jun 25 13:01:51.285679077 (51h51m26.056320402s) [upload=41394]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 2)
Duration: 5.62948665s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
5.643305279s
FAIL (2025-06-25 13:47:07 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 2)
======LOGS======
e_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941388971 (51h50m56.712030306s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941623656 (51h50m56.712264991s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941854513 (51h50m56.712495848s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942064570 (51h50m56.712705905s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942282010 (51h50m56.712923335s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942496205 (51h50m56.71313754s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942703717 (51h50m56.713345052s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942880470 (51h50m56.713521805s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943056550 (51h50m56.713697885s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943230217 (51h50m56.713871552s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943408452 (51h50m56.714049787s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943621615 (51h50m56.71426295s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943804579 (51h50m56.714445914s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:23.625961904 (51h50m58.396603239s) [upload=41394]: Next returned nil segment
Jun 25 13:01:23.625993946 (51h50m58.396635281s) [upload=41394]: Waiting for error group managing segments...
Jun 25 13:01:23.927659351 (51h50m58.698300676s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:23.945179161 (51h50m58.715820496s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:51.053961520 (51h51m25.824602846s) [noise=true , address=45.91.116.12:5226 , piece_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:5226): protocol: rpc: dial tcp 45.91.116.12:5226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054009372 (51h51m25.824650707s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: rpc: dial tcp 77.90.31.17:4772: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054041034 (51h51m25.824682369s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: rpc: dial tcp 77.90.31.21:4878: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054078988 (51h51m25.824720323s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: rpc: dial tcp 77.90.31.18:4806: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054109858 (51h51m25.824751193s) [noise=true , address=45.91.116.5:5298 , piece_id=2BSJEDM3GKA7GXK2HJSYY3PGO5YORAEKKOAKI2SXS3CRLEJJSQBA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:5298): protocol: rpc: dial tcp 45.91.116.5:5298: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054146298 (51h51m25.824787623s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054174773 (51h51m25.824816108s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:5261): protocol: write tcp 188.166.225.170:48522->45.91.116.9:5261: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054198679 (51h51m25.824840004s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054214630 (51h51m25.824855965s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054242735 (51h51m25.82488407s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054252153 (51h51m25.824893488s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: rpc: dial tcp 77.90.31.10:4520: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054273424 (51h51m25.824914749s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: rpc: dial tcp 77.90.31.16:4733: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054287702 (51h51m25.824929037s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054292161 (51h51m25.824933486s) [noise=true , address=77.90.31.13:4626 , piece_id=LVPEQZCSQTLIZAKLZGDTR5JTCL2VEEXWNKG7LLEZVLEIUP2L4XUQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: rpc: dial tcp 77.90.31.13:4626: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054325435 (51h51m25.82496676s) [seg_pos={0 0}, upload=41394]: Done waiting for segment. successful: 2 optimal: 13 errs: <nil>
Jun 25 13:01:51.285654058 (51h51m26.056295383s) [upload=41394]: Done uploading segments...
Jun 25 13:01:51.285679077 (51h51m26.056320402s) [upload=41394]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 2)
Duration: 5.643335388s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.278336906s
FAIL (2025-06-25 13:46:33 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.278358428s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.415373272s
FAIL (2025-06-25 13:46:18 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.415384654s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000649559s
FAIL (2025-06-25 13:46:15 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 30.000673495s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [X.X.........................................................] duration:
5.645378506s
FAIL (2025-06-25 13:46:05 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 2)
======LOGS======
e_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941388971 (51h50m56.712030306s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941623656 (51h50m56.712264991s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941854513 (51h50m56.712495848s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942064570 (51h50m56.712705905s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942282010 (51h50m56.712923335s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942496205 (51h50m56.71313754s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942703717 (51h50m56.713345052s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942880470 (51h50m56.713521805s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943056550 (51h50m56.713697885s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943230217 (51h50m56.713871552s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943408452 (51h50m56.714049787s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943621615 (51h50m56.71426295s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943804579 (51h50m56.714445914s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:23.625961904 (51h50m58.396603239s) [upload=41394]: Next returned nil segment
Jun 25 13:01:23.625993946 (51h50m58.396635281s) [upload=41394]: Waiting for error group managing segments...
Jun 25 13:01:23.927659351 (51h50m58.698300676s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:23.945179161 (51h50m58.715820496s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:51.053961520 (51h51m25.824602846s) [noise=true , address=45.91.116.12:5226 , piece_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:5226): protocol: rpc: dial tcp 45.91.116.12:5226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054009372 (51h51m25.824650707s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: rpc: dial tcp 77.90.31.17:4772: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054041034 (51h51m25.824682369s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: rpc: dial tcp 77.90.31.21:4878: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054078988 (51h51m25.824720323s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: rpc: dial tcp 77.90.31.18:4806: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054109858 (51h51m25.824751193s) [noise=true , address=45.91.116.5:5298 , piece_id=2BSJEDM3GKA7GXK2HJSYY3PGO5YORAEKKOAKI2SXS3CRLEJJSQBA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:5298): protocol: rpc: dial tcp 45.91.116.5:5298: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054146298 (51h51m25.824787623s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054174773 (51h51m25.824816108s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:5261): protocol: write tcp 188.166.225.170:48522->45.91.116.9:5261: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054198679 (51h51m25.824840004s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054214630 (51h51m25.824855965s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054242735 (51h51m25.82488407s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054252153 (51h51m25.824893488s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: rpc: dial tcp 77.90.31.10:4520: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054273424 (51h51m25.824914749s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: rpc: dial tcp 77.90.31.16:4733: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054287702 (51h51m25.824929037s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054292161 (51h51m25.824933486s) [noise=true , address=77.90.31.13:4626 , piece_id=LVPEQZCSQTLIZAKLZGDTR5JTCL2VEEXWNKG7LLEZVLEIUP2L4XUQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: rpc: dial tcp 77.90.31.13:4626: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054325435 (51h51m25.82496676s) [seg_pos={0 0}, upload=41394]: Done waiting for segment. successful: 2 optimal: 13 errs: <nil>
Jun 25 13:01:51.285654058 (51h51m26.056295383s) [upload=41394]: Done uploading segments...
Jun 25 13:01:51.285679077 (51h51m26.056320402s) [upload=41394]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 2)
Duration: 5.645404717s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X.X........................................................] duration:
5.61443357s
FAIL (2025-06-25 13:45:38 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 2)
======LOGS======
e_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941388971 (51h50m56.712030306s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941623656 (51h50m56.712264991s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941854513 (51h50m56.712495848s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942064570 (51h50m56.712705905s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942282010 (51h50m56.712923335s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942496205 (51h50m56.71313754s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942703717 (51h50m56.713345052s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942880470 (51h50m56.713521805s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943056550 (51h50m56.713697885s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943230217 (51h50m56.713871552s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943408452 (51h50m56.714049787s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943621615 (51h50m56.71426295s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943804579 (51h50m56.714445914s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:23.625961904 (51h50m58.396603239s) [upload=41394]: Next returned nil segment
Jun 25 13:01:23.625993946 (51h50m58.396635281s) [upload=41394]: Waiting for error group managing segments...
Jun 25 13:01:23.927659351 (51h50m58.698300676s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:23.945179161 (51h50m58.715820496s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:51.053961520 (51h51m25.824602846s) [noise=true , address=45.91.116.12:5226 , piece_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:5226): protocol: rpc: dial tcp 45.91.116.12:5226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054009372 (51h51m25.824650707s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: rpc: dial tcp 77.90.31.17:4772: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054041034 (51h51m25.824682369s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: rpc: dial tcp 77.90.31.21:4878: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054078988 (51h51m25.824720323s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: rpc: dial tcp 77.90.31.18:4806: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054109858 (51h51m25.824751193s) [noise=true , address=45.91.116.5:5298 , piece_id=2BSJEDM3GKA7GXK2HJSYY3PGO5YORAEKKOAKI2SXS3CRLEJJSQBA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:5298): protocol: rpc: dial tcp 45.91.116.5:5298: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054146298 (51h51m25.824787623s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054174773 (51h51m25.824816108s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:5261): protocol: write tcp 188.166.225.170:48522->45.91.116.9:5261: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054198679 (51h51m25.824840004s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054214630 (51h51m25.824855965s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054242735 (51h51m25.82488407s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054252153 (51h51m25.824893488s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: rpc: dial tcp 77.90.31.10:4520: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054273424 (51h51m25.824914749s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: rpc: dial tcp 77.90.31.16:4733: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054287702 (51h51m25.824929037s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054292161 (51h51m25.824933486s) [noise=true , address=77.90.31.13:4626 , piece_id=LVPEQZCSQTLIZAKLZGDTR5JTCL2VEEXWNKG7LLEZVLEIUP2L4XUQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: rpc: dial tcp 77.90.31.13:4626: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054325435 (51h51m25.82496676s) [seg_pos={0 0}, upload=41394]: Done waiting for segment. successful: 2 optimal: 13 errs: <nil>
Jun 25 13:01:51.285654058 (51h51m26.056295383s) [upload=41394]: Done uploading segments...
Jun 25 13:01:51.285679077 (51h51m26.056320402s) [upload=41394]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 2)
Duration: 5.61446925s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X.X.......................................................] duration:
5.73554351s
FAIL (2025-06-25 13:45:06 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 2)
======LOGS======
e_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941388971 (51h50m56.712030306s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941623656 (51h50m56.712264991s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941854513 (51h50m56.712495848s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942064570 (51h50m56.712705905s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942282010 (51h50m56.712923335s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942496205 (51h50m56.71313754s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942703717 (51h50m56.713345052s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942880470 (51h50m56.713521805s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943056550 (51h50m56.713697885s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943230217 (51h50m56.713871552s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943408452 (51h50m56.714049787s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943621615 (51h50m56.71426295s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943804579 (51h50m56.714445914s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:23.625961904 (51h50m58.396603239s) [upload=41394]: Next returned nil segment
Jun 25 13:01:23.625993946 (51h50m58.396635281s) [upload=41394]: Waiting for error group managing segments...
Jun 25 13:01:23.927659351 (51h50m58.698300676s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:23.945179161 (51h50m58.715820496s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:51.053961520 (51h51m25.824602846s) [noise=true , address=45.91.116.12:5226 , piece_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:5226): protocol: rpc: dial tcp 45.91.116.12:5226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054009372 (51h51m25.824650707s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: rpc: dial tcp 77.90.31.17:4772: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054041034 (51h51m25.824682369s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: rpc: dial tcp 77.90.31.21:4878: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054078988 (51h51m25.824720323s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: rpc: dial tcp 77.90.31.18:4806: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054109858 (51h51m25.824751193s) [noise=true , address=45.91.116.5:5298 , piece_id=2BSJEDM3GKA7GXK2HJSYY3PGO5YORAEKKOAKI2SXS3CRLEJJSQBA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:5298): protocol: rpc: dial tcp 45.91.116.5:5298: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054146298 (51h51m25.824787623s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054174773 (51h51m25.824816108s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:5261): protocol: write tcp 188.166.225.170:48522->45.91.116.9:5261: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054198679 (51h51m25.824840004s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054214630 (51h51m25.824855965s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054242735 (51h51m25.82488407s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054252153 (51h51m25.824893488s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: rpc: dial tcp 77.90.31.10:4520: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054273424 (51h51m25.824914749s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: rpc: dial tcp 77.90.31.16:4733: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054287702 (51h51m25.824929037s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054292161 (51h51m25.824933486s) [noise=true , address=77.90.31.13:4626 , piece_id=LVPEQZCSQTLIZAKLZGDTR5JTCL2VEEXWNKG7LLEZVLEIUP2L4XUQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: rpc: dial tcp 77.90.31.13:4626: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054325435 (51h51m25.82496676s) [seg_pos={0 0}, upload=41394]: Done waiting for segment. successful: 2 optimal: 13 errs: <nil>
Jun 25 13:01:51.285654058 (51h51m26.056295383s) [upload=41394]: Done uploading segments...
Jun 25 13:01:51.285679077 (51h51m26.056320402s) [upload=41394]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 2)
Duration: 5.735564181s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X.X......................................................] duration:
5.62639489s
FAIL (2025-06-25 13:44:03 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 2)
======LOGS======
e_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941388971 (51h50m56.712030306s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941623656 (51h50m56.712264991s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941854513 (51h50m56.712495848s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942064570 (51h50m56.712705905s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942282010 (51h50m56.712923335s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942496205 (51h50m56.71313754s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942703717 (51h50m56.713345052s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942880470 (51h50m56.713521805s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943056550 (51h50m56.713697885s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943230217 (51h50m56.713871552s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943408452 (51h50m56.714049787s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943621615 (51h50m56.71426295s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943804579 (51h50m56.714445914s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:23.625961904 (51h50m58.396603239s) [upload=41394]: Next returned nil segment
Jun 25 13:01:23.625993946 (51h50m58.396635281s) [upload=41394]: Waiting for error group managing segments...
Jun 25 13:01:23.927659351 (51h50m58.698300676s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:23.945179161 (51h50m58.715820496s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:51.053961520 (51h51m25.824602846s) [noise=true , address=45.91.116.12:5226 , piece_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:5226): protocol: rpc: dial tcp 45.91.116.12:5226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054009372 (51h51m25.824650707s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: rpc: dial tcp 77.90.31.17:4772: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054041034 (51h51m25.824682369s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: rpc: dial tcp 77.90.31.21:4878: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054078988 (51h51m25.824720323s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: rpc: dial tcp 77.90.31.18:4806: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054109858 (51h51m25.824751193s) [noise=true , address=45.91.116.5:5298 , piece_id=2BSJEDM3GKA7GXK2HJSYY3PGO5YORAEKKOAKI2SXS3CRLEJJSQBA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:5298): protocol: rpc: dial tcp 45.91.116.5:5298: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054146298 (51h51m25.824787623s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054174773 (51h51m25.824816108s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:5261): protocol: write tcp 188.166.225.170:48522->45.91.116.9:5261: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054198679 (51h51m25.824840004s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054214630 (51h51m25.824855965s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054242735 (51h51m25.82488407s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054252153 (51h51m25.824893488s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: rpc: dial tcp 77.90.31.10:4520: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054273424 (51h51m25.824914749s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: rpc: dial tcp 77.90.31.16:4733: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054287702 (51h51m25.824929037s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054292161 (51h51m25.824933486s) [noise=true , address=77.90.31.13:4626 , piece_id=LVPEQZCSQTLIZAKLZGDTR5JTCL2VEEXWNKG7LLEZVLEIUP2L4XUQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: rpc: dial tcp 77.90.31.13:4626: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054325435 (51h51m25.82496676s) [seg_pos={0 0}, upload=41394]: Done waiting for segment. successful: 2 optimal: 13 errs: <nil>
Jun 25 13:01:51.285654058 (51h51m26.056295383s) [upload=41394]: Done uploading segments...
Jun 25 13:01:51.285679077 (51h51m26.056320402s) [upload=41394]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 2)
Duration: 5.626420439s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X.X.....................................................] duration:
5.706713776s
FAIL (2025-06-25 13:43:37 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 2)
======LOGS======
e_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941388971 (51h50m56.712030306s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941623656 (51h50m56.712264991s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941854513 (51h50m56.712495848s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942064570 (51h50m56.712705905s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942282010 (51h50m56.712923335s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942496205 (51h50m56.71313754s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942703717 (51h50m56.713345052s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942880470 (51h50m56.713521805s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943056550 (51h50m56.713697885s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943230217 (51h50m56.713871552s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943408452 (51h50m56.714049787s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943621615 (51h50m56.71426295s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943804579 (51h50m56.714445914s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:23.625961904 (51h50m58.396603239s) [upload=41394]: Next returned nil segment
Jun 25 13:01:23.625993946 (51h50m58.396635281s) [upload=41394]: Waiting for error group managing segments...
Jun 25 13:01:23.927659351 (51h50m58.698300676s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:23.945179161 (51h50m58.715820496s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:51.053961520 (51h51m25.824602846s) [noise=true , address=45.91.116.12:5226 , piece_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:5226): protocol: rpc: dial tcp 45.91.116.12:5226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054009372 (51h51m25.824650707s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: rpc: dial tcp 77.90.31.17:4772: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054041034 (51h51m25.824682369s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: rpc: dial tcp 77.90.31.21:4878: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054078988 (51h51m25.824720323s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: rpc: dial tcp 77.90.31.18:4806: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054109858 (51h51m25.824751193s) [noise=true , address=45.91.116.5:5298 , piece_id=2BSJEDM3GKA7GXK2HJSYY3PGO5YORAEKKOAKI2SXS3CRLEJJSQBA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:5298): protocol: rpc: dial tcp 45.91.116.5:5298: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054146298 (51h51m25.824787623s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054174773 (51h51m25.824816108s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:5261): protocol: write tcp 188.166.225.170:48522->45.91.116.9:5261: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054198679 (51h51m25.824840004s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054214630 (51h51m25.824855965s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054242735 (51h51m25.82488407s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054252153 (51h51m25.824893488s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: rpc: dial tcp 77.90.31.10:4520: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054273424 (51h51m25.824914749s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: rpc: dial tcp 77.90.31.16:4733: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054287702 (51h51m25.824929037s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054292161 (51h51m25.824933486s) [noise=true , address=77.90.31.13:4626 , piece_id=LVPEQZCSQTLIZAKLZGDTR5JTCL2VEEXWNKG7LLEZVLEIUP2L4XUQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: rpc: dial tcp 77.90.31.13:4626: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054325435 (51h51m25.82496676s) [seg_pos={0 0}, upload=41394]: Done waiting for segment. successful: 2 optimal: 13 errs: <nil>
Jun 25 13:01:51.285654058 (51h51m26.056295383s) [upload=41394]: Done uploading segments...
Jun 25 13:01:51.285679077 (51h51m26.056320402s) [upload=41394]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 2)
Duration: 5.706731422s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X.X....................................................] duration:
5.730730602s
FAIL (2025-06-25 13:43:02 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 2)
======LOGS======
e_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941388971 (51h50m56.712030306s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941623656 (51h50m56.712264991s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941854513 (51h50m56.712495848s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942064570 (51h50m56.712705905s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942282010 (51h50m56.712923335s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942496205 (51h50m56.71313754s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942703717 (51h50m56.713345052s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942880470 (51h50m56.713521805s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943056550 (51h50m56.713697885s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943230217 (51h50m56.713871552s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943408452 (51h50m56.714049787s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943621615 (51h50m56.71426295s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943804579 (51h50m56.714445914s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:23.625961904 (51h50m58.396603239s) [upload=41394]: Next returned nil segment
Jun 25 13:01:23.625993946 (51h50m58.396635281s) [upload=41394]: Waiting for error group managing segments...
Jun 25 13:01:23.927659351 (51h50m58.698300676s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:23.945179161 (51h50m58.715820496s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:51.053961520 (51h51m25.824602846s) [noise=true , address=45.91.116.12:5226 , piece_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:5226): protocol: rpc: dial tcp 45.91.116.12:5226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054009372 (51h51m25.824650707s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: rpc: dial tcp 77.90.31.17:4772: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054041034 (51h51m25.824682369s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: rpc: dial tcp 77.90.31.21:4878: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054078988 (51h51m25.824720323s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: rpc: dial tcp 77.90.31.18:4806: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054109858 (51h51m25.824751193s) [noise=true , address=45.91.116.5:5298 , piece_id=2BSJEDM3GKA7GXK2HJSYY3PGO5YORAEKKOAKI2SXS3CRLEJJSQBA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:5298): protocol: rpc: dial tcp 45.91.116.5:5298: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054146298 (51h51m25.824787623s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054174773 (51h51m25.824816108s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:5261): protocol: write tcp 188.166.225.170:48522->45.91.116.9:5261: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054198679 (51h51m25.824840004s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054214630 (51h51m25.824855965s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054242735 (51h51m25.82488407s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054252153 (51h51m25.824893488s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: rpc: dial tcp 77.90.31.10:4520: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054273424 (51h51m25.824914749s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: rpc: dial tcp 77.90.31.16:4733: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054287702 (51h51m25.824929037s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054292161 (51h51m25.824933486s) [noise=true , address=77.90.31.13:4626 , piece_id=LVPEQZCSQTLIZAKLZGDTR5JTCL2VEEXWNKG7LLEZVLEIUP2L4XUQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: rpc: dial tcp 77.90.31.13:4626: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054325435 (51h51m25.82496676s) [seg_pos={0 0}, upload=41394]: Done waiting for segment. successful: 2 optimal: 13 errs: <nil>
Jun 25 13:01:51.285654058 (51h51m26.056295383s) [upload=41394]: Done uploading segments...
Jun 25 13:01:51.285679077 (51h51m26.056320402s) [upload=41394]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 2)
Duration: 5.730753235s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X.X...................................................] duration:
5.687346017s
FAIL (2025-06-25 13:42:36 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 2)
======LOGS======
e_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941388971 (51h50m56.712030306s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941623656 (51h50m56.712264991s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941854513 (51h50m56.712495848s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942064570 (51h50m56.712705905s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942282010 (51h50m56.712923335s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942496205 (51h50m56.71313754s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942703717 (51h50m56.713345052s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942880470 (51h50m56.713521805s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943056550 (51h50m56.713697885s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943230217 (51h50m56.713871552s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943408452 (51h50m56.714049787s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943621615 (51h50m56.71426295s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943804579 (51h50m56.714445914s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:23.625961904 (51h50m58.396603239s) [upload=41394]: Next returned nil segment
Jun 25 13:01:23.625993946 (51h50m58.396635281s) [upload=41394]: Waiting for error group managing segments...
Jun 25 13:01:23.927659351 (51h50m58.698300676s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:23.945179161 (51h50m58.715820496s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:51.053961520 (51h51m25.824602846s) [noise=true , address=45.91.116.12:5226 , piece_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:5226): protocol: rpc: dial tcp 45.91.116.12:5226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054009372 (51h51m25.824650707s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: rpc: dial tcp 77.90.31.17:4772: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054041034 (51h51m25.824682369s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: rpc: dial tcp 77.90.31.21:4878: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054078988 (51h51m25.824720323s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: rpc: dial tcp 77.90.31.18:4806: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054109858 (51h51m25.824751193s) [noise=true , address=45.91.116.5:5298 , piece_id=2BSJEDM3GKA7GXK2HJSYY3PGO5YORAEKKOAKI2SXS3CRLEJJSQBA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:5298): protocol: rpc: dial tcp 45.91.116.5:5298: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054146298 (51h51m25.824787623s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054174773 (51h51m25.824816108s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:5261): protocol: write tcp 188.166.225.170:48522->45.91.116.9:5261: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054198679 (51h51m25.824840004s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054214630 (51h51m25.824855965s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054242735 (51h51m25.82488407s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054252153 (51h51m25.824893488s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: rpc: dial tcp 77.90.31.10:4520: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054273424 (51h51m25.824914749s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: rpc: dial tcp 77.90.31.16:4733: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054287702 (51h51m25.824929037s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054292161 (51h51m25.824933486s) [noise=true , address=77.90.31.13:4626 , piece_id=LVPEQZCSQTLIZAKLZGDTR5JTCL2VEEXWNKG7LLEZVLEIUP2L4XUQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: rpc: dial tcp 77.90.31.13:4626: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054325435 (51h51m25.82496676s) [seg_pos={0 0}, upload=41394]: Done waiting for segment. successful: 2 optimal: 13 errs: <nil>
Jun 25 13:01:51.285654058 (51h51m26.056295383s) [upload=41394]: Done uploading segments...
Jun 25 13:01:51.285679077 (51h51m26.056320402s) [upload=41394]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 2)
Duration: 5.6873735s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X.X..................................................] duration:
5.638199552s
FAIL (2025-06-25 13:41:47 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 2)
======LOGS======
e_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941388971 (51h50m56.712030306s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941623656 (51h50m56.712264991s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941854513 (51h50m56.712495848s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942064570 (51h50m56.712705905s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942282010 (51h50m56.712923335s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942496205 (51h50m56.71313754s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942703717 (51h50m56.713345052s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942880470 (51h50m56.713521805s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943056550 (51h50m56.713697885s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943230217 (51h50m56.713871552s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943408452 (51h50m56.714049787s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943621615 (51h50m56.71426295s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943804579 (51h50m56.714445914s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:23.625961904 (51h50m58.396603239s) [upload=41394]: Next returned nil segment
Jun 25 13:01:23.625993946 (51h50m58.396635281s) [upload=41394]: Waiting for error group managing segments...
Jun 25 13:01:23.927659351 (51h50m58.698300676s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:23.945179161 (51h50m58.715820496s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:51.053961520 (51h51m25.824602846s) [noise=true , address=45.91.116.12:5226 , piece_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:5226): protocol: rpc: dial tcp 45.91.116.12:5226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054009372 (51h51m25.824650707s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: rpc: dial tcp 77.90.31.17:4772: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054041034 (51h51m25.824682369s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: rpc: dial tcp 77.90.31.21:4878: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054078988 (51h51m25.824720323s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: rpc: dial tcp 77.90.31.18:4806: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054109858 (51h51m25.824751193s) [noise=true , address=45.91.116.5:5298 , piece_id=2BSJEDM3GKA7GXK2HJSYY3PGO5YORAEKKOAKI2SXS3CRLEJJSQBA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:5298): protocol: rpc: dial tcp 45.91.116.5:5298: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054146298 (51h51m25.824787623s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054174773 (51h51m25.824816108s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:5261): protocol: write tcp 188.166.225.170:48522->45.91.116.9:5261: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054198679 (51h51m25.824840004s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054214630 (51h51m25.824855965s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054242735 (51h51m25.82488407s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054252153 (51h51m25.824893488s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: rpc: dial tcp 77.90.31.10:4520: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054273424 (51h51m25.824914749s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: rpc: dial tcp 77.90.31.16:4733: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054287702 (51h51m25.824929037s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054292161 (51h51m25.824933486s) [noise=true , address=77.90.31.13:4626 , piece_id=LVPEQZCSQTLIZAKLZGDTR5JTCL2VEEXWNKG7LLEZVLEIUP2L4XUQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: rpc: dial tcp 77.90.31.13:4626: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054325435 (51h51m25.82496676s) [seg_pos={0 0}, upload=41394]: Done waiting for segment. successful: 2 optimal: 13 errs: <nil>
Jun 25 13:01:51.285654058 (51h51m26.056295383s) [upload=41394]: Done uploading segments...
Jun 25 13:01:51.285679077 (51h51m26.056320402s) [upload=41394]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 2)
Duration: 5.638227065s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X.X.................................................] duration:
5.926398592s
FAIL (2025-06-25 13:40:47 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 2)
======LOGS======
e_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941388971 (51h50m56.712030306s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941623656 (51h50m56.712264991s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941854513 (51h50m56.712495848s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942064570 (51h50m56.712705905s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942282010 (51h50m56.712923335s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942496205 (51h50m56.71313754s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942703717 (51h50m56.713345052s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942880470 (51h50m56.713521805s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943056550 (51h50m56.713697885s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943230217 (51h50m56.713871552s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943408452 (51h50m56.714049787s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943621615 (51h50m56.71426295s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943804579 (51h50m56.714445914s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:23.625961904 (51h50m58.396603239s) [upload=41394]: Next returned nil segment
Jun 25 13:01:23.625993946 (51h50m58.396635281s) [upload=41394]: Waiting for error group managing segments...
Jun 25 13:01:23.927659351 (51h50m58.698300676s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:23.945179161 (51h50m58.715820496s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:51.053961520 (51h51m25.824602846s) [noise=true , address=45.91.116.12:5226 , piece_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:5226): protocol: rpc: dial tcp 45.91.116.12:5226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054009372 (51h51m25.824650707s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: rpc: dial tcp 77.90.31.17:4772: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054041034 (51h51m25.824682369s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: rpc: dial tcp 77.90.31.21:4878: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054078988 (51h51m25.824720323s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: rpc: dial tcp 77.90.31.18:4806: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054109858 (51h51m25.824751193s) [noise=true , address=45.91.116.5:5298 , piece_id=2BSJEDM3GKA7GXK2HJSYY3PGO5YORAEKKOAKI2SXS3CRLEJJSQBA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:5298): protocol: rpc: dial tcp 45.91.116.5:5298: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054146298 (51h51m25.824787623s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054174773 (51h51m25.824816108s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:5261): protocol: write tcp 188.166.225.170:48522->45.91.116.9:5261: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054198679 (51h51m25.824840004s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054214630 (51h51m25.824855965s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054242735 (51h51m25.82488407s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054252153 (51h51m25.824893488s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: rpc: dial tcp 77.90.31.10:4520: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054273424 (51h51m25.824914749s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: rpc: dial tcp 77.90.31.16:4733: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054287702 (51h51m25.824929037s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054292161 (51h51m25.824933486s) [noise=true , address=77.90.31.13:4626 , piece_id=LVPEQZCSQTLIZAKLZGDTR5JTCL2VEEXWNKG7LLEZVLEIUP2L4XUQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: rpc: dial tcp 77.90.31.13:4626: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054325435 (51h51m25.82496676s) [seg_pos={0 0}, upload=41394]: Done waiting for segment. successful: 2 optimal: 13 errs: <nil>
Jun 25 13:01:51.285654058 (51h51m26.056295383s) [upload=41394]: Done uploading segments...
Jun 25 13:01:51.285679077 (51h51m26.056320402s) [upload=41394]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 2)
Duration: 5.926421156s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X.X................................................] duration:
5.695937306s
FAIL (2025-06-25 13:39:52 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 2)
======LOGS======
e_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941388971 (51h50m56.712030306s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941623656 (51h50m56.712264991s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941854513 (51h50m56.712495848s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942064570 (51h50m56.712705905s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942282010 (51h50m56.712923335s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942496205 (51h50m56.71313754s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942703717 (51h50m56.713345052s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942880470 (51h50m56.713521805s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943056550 (51h50m56.713697885s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943230217 (51h50m56.713871552s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943408452 (51h50m56.714049787s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943621615 (51h50m56.71426295s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943804579 (51h50m56.714445914s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:23.625961904 (51h50m58.396603239s) [upload=41394]: Next returned nil segment
Jun 25 13:01:23.625993946 (51h50m58.396635281s) [upload=41394]: Waiting for error group managing segments...
Jun 25 13:01:23.927659351 (51h50m58.698300676s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:23.945179161 (51h50m58.715820496s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:51.053961520 (51h51m25.824602846s) [noise=true , address=45.91.116.12:5226 , piece_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:5226): protocol: rpc: dial tcp 45.91.116.12:5226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054009372 (51h51m25.824650707s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: rpc: dial tcp 77.90.31.17:4772: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054041034 (51h51m25.824682369s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: rpc: dial tcp 77.90.31.21:4878: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054078988 (51h51m25.824720323s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: rpc: dial tcp 77.90.31.18:4806: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054109858 (51h51m25.824751193s) [noise=true , address=45.91.116.5:5298 , piece_id=2BSJEDM3GKA7GXK2HJSYY3PGO5YORAEKKOAKI2SXS3CRLEJJSQBA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:5298): protocol: rpc: dial tcp 45.91.116.5:5298: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054146298 (51h51m25.824787623s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054174773 (51h51m25.824816108s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:5261): protocol: write tcp 188.166.225.170:48522->45.91.116.9:5261: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054198679 (51h51m25.824840004s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054214630 (51h51m25.824855965s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054242735 (51h51m25.82488407s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054252153 (51h51m25.824893488s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: rpc: dial tcp 77.90.31.10:4520: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054273424 (51h51m25.824914749s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: rpc: dial tcp 77.90.31.16:4733: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054287702 (51h51m25.824929037s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054292161 (51h51m25.824933486s) [noise=true , address=77.90.31.13:4626 , piece_id=LVPEQZCSQTLIZAKLZGDTR5JTCL2VEEXWNKG7LLEZVLEIUP2L4XUQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: rpc: dial tcp 77.90.31.13:4626: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054325435 (51h51m25.82496676s) [seg_pos={0 0}, upload=41394]: Done waiting for segment. successful: 2 optimal: 13 errs: <nil>
Jun 25 13:01:51.285654058 (51h51m26.056295383s) [upload=41394]: Done uploading segments...
Jun 25 13:01:51.285679077 (51h51m26.056320402s) [upload=41394]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 2)
Duration: 5.69595993s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X.X...............................................] duration:
5.674233623s
FAIL (2025-06-25 13:38:47 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 2)
======LOGS======
e_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941388971 (51h50m56.712030306s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941623656 (51h50m56.712264991s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.941854513 (51h50m56.712495848s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942064570 (51h50m56.712705905s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942282010 (51h50m56.712923335s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942496205 (51h50m56.71313754s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942703717 (51h50m56.713345052s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.942880470 (51h50m56.713521805s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943056550 (51h50m56.713697885s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943230217 (51h50m56.713871552s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943408452 (51h50m56.714049787s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943621615 (51h50m56.71426295s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:21.943804579 (51h50m56.714445914s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Uploading piece...
Jun 25 13:01:23.625961904 (51h50m58.396603239s) [upload=41394]: Next returned nil segment
Jun 25 13:01:23.625993946 (51h50m58.396635281s) [upload=41394]: Waiting for error group managing segments...
Jun 25 13:01:23.927659351 (51h50m58.698300676s) [noise=true , address=104.36.82.7:4912 , piece_id=4PWENM3XQ3OC3FQXXOYOHJL4OCUWM5XHHG5FSYE2INIUTOQJH4JA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:23.945179161 (51h50m58.715820496s) [noise=true , address=104.36.82.3:4765 , piece_id=FRLDDLMN46BOORGZTEZDP5EVGZOGUN6WRE5J3FI3ECWXVHZEB5HA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: <nil>
Jun 25 13:01:51.053961520 (51h51m25.824602846s) [noise=true , address=45.91.116.12:5226 , piece_id=NSYZERWFIN5CMEX3BIV5NXLOAIFH3HWY5EQY2MLK3F2ES3LBKEVA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:5226): protocol: rpc: dial tcp 45.91.116.12:5226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054009372 (51h51m25.824650707s) [noise=true , address=77.90.31.17:4772 , piece_id=PKPQYYK3AP6BTTRW7NNB4NSCJASN6PDIFFZ5HBNM6YEEBFKZVUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: rpc: dial tcp 77.90.31.17:4772: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054041034 (51h51m25.824682369s) [noise=true , address=77.90.31.21:4878 , piece_id=Z22HC22H4X3G6UQHQSLJOXRTQ54U4PXVBAHA5C22YHO7BFP7BUZA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: rpc: dial tcp 77.90.31.21:4878: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054078988 (51h51m25.824720323s) [noise=true , address=77.90.31.18:4806 , piece_id=S4EKNUIRGPWMUCTZF4FQHA6RBYSBK5HRINHRF7VSJQ3ZOT7HZYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: rpc: dial tcp 77.90.31.18:4806: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054109858 (51h51m25.824751193s) [noise=true , address=45.91.116.5:5298 , piece_id=2BSJEDM3GKA7GXK2HJSYY3PGO5YORAEKKOAKI2SXS3CRLEJJSQBA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:5298): protocol: rpc: dial tcp 45.91.116.5:5298: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054146298 (51h51m25.824787623s) [noise=true , address=77.90.31.14:4663 , piece_id=4Z7H3SH5HDKOLAXANUJEEDOM7ELB3I7X6N2M3UFVMJQKBQZZ7REQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054174773 (51h51m25.824816108s) [noise=true , address=45.91.116.9:5261 , piece_id=N5AX5K6L6FBTUEB3ZBDPJK4MZSOK7PVHWANLV4FMP2P4YFFH5FBQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:5261): protocol: write tcp 188.166.225.170:48522->45.91.116.9:5261: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054198679 (51h51m25.824840004s) [noise=true , address=45.91.116.11:4119 , piece_id=HCH7HK5DNKKCIDY777JHRIODOTD2KGGX2AK3KINQDSG4L5Y7RBRQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054214630 (51h51m25.824855965s) [noise=true , address=77.90.31.12:4592 , piece_id=755TNH7RCWX7LTNQAP5JFOPVFXSNPCUXM7ITVDLC5ITX2PE5WYPQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054242735 (51h51m25.82488407s) [noise=true , address=45.91.116.14:4190 , piece_id=WS6JVZWH5CTTXHLE5HDWLGFXKUYD5BXT3YKX6FXFY3YDGFFHTA2Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054252153 (51h51m25.824893488s) [noise=true , address=77.90.31.10:4520 , piece_id=VGPLDMWQH3BLAAGPFE5IU3HVAJ25C4DPMEY2TSAAJBFRZQOVFFFA, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: rpc: dial tcp 77.90.31.10:4520: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054273424 (51h51m25.824914749s) [noise=true , address=77.90.31.16:4733 , piece_id=MZUAL7GUO2IWC4ZYXMHXXLTIX4NJELCQL6WFLPULNP3YGMKUZG6Q, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: rpc: dial tcp 77.90.31.16:4733: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054287702 (51h51m25.824929037s) [noise=true , address=77.90.31.19:4841 , piece_id=C7WPSPITV6KAIQFAQMLDFJ6QX2K4ANTJ6WTYA2QBNUEC636OBH3A, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054292161 (51h51m25.824933486s) [noise=true , address=77.90.31.13:4626 , piece_id=LVPEQZCSQTLIZAKLZGDTR5JTCL2VEEXWNKG7LLEZVLEIUP2L4XUQ, seg_pos={0 0}, upload=41394]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: rpc: dial tcp 77.90.31.13:4626: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 13:01:51.054325435 (51h51m25.82496676s) [seg_pos={0 0}, upload=41394]: Done waiting for segment. successful: 2 optimal: 13 errs: <nil>
Jun 25 13:01:51.285654058 (51h51m26.056295383s) [upload=41394]: Done uploading segments...
Jun 25 13:01:51.285679077 (51h51m26.056320402s) [upload=41394]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 2)
Duration: 5.674257538s
core
uplink
us-select-1
|