Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
6.412497465s
FAIL (2025-10-12 16:54:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.412524667s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
6.163112648s
FAIL (2025-10-12 16:53:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.163142285s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
6.339623408s
FAIL (2025-10-12 16:53:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.339650127s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
6.164453974s
FAIL (2025-10-12 16:52:37 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.164513437s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
6.080742909s
FAIL (2025-10-12 16:51:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.080768578s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
6.498405709s
FAIL (2025-10-12 16:50:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.498452709s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
6.184556888s
FAIL (2025-10-12 16:49:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.18457833s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
6.248128874s
FAIL (2025-10-12 16:49:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.248177838s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
6.435917461s
FAIL (2025-10-12 16:48:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.435976493s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
6.18986457s
FAIL (2025-10-12 16:48:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.189897252s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
6.247681854s
FAIL (2025-10-12 16:47:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.247708984s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
6.403031279s
FAIL (2025-10-12 16:46:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.403060975s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
6.58681478s
FAIL (2025-10-12 16:45:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.586845278s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
6.294348612s
FAIL (2025-10-12 16:45:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.29437801s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
6.239497969s
FAIL (2025-10-12 16:44:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.23952528s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
6.28704075s
FAIL (2025-10-12 16:43:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.287072368s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
6.423945995s
FAIL (2025-10-12 16:43:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.423976383s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
6.310093899s
FAIL (2025-10-12 16:42:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.310207836s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
6.369388865s
FAIL (2025-10-12 16:42:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.369415937s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
6.268041962s
FAIL (2025-10-12 16:41:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.268458986s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
6.128788505s
FAIL (2025-10-12 16:40:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.128817611s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
6.143803632s
FAIL (2025-10-12 16:39:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.143832957s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
6.260469097s
FAIL (2025-10-12 16:39:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.260499654s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
6.02208718s
FAIL (2025-10-12 16:38:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.022116006s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
6.341610835s
FAIL (2025-10-12 16:37:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.341632026s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
6.592030192s
FAIL (2025-10-12 16:37:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.592080799s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
6.176505864s
FAIL (2025-10-12 16:36:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.176633147s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
6.413235783s
FAIL (2025-10-12 16:36:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.41327137s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
6.166053979s
FAIL (2025-10-12 16:35:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.166082664s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
6.452031945s
FAIL (2025-10-12 16:35:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.452056192s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
6.475489087s
FAIL (2025-10-12 16:34:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.475511499s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
6.181354426s
FAIL (2025-10-12 16:33:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.181413107s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
6.688167266s
FAIL (2025-10-12 16:33:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.688192465s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
6.509281262s
FAIL (2025-10-12 16:33:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.509308544s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
6.261546166s
FAIL (2025-10-12 16:32:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.261559802s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001218303s
FAIL (2025-10-12 16:32:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001243451s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
5.914946859s
FAIL (2025-10-12 08:15:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
77730639s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416237166 (449h57m36.878329649s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416461945 (449h57m36.878554428s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416916230 (449h57m36.879008713s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.417375644 (449h57m36.879468127s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418400055 (449h57m36.880492528s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418866062 (449h57m36.880958535s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418979619 (449h57m36.881072102s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419378027 (449h57m36.88147051s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419722002 (449h57m36.881814475s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420558705 (449h57m36.882651188s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420895536 (449h57m36.882988009s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.421204444 (449h57m36.883296917s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.422858264 (449h57m36.884950747s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.423521166 (449h57m36.885613649s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424082044 (449h57m36.886174527s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424779732 (449h57m36.886872215s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:52.786636217 (449h57m38.248728701s) [upload=395866]: Next returned nil segment
Oct 12 07:28:52.786658098 (449h57m38.248750582s) [upload=395866]: Waiting for error group managing segments...
Oct 12 07:28:53.125949247 (449h57m38.58804172s) [noise=true , address=64.49.13.139:4478 , piece_id=HVWUJRHVDFVXOXACMLC6S45IETYUIGYJIRUOKPAPBFB24AJMV6KA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.193237435 (449h57m38.655329908s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.281648515 (449h57m38.743740988s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.290618025 (449h57m38.752710528s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.295090571 (449h57m38.757183044s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.407237007 (449h57m38.86932949s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.410098435 (449h57m38.872190918s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.435342173 (449h57m38.897434646s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.446302454 (449h57m38.908394967s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.449744248 (449h57m38.911836731s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.468040638 (449h57m38.930133111s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.473743357 (449h57m38.93583583s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.480387758 (449h57m38.942480232s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512244629 (449h57m38.974337102s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512311767 (449h57m38.97440424s) [seg_pos={0 0}, upload=395866]: Segment reached optimal threshold of 14 pieces.
Oct 12 07:28:53.512475328 (449h57m38.974567812s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQCT2yf3pZep8VeNBcKma579ot9EfWgaNkXQNofKjHTzdCuoc): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512483894 (449h57m38.974576378s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512591209 (449h57m38.974683692s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512612971 (449h57m38.974705454s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512621867 (449h57m38.97471434s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512646545 (449h57m38.974739028s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512703072 (449h57m38.974795545s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512709154 (449h57m38.974801637s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512738749 (449h57m38.974831233s) [seg_pos={0 0}, upload=395866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 12 07:28:53.512862896 (449h57m38.974955369s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 12 07:28:53.512871603 (449h57m38.974964086s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 12 07:31:22.820504910 (450h0m8.282597403s) [upload=395866]: Done uploading segments...
Oct 12 07:31:22.820535368 (450h0m8.282627851s) [upload=395866]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.914978701s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
5.802893667s
FAIL (2025-10-12 08:14:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
77730639s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416237166 (449h57m36.878329649s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416461945 (449h57m36.878554428s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416916230 (449h57m36.879008713s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.417375644 (449h57m36.879468127s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418400055 (449h57m36.880492528s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418866062 (449h57m36.880958535s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418979619 (449h57m36.881072102s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419378027 (449h57m36.88147051s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419722002 (449h57m36.881814475s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420558705 (449h57m36.882651188s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420895536 (449h57m36.882988009s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.421204444 (449h57m36.883296917s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.422858264 (449h57m36.884950747s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.423521166 (449h57m36.885613649s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424082044 (449h57m36.886174527s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424779732 (449h57m36.886872215s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:52.786636217 (449h57m38.248728701s) [upload=395866]: Next returned nil segment
Oct 12 07:28:52.786658098 (449h57m38.248750582s) [upload=395866]: Waiting for error group managing segments...
Oct 12 07:28:53.125949247 (449h57m38.58804172s) [noise=true , address=64.49.13.139:4478 , piece_id=HVWUJRHVDFVXOXACMLC6S45IETYUIGYJIRUOKPAPBFB24AJMV6KA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.193237435 (449h57m38.655329908s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.281648515 (449h57m38.743740988s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.290618025 (449h57m38.752710528s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.295090571 (449h57m38.757183044s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.407237007 (449h57m38.86932949s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.410098435 (449h57m38.872190918s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.435342173 (449h57m38.897434646s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.446302454 (449h57m38.908394967s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.449744248 (449h57m38.911836731s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.468040638 (449h57m38.930133111s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.473743357 (449h57m38.93583583s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.480387758 (449h57m38.942480232s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512244629 (449h57m38.974337102s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512311767 (449h57m38.97440424s) [seg_pos={0 0}, upload=395866]: Segment reached optimal threshold of 14 pieces.
Oct 12 07:28:53.512475328 (449h57m38.974567812s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQCT2yf3pZep8VeNBcKma579ot9EfWgaNkXQNofKjHTzdCuoc): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512483894 (449h57m38.974576378s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512591209 (449h57m38.974683692s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512612971 (449h57m38.974705454s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512621867 (449h57m38.97471434s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512646545 (449h57m38.974739028s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512703072 (449h57m38.974795545s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512709154 (449h57m38.974801637s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512738749 (449h57m38.974831233s) [seg_pos={0 0}, upload=395866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 12 07:28:53.512862896 (449h57m38.974955369s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 12 07:28:53.512871603 (449h57m38.974964086s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 12 07:31:22.820504910 (450h0m8.282597403s) [upload=395866]: Done uploading segments...
Oct 12 07:31:22.820535368 (450h0m8.282627851s) [upload=395866]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.802922462s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
5.779287779s
FAIL (2025-10-12 08:13:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
77730639s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416237166 (449h57m36.878329649s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416461945 (449h57m36.878554428s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416916230 (449h57m36.879008713s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.417375644 (449h57m36.879468127s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418400055 (449h57m36.880492528s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418866062 (449h57m36.880958535s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418979619 (449h57m36.881072102s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419378027 (449h57m36.88147051s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419722002 (449h57m36.881814475s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420558705 (449h57m36.882651188s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420895536 (449h57m36.882988009s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.421204444 (449h57m36.883296917s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.422858264 (449h57m36.884950747s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.423521166 (449h57m36.885613649s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424082044 (449h57m36.886174527s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424779732 (449h57m36.886872215s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:52.786636217 (449h57m38.248728701s) [upload=395866]: Next returned nil segment
Oct 12 07:28:52.786658098 (449h57m38.248750582s) [upload=395866]: Waiting for error group managing segments...
Oct 12 07:28:53.125949247 (449h57m38.58804172s) [noise=true , address=64.49.13.139:4478 , piece_id=HVWUJRHVDFVXOXACMLC6S45IETYUIGYJIRUOKPAPBFB24AJMV6KA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.193237435 (449h57m38.655329908s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.281648515 (449h57m38.743740988s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.290618025 (449h57m38.752710528s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.295090571 (449h57m38.757183044s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.407237007 (449h57m38.86932949s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.410098435 (449h57m38.872190918s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.435342173 (449h57m38.897434646s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.446302454 (449h57m38.908394967s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.449744248 (449h57m38.911836731s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.468040638 (449h57m38.930133111s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.473743357 (449h57m38.93583583s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.480387758 (449h57m38.942480232s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512244629 (449h57m38.974337102s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512311767 (449h57m38.97440424s) [seg_pos={0 0}, upload=395866]: Segment reached optimal threshold of 14 pieces.
Oct 12 07:28:53.512475328 (449h57m38.974567812s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQCT2yf3pZep8VeNBcKma579ot9EfWgaNkXQNofKjHTzdCuoc): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512483894 (449h57m38.974576378s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512591209 (449h57m38.974683692s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512612971 (449h57m38.974705454s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512621867 (449h57m38.97471434s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512646545 (449h57m38.974739028s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512703072 (449h57m38.974795545s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512709154 (449h57m38.974801637s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512738749 (449h57m38.974831233s) [seg_pos={0 0}, upload=395866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 12 07:28:53.512862896 (449h57m38.974955369s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 12 07:28:53.512871603 (449h57m38.974964086s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 12 07:31:22.820504910 (450h0m8.282597403s) [upload=395866]: Done uploading segments...
Oct 12 07:31:22.820535368 (450h0m8.282627851s) [upload=395866]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.779312886s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
6.177165771s
FAIL (2025-10-12 08:12:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
77730639s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416237166 (449h57m36.878329649s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416461945 (449h57m36.878554428s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416916230 (449h57m36.879008713s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.417375644 (449h57m36.879468127s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418400055 (449h57m36.880492528s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418866062 (449h57m36.880958535s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418979619 (449h57m36.881072102s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419378027 (449h57m36.88147051s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419722002 (449h57m36.881814475s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420558705 (449h57m36.882651188s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420895536 (449h57m36.882988009s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.421204444 (449h57m36.883296917s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.422858264 (449h57m36.884950747s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.423521166 (449h57m36.885613649s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424082044 (449h57m36.886174527s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424779732 (449h57m36.886872215s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:52.786636217 (449h57m38.248728701s) [upload=395866]: Next returned nil segment
Oct 12 07:28:52.786658098 (449h57m38.248750582s) [upload=395866]: Waiting for error group managing segments...
Oct 12 07:28:53.125949247 (449h57m38.58804172s) [noise=true , address=64.49.13.139:4478 , piece_id=HVWUJRHVDFVXOXACMLC6S45IETYUIGYJIRUOKPAPBFB24AJMV6KA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.193237435 (449h57m38.655329908s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.281648515 (449h57m38.743740988s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.290618025 (449h57m38.752710528s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.295090571 (449h57m38.757183044s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.407237007 (449h57m38.86932949s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.410098435 (449h57m38.872190918s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.435342173 (449h57m38.897434646s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.446302454 (449h57m38.908394967s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.449744248 (449h57m38.911836731s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.468040638 (449h57m38.930133111s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.473743357 (449h57m38.93583583s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.480387758 (449h57m38.942480232s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512244629 (449h57m38.974337102s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512311767 (449h57m38.97440424s) [seg_pos={0 0}, upload=395866]: Segment reached optimal threshold of 14 pieces.
Oct 12 07:28:53.512475328 (449h57m38.974567812s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQCT2yf3pZep8VeNBcKma579ot9EfWgaNkXQNofKjHTzdCuoc): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512483894 (449h57m38.974576378s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512591209 (449h57m38.974683692s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512612971 (449h57m38.974705454s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512621867 (449h57m38.97471434s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512646545 (449h57m38.974739028s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512703072 (449h57m38.974795545s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512709154 (449h57m38.974801637s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512738749 (449h57m38.974831233s) [seg_pos={0 0}, upload=395866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 12 07:28:53.512862896 (449h57m38.974955369s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 12 07:28:53.512871603 (449h57m38.974964086s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 12 07:31:22.820504910 (450h0m8.282597403s) [upload=395866]: Done uploading segments...
Oct 12 07:31:22.820535368 (450h0m8.282627851s) [upload=395866]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.177204575s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
5.790476743s
FAIL (2025-10-12 08:11:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
77730639s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416237166 (449h57m36.878329649s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416461945 (449h57m36.878554428s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416916230 (449h57m36.879008713s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.417375644 (449h57m36.879468127s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418400055 (449h57m36.880492528s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418866062 (449h57m36.880958535s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418979619 (449h57m36.881072102s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419378027 (449h57m36.88147051s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419722002 (449h57m36.881814475s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420558705 (449h57m36.882651188s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420895536 (449h57m36.882988009s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.421204444 (449h57m36.883296917s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.422858264 (449h57m36.884950747s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.423521166 (449h57m36.885613649s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424082044 (449h57m36.886174527s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424779732 (449h57m36.886872215s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:52.786636217 (449h57m38.248728701s) [upload=395866]: Next returned nil segment
Oct 12 07:28:52.786658098 (449h57m38.248750582s) [upload=395866]: Waiting for error group managing segments...
Oct 12 07:28:53.125949247 (449h57m38.58804172s) [noise=true , address=64.49.13.139:4478 , piece_id=HVWUJRHVDFVXOXACMLC6S45IETYUIGYJIRUOKPAPBFB24AJMV6KA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.193237435 (449h57m38.655329908s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.281648515 (449h57m38.743740988s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.290618025 (449h57m38.752710528s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.295090571 (449h57m38.757183044s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.407237007 (449h57m38.86932949s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.410098435 (449h57m38.872190918s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.435342173 (449h57m38.897434646s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.446302454 (449h57m38.908394967s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.449744248 (449h57m38.911836731s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.468040638 (449h57m38.930133111s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.473743357 (449h57m38.93583583s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.480387758 (449h57m38.942480232s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512244629 (449h57m38.974337102s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512311767 (449h57m38.97440424s) [seg_pos={0 0}, upload=395866]: Segment reached optimal threshold of 14 pieces.
Oct 12 07:28:53.512475328 (449h57m38.974567812s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQCT2yf3pZep8VeNBcKma579ot9EfWgaNkXQNofKjHTzdCuoc): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512483894 (449h57m38.974576378s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512591209 (449h57m38.974683692s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512612971 (449h57m38.974705454s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512621867 (449h57m38.97471434s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512646545 (449h57m38.974739028s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512703072 (449h57m38.974795545s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512709154 (449h57m38.974801637s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512738749 (449h57m38.974831233s) [seg_pos={0 0}, upload=395866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 12 07:28:53.512862896 (449h57m38.974955369s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 12 07:28:53.512871603 (449h57m38.974964086s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 12 07:31:22.820504910 (450h0m8.282597403s) [upload=395866]: Done uploading segments...
Oct 12 07:31:22.820535368 (450h0m8.282627851s) [upload=395866]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.790508855s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
5.991591654s
FAIL (2025-10-12 08:10:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
77730639s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416237166 (449h57m36.878329649s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416461945 (449h57m36.878554428s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416916230 (449h57m36.879008713s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.417375644 (449h57m36.879468127s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418400055 (449h57m36.880492528s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418866062 (449h57m36.880958535s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418979619 (449h57m36.881072102s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419378027 (449h57m36.88147051s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419722002 (449h57m36.881814475s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420558705 (449h57m36.882651188s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420895536 (449h57m36.882988009s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.421204444 (449h57m36.883296917s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.422858264 (449h57m36.884950747s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.423521166 (449h57m36.885613649s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424082044 (449h57m36.886174527s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424779732 (449h57m36.886872215s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:52.786636217 (449h57m38.248728701s) [upload=395866]: Next returned nil segment
Oct 12 07:28:52.786658098 (449h57m38.248750582s) [upload=395866]: Waiting for error group managing segments...
Oct 12 07:28:53.125949247 (449h57m38.58804172s) [noise=true , address=64.49.13.139:4478 , piece_id=HVWUJRHVDFVXOXACMLC6S45IETYUIGYJIRUOKPAPBFB24AJMV6KA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.193237435 (449h57m38.655329908s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.281648515 (449h57m38.743740988s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.290618025 (449h57m38.752710528s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.295090571 (449h57m38.757183044s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.407237007 (449h57m38.86932949s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.410098435 (449h57m38.872190918s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.435342173 (449h57m38.897434646s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.446302454 (449h57m38.908394967s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.449744248 (449h57m38.911836731s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.468040638 (449h57m38.930133111s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.473743357 (449h57m38.93583583s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.480387758 (449h57m38.942480232s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512244629 (449h57m38.974337102s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512311767 (449h57m38.97440424s) [seg_pos={0 0}, upload=395866]: Segment reached optimal threshold of 14 pieces.
Oct 12 07:28:53.512475328 (449h57m38.974567812s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQCT2yf3pZep8VeNBcKma579ot9EfWgaNkXQNofKjHTzdCuoc): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512483894 (449h57m38.974576378s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512591209 (449h57m38.974683692s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512612971 (449h57m38.974705454s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512621867 (449h57m38.97471434s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512646545 (449h57m38.974739028s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512703072 (449h57m38.974795545s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512709154 (449h57m38.974801637s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512738749 (449h57m38.974831233s) [seg_pos={0 0}, upload=395866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 12 07:28:53.512862896 (449h57m38.974955369s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 12 07:28:53.512871603 (449h57m38.974964086s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 12 07:31:22.820504910 (450h0m8.282597403s) [upload=395866]: Done uploading segments...
Oct 12 07:31:22.820535368 (450h0m8.282627851s) [upload=395866]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.991627644s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
6.09357682s
FAIL (2025-10-12 08:09:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
77730639s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416237166 (449h57m36.878329649s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416461945 (449h57m36.878554428s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416916230 (449h57m36.879008713s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.417375644 (449h57m36.879468127s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418400055 (449h57m36.880492528s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418866062 (449h57m36.880958535s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418979619 (449h57m36.881072102s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419378027 (449h57m36.88147051s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419722002 (449h57m36.881814475s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420558705 (449h57m36.882651188s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420895536 (449h57m36.882988009s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.421204444 (449h57m36.883296917s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.422858264 (449h57m36.884950747s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.423521166 (449h57m36.885613649s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424082044 (449h57m36.886174527s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424779732 (449h57m36.886872215s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:52.786636217 (449h57m38.248728701s) [upload=395866]: Next returned nil segment
Oct 12 07:28:52.786658098 (449h57m38.248750582s) [upload=395866]: Waiting for error group managing segments...
Oct 12 07:28:53.125949247 (449h57m38.58804172s) [noise=true , address=64.49.13.139:4478 , piece_id=HVWUJRHVDFVXOXACMLC6S45IETYUIGYJIRUOKPAPBFB24AJMV6KA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.193237435 (449h57m38.655329908s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.281648515 (449h57m38.743740988s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.290618025 (449h57m38.752710528s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.295090571 (449h57m38.757183044s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.407237007 (449h57m38.86932949s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.410098435 (449h57m38.872190918s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.435342173 (449h57m38.897434646s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.446302454 (449h57m38.908394967s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.449744248 (449h57m38.911836731s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.468040638 (449h57m38.930133111s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.473743357 (449h57m38.93583583s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.480387758 (449h57m38.942480232s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512244629 (449h57m38.974337102s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512311767 (449h57m38.97440424s) [seg_pos={0 0}, upload=395866]: Segment reached optimal threshold of 14 pieces.
Oct 12 07:28:53.512475328 (449h57m38.974567812s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQCT2yf3pZep8VeNBcKma579ot9EfWgaNkXQNofKjHTzdCuoc): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512483894 (449h57m38.974576378s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512591209 (449h57m38.974683692s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512612971 (449h57m38.974705454s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512621867 (449h57m38.97471434s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512646545 (449h57m38.974739028s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512703072 (449h57m38.974795545s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512709154 (449h57m38.974801637s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512738749 (449h57m38.974831233s) [seg_pos={0 0}, upload=395866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 12 07:28:53.512862896 (449h57m38.974955369s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 12 07:28:53.512871603 (449h57m38.974964086s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 12 07:31:22.820504910 (450h0m8.282597403s) [upload=395866]: Done uploading segments...
Oct 12 07:31:22.820535368 (450h0m8.282627851s) [upload=395866]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.09360827s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
6.243768543s
FAIL (2025-10-12 08:09:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
77730639s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416237166 (449h57m36.878329649s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416461945 (449h57m36.878554428s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416916230 (449h57m36.879008713s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.417375644 (449h57m36.879468127s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418400055 (449h57m36.880492528s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418866062 (449h57m36.880958535s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418979619 (449h57m36.881072102s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419378027 (449h57m36.88147051s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419722002 (449h57m36.881814475s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420558705 (449h57m36.882651188s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420895536 (449h57m36.882988009s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.421204444 (449h57m36.883296917s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.422858264 (449h57m36.884950747s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.423521166 (449h57m36.885613649s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424082044 (449h57m36.886174527s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424779732 (449h57m36.886872215s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:52.786636217 (449h57m38.248728701s) [upload=395866]: Next returned nil segment
Oct 12 07:28:52.786658098 (449h57m38.248750582s) [upload=395866]: Waiting for error group managing segments...
Oct 12 07:28:53.125949247 (449h57m38.58804172s) [noise=true , address=64.49.13.139:4478 , piece_id=HVWUJRHVDFVXOXACMLC6S45IETYUIGYJIRUOKPAPBFB24AJMV6KA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.193237435 (449h57m38.655329908s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.281648515 (449h57m38.743740988s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.290618025 (449h57m38.752710528s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.295090571 (449h57m38.757183044s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.407237007 (449h57m38.86932949s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.410098435 (449h57m38.872190918s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.435342173 (449h57m38.897434646s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.446302454 (449h57m38.908394967s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.449744248 (449h57m38.911836731s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.468040638 (449h57m38.930133111s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.473743357 (449h57m38.93583583s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.480387758 (449h57m38.942480232s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512244629 (449h57m38.974337102s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512311767 (449h57m38.97440424s) [seg_pos={0 0}, upload=395866]: Segment reached optimal threshold of 14 pieces.
Oct 12 07:28:53.512475328 (449h57m38.974567812s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQCT2yf3pZep8VeNBcKma579ot9EfWgaNkXQNofKjHTzdCuoc): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512483894 (449h57m38.974576378s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512591209 (449h57m38.974683692s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512612971 (449h57m38.974705454s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512621867 (449h57m38.97471434s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512646545 (449h57m38.974739028s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512703072 (449h57m38.974795545s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512709154 (449h57m38.974801637s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512738749 (449h57m38.974831233s) [seg_pos={0 0}, upload=395866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 12 07:28:53.512862896 (449h57m38.974955369s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 12 07:28:53.512871603 (449h57m38.974964086s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 12 07:31:22.820504910 (450h0m8.282597403s) [upload=395866]: Done uploading segments...
Oct 12 07:31:22.820535368 (450h0m8.282627851s) [upload=395866]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.243804271s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
5.889368299s
FAIL (2025-10-12 08:08:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
77730639s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416237166 (449h57m36.878329649s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416461945 (449h57m36.878554428s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416916230 (449h57m36.879008713s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.417375644 (449h57m36.879468127s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418400055 (449h57m36.880492528s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418866062 (449h57m36.880958535s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418979619 (449h57m36.881072102s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419378027 (449h57m36.88147051s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419722002 (449h57m36.881814475s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420558705 (449h57m36.882651188s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420895536 (449h57m36.882988009s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.421204444 (449h57m36.883296917s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.422858264 (449h57m36.884950747s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.423521166 (449h57m36.885613649s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424082044 (449h57m36.886174527s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424779732 (449h57m36.886872215s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:52.786636217 (449h57m38.248728701s) [upload=395866]: Next returned nil segment
Oct 12 07:28:52.786658098 (449h57m38.248750582s) [upload=395866]: Waiting for error group managing segments...
Oct 12 07:28:53.125949247 (449h57m38.58804172s) [noise=true , address=64.49.13.139:4478 , piece_id=HVWUJRHVDFVXOXACMLC6S45IETYUIGYJIRUOKPAPBFB24AJMV6KA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.193237435 (449h57m38.655329908s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.281648515 (449h57m38.743740988s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.290618025 (449h57m38.752710528s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.295090571 (449h57m38.757183044s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.407237007 (449h57m38.86932949s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.410098435 (449h57m38.872190918s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.435342173 (449h57m38.897434646s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.446302454 (449h57m38.908394967s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.449744248 (449h57m38.911836731s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.468040638 (449h57m38.930133111s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.473743357 (449h57m38.93583583s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.480387758 (449h57m38.942480232s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512244629 (449h57m38.974337102s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512311767 (449h57m38.97440424s) [seg_pos={0 0}, upload=395866]: Segment reached optimal threshold of 14 pieces.
Oct 12 07:28:53.512475328 (449h57m38.974567812s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQCT2yf3pZep8VeNBcKma579ot9EfWgaNkXQNofKjHTzdCuoc): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512483894 (449h57m38.974576378s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512591209 (449h57m38.974683692s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512612971 (449h57m38.974705454s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512621867 (449h57m38.97471434s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512646545 (449h57m38.974739028s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512703072 (449h57m38.974795545s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512709154 (449h57m38.974801637s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512738749 (449h57m38.974831233s) [seg_pos={0 0}, upload=395866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 12 07:28:53.512862896 (449h57m38.974955369s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 12 07:28:53.512871603 (449h57m38.974964086s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 12 07:31:22.820504910 (450h0m8.282597403s) [upload=395866]: Done uploading segments...
Oct 12 07:31:22.820535368 (450h0m8.282627851s) [upload=395866]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.889402305s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
6.082032368s
FAIL (2025-10-12 08:08:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
77730639s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416237166 (449h57m36.878329649s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416461945 (449h57m36.878554428s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416916230 (449h57m36.879008713s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.417375644 (449h57m36.879468127s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418400055 (449h57m36.880492528s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418866062 (449h57m36.880958535s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418979619 (449h57m36.881072102s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419378027 (449h57m36.88147051s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419722002 (449h57m36.881814475s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420558705 (449h57m36.882651188s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420895536 (449h57m36.882988009s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.421204444 (449h57m36.883296917s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.422858264 (449h57m36.884950747s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.423521166 (449h57m36.885613649s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424082044 (449h57m36.886174527s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424779732 (449h57m36.886872215s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:52.786636217 (449h57m38.248728701s) [upload=395866]: Next returned nil segment
Oct 12 07:28:52.786658098 (449h57m38.248750582s) [upload=395866]: Waiting for error group managing segments...
Oct 12 07:28:53.125949247 (449h57m38.58804172s) [noise=true , address=64.49.13.139:4478 , piece_id=HVWUJRHVDFVXOXACMLC6S45IETYUIGYJIRUOKPAPBFB24AJMV6KA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.193237435 (449h57m38.655329908s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.281648515 (449h57m38.743740988s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.290618025 (449h57m38.752710528s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.295090571 (449h57m38.757183044s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.407237007 (449h57m38.86932949s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.410098435 (449h57m38.872190918s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.435342173 (449h57m38.897434646s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.446302454 (449h57m38.908394967s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.449744248 (449h57m38.911836731s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.468040638 (449h57m38.930133111s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.473743357 (449h57m38.93583583s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.480387758 (449h57m38.942480232s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512244629 (449h57m38.974337102s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512311767 (449h57m38.97440424s) [seg_pos={0 0}, upload=395866]: Segment reached optimal threshold of 14 pieces.
Oct 12 07:28:53.512475328 (449h57m38.974567812s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQCT2yf3pZep8VeNBcKma579ot9EfWgaNkXQNofKjHTzdCuoc): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512483894 (449h57m38.974576378s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512591209 (449h57m38.974683692s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512612971 (449h57m38.974705454s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512621867 (449h57m38.97471434s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512646545 (449h57m38.974739028s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512703072 (449h57m38.974795545s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512709154 (449h57m38.974801637s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512738749 (449h57m38.974831233s) [seg_pos={0 0}, upload=395866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 12 07:28:53.512862896 (449h57m38.974955369s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 12 07:28:53.512871603 (449h57m38.974964086s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 12 07:31:22.820504910 (450h0m8.282597403s) [upload=395866]: Done uploading segments...
Oct 12 07:31:22.820535368 (450h0m8.282627851s) [upload=395866]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.082063436s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
5.982230386s
FAIL (2025-10-12 08:06:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
77730639s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416237166 (449h57m36.878329649s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416461945 (449h57m36.878554428s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416916230 (449h57m36.879008713s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.417375644 (449h57m36.879468127s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418400055 (449h57m36.880492528s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418866062 (449h57m36.880958535s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418979619 (449h57m36.881072102s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419378027 (449h57m36.88147051s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419722002 (449h57m36.881814475s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420558705 (449h57m36.882651188s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420895536 (449h57m36.882988009s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.421204444 (449h57m36.883296917s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.422858264 (449h57m36.884950747s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.423521166 (449h57m36.885613649s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424082044 (449h57m36.886174527s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424779732 (449h57m36.886872215s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:52.786636217 (449h57m38.248728701s) [upload=395866]: Next returned nil segment
Oct 12 07:28:52.786658098 (449h57m38.248750582s) [upload=395866]: Waiting for error group managing segments...
Oct 12 07:28:53.125949247 (449h57m38.58804172s) [noise=true , address=64.49.13.139:4478 , piece_id=HVWUJRHVDFVXOXACMLC6S45IETYUIGYJIRUOKPAPBFB24AJMV6KA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.193237435 (449h57m38.655329908s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.281648515 (449h57m38.743740988s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.290618025 (449h57m38.752710528s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.295090571 (449h57m38.757183044s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.407237007 (449h57m38.86932949s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.410098435 (449h57m38.872190918s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.435342173 (449h57m38.897434646s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.446302454 (449h57m38.908394967s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.449744248 (449h57m38.911836731s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.468040638 (449h57m38.930133111s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.473743357 (449h57m38.93583583s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.480387758 (449h57m38.942480232s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512244629 (449h57m38.974337102s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512311767 (449h57m38.97440424s) [seg_pos={0 0}, upload=395866]: Segment reached optimal threshold of 14 pieces.
Oct 12 07:28:53.512475328 (449h57m38.974567812s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQCT2yf3pZep8VeNBcKma579ot9EfWgaNkXQNofKjHTzdCuoc): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512483894 (449h57m38.974576378s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512591209 (449h57m38.974683692s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512612971 (449h57m38.974705454s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512621867 (449h57m38.97471434s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512646545 (449h57m38.974739028s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512703072 (449h57m38.974795545s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512709154 (449h57m38.974801637s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512738749 (449h57m38.974831233s) [seg_pos={0 0}, upload=395866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 12 07:28:53.512862896 (449h57m38.974955369s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 12 07:28:53.512871603 (449h57m38.974964086s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 12 07:31:22.820504910 (450h0m8.282597403s) [upload=395866]: Done uploading segments...
Oct 12 07:31:22.820535368 (450h0m8.282627851s) [upload=395866]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.98227424s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
6.259004255s
FAIL (2025-10-12 08:05:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
77730639s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416237166 (449h57m36.878329649s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416461945 (449h57m36.878554428s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416916230 (449h57m36.879008713s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.417375644 (449h57m36.879468127s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418400055 (449h57m36.880492528s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418866062 (449h57m36.880958535s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418979619 (449h57m36.881072102s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419378027 (449h57m36.88147051s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419722002 (449h57m36.881814475s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420558705 (449h57m36.882651188s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420895536 (449h57m36.882988009s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.421204444 (449h57m36.883296917s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.422858264 (449h57m36.884950747s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.423521166 (449h57m36.885613649s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424082044 (449h57m36.886174527s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424779732 (449h57m36.886872215s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:52.786636217 (449h57m38.248728701s) [upload=395866]: Next returned nil segment
Oct 12 07:28:52.786658098 (449h57m38.248750582s) [upload=395866]: Waiting for error group managing segments...
Oct 12 07:28:53.125949247 (449h57m38.58804172s) [noise=true , address=64.49.13.139:4478 , piece_id=HVWUJRHVDFVXOXACMLC6S45IETYUIGYJIRUOKPAPBFB24AJMV6KA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.193237435 (449h57m38.655329908s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.281648515 (449h57m38.743740988s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.290618025 (449h57m38.752710528s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.295090571 (449h57m38.757183044s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.407237007 (449h57m38.86932949s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.410098435 (449h57m38.872190918s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.435342173 (449h57m38.897434646s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.446302454 (449h57m38.908394967s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.449744248 (449h57m38.911836731s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.468040638 (449h57m38.930133111s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.473743357 (449h57m38.93583583s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.480387758 (449h57m38.942480232s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512244629 (449h57m38.974337102s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512311767 (449h57m38.97440424s) [seg_pos={0 0}, upload=395866]: Segment reached optimal threshold of 14 pieces.
Oct 12 07:28:53.512475328 (449h57m38.974567812s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQCT2yf3pZep8VeNBcKma579ot9EfWgaNkXQNofKjHTzdCuoc): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512483894 (449h57m38.974576378s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512591209 (449h57m38.974683692s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512612971 (449h57m38.974705454s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512621867 (449h57m38.97471434s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512646545 (449h57m38.974739028s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512703072 (449h57m38.974795545s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512709154 (449h57m38.974801637s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512738749 (449h57m38.974831233s) [seg_pos={0 0}, upload=395866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 12 07:28:53.512862896 (449h57m38.974955369s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 12 07:28:53.512871603 (449h57m38.974964086s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 12 07:31:22.820504910 (450h0m8.282597403s) [upload=395866]: Done uploading segments...
Oct 12 07:31:22.820535368 (450h0m8.282627851s) [upload=395866]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.259064821s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
5.937725984s
FAIL (2025-10-12 08:05:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
77730639s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416237166 (449h57m36.878329649s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416461945 (449h57m36.878554428s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416916230 (449h57m36.879008713s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.417375644 (449h57m36.879468127s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418400055 (449h57m36.880492528s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418866062 (449h57m36.880958535s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418979619 (449h57m36.881072102s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419378027 (449h57m36.88147051s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419722002 (449h57m36.881814475s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420558705 (449h57m36.882651188s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420895536 (449h57m36.882988009s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.421204444 (449h57m36.883296917s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.422858264 (449h57m36.884950747s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.423521166 (449h57m36.885613649s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424082044 (449h57m36.886174527s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424779732 (449h57m36.886872215s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:52.786636217 (449h57m38.248728701s) [upload=395866]: Next returned nil segment
Oct 12 07:28:52.786658098 (449h57m38.248750582s) [upload=395866]: Waiting for error group managing segments...
Oct 12 07:28:53.125949247 (449h57m38.58804172s) [noise=true , address=64.49.13.139:4478 , piece_id=HVWUJRHVDFVXOXACMLC6S45IETYUIGYJIRUOKPAPBFB24AJMV6KA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.193237435 (449h57m38.655329908s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.281648515 (449h57m38.743740988s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.290618025 (449h57m38.752710528s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.295090571 (449h57m38.757183044s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.407237007 (449h57m38.86932949s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.410098435 (449h57m38.872190918s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.435342173 (449h57m38.897434646s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.446302454 (449h57m38.908394967s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.449744248 (449h57m38.911836731s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.468040638 (449h57m38.930133111s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.473743357 (449h57m38.93583583s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.480387758 (449h57m38.942480232s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512244629 (449h57m38.974337102s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512311767 (449h57m38.97440424s) [seg_pos={0 0}, upload=395866]: Segment reached optimal threshold of 14 pieces.
Oct 12 07:28:53.512475328 (449h57m38.974567812s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQCT2yf3pZep8VeNBcKma579ot9EfWgaNkXQNofKjHTzdCuoc): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512483894 (449h57m38.974576378s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512591209 (449h57m38.974683692s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512612971 (449h57m38.974705454s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512621867 (449h57m38.97471434s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512646545 (449h57m38.974739028s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512703072 (449h57m38.974795545s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512709154 (449h57m38.974801637s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512738749 (449h57m38.974831233s) [seg_pos={0 0}, upload=395866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 12 07:28:53.512862896 (449h57m38.974955369s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 12 07:28:53.512871603 (449h57m38.974964086s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 12 07:31:22.820504910 (450h0m8.282597403s) [upload=395866]: Done uploading segments...
Oct 12 07:31:22.820535368 (450h0m8.282627851s) [upload=395866]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.937758766s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
6.275832838s
FAIL (2025-10-12 08:04:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
77730639s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416237166 (449h57m36.878329649s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416461945 (449h57m36.878554428s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.416916230 (449h57m36.879008713s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.417375644 (449h57m36.879468127s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418400055 (449h57m36.880492528s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418866062 (449h57m36.880958535s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.418979619 (449h57m36.881072102s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419378027 (449h57m36.88147051s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.419722002 (449h57m36.881814475s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420558705 (449h57m36.882651188s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.420895536 (449h57m36.882988009s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.421204444 (449h57m36.883296917s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.422858264 (449h57m36.884950747s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.423521166 (449h57m36.885613649s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424082044 (449h57m36.886174527s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:51.424779732 (449h57m36.886872215s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Uploading piece...
Oct 12 07:28:52.786636217 (449h57m38.248728701s) [upload=395866]: Next returned nil segment
Oct 12 07:28:52.786658098 (449h57m38.248750582s) [upload=395866]: Waiting for error group managing segments...
Oct 12 07:28:53.125949247 (449h57m38.58804172s) [noise=true , address=64.49.13.139:4478 , piece_id=HVWUJRHVDFVXOXACMLC6S45IETYUIGYJIRUOKPAPBFB24AJMV6KA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.193237435 (449h57m38.655329908s) [noise=true , address=64.49.13.138:4487 , piece_id=U33EDVLL4EWXXYKHJORKQT5IPITCRHTSHX5O3XPRT7XNBOUVC2ZA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.281648515 (449h57m38.743740988s) [noise=true , address=145.79.227.52:4465 , piece_id=4I4HG5NO3ENHIUHNATI76ZJJ7H3TN6ZN3WBHTCOQEEZNUJUOEQSA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.290618025 (449h57m38.752710528s) [noise=true , address=145.79.227.49:4367 , piece_id=TOIU4HYKJQC5RJUMAVI7C3XR6KXU3YL776CWN6JXYWJ4P5WX65KQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.295090571 (449h57m38.757183044s) [noise=true , address=145.79.227.35:4499 , piece_id=6OBKKQN4QVX7KRGUKWLVFFFD5D5FUJ63T43TBVG2VJ3IS2AOZIDQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.407237007 (449h57m38.86932949s) [noise=true , address=45.91.116.13:4173 , piece_id=F55RKFNMQ4DP3XKTYDVHA7GNCFBJLXJLKWKG7SAKKXUYDJ2EFTOQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.410098435 (449h57m38.872190918s) [noise=true , address=45.91.116.8:4050 , piece_id=O4PTDNWNEOR4XJRWB6JURLIT73DCRC6WMEO4TWE2RLVRJNE445AQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.435342173 (449h57m38.897434646s) [noise=true , address=77.90.31.12:4605 , piece_id=6II3C4XJTZYCQMBLY5MVRFLKLHTIPOODQLYNI4F626BGHOZOAEBA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.446302454 (449h57m38.908394967s) [noise=true , address=45.91.116.7:4031 , piece_id=E6O2L7EQAFBKEKVE7IQBUZRGWNQI4DHBUWYAKHLAQ635GZ6JUTUA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.449744248 (449h57m38.911836731s) [noise=true , address=45.91.116.6:4995 , piece_id=ZV53CRRZMTP7L4LABA2Z6PVNPDJMOMVFEFAI3CWMS5K35RZ3CYIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.468040638 (449h57m38.930133111s) [noise=true , address=77.90.31.10:4540 , piece_id=CWKJYN2J46XP6BZIHR7CA72JOGL4E4CDUDDLP3676GKRNZWXFGIA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.473743357 (449h57m38.93583583s) [noise=true , address=45.91.116.12:4242 , piece_id=QCNPWTUODSXMSOIZC76NFPVNTINHLFO5YIECW6APBLWM5TSHG45A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.480387758 (449h57m38.942480232s) [noise=true , address=77.90.31.17:4801 , piece_id=5S6JFFEKPI24LBUAI74GSC2CEGBUFMVRYPZS5ISGVSGWCANQLOPA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512244629 (449h57m38.974337102s) [noise=true , address=45.91.116.10:4102 , piece_id=OYXOG34E7T5RTE6PEL4QFDR5JRY46STZ3PBQYJS3C6MCO5P7SGTA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: <nil>
Oct 12 07:28:53.512311767 (449h57m38.97440424s) [seg_pos={0 0}, upload=395866]: Segment reached optimal threshold of 14 pieces.
Oct 12 07:28:53.512475328 (449h57m38.974567812s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQCT2yf3pZep8VeNBcKma579ot9EfWgaNkXQNofKjHTzdCuoc): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512483894 (449h57m38.974576378s) [noise=true , address=77.90.31.11:4575 , piece_id=BF3VNSBOZSXRJSK2DK4QB3KY73P3IZIKGMCU2BGYLO7SNXNANUOA, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512591209 (449h57m38.974683692s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512612971 (449h57m38.974705454s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512621867 (449h57m38.97471434s) [noise=true , address=77.90.31.14:4664 , piece_id=T3LLQNMNZCECGESCMXYXAHIAK67LONR6VMYP6RKKGHK4MD6Q2ITQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512646545 (449h57m38.974739028s) [noise=true , address=77.90.31.15:4727 , piece_id=NAPUST6O53HNISWR6CSGX2L2VSZFYYO5P7N2HNEQMIZB7PH4T52A, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512703072 (449h57m38.974795545s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Oct 12 07:28:53.512709154 (449h57m38.974801637s) [noise=true , address=77.90.31.16:4767 , piece_id=RKNWM4BZ7Q4NE7CMKUI3AAF5DF3SPIZUYF3USU7Z36TAXSZDPNJQ, seg_pos={0 0}, upload=395866]: Long tail cancellation due to optimal threshold
Oct 12 07:28:53.512738749 (449h57m38.974831233s) [seg_pos={0 0}, upload=395866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 12 07:28:53.512862896 (449h57m38.974955369s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 12 07:28:53.512871603 (449h57m38.974964086s) [upload=395866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 12 07:31:22.820504910 (450h0m8.282597403s) [upload=395866]: Done uploading segments...
Oct 12 07:31:22.820535368 (450h0m8.282627851s) [upload=395866]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.275870019s
core
uplink
us-select-1
us1-placement-20
|