Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
4.813501019s
FAIL (2025-07-07 20:48:19 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.813523802s
core
uplink
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
5.545415427s
FAIL (2025-07-07 20:48:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.545437111s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.524651321s
FAIL (2025-07-07 20:47:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.524683552s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
5.044751532s
FAIL (2025-07-07 20:47:05 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.044778544s
core
uplink
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.474527143s
FAIL (2025-07-07 20:46:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.474554163s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
5.100974209s
FAIL (2025-07-07 20:46:34 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.101004537s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
4.89050401s
FAIL (2025-07-07 20:46:19 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.890532666s
core
uplink
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.580924036s
FAIL (2025-07-07 20:45:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.580944817s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
4.913690776s
FAIL (2025-07-07 20:45:17 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.913713419s
core
uplink
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.482239665s
FAIL (2025-07-07 20:44:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.482264161s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
4.955344843s
FAIL (2025-07-07 20:44:44 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.955371703s
core
uplink
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
5.422259584s
FAIL (2025-07-07 20:44:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.422302186s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000998228s
FAIL (2025-07-07 20:44:21 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 30.001021131s
core
uplink
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
5.46864286s
FAIL (2025-07-07 20:43:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.468662718s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.447720208s
FAIL (2025-07-07 20:42:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.447783299s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
5.444846874s
FAIL (2025-07-07 20:41:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.444870108s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
5.487811314s
FAIL (2025-07-07 20:41:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.487830239s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
5.525463001s
FAIL (2025-07-07 20:40:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.525482841s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
5.528730161s
FAIL (2025-07-07 20:39:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.528756511s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
5.461245582s
FAIL (2025-07-07 20:39:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.461281692s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
5.505718769s
FAIL (2025-07-07 20:38:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.505755979s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
5.458044147s
FAIL (2025-07-07 20:37:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.458078452s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
5.544681391s
FAIL (2025-07-07 20:36:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.544703435s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
5.553494281s
FAIL (2025-07-07 20:36:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.553517596s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
5.449570397s
FAIL (2025-07-07 20:35:28 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.449618529s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
5.59808751s
FAIL (2025-07-07 20:34:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.598100815s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
5.555668398s
FAIL (2025-07-07 20:33:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.555680771s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.001376248s
FAIL (2025-07-07 20:33:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.001391216s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
1.950011204s
FAIL (2025-07-07 16:58:38 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.950037286s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
1.873170997s
FAIL (2025-07-07 16:57:28 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.873189623s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
5.579936276s
FAIL (2025-07-07 16:56:28 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.579962414s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................] duration:
1.896338951s
FAIL (2025-07-07 16:56:19 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.896362899s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..XX........................................................] duration:
1.884553434s
FAIL (2025-07-07 16:55:47 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.884578461s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
5.589829902s
FAIL (2025-07-07 16:55:45 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.589854709s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
5.544223678s
FAIL (2025-07-07 16:55:10 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.544253868s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...XX.......................................................] duration:
1.835266278s
FAIL (2025-07-07 16:54:53 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.83529291s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
5.563794122s
FAIL (2025-07-07 16:54:06 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.563836393s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [....XX......................................................] duration:
1.939029905s
FAIL (2025-07-07 16:54:02 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.93906922s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
5.531093926s
FAIL (2025-07-07 16:53:11 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.531132128s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration:
1.8666636s
FAIL (2025-07-07 16:53:02 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.866693869s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [......XX....................................................] duration:
2.034710462s
FAIL (2025-07-07 16:52:16 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.034750289s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
5.788852544s
FAIL (2025-07-07 16:52:08 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.788876119s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
5.584177254s
FAIL (2025-07-07 16:51:13 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.584204576s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......XX...................................................] duration:
1.857841669s
FAIL (2025-07-07 16:51:09 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.857866678s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
5.706738656s
FAIL (2025-07-07 16:50:57 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.706769806s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [........XX..................................................] duration:
1.927580032s
FAIL (2025-07-07 16:50:10 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.927606814s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
5.602054596s
FAIL (2025-07-07 16:50:07 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.602084893s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........XX.................................................] duration:
1.875404011s
FAIL (2025-07-07 16:49:17 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.87542463s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
5.565314175s
FAIL (2025-07-07 16:48:57 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.565339023s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
5.612898803s
FAIL (2025-07-07 16:48:29 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.61293984s
core
uplink
us-select-1
|