Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
3.462326916s
FAIL (2025-10-14 00:51:47 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.462357794s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
3.337977533s
FAIL (2025-10-14 00:51:01 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.338013811s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
3.849166951s
FAIL (2025-10-14 00:50:11 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.849207166s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
3.700475554s
FAIL (2025-10-14 00:49:03 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.701296647s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
3.816128296s
FAIL (2025-10-14 00:47:58 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.816160608s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
3.38303787s
FAIL (2025-10-14 00:47:35 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.383073137s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
4.074606461s
FAIL (2025-10-14 00:47:02 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 4.07464263s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
3.508881385s
FAIL (2025-10-14 00:45:57 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.508907604s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
3.467605849s
FAIL (2025-10-14 00:45:00 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.46763819s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
3.489642009s
FAIL (2025-10-14 00:44:31 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.489680081s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
3.657763123s
FAIL (2025-10-14 00:44:16 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.657796646s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
3.172888204s
FAIL (2025-10-14 00:43:15 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.17292871s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
3.692615241s
FAIL (2025-10-14 00:42:46 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.692645359s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
4.184855083s
FAIL (2025-10-14 00:41:56 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 4.184887063s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
3.588947098s
FAIL (2025-10-14 00:40:45 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.588977998s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
3.338906457s
FAIL (2025-10-14 00:40:19 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.33893946s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
4.22191295s
FAIL (2025-10-14 00:39:16 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 4.221945762s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
3.867011805s
FAIL (2025-10-14 00:38:11 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.867052322s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
3.585139323s
FAIL (2025-10-14 00:37:12 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.585176033s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
3.886275396s
FAIL (2025-10-14 00:36:55 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.886303871s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
3.535246276s
FAIL (2025-10-14 00:36:07 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.535280643s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
4.031799396s
FAIL (2025-10-14 00:35:30 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 4.031897663s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
3.587486139s
FAIL (2025-10-14 00:34:51 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.587525695s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
3.461185173s
FAIL (2025-10-14 00:33:47 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.461247663s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
3.529258573s
FAIL (2025-10-14 00:32:55 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.529290454s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
3.303372477s
FAIL (2025-10-14 00:32:25 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.303407742s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
3.599700627s
FAIL (2025-10-14 00:31:15 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.599736124s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
3.665080758s
FAIL (2025-10-14 00:30:28 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.66511354s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
3.894721158s
FAIL (2025-10-14 00:29:40 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.894756094s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
3.850071981s
FAIL (2025-10-14 00:29:16 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.850107868s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
3.468557664s
FAIL (2025-10-14 00:28:22 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.468640102s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
3.640199823s
FAIL (2025-10-14 00:27:47 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.640243387s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
3.479518525s
FAIL (2025-10-14 00:27:27 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.479552239s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
3.611629175s
FAIL (2025-10-14 00:26:37 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.611660944s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
3.534185098s
FAIL (2025-10-14 00:25:51 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.534223541s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
3.612533897s
FAIL (2025-10-14 00:25:22 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.612559176s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
4.067892472s
FAIL (2025-10-14 00:25:04 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 4.067929652s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
3.56693625s
FAIL (2025-10-14 00:24:26 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.566964966s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
3.69236348s
FAIL (2025-10-14 00:23:56 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.692398077s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001357541s
FAIL (2025-10-14 00:23:51 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 30.001393941s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
6.20317967s
FAIL (2025-10-13 22:01:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3 21:21:43.208753166 (487h50m28.670845639s) [upload=429251]: Starting upload
Oct 13 21:21:43.208838728 (487h50m28.670931202s) [upload=429251]: Done starting upload
Oct 13 21:21:43.208904724 (487h50m28.670997217s) [upload=429251]: Uploading segments...
Oct 13 21:21:43.209134803 (487h50m28.671227286s) [upload=429251]: Got next segment. Inline: false
Oct 13 21:21:43.209186511 (487h50m28.671278994s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 21:21:43.209191119 (487h50m28.671283602s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 21:21:43.459051478 (487h50m28.921143961s) [seg_pos={0 0}, upload=429251]: Begin upload segment...
Oct 13 21:21:43.459117394 (487h50m28.921209867s) [seg_pos={0 0}, upload=429251]: Done begin upload segment.
Oct 13 21:21:43.459141921 (487h50m28.921234404s) [noise=true , address=77.90.31.13:4626 , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459153272 (487h50m28.921245745s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459704492 (487h50m28.921796975s) [noise=true , address=77.90.31.17:4771 , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460006397 (487h50m28.92209888s) [noise=true , address=45.91.116.11:4119 , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460349981 (487h50m28.922442464s) [noise=true , address=45.91.116.10:4082 , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460643880 (487h50m28.922736353s) [noise=true , address=77.90.31.14:4662 , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460924124 (487h50m28.923016637s) [noise=true , address=145.79.227.4:4187 , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461331059 (487h50m28.923423542s) [noise=true , address=145.79.227.3:4150 , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461649796 (487h50m28.923742269s) [noise=true , address=45.91.116.12:4225 , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461988581 (487h50m28.924081064s) [noise=true , address=145.79.227.15:4876 , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462295124 (487h50m28.924387607s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462604013 (487h50m28.924696486s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.463749614 (487h50m28.925842097s) [noise=true , address=45.91.116.7:4009 , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.465309224 (487h50m28.927401697s) [noise=true , address=145.79.227.19:4078 , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.466722174 (487h50m28.928814647s) [noise=true , address=145.79.227.7:4295 , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.467941596 (487h50m28.930034079s) [noise=true , address=77.90.31.19:4843 , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:45.132160807 (487h50m30.59425329s) [upload=429251]: Next returned nil segment
Oct 13 21:21:45.132180966 (487h50m30.594273439s) [upload=429251]: Waiting for error group managing segments...
Oct 13 21:21:45.523192496 (487h50m30.985284969s) [noise=true , address=45.91.116.11:4119 , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.523361808 (487h50m30.985454301s) [noise=true , address=45.91.116.10:4082 , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.556129803 (487h50m31.018222286s) [noise=true , address=77.90.31.17:4771 , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.582580128 (487h50m31.044672611s) [noise=true , address=45.91.116.12:4225 , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.598122533 (487h50m31.060215016s) [noise=true , address=45.91.116.7:4009 , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.604802873 (487h50m31.066895356s) [noise=true , address=77.90.31.13:4626 , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.690936343 (487h50m31.153028826s) [noise=true , address=77.90.31.14:4662 , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:47.280063207 (487h50m32.74215569s) [noise=true , address=77.90.31.19:4843 , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:51.841493088 (487h50m37.303585561s) [noise=true , address=145.79.227.4:4187 , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:53.452618783 (487h50m38.914711266s) [noise=true , address=145.79.227.7:4295 , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:09.822619999 (487h50m55.284712482s) [noise=true , address=145.79.227.3:4150 , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:10.548898293 (487h50m56.010990776s) [noise=true , address=145.79.227.15:4876 , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439164903 (487h50m56.901257376s) [noise=true , address=145.79.227.19:4078 , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439197545 (487h50m56.901290028s) [seg_pos={0 0}, upload=429251]: Segment reached optimal threshold of 13 pieces.
Oct 13 21:22:11.439352361 (487h50m56.901444834s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439367489 (487h50m56.901459972s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439393759 (487h50m56.901486242s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht): protocol: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection
Oct 13 21:22:11.439401664 (487h50m56.901494137s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439455747 (487h50m56.90154823s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439464724 (487h50m56.901557197s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439482207 (487h50m56.90157469s) [seg_pos={0 0}, upload=429251]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 13 21:22:11.439574253 (487h50m56.901666736s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 13 21:22:11.439581937 (487h50m56.90167442s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 13 21:22:12.015981601 (487h50m57.478074085s) [upload=429251]: Done uploading segments...
Oct 13 21:22:12.016007029 (487h50m57.478099512s) [upload=429251]: Upload finished. err: <nil>
Duration: 6.203229615s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
5.997077885s
FAIL (2025-10-13 22:01:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3 21:21:43.208753166 (487h50m28.670845639s) [upload=429251]: Starting upload
Oct 13 21:21:43.208838728 (487h50m28.670931202s) [upload=429251]: Done starting upload
Oct 13 21:21:43.208904724 (487h50m28.670997217s) [upload=429251]: Uploading segments...
Oct 13 21:21:43.209134803 (487h50m28.671227286s) [upload=429251]: Got next segment. Inline: false
Oct 13 21:21:43.209186511 (487h50m28.671278994s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 21:21:43.209191119 (487h50m28.671283602s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 21:21:43.459051478 (487h50m28.921143961s) [seg_pos={0 0}, upload=429251]: Begin upload segment...
Oct 13 21:21:43.459117394 (487h50m28.921209867s) [seg_pos={0 0}, upload=429251]: Done begin upload segment.
Oct 13 21:21:43.459141921 (487h50m28.921234404s) [noise=true , address=77.90.31.13:4626 , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459153272 (487h50m28.921245745s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459704492 (487h50m28.921796975s) [noise=true , address=77.90.31.17:4771 , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460006397 (487h50m28.92209888s) [noise=true , address=45.91.116.11:4119 , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460349981 (487h50m28.922442464s) [noise=true , address=45.91.116.10:4082 , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460643880 (487h50m28.922736353s) [noise=true , address=77.90.31.14:4662 , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460924124 (487h50m28.923016637s) [noise=true , address=145.79.227.4:4187 , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461331059 (487h50m28.923423542s) [noise=true , address=145.79.227.3:4150 , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461649796 (487h50m28.923742269s) [noise=true , address=45.91.116.12:4225 , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461988581 (487h50m28.924081064s) [noise=true , address=145.79.227.15:4876 , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462295124 (487h50m28.924387607s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462604013 (487h50m28.924696486s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.463749614 (487h50m28.925842097s) [noise=true , address=45.91.116.7:4009 , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.465309224 (487h50m28.927401697s) [noise=true , address=145.79.227.19:4078 , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.466722174 (487h50m28.928814647s) [noise=true , address=145.79.227.7:4295 , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.467941596 (487h50m28.930034079s) [noise=true , address=77.90.31.19:4843 , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:45.132160807 (487h50m30.59425329s) [upload=429251]: Next returned nil segment
Oct 13 21:21:45.132180966 (487h50m30.594273439s) [upload=429251]: Waiting for error group managing segments...
Oct 13 21:21:45.523192496 (487h50m30.985284969s) [noise=true , address=45.91.116.11:4119 , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.523361808 (487h50m30.985454301s) [noise=true , address=45.91.116.10:4082 , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.556129803 (487h50m31.018222286s) [noise=true , address=77.90.31.17:4771 , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.582580128 (487h50m31.044672611s) [noise=true , address=45.91.116.12:4225 , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.598122533 (487h50m31.060215016s) [noise=true , address=45.91.116.7:4009 , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.604802873 (487h50m31.066895356s) [noise=true , address=77.90.31.13:4626 , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.690936343 (487h50m31.153028826s) [noise=true , address=77.90.31.14:4662 , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:47.280063207 (487h50m32.74215569s) [noise=true , address=77.90.31.19:4843 , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:51.841493088 (487h50m37.303585561s) [noise=true , address=145.79.227.4:4187 , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:53.452618783 (487h50m38.914711266s) [noise=true , address=145.79.227.7:4295 , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:09.822619999 (487h50m55.284712482s) [noise=true , address=145.79.227.3:4150 , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:10.548898293 (487h50m56.010990776s) [noise=true , address=145.79.227.15:4876 , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439164903 (487h50m56.901257376s) [noise=true , address=145.79.227.19:4078 , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439197545 (487h50m56.901290028s) [seg_pos={0 0}, upload=429251]: Segment reached optimal threshold of 13 pieces.
Oct 13 21:22:11.439352361 (487h50m56.901444834s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439367489 (487h50m56.901459972s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439393759 (487h50m56.901486242s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht): protocol: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection
Oct 13 21:22:11.439401664 (487h50m56.901494137s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439455747 (487h50m56.90154823s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439464724 (487h50m56.901557197s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439482207 (487h50m56.90157469s) [seg_pos={0 0}, upload=429251]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 13 21:22:11.439574253 (487h50m56.901666736s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 13 21:22:11.439581937 (487h50m56.90167442s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 13 21:22:12.015981601 (487h50m57.478074085s) [upload=429251]: Done uploading segments...
Oct 13 21:22:12.016007029 (487h50m57.478099512s) [upload=429251]: Upload finished. err: <nil>
Duration: 5.99711223s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
6.223102588s
FAIL (2025-10-13 22:00:44 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3 21:21:43.208753166 (487h50m28.670845639s) [upload=429251]: Starting upload
Oct 13 21:21:43.208838728 (487h50m28.670931202s) [upload=429251]: Done starting upload
Oct 13 21:21:43.208904724 (487h50m28.670997217s) [upload=429251]: Uploading segments...
Oct 13 21:21:43.209134803 (487h50m28.671227286s) [upload=429251]: Got next segment. Inline: false
Oct 13 21:21:43.209186511 (487h50m28.671278994s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 21:21:43.209191119 (487h50m28.671283602s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 21:21:43.459051478 (487h50m28.921143961s) [seg_pos={0 0}, upload=429251]: Begin upload segment...
Oct 13 21:21:43.459117394 (487h50m28.921209867s) [seg_pos={0 0}, upload=429251]: Done begin upload segment.
Oct 13 21:21:43.459141921 (487h50m28.921234404s) [noise=true , address=77.90.31.13:4626 , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459153272 (487h50m28.921245745s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459704492 (487h50m28.921796975s) [noise=true , address=77.90.31.17:4771 , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460006397 (487h50m28.92209888s) [noise=true , address=45.91.116.11:4119 , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460349981 (487h50m28.922442464s) [noise=true , address=45.91.116.10:4082 , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460643880 (487h50m28.922736353s) [noise=true , address=77.90.31.14:4662 , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460924124 (487h50m28.923016637s) [noise=true , address=145.79.227.4:4187 , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461331059 (487h50m28.923423542s) [noise=true , address=145.79.227.3:4150 , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461649796 (487h50m28.923742269s) [noise=true , address=45.91.116.12:4225 , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461988581 (487h50m28.924081064s) [noise=true , address=145.79.227.15:4876 , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462295124 (487h50m28.924387607s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462604013 (487h50m28.924696486s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.463749614 (487h50m28.925842097s) [noise=true , address=45.91.116.7:4009 , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.465309224 (487h50m28.927401697s) [noise=true , address=145.79.227.19:4078 , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.466722174 (487h50m28.928814647s) [noise=true , address=145.79.227.7:4295 , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.467941596 (487h50m28.930034079s) [noise=true , address=77.90.31.19:4843 , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:45.132160807 (487h50m30.59425329s) [upload=429251]: Next returned nil segment
Oct 13 21:21:45.132180966 (487h50m30.594273439s) [upload=429251]: Waiting for error group managing segments...
Oct 13 21:21:45.523192496 (487h50m30.985284969s) [noise=true , address=45.91.116.11:4119 , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.523361808 (487h50m30.985454301s) [noise=true , address=45.91.116.10:4082 , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.556129803 (487h50m31.018222286s) [noise=true , address=77.90.31.17:4771 , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.582580128 (487h50m31.044672611s) [noise=true , address=45.91.116.12:4225 , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.598122533 (487h50m31.060215016s) [noise=true , address=45.91.116.7:4009 , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.604802873 (487h50m31.066895356s) [noise=true , address=77.90.31.13:4626 , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.690936343 (487h50m31.153028826s) [noise=true , address=77.90.31.14:4662 , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:47.280063207 (487h50m32.74215569s) [noise=true , address=77.90.31.19:4843 , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:51.841493088 (487h50m37.303585561s) [noise=true , address=145.79.227.4:4187 , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:53.452618783 (487h50m38.914711266s) [noise=true , address=145.79.227.7:4295 , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:09.822619999 (487h50m55.284712482s) [noise=true , address=145.79.227.3:4150 , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:10.548898293 (487h50m56.010990776s) [noise=true , address=145.79.227.15:4876 , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439164903 (487h50m56.901257376s) [noise=true , address=145.79.227.19:4078 , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439197545 (487h50m56.901290028s) [seg_pos={0 0}, upload=429251]: Segment reached optimal threshold of 13 pieces.
Oct 13 21:22:11.439352361 (487h50m56.901444834s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439367489 (487h50m56.901459972s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439393759 (487h50m56.901486242s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht): protocol: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection
Oct 13 21:22:11.439401664 (487h50m56.901494137s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439455747 (487h50m56.90154823s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439464724 (487h50m56.901557197s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439482207 (487h50m56.90157469s) [seg_pos={0 0}, upload=429251]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 13 21:22:11.439574253 (487h50m56.901666736s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 13 21:22:11.439581937 (487h50m56.90167442s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 13 21:22:12.015981601 (487h50m57.478074085s) [upload=429251]: Done uploading segments...
Oct 13 21:22:12.016007029 (487h50m57.478099512s) [upload=429251]: Upload finished. err: <nil>
Duration: 6.22313022s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
6.081760539s
FAIL (2025-10-13 22:00:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3 21:21:43.208753166 (487h50m28.670845639s) [upload=429251]: Starting upload
Oct 13 21:21:43.208838728 (487h50m28.670931202s) [upload=429251]: Done starting upload
Oct 13 21:21:43.208904724 (487h50m28.670997217s) [upload=429251]: Uploading segments...
Oct 13 21:21:43.209134803 (487h50m28.671227286s) [upload=429251]: Got next segment. Inline: false
Oct 13 21:21:43.209186511 (487h50m28.671278994s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 21:21:43.209191119 (487h50m28.671283602s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 21:21:43.459051478 (487h50m28.921143961s) [seg_pos={0 0}, upload=429251]: Begin upload segment...
Oct 13 21:21:43.459117394 (487h50m28.921209867s) [seg_pos={0 0}, upload=429251]: Done begin upload segment.
Oct 13 21:21:43.459141921 (487h50m28.921234404s) [noise=true , address=77.90.31.13:4626 , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459153272 (487h50m28.921245745s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459704492 (487h50m28.921796975s) [noise=true , address=77.90.31.17:4771 , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460006397 (487h50m28.92209888s) [noise=true , address=45.91.116.11:4119 , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460349981 (487h50m28.922442464s) [noise=true , address=45.91.116.10:4082 , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460643880 (487h50m28.922736353s) [noise=true , address=77.90.31.14:4662 , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460924124 (487h50m28.923016637s) [noise=true , address=145.79.227.4:4187 , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461331059 (487h50m28.923423542s) [noise=true , address=145.79.227.3:4150 , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461649796 (487h50m28.923742269s) [noise=true , address=45.91.116.12:4225 , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461988581 (487h50m28.924081064s) [noise=true , address=145.79.227.15:4876 , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462295124 (487h50m28.924387607s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462604013 (487h50m28.924696486s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.463749614 (487h50m28.925842097s) [noise=true , address=45.91.116.7:4009 , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.465309224 (487h50m28.927401697s) [noise=true , address=145.79.227.19:4078 , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.466722174 (487h50m28.928814647s) [noise=true , address=145.79.227.7:4295 , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.467941596 (487h50m28.930034079s) [noise=true , address=77.90.31.19:4843 , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:45.132160807 (487h50m30.59425329s) [upload=429251]: Next returned nil segment
Oct 13 21:21:45.132180966 (487h50m30.594273439s) [upload=429251]: Waiting for error group managing segments...
Oct 13 21:21:45.523192496 (487h50m30.985284969s) [noise=true , address=45.91.116.11:4119 , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.523361808 (487h50m30.985454301s) [noise=true , address=45.91.116.10:4082 , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.556129803 (487h50m31.018222286s) [noise=true , address=77.90.31.17:4771 , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.582580128 (487h50m31.044672611s) [noise=true , address=45.91.116.12:4225 , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.598122533 (487h50m31.060215016s) [noise=true , address=45.91.116.7:4009 , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.604802873 (487h50m31.066895356s) [noise=true , address=77.90.31.13:4626 , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.690936343 (487h50m31.153028826s) [noise=true , address=77.90.31.14:4662 , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:47.280063207 (487h50m32.74215569s) [noise=true , address=77.90.31.19:4843 , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:51.841493088 (487h50m37.303585561s) [noise=true , address=145.79.227.4:4187 , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:53.452618783 (487h50m38.914711266s) [noise=true , address=145.79.227.7:4295 , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:09.822619999 (487h50m55.284712482s) [noise=true , address=145.79.227.3:4150 , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:10.548898293 (487h50m56.010990776s) [noise=true , address=145.79.227.15:4876 , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439164903 (487h50m56.901257376s) [noise=true , address=145.79.227.19:4078 , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439197545 (487h50m56.901290028s) [seg_pos={0 0}, upload=429251]: Segment reached optimal threshold of 13 pieces.
Oct 13 21:22:11.439352361 (487h50m56.901444834s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439367489 (487h50m56.901459972s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439393759 (487h50m56.901486242s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht): protocol: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection
Oct 13 21:22:11.439401664 (487h50m56.901494137s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439455747 (487h50m56.90154823s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439464724 (487h50m56.901557197s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439482207 (487h50m56.90157469s) [seg_pos={0 0}, upload=429251]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 13 21:22:11.439574253 (487h50m56.901666736s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 13 21:22:11.439581937 (487h50m56.90167442s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 13 21:22:12.015981601 (487h50m57.478074085s) [upload=429251]: Done uploading segments...
Oct 13 21:22:12.016007029 (487h50m57.478099512s) [upload=429251]: Upload finished. err: <nil>
Duration: 6.081797861s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
6.239815003s
FAIL (2025-10-13 22:00:06 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3 21:21:43.208753166 (487h50m28.670845639s) [upload=429251]: Starting upload
Oct 13 21:21:43.208838728 (487h50m28.670931202s) [upload=429251]: Done starting upload
Oct 13 21:21:43.208904724 (487h50m28.670997217s) [upload=429251]: Uploading segments...
Oct 13 21:21:43.209134803 (487h50m28.671227286s) [upload=429251]: Got next segment. Inline: false
Oct 13 21:21:43.209186511 (487h50m28.671278994s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 21:21:43.209191119 (487h50m28.671283602s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 21:21:43.459051478 (487h50m28.921143961s) [seg_pos={0 0}, upload=429251]: Begin upload segment...
Oct 13 21:21:43.459117394 (487h50m28.921209867s) [seg_pos={0 0}, upload=429251]: Done begin upload segment.
Oct 13 21:21:43.459141921 (487h50m28.921234404s) [noise=true , address=77.90.31.13:4626 , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459153272 (487h50m28.921245745s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459704492 (487h50m28.921796975s) [noise=true , address=77.90.31.17:4771 , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460006397 (487h50m28.92209888s) [noise=true , address=45.91.116.11:4119 , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460349981 (487h50m28.922442464s) [noise=true , address=45.91.116.10:4082 , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460643880 (487h50m28.922736353s) [noise=true , address=77.90.31.14:4662 , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460924124 (487h50m28.923016637s) [noise=true , address=145.79.227.4:4187 , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461331059 (487h50m28.923423542s) [noise=true , address=145.79.227.3:4150 , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461649796 (487h50m28.923742269s) [noise=true , address=45.91.116.12:4225 , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461988581 (487h50m28.924081064s) [noise=true , address=145.79.227.15:4876 , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462295124 (487h50m28.924387607s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462604013 (487h50m28.924696486s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.463749614 (487h50m28.925842097s) [noise=true , address=45.91.116.7:4009 , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.465309224 (487h50m28.927401697s) [noise=true , address=145.79.227.19:4078 , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.466722174 (487h50m28.928814647s) [noise=true , address=145.79.227.7:4295 , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.467941596 (487h50m28.930034079s) [noise=true , address=77.90.31.19:4843 , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:45.132160807 (487h50m30.59425329s) [upload=429251]: Next returned nil segment
Oct 13 21:21:45.132180966 (487h50m30.594273439s) [upload=429251]: Waiting for error group managing segments...
Oct 13 21:21:45.523192496 (487h50m30.985284969s) [noise=true , address=45.91.116.11:4119 , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.523361808 (487h50m30.985454301s) [noise=true , address=45.91.116.10:4082 , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.556129803 (487h50m31.018222286s) [noise=true , address=77.90.31.17:4771 , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.582580128 (487h50m31.044672611s) [noise=true , address=45.91.116.12:4225 , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.598122533 (487h50m31.060215016s) [noise=true , address=45.91.116.7:4009 , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.604802873 (487h50m31.066895356s) [noise=true , address=77.90.31.13:4626 , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.690936343 (487h50m31.153028826s) [noise=true , address=77.90.31.14:4662 , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:47.280063207 (487h50m32.74215569s) [noise=true , address=77.90.31.19:4843 , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:51.841493088 (487h50m37.303585561s) [noise=true , address=145.79.227.4:4187 , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:53.452618783 (487h50m38.914711266s) [noise=true , address=145.79.227.7:4295 , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:09.822619999 (487h50m55.284712482s) [noise=true , address=145.79.227.3:4150 , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:10.548898293 (487h50m56.010990776s) [noise=true , address=145.79.227.15:4876 , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439164903 (487h50m56.901257376s) [noise=true , address=145.79.227.19:4078 , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439197545 (487h50m56.901290028s) [seg_pos={0 0}, upload=429251]: Segment reached optimal threshold of 13 pieces.
Oct 13 21:22:11.439352361 (487h50m56.901444834s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439367489 (487h50m56.901459972s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439393759 (487h50m56.901486242s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht): protocol: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection
Oct 13 21:22:11.439401664 (487h50m56.901494137s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439455747 (487h50m56.90154823s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439464724 (487h50m56.901557197s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439482207 (487h50m56.90157469s) [seg_pos={0 0}, upload=429251]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 13 21:22:11.439574253 (487h50m56.901666736s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 13 21:22:11.439581937 (487h50m56.90167442s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 13 21:22:12.015981601 (487h50m57.478074085s) [upload=429251]: Done uploading segments...
Oct 13 21:22:12.016007029 (487h50m57.478099512s) [upload=429251]: Upload finished. err: <nil>
Duration: 6.239850158s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
6.10814987s
FAIL (2025-10-13 21:58:55 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3 21:21:43.208753166 (487h50m28.670845639s) [upload=429251]: Starting upload
Oct 13 21:21:43.208838728 (487h50m28.670931202s) [upload=429251]: Done starting upload
Oct 13 21:21:43.208904724 (487h50m28.670997217s) [upload=429251]: Uploading segments...
Oct 13 21:21:43.209134803 (487h50m28.671227286s) [upload=429251]: Got next segment. Inline: false
Oct 13 21:21:43.209186511 (487h50m28.671278994s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 21:21:43.209191119 (487h50m28.671283602s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 21:21:43.459051478 (487h50m28.921143961s) [seg_pos={0 0}, upload=429251]: Begin upload segment...
Oct 13 21:21:43.459117394 (487h50m28.921209867s) [seg_pos={0 0}, upload=429251]: Done begin upload segment.
Oct 13 21:21:43.459141921 (487h50m28.921234404s) [noise=true , address=77.90.31.13:4626 , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459153272 (487h50m28.921245745s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459704492 (487h50m28.921796975s) [noise=true , address=77.90.31.17:4771 , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460006397 (487h50m28.92209888s) [noise=true , address=45.91.116.11:4119 , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460349981 (487h50m28.922442464s) [noise=true , address=45.91.116.10:4082 , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460643880 (487h50m28.922736353s) [noise=true , address=77.90.31.14:4662 , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460924124 (487h50m28.923016637s) [noise=true , address=145.79.227.4:4187 , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461331059 (487h50m28.923423542s) [noise=true , address=145.79.227.3:4150 , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461649796 (487h50m28.923742269s) [noise=true , address=45.91.116.12:4225 , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461988581 (487h50m28.924081064s) [noise=true , address=145.79.227.15:4876 , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462295124 (487h50m28.924387607s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462604013 (487h50m28.924696486s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.463749614 (487h50m28.925842097s) [noise=true , address=45.91.116.7:4009 , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.465309224 (487h50m28.927401697s) [noise=true , address=145.79.227.19:4078 , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.466722174 (487h50m28.928814647s) [noise=true , address=145.79.227.7:4295 , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.467941596 (487h50m28.930034079s) [noise=true , address=77.90.31.19:4843 , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:45.132160807 (487h50m30.59425329s) [upload=429251]: Next returned nil segment
Oct 13 21:21:45.132180966 (487h50m30.594273439s) [upload=429251]: Waiting for error group managing segments...
Oct 13 21:21:45.523192496 (487h50m30.985284969s) [noise=true , address=45.91.116.11:4119 , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.523361808 (487h50m30.985454301s) [noise=true , address=45.91.116.10:4082 , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.556129803 (487h50m31.018222286s) [noise=true , address=77.90.31.17:4771 , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.582580128 (487h50m31.044672611s) [noise=true , address=45.91.116.12:4225 , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.598122533 (487h50m31.060215016s) [noise=true , address=45.91.116.7:4009 , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.604802873 (487h50m31.066895356s) [noise=true , address=77.90.31.13:4626 , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.690936343 (487h50m31.153028826s) [noise=true , address=77.90.31.14:4662 , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:47.280063207 (487h50m32.74215569s) [noise=true , address=77.90.31.19:4843 , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:51.841493088 (487h50m37.303585561s) [noise=true , address=145.79.227.4:4187 , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:53.452618783 (487h50m38.914711266s) [noise=true , address=145.79.227.7:4295 , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:09.822619999 (487h50m55.284712482s) [noise=true , address=145.79.227.3:4150 , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:10.548898293 (487h50m56.010990776s) [noise=true , address=145.79.227.15:4876 , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439164903 (487h50m56.901257376s) [noise=true , address=145.79.227.19:4078 , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439197545 (487h50m56.901290028s) [seg_pos={0 0}, upload=429251]: Segment reached optimal threshold of 13 pieces.
Oct 13 21:22:11.439352361 (487h50m56.901444834s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439367489 (487h50m56.901459972s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439393759 (487h50m56.901486242s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht): protocol: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection
Oct 13 21:22:11.439401664 (487h50m56.901494137s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439455747 (487h50m56.90154823s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439464724 (487h50m56.901557197s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439482207 (487h50m56.90157469s) [seg_pos={0 0}, upload=429251]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 13 21:22:11.439574253 (487h50m56.901666736s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 13 21:22:11.439581937 (487h50m56.90167442s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 13 21:22:12.015981601 (487h50m57.478074085s) [upload=429251]: Done uploading segments...
Oct 13 21:22:12.016007029 (487h50m57.478099512s) [upload=429251]: Upload finished. err: <nil>
Duration: 6.10818722s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
6.199906991s
FAIL (2025-10-13 21:58:24 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3 21:21:43.208753166 (487h50m28.670845639s) [upload=429251]: Starting upload
Oct 13 21:21:43.208838728 (487h50m28.670931202s) [upload=429251]: Done starting upload
Oct 13 21:21:43.208904724 (487h50m28.670997217s) [upload=429251]: Uploading segments...
Oct 13 21:21:43.209134803 (487h50m28.671227286s) [upload=429251]: Got next segment. Inline: false
Oct 13 21:21:43.209186511 (487h50m28.671278994s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 21:21:43.209191119 (487h50m28.671283602s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 21:21:43.459051478 (487h50m28.921143961s) [seg_pos={0 0}, upload=429251]: Begin upload segment...
Oct 13 21:21:43.459117394 (487h50m28.921209867s) [seg_pos={0 0}, upload=429251]: Done begin upload segment.
Oct 13 21:21:43.459141921 (487h50m28.921234404s) [noise=true , address=77.90.31.13:4626 , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459153272 (487h50m28.921245745s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459704492 (487h50m28.921796975s) [noise=true , address=77.90.31.17:4771 , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460006397 (487h50m28.92209888s) [noise=true , address=45.91.116.11:4119 , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460349981 (487h50m28.922442464s) [noise=true , address=45.91.116.10:4082 , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460643880 (487h50m28.922736353s) [noise=true , address=77.90.31.14:4662 , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460924124 (487h50m28.923016637s) [noise=true , address=145.79.227.4:4187 , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461331059 (487h50m28.923423542s) [noise=true , address=145.79.227.3:4150 , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461649796 (487h50m28.923742269s) [noise=true , address=45.91.116.12:4225 , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461988581 (487h50m28.924081064s) [noise=true , address=145.79.227.15:4876 , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462295124 (487h50m28.924387607s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462604013 (487h50m28.924696486s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.463749614 (487h50m28.925842097s) [noise=true , address=45.91.116.7:4009 , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.465309224 (487h50m28.927401697s) [noise=true , address=145.79.227.19:4078 , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.466722174 (487h50m28.928814647s) [noise=true , address=145.79.227.7:4295 , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.467941596 (487h50m28.930034079s) [noise=true , address=77.90.31.19:4843 , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:45.132160807 (487h50m30.59425329s) [upload=429251]: Next returned nil segment
Oct 13 21:21:45.132180966 (487h50m30.594273439s) [upload=429251]: Waiting for error group managing segments...
Oct 13 21:21:45.523192496 (487h50m30.985284969s) [noise=true , address=45.91.116.11:4119 , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.523361808 (487h50m30.985454301s) [noise=true , address=45.91.116.10:4082 , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.556129803 (487h50m31.018222286s) [noise=true , address=77.90.31.17:4771 , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.582580128 (487h50m31.044672611s) [noise=true , address=45.91.116.12:4225 , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.598122533 (487h50m31.060215016s) [noise=true , address=45.91.116.7:4009 , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.604802873 (487h50m31.066895356s) [noise=true , address=77.90.31.13:4626 , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.690936343 (487h50m31.153028826s) [noise=true , address=77.90.31.14:4662 , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:47.280063207 (487h50m32.74215569s) [noise=true , address=77.90.31.19:4843 , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:51.841493088 (487h50m37.303585561s) [noise=true , address=145.79.227.4:4187 , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:53.452618783 (487h50m38.914711266s) [noise=true , address=145.79.227.7:4295 , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:09.822619999 (487h50m55.284712482s) [noise=true , address=145.79.227.3:4150 , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:10.548898293 (487h50m56.010990776s) [noise=true , address=145.79.227.15:4876 , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439164903 (487h50m56.901257376s) [noise=true , address=145.79.227.19:4078 , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439197545 (487h50m56.901290028s) [seg_pos={0 0}, upload=429251]: Segment reached optimal threshold of 13 pieces.
Oct 13 21:22:11.439352361 (487h50m56.901444834s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439367489 (487h50m56.901459972s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439393759 (487h50m56.901486242s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht): protocol: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection
Oct 13 21:22:11.439401664 (487h50m56.901494137s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439455747 (487h50m56.90154823s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439464724 (487h50m56.901557197s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439482207 (487h50m56.90157469s) [seg_pos={0 0}, upload=429251]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 13 21:22:11.439574253 (487h50m56.901666736s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 13 21:22:11.439581937 (487h50m56.90167442s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 13 21:22:12.015981601 (487h50m57.478074085s) [upload=429251]: Done uploading segments...
Oct 13 21:22:12.016007029 (487h50m57.478099512s) [upload=429251]: Upload finished. err: <nil>
Duration: 6.199935366s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
6.105592389s
FAIL (2025-10-13 21:57:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3 21:21:43.208753166 (487h50m28.670845639s) [upload=429251]: Starting upload
Oct 13 21:21:43.208838728 (487h50m28.670931202s) [upload=429251]: Done starting upload
Oct 13 21:21:43.208904724 (487h50m28.670997217s) [upload=429251]: Uploading segments...
Oct 13 21:21:43.209134803 (487h50m28.671227286s) [upload=429251]: Got next segment. Inline: false
Oct 13 21:21:43.209186511 (487h50m28.671278994s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 21:21:43.209191119 (487h50m28.671283602s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 21:21:43.459051478 (487h50m28.921143961s) [seg_pos={0 0}, upload=429251]: Begin upload segment...
Oct 13 21:21:43.459117394 (487h50m28.921209867s) [seg_pos={0 0}, upload=429251]: Done begin upload segment.
Oct 13 21:21:43.459141921 (487h50m28.921234404s) [noise=true , address=77.90.31.13:4626 , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459153272 (487h50m28.921245745s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459704492 (487h50m28.921796975s) [noise=true , address=77.90.31.17:4771 , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460006397 (487h50m28.92209888s) [noise=true , address=45.91.116.11:4119 , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460349981 (487h50m28.922442464s) [noise=true , address=45.91.116.10:4082 , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460643880 (487h50m28.922736353s) [noise=true , address=77.90.31.14:4662 , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460924124 (487h50m28.923016637s) [noise=true , address=145.79.227.4:4187 , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461331059 (487h50m28.923423542s) [noise=true , address=145.79.227.3:4150 , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461649796 (487h50m28.923742269s) [noise=true , address=45.91.116.12:4225 , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461988581 (487h50m28.924081064s) [noise=true , address=145.79.227.15:4876 , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462295124 (487h50m28.924387607s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462604013 (487h50m28.924696486s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.463749614 (487h50m28.925842097s) [noise=true , address=45.91.116.7:4009 , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.465309224 (487h50m28.927401697s) [noise=true , address=145.79.227.19:4078 , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.466722174 (487h50m28.928814647s) [noise=true , address=145.79.227.7:4295 , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.467941596 (487h50m28.930034079s) [noise=true , address=77.90.31.19:4843 , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:45.132160807 (487h50m30.59425329s) [upload=429251]: Next returned nil segment
Oct 13 21:21:45.132180966 (487h50m30.594273439s) [upload=429251]: Waiting for error group managing segments...
Oct 13 21:21:45.523192496 (487h50m30.985284969s) [noise=true , address=45.91.116.11:4119 , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.523361808 (487h50m30.985454301s) [noise=true , address=45.91.116.10:4082 , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.556129803 (487h50m31.018222286s) [noise=true , address=77.90.31.17:4771 , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.582580128 (487h50m31.044672611s) [noise=true , address=45.91.116.12:4225 , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.598122533 (487h50m31.060215016s) [noise=true , address=45.91.116.7:4009 , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.604802873 (487h50m31.066895356s) [noise=true , address=77.90.31.13:4626 , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.690936343 (487h50m31.153028826s) [noise=true , address=77.90.31.14:4662 , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:47.280063207 (487h50m32.74215569s) [noise=true , address=77.90.31.19:4843 , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:51.841493088 (487h50m37.303585561s) [noise=true , address=145.79.227.4:4187 , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:53.452618783 (487h50m38.914711266s) [noise=true , address=145.79.227.7:4295 , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:09.822619999 (487h50m55.284712482s) [noise=true , address=145.79.227.3:4150 , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:10.548898293 (487h50m56.010990776s) [noise=true , address=145.79.227.15:4876 , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439164903 (487h50m56.901257376s) [noise=true , address=145.79.227.19:4078 , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439197545 (487h50m56.901290028s) [seg_pos={0 0}, upload=429251]: Segment reached optimal threshold of 13 pieces.
Oct 13 21:22:11.439352361 (487h50m56.901444834s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439367489 (487h50m56.901459972s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439393759 (487h50m56.901486242s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht): protocol: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection
Oct 13 21:22:11.439401664 (487h50m56.901494137s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439455747 (487h50m56.90154823s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439464724 (487h50m56.901557197s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439482207 (487h50m56.90157469s) [seg_pos={0 0}, upload=429251]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 13 21:22:11.439574253 (487h50m56.901666736s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 13 21:22:11.439581937 (487h50m56.90167442s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 13 21:22:12.015981601 (487h50m57.478074085s) [upload=429251]: Done uploading segments...
Oct 13 21:22:12.016007029 (487h50m57.478099512s) [upload=429251]: Upload finished. err: <nil>
Duration: 6.105631113s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
6.108703286s
FAIL (2025-10-13 21:56:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3 21:21:43.208753166 (487h50m28.670845639s) [upload=429251]: Starting upload
Oct 13 21:21:43.208838728 (487h50m28.670931202s) [upload=429251]: Done starting upload
Oct 13 21:21:43.208904724 (487h50m28.670997217s) [upload=429251]: Uploading segments...
Oct 13 21:21:43.209134803 (487h50m28.671227286s) [upload=429251]: Got next segment. Inline: false
Oct 13 21:21:43.209186511 (487h50m28.671278994s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 21:21:43.209191119 (487h50m28.671283602s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 21:21:43.459051478 (487h50m28.921143961s) [seg_pos={0 0}, upload=429251]: Begin upload segment...
Oct 13 21:21:43.459117394 (487h50m28.921209867s) [seg_pos={0 0}, upload=429251]: Done begin upload segment.
Oct 13 21:21:43.459141921 (487h50m28.921234404s) [noise=true , address=77.90.31.13:4626 , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459153272 (487h50m28.921245745s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459704492 (487h50m28.921796975s) [noise=true , address=77.90.31.17:4771 , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460006397 (487h50m28.92209888s) [noise=true , address=45.91.116.11:4119 , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460349981 (487h50m28.922442464s) [noise=true , address=45.91.116.10:4082 , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460643880 (487h50m28.922736353s) [noise=true , address=77.90.31.14:4662 , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460924124 (487h50m28.923016637s) [noise=true , address=145.79.227.4:4187 , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461331059 (487h50m28.923423542s) [noise=true , address=145.79.227.3:4150 , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461649796 (487h50m28.923742269s) [noise=true , address=45.91.116.12:4225 , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461988581 (487h50m28.924081064s) [noise=true , address=145.79.227.15:4876 , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462295124 (487h50m28.924387607s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462604013 (487h50m28.924696486s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.463749614 (487h50m28.925842097s) [noise=true , address=45.91.116.7:4009 , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.465309224 (487h50m28.927401697s) [noise=true , address=145.79.227.19:4078 , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.466722174 (487h50m28.928814647s) [noise=true , address=145.79.227.7:4295 , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.467941596 (487h50m28.930034079s) [noise=true , address=77.90.31.19:4843 , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:45.132160807 (487h50m30.59425329s) [upload=429251]: Next returned nil segment
Oct 13 21:21:45.132180966 (487h50m30.594273439s) [upload=429251]: Waiting for error group managing segments...
Oct 13 21:21:45.523192496 (487h50m30.985284969s) [noise=true , address=45.91.116.11:4119 , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.523361808 (487h50m30.985454301s) [noise=true , address=45.91.116.10:4082 , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.556129803 (487h50m31.018222286s) [noise=true , address=77.90.31.17:4771 , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.582580128 (487h50m31.044672611s) [noise=true , address=45.91.116.12:4225 , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.598122533 (487h50m31.060215016s) [noise=true , address=45.91.116.7:4009 , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.604802873 (487h50m31.066895356s) [noise=true , address=77.90.31.13:4626 , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.690936343 (487h50m31.153028826s) [noise=true , address=77.90.31.14:4662 , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:47.280063207 (487h50m32.74215569s) [noise=true , address=77.90.31.19:4843 , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:51.841493088 (487h50m37.303585561s) [noise=true , address=145.79.227.4:4187 , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:53.452618783 (487h50m38.914711266s) [noise=true , address=145.79.227.7:4295 , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:09.822619999 (487h50m55.284712482s) [noise=true , address=145.79.227.3:4150 , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:10.548898293 (487h50m56.010990776s) [noise=true , address=145.79.227.15:4876 , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439164903 (487h50m56.901257376s) [noise=true , address=145.79.227.19:4078 , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439197545 (487h50m56.901290028s) [seg_pos={0 0}, upload=429251]: Segment reached optimal threshold of 13 pieces.
Oct 13 21:22:11.439352361 (487h50m56.901444834s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439367489 (487h50m56.901459972s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439393759 (487h50m56.901486242s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht): protocol: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection
Oct 13 21:22:11.439401664 (487h50m56.901494137s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439455747 (487h50m56.90154823s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439464724 (487h50m56.901557197s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439482207 (487h50m56.90157469s) [seg_pos={0 0}, upload=429251]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 13 21:22:11.439574253 (487h50m56.901666736s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 13 21:22:11.439581937 (487h50m56.90167442s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 13 21:22:12.015981601 (487h50m57.478074085s) [upload=429251]: Done uploading segments...
Oct 13 21:22:12.016007029 (487h50m57.478099512s) [upload=429251]: Upload finished. err: <nil>
Duration: 6.108735397s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
6.048492996s
FAIL (2025-10-13 21:55:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3 21:21:43.208753166 (487h50m28.670845639s) [upload=429251]: Starting upload
Oct 13 21:21:43.208838728 (487h50m28.670931202s) [upload=429251]: Done starting upload
Oct 13 21:21:43.208904724 (487h50m28.670997217s) [upload=429251]: Uploading segments...
Oct 13 21:21:43.209134803 (487h50m28.671227286s) [upload=429251]: Got next segment. Inline: false
Oct 13 21:21:43.209186511 (487h50m28.671278994s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 13 21:21:43.209191119 (487h50m28.671283602s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 13 21:21:43.459051478 (487h50m28.921143961s) [seg_pos={0 0}, upload=429251]: Begin upload segment...
Oct 13 21:21:43.459117394 (487h50m28.921209867s) [seg_pos={0 0}, upload=429251]: Done begin upload segment.
Oct 13 21:21:43.459141921 (487h50m28.921234404s) [noise=true , address=77.90.31.13:4626 , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459153272 (487h50m28.921245745s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.459704492 (487h50m28.921796975s) [noise=true , address=77.90.31.17:4771 , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460006397 (487h50m28.92209888s) [noise=true , address=45.91.116.11:4119 , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460349981 (487h50m28.922442464s) [noise=true , address=45.91.116.10:4082 , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460643880 (487h50m28.922736353s) [noise=true , address=77.90.31.14:4662 , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.460924124 (487h50m28.923016637s) [noise=true , address=145.79.227.4:4187 , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461331059 (487h50m28.923423542s) [noise=true , address=145.79.227.3:4150 , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461649796 (487h50m28.923742269s) [noise=true , address=45.91.116.12:4225 , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.461988581 (487h50m28.924081064s) [noise=true , address=145.79.227.15:4876 , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462295124 (487h50m28.924387607s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.462604013 (487h50m28.924696486s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.463749614 (487h50m28.925842097s) [noise=true , address=45.91.116.7:4009 , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.465309224 (487h50m28.927401697s) [noise=true , address=145.79.227.19:4078 , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.466722174 (487h50m28.928814647s) [noise=true , address=145.79.227.7:4295 , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:43.467941596 (487h50m28.930034079s) [noise=true , address=77.90.31.19:4843 , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Uploading piece...
Oct 13 21:21:45.132160807 (487h50m30.59425329s) [upload=429251]: Next returned nil segment
Oct 13 21:21:45.132180966 (487h50m30.594273439s) [upload=429251]: Waiting for error group managing segments...
Oct 13 21:21:45.523192496 (487h50m30.985284969s) [noise=true , address=45.91.116.11:4119 , piece_id=D5E6IFIZLAGPBWS7DIS2LPV24AZTQTFSALYAQCKMUWDAOQDHHNNQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.523361808 (487h50m30.985454301s) [noise=true , address=45.91.116.10:4082 , piece_id=TTP66LAP5MRAHU4WMLXUSITWVWNYTXR5YGROHRIGKUOQFJJNPBTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.556129803 (487h50m31.018222286s) [noise=true , address=77.90.31.17:4771 , piece_id=H5UT5TTRRVPQQMKE4QOSOKPMTY7FG53ANWAZYI4YHCN4VVTV4FCQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.582580128 (487h50m31.044672611s) [noise=true , address=45.91.116.12:4225 , piece_id=WB6XIMP5KHTB5U6XG3QADSAW6SG6MHDBAXPDM4TXNRWOFYOIE3YQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.598122533 (487h50m31.060215016s) [noise=true , address=45.91.116.7:4009 , piece_id=DRBY5MWUG2OMEU2BVX5CBYGE6VC3TAZLTP6TB3LEV3G2CY25DQDQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.604802873 (487h50m31.066895356s) [noise=true , address=77.90.31.13:4626 , piece_id=WAF4AHWDKJ3ZZTUE2SHUWPVA7GJ2MDYORAKWDYKGMKKVZVHSY5JQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:45.690936343 (487h50m31.153028826s) [noise=true , address=77.90.31.14:4662 , piece_id=B4FDCDGOYDRDBYR7OWOY2KBIHVMUEVZDA27JYZNMMMRZEQB4IP6A, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:47.280063207 (487h50m32.74215569s) [noise=true , address=77.90.31.19:4843 , piece_id=QKMSA5UGJ3CPWLY3ZSXETBQZBS5BKWJFNE5RUVMJ3SGHULYKU7UA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:51.841493088 (487h50m37.303585561s) [noise=true , address=145.79.227.4:4187 , piece_id=IBL3MWRHJAAL37SSZZBEPUJUEWS7E2SNQA54NYSHCRQWDJRCY3DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:21:53.452618783 (487h50m38.914711266s) [noise=true , address=145.79.227.7:4295 , piece_id=VETU3K3MCJ7Q7JLMDF2YT3K7ODF5HQY2EBQIZN7ERRN7YYA6W3WA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:09.822619999 (487h50m55.284712482s) [noise=true , address=145.79.227.3:4150 , piece_id=NR2QSMGRJBMTBVX5C4GLCPHNC3VNH75OCMCHG54IVUCPNPOU6HGA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:10.548898293 (487h50m56.010990776s) [noise=true , address=145.79.227.15:4876 , piece_id=CTL7FCECSYPT7HTR2IEXS6XHTH7ZRLRGWUFRTSESEWHACS4G2ALQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439164903 (487h50m56.901257376s) [noise=true , address=145.79.227.19:4078 , piece_id=JZ2N3O7UW7YLS6UUEXP5B2V4TLXMWYLH2L5XE6T4RIFYCOZF5HIA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: <nil>
Oct 13 21:22:11.439197545 (487h50m56.901290028s) [seg_pos={0 0}, upload=429251]: Segment reached optimal threshold of 13 pieces.
Oct 13 21:22:11.439352361 (487h50m56.901444834s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439367489 (487h50m56.901459972s) [noise=true , address=145.79.227.18:4005 , piece_id=RRJUWV6GKRWJIT7MIIC4YSYXLLSUNI6Z6HHSWKY4RSEYEMK2O6DQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439393759 (487h50m56.901486242s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht): protocol: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34052->145.79.227.4:4186: use of closed network connection
Oct 13 21:22:11.439401664 (487h50m56.901494137s) [noise=true , address=145.79.227.4:4186 , piece_id=YUI3BWEX6NFLIUY4YX2ZHMZ2RYC2TTTO45X6RDTQNRD4K7QEGLYQ, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439455747 (487h50m56.90154823s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF
Oct 13 21:22:11.439464724 (487h50m56.901557197s) [noise=true , address=145.79.227.5:4223 , piece_id=5PENTEEMYJRHQMDHY23ZQJHZ56J2GRVEFQKHOGWZNWD3UL7BJPTA, seg_pos={0 0}, upload=429251]: Long tail cancellation due to optimal threshold
Oct 13 21:22:11.439482207 (487h50m56.90157469s) [seg_pos={0 0}, upload=429251]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 13 21:22:11.439574253 (487h50m56.901666736s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 13 21:22:11.439581937 (487h50m56.90167442s) [upload=429251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 13 21:22:12.015981601 (487h50m57.478074085s) [upload=429251]: Done uploading segments...
Oct 13 21:22:12.016007029 (487h50m57.478099512s) [upload=429251]: Upload finished. err: <nil>
Duration: 6.048524344s
core
uplink
us-select-1
|