Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
5.873199083s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:38:05 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.873228679s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
5.798145997s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:37:16 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.798175654s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
5.869986266s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:36:51 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.870013777s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
5.594214518s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:35:48 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.594282818s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
5.908903689s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:34:50 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.908937373s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
5.764573263s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:33:44 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.764605314s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
5.81148969s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:33:00 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.811519486s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
5.686893563s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:31:48 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.686925334s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
5.730896368s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:30:40 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.730929571s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
6.072333967s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:30:09 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 6.072413888s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
5.642366558s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:29:46 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.642399861s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
5.813924096s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:29:13 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.813971905s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.845956032s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:28:21 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.845978525s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.930432961s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:27:06 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.930466064s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.814577028s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:26:07 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.814610613s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
6.006654431s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:25:15 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 6.006718422s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
5.877374238s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:24:01 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.877407282s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
5.761428565s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:23:41 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.761459634s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.765966844s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:22:36 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.766041497s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
5.910564487s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:21:30 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.910592251s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
5.909334955s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:20:20 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.909372177s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
5.74944762s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:19:50 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.749479481s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
5.768523222s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:18:49 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.768543972s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
5.885484261s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:17:38 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.885503817s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
6.221857291s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:17:10 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 6.221889873s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
5.857543008s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:16:08 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.857574779s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
5.730626535s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:15:23 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.73065481s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
5.799075687s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:14:34 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.79910847s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
5.965070592s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:13:29 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.965102292s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
5.735489716s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:12:21 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.735526297s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
5.838977247s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:11:29 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.838999289s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.007213648s trace:
https://jaeger.dev.storj.io/trace/77849155ced6ab16
FAIL (2025-11-30 03:11:23 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 30.007242492s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
6.140490186s trace:
https://jaeger.dev.storj.io/trace/d24e282cae355a8
FAIL (2025-11-29 23:48:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
63204 (495h0m13.918633665s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367386489 (495h0m13.91885694s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367586149 (495h0m13.919056611s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.368368469 (495h0m13.91983893s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.370168877 (495h0m13.921639338s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.372146263 (495h0m13.923616714s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.373978502 (495h0m13.925448963s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.374415854 (495h0m13.925886596s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.375566746 (495h0m13.927037207s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.379743138 (495h0m13.931213599s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:16.193964208 (495h0m14.745434669s) [upload=435893]: Next returned nil segment
Nov 29 23:04:16.193980790 (495h0m14.745451241s) [upload=435893]: Waiting for error group managing segments...
Nov 29 23:04:16.588328531 (495h0m15.139798982s) [noise=true , address=185.167.204.205:4022 , piece_id=KQGAPJ7IJQDN6N4LEIQTD43THU2KPWLMYSFUYKPBBE23K5MPTXYA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.588450043 (495h0m15.139920504s) [noise=true , address=185.167.204.206:4061 , piece_id=R6OFY6MJVY5ENXOZZWHC2CKS73QNXJIWDRBKXTYJRXNOOQYTKDOA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.591055714 (495h0m15.142526175s) [noise=true , address=185.167.204.205:4015 , piece_id=BH4FVVQEWVY5OP3GHPVVHYXV7YXXL7VBEKVBNICNQIUMZOQMBSAA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.595531226 (495h0m15.147001677s) [noise=true , address=185.167.204.205:4005 , piece_id=YFK5HBNTOTKRSUS4XRZ3YRPAI4ZEK3DKBLXSIG56DZPOPCTXPOKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.596866599 (495h0m15.14833706s) [noise=true , address=185.167.204.205:4033 , piece_id=YP3HYJ5S3HAPYPPQ5X4BBKI7LERBP7LOVOKZHWMR5GTZC6QMWE3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600090748 (495h0m15.151561209s) [noise=true , address=185.167.204.206:4072 , piece_id=IQ4AAJG4NXO7I2JOJTSSDWF5KXZGLIN6H4BZVUOMVWRSWEIPQHRA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600437999 (495h0m15.15190846s) [noise=true , address=185.167.204.205:4021 , piece_id=GISPTI7P22CQBEETXZ7S4K4RKLTOCAGNKPEQNJK4SA6OZ3LSIE7Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.606498990 (495h0m15.157969441s) [noise=true , address=185.167.204.206:4055 , piece_id=B3BO65PLZH6WDE7YB4PNBRIZPKDWA7E2LIUQZL5WZB7MYJFXSIVQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607132467 (495h0m15.158602918s) [noise=true , address=185.167.204.206:4056 , piece_id=BS26JRUAU2EQAW4FY3IRCVHLH6W34RM55ZRD5HZQFEZ72MTOK7UA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607358097 (495h0m15.158828558s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.608394009 (495h0m15.15986447s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.609654600 (495h0m15.161125061s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610336178 (495h0m15.161806639s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610894210 (495h0m15.162364671s) [noise=true , address=185.167.204.206:4064 , piece_id=36FVLSJCAL36EI6RP2ZB2TRZ3DSBB2K2WIVYWTD6E2SJK2VMOR4Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.612907824 (495h0m15.164378285s) [noise=true , address=185.167.204.206:4040 , piece_id=JI3FSPBHYZXSTJSXXADXEZKO24UGVPYITM64Z7ORHFSPQQS7PE7A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.613654436 (495h0m15.165124887s) [noise=true , address=185.167.204.205:4020 , piece_id=P6XJ6EVG4HEEC4MNEFKCTOZOX55EJIMTTL4RSWPC5MTS77MVOA4A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.614271882 (495h0m15.165742343s) [noise=true , address=185.167.204.206:4062 , piece_id=H3SUGOYJRWVMUSGMLIG5GFW5PHWTVVM6M6XJOUJ6OSY7VAL2UM5A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615166645 (495h0m15.166637096s) [noise=true , address=185.167.204.206:4038 , piece_id=ZU7CEJCYELXC7FKN2QPJ5IAZP6EFPPV4J4J66RH3KCDJV23275RA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615702125 (495h0m15.167172586s) [noise=true , address=185.167.204.206:4071 , piece_id=IYOTAVZNF2NHM4EENETKXNZEDDOSQ2S5JM6Y6WU2C42XMEUEZSPQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.622348872 (495h0m15.173819323s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.623554238 (495h0m15.175024699s) [noise=true , address=185.167.204.206:4045 , piece_id=YSXBKASXLB4PWVBCXYKKZKFLWYDSCNLRLAZWTDLXK5RGM5JLIBQA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.625468773 (495h0m15.176939234s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.633697702 (495h0m15.185168163s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:17.952847920 (495h0m16.504318381s) [noise=true , address=89.149.201.147:4007 , piece_id=FYFK5AZQPRL5X34B5LH53Z2ONLLDNRHNBJ2Q4AU2APNX23BU5TBA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.168814250 (495h0m16.720284711s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905289666 (495h0m17.456760137s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905315666 (495h0m17.456786137s) [seg_pos={0 0}, upload=435893]: Segment reached optimal threshold of 26 pieces.
Nov 29 23:04:18.905784339 (495h0m17.45725481s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Nov 29 23:04:18.905833892 (495h0m17.457304364s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906246979 (495h0m17.45771745s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: read tcp 188.166.225.170:44936->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 29 23:04:18.906260154 (495h0m17.457730615s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906282096 (495h0m17.457752567s) [seg_pos={0 0}, upload=435893]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 29 23:04:18.906373140 (495h0m17.457843601s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 29 23:04:18.906380694 (495h0m17.457851165s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 29 23:04:19.169071817 (495h0m17.720542278s) [upload=435893]: Done uploading segments...
Nov 29 23:04:19.169097004 (495h0m17.720567465s) [upload=435893]: Upload finished. err: <nil>
Duration: 6.140521125s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
5.777401521s trace:
https://jaeger.dev.storj.io/trace/d24e282cae355a8
FAIL (2025-11-29 23:48:19 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
63204 (495h0m13.918633665s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367386489 (495h0m13.91885694s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367586149 (495h0m13.919056611s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.368368469 (495h0m13.91983893s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.370168877 (495h0m13.921639338s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.372146263 (495h0m13.923616714s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.373978502 (495h0m13.925448963s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.374415854 (495h0m13.925886596s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.375566746 (495h0m13.927037207s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.379743138 (495h0m13.931213599s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:16.193964208 (495h0m14.745434669s) [upload=435893]: Next returned nil segment
Nov 29 23:04:16.193980790 (495h0m14.745451241s) [upload=435893]: Waiting for error group managing segments...
Nov 29 23:04:16.588328531 (495h0m15.139798982s) [noise=true , address=185.167.204.205:4022 , piece_id=KQGAPJ7IJQDN6N4LEIQTD43THU2KPWLMYSFUYKPBBE23K5MPTXYA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.588450043 (495h0m15.139920504s) [noise=true , address=185.167.204.206:4061 , piece_id=R6OFY6MJVY5ENXOZZWHC2CKS73QNXJIWDRBKXTYJRXNOOQYTKDOA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.591055714 (495h0m15.142526175s) [noise=true , address=185.167.204.205:4015 , piece_id=BH4FVVQEWVY5OP3GHPVVHYXV7YXXL7VBEKVBNICNQIUMZOQMBSAA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.595531226 (495h0m15.147001677s) [noise=true , address=185.167.204.205:4005 , piece_id=YFK5HBNTOTKRSUS4XRZ3YRPAI4ZEK3DKBLXSIG56DZPOPCTXPOKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.596866599 (495h0m15.14833706s) [noise=true , address=185.167.204.205:4033 , piece_id=YP3HYJ5S3HAPYPPQ5X4BBKI7LERBP7LOVOKZHWMR5GTZC6QMWE3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600090748 (495h0m15.151561209s) [noise=true , address=185.167.204.206:4072 , piece_id=IQ4AAJG4NXO7I2JOJTSSDWF5KXZGLIN6H4BZVUOMVWRSWEIPQHRA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600437999 (495h0m15.15190846s) [noise=true , address=185.167.204.205:4021 , piece_id=GISPTI7P22CQBEETXZ7S4K4RKLTOCAGNKPEQNJK4SA6OZ3LSIE7Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.606498990 (495h0m15.157969441s) [noise=true , address=185.167.204.206:4055 , piece_id=B3BO65PLZH6WDE7YB4PNBRIZPKDWA7E2LIUQZL5WZB7MYJFXSIVQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607132467 (495h0m15.158602918s) [noise=true , address=185.167.204.206:4056 , piece_id=BS26JRUAU2EQAW4FY3IRCVHLH6W34RM55ZRD5HZQFEZ72MTOK7UA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607358097 (495h0m15.158828558s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.608394009 (495h0m15.15986447s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.609654600 (495h0m15.161125061s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610336178 (495h0m15.161806639s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610894210 (495h0m15.162364671s) [noise=true , address=185.167.204.206:4064 , piece_id=36FVLSJCAL36EI6RP2ZB2TRZ3DSBB2K2WIVYWTD6E2SJK2VMOR4Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.612907824 (495h0m15.164378285s) [noise=true , address=185.167.204.206:4040 , piece_id=JI3FSPBHYZXSTJSXXADXEZKO24UGVPYITM64Z7ORHFSPQQS7PE7A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.613654436 (495h0m15.165124887s) [noise=true , address=185.167.204.205:4020 , piece_id=P6XJ6EVG4HEEC4MNEFKCTOZOX55EJIMTTL4RSWPC5MTS77MVOA4A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.614271882 (495h0m15.165742343s) [noise=true , address=185.167.204.206:4062 , piece_id=H3SUGOYJRWVMUSGMLIG5GFW5PHWTVVM6M6XJOUJ6OSY7VAL2UM5A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615166645 (495h0m15.166637096s) [noise=true , address=185.167.204.206:4038 , piece_id=ZU7CEJCYELXC7FKN2QPJ5IAZP6EFPPV4J4J66RH3KCDJV23275RA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615702125 (495h0m15.167172586s) [noise=true , address=185.167.204.206:4071 , piece_id=IYOTAVZNF2NHM4EENETKXNZEDDOSQ2S5JM6Y6WU2C42XMEUEZSPQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.622348872 (495h0m15.173819323s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.623554238 (495h0m15.175024699s) [noise=true , address=185.167.204.206:4045 , piece_id=YSXBKASXLB4PWVBCXYKKZKFLWYDSCNLRLAZWTDLXK5RGM5JLIBQA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.625468773 (495h0m15.176939234s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.633697702 (495h0m15.185168163s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:17.952847920 (495h0m16.504318381s) [noise=true , address=89.149.201.147:4007 , piece_id=FYFK5AZQPRL5X34B5LH53Z2ONLLDNRHNBJ2Q4AU2APNX23BU5TBA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.168814250 (495h0m16.720284711s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905289666 (495h0m17.456760137s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905315666 (495h0m17.456786137s) [seg_pos={0 0}, upload=435893]: Segment reached optimal threshold of 26 pieces.
Nov 29 23:04:18.905784339 (495h0m17.45725481s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Nov 29 23:04:18.905833892 (495h0m17.457304364s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906246979 (495h0m17.45771745s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: read tcp 188.166.225.170:44936->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 29 23:04:18.906260154 (495h0m17.457730615s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906282096 (495h0m17.457752567s) [seg_pos={0 0}, upload=435893]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 29 23:04:18.906373140 (495h0m17.457843601s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 29 23:04:18.906380694 (495h0m17.457851165s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 29 23:04:19.169071817 (495h0m17.720542278s) [upload=435893]: Done uploading segments...
Nov 29 23:04:19.169097004 (495h0m17.720567465s) [upload=435893]: Upload finished. err: <nil>
Duration: 5.777431418s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
6.169816139s trace:
https://jaeger.dev.storj.io/trace/d24e282cae355a8
FAIL (2025-11-29 23:47:31 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
63204 (495h0m13.918633665s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367386489 (495h0m13.91885694s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367586149 (495h0m13.919056611s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.368368469 (495h0m13.91983893s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.370168877 (495h0m13.921639338s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.372146263 (495h0m13.923616714s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.373978502 (495h0m13.925448963s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.374415854 (495h0m13.925886596s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.375566746 (495h0m13.927037207s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.379743138 (495h0m13.931213599s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:16.193964208 (495h0m14.745434669s) [upload=435893]: Next returned nil segment
Nov 29 23:04:16.193980790 (495h0m14.745451241s) [upload=435893]: Waiting for error group managing segments...
Nov 29 23:04:16.588328531 (495h0m15.139798982s) [noise=true , address=185.167.204.205:4022 , piece_id=KQGAPJ7IJQDN6N4LEIQTD43THU2KPWLMYSFUYKPBBE23K5MPTXYA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.588450043 (495h0m15.139920504s) [noise=true , address=185.167.204.206:4061 , piece_id=R6OFY6MJVY5ENXOZZWHC2CKS73QNXJIWDRBKXTYJRXNOOQYTKDOA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.591055714 (495h0m15.142526175s) [noise=true , address=185.167.204.205:4015 , piece_id=BH4FVVQEWVY5OP3GHPVVHYXV7YXXL7VBEKVBNICNQIUMZOQMBSAA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.595531226 (495h0m15.147001677s) [noise=true , address=185.167.204.205:4005 , piece_id=YFK5HBNTOTKRSUS4XRZ3YRPAI4ZEK3DKBLXSIG56DZPOPCTXPOKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.596866599 (495h0m15.14833706s) [noise=true , address=185.167.204.205:4033 , piece_id=YP3HYJ5S3HAPYPPQ5X4BBKI7LERBP7LOVOKZHWMR5GTZC6QMWE3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600090748 (495h0m15.151561209s) [noise=true , address=185.167.204.206:4072 , piece_id=IQ4AAJG4NXO7I2JOJTSSDWF5KXZGLIN6H4BZVUOMVWRSWEIPQHRA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600437999 (495h0m15.15190846s) [noise=true , address=185.167.204.205:4021 , piece_id=GISPTI7P22CQBEETXZ7S4K4RKLTOCAGNKPEQNJK4SA6OZ3LSIE7Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.606498990 (495h0m15.157969441s) [noise=true , address=185.167.204.206:4055 , piece_id=B3BO65PLZH6WDE7YB4PNBRIZPKDWA7E2LIUQZL5WZB7MYJFXSIVQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607132467 (495h0m15.158602918s) [noise=true , address=185.167.204.206:4056 , piece_id=BS26JRUAU2EQAW4FY3IRCVHLH6W34RM55ZRD5HZQFEZ72MTOK7UA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607358097 (495h0m15.158828558s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.608394009 (495h0m15.15986447s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.609654600 (495h0m15.161125061s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610336178 (495h0m15.161806639s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610894210 (495h0m15.162364671s) [noise=true , address=185.167.204.206:4064 , piece_id=36FVLSJCAL36EI6RP2ZB2TRZ3DSBB2K2WIVYWTD6E2SJK2VMOR4Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.612907824 (495h0m15.164378285s) [noise=true , address=185.167.204.206:4040 , piece_id=JI3FSPBHYZXSTJSXXADXEZKO24UGVPYITM64Z7ORHFSPQQS7PE7A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.613654436 (495h0m15.165124887s) [noise=true , address=185.167.204.205:4020 , piece_id=P6XJ6EVG4HEEC4MNEFKCTOZOX55EJIMTTL4RSWPC5MTS77MVOA4A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.614271882 (495h0m15.165742343s) [noise=true , address=185.167.204.206:4062 , piece_id=H3SUGOYJRWVMUSGMLIG5GFW5PHWTVVM6M6XJOUJ6OSY7VAL2UM5A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615166645 (495h0m15.166637096s) [noise=true , address=185.167.204.206:4038 , piece_id=ZU7CEJCYELXC7FKN2QPJ5IAZP6EFPPV4J4J66RH3KCDJV23275RA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615702125 (495h0m15.167172586s) [noise=true , address=185.167.204.206:4071 , piece_id=IYOTAVZNF2NHM4EENETKXNZEDDOSQ2S5JM6Y6WU2C42XMEUEZSPQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.622348872 (495h0m15.173819323s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.623554238 (495h0m15.175024699s) [noise=true , address=185.167.204.206:4045 , piece_id=YSXBKASXLB4PWVBCXYKKZKFLWYDSCNLRLAZWTDLXK5RGM5JLIBQA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.625468773 (495h0m15.176939234s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.633697702 (495h0m15.185168163s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:17.952847920 (495h0m16.504318381s) [noise=true , address=89.149.201.147:4007 , piece_id=FYFK5AZQPRL5X34B5LH53Z2ONLLDNRHNBJ2Q4AU2APNX23BU5TBA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.168814250 (495h0m16.720284711s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905289666 (495h0m17.456760137s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905315666 (495h0m17.456786137s) [seg_pos={0 0}, upload=435893]: Segment reached optimal threshold of 26 pieces.
Nov 29 23:04:18.905784339 (495h0m17.45725481s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Nov 29 23:04:18.905833892 (495h0m17.457304364s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906246979 (495h0m17.45771745s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: read tcp 188.166.225.170:44936->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 29 23:04:18.906260154 (495h0m17.457730615s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906282096 (495h0m17.457752567s) [seg_pos={0 0}, upload=435893]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 29 23:04:18.906373140 (495h0m17.457843601s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 29 23:04:18.906380694 (495h0m17.457851165s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 29 23:04:19.169071817 (495h0m17.720542278s) [upload=435893]: Done uploading segments...
Nov 29 23:04:19.169097004 (495h0m17.720567465s) [upload=435893]: Upload finished. err: <nil>
Duration: 6.169876493s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
5.830813998s trace:
https://jaeger.dev.storj.io/trace/d24e282cae355a8
FAIL (2025-11-29 23:46:21 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
63204 (495h0m13.918633665s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367386489 (495h0m13.91885694s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367586149 (495h0m13.919056611s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.368368469 (495h0m13.91983893s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.370168877 (495h0m13.921639338s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.372146263 (495h0m13.923616714s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.373978502 (495h0m13.925448963s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.374415854 (495h0m13.925886596s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.375566746 (495h0m13.927037207s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.379743138 (495h0m13.931213599s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:16.193964208 (495h0m14.745434669s) [upload=435893]: Next returned nil segment
Nov 29 23:04:16.193980790 (495h0m14.745451241s) [upload=435893]: Waiting for error group managing segments...
Nov 29 23:04:16.588328531 (495h0m15.139798982s) [noise=true , address=185.167.204.205:4022 , piece_id=KQGAPJ7IJQDN6N4LEIQTD43THU2KPWLMYSFUYKPBBE23K5MPTXYA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.588450043 (495h0m15.139920504s) [noise=true , address=185.167.204.206:4061 , piece_id=R6OFY6MJVY5ENXOZZWHC2CKS73QNXJIWDRBKXTYJRXNOOQYTKDOA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.591055714 (495h0m15.142526175s) [noise=true , address=185.167.204.205:4015 , piece_id=BH4FVVQEWVY5OP3GHPVVHYXV7YXXL7VBEKVBNICNQIUMZOQMBSAA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.595531226 (495h0m15.147001677s) [noise=true , address=185.167.204.205:4005 , piece_id=YFK5HBNTOTKRSUS4XRZ3YRPAI4ZEK3DKBLXSIG56DZPOPCTXPOKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.596866599 (495h0m15.14833706s) [noise=true , address=185.167.204.205:4033 , piece_id=YP3HYJ5S3HAPYPPQ5X4BBKI7LERBP7LOVOKZHWMR5GTZC6QMWE3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600090748 (495h0m15.151561209s) [noise=true , address=185.167.204.206:4072 , piece_id=IQ4AAJG4NXO7I2JOJTSSDWF5KXZGLIN6H4BZVUOMVWRSWEIPQHRA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600437999 (495h0m15.15190846s) [noise=true , address=185.167.204.205:4021 , piece_id=GISPTI7P22CQBEETXZ7S4K4RKLTOCAGNKPEQNJK4SA6OZ3LSIE7Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.606498990 (495h0m15.157969441s) [noise=true , address=185.167.204.206:4055 , piece_id=B3BO65PLZH6WDE7YB4PNBRIZPKDWA7E2LIUQZL5WZB7MYJFXSIVQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607132467 (495h0m15.158602918s) [noise=true , address=185.167.204.206:4056 , piece_id=BS26JRUAU2EQAW4FY3IRCVHLH6W34RM55ZRD5HZQFEZ72MTOK7UA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607358097 (495h0m15.158828558s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.608394009 (495h0m15.15986447s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.609654600 (495h0m15.161125061s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610336178 (495h0m15.161806639s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610894210 (495h0m15.162364671s) [noise=true , address=185.167.204.206:4064 , piece_id=36FVLSJCAL36EI6RP2ZB2TRZ3DSBB2K2WIVYWTD6E2SJK2VMOR4Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.612907824 (495h0m15.164378285s) [noise=true , address=185.167.204.206:4040 , piece_id=JI3FSPBHYZXSTJSXXADXEZKO24UGVPYITM64Z7ORHFSPQQS7PE7A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.613654436 (495h0m15.165124887s) [noise=true , address=185.167.204.205:4020 , piece_id=P6XJ6EVG4HEEC4MNEFKCTOZOX55EJIMTTL4RSWPC5MTS77MVOA4A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.614271882 (495h0m15.165742343s) [noise=true , address=185.167.204.206:4062 , piece_id=H3SUGOYJRWVMUSGMLIG5GFW5PHWTVVM6M6XJOUJ6OSY7VAL2UM5A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615166645 (495h0m15.166637096s) [noise=true , address=185.167.204.206:4038 , piece_id=ZU7CEJCYELXC7FKN2QPJ5IAZP6EFPPV4J4J66RH3KCDJV23275RA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615702125 (495h0m15.167172586s) [noise=true , address=185.167.204.206:4071 , piece_id=IYOTAVZNF2NHM4EENETKXNZEDDOSQ2S5JM6Y6WU2C42XMEUEZSPQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.622348872 (495h0m15.173819323s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.623554238 (495h0m15.175024699s) [noise=true , address=185.167.204.206:4045 , piece_id=YSXBKASXLB4PWVBCXYKKZKFLWYDSCNLRLAZWTDLXK5RGM5JLIBQA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.625468773 (495h0m15.176939234s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.633697702 (495h0m15.185168163s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:17.952847920 (495h0m16.504318381s) [noise=true , address=89.149.201.147:4007 , piece_id=FYFK5AZQPRL5X34B5LH53Z2ONLLDNRHNBJ2Q4AU2APNX23BU5TBA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.168814250 (495h0m16.720284711s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905289666 (495h0m17.456760137s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905315666 (495h0m17.456786137s) [seg_pos={0 0}, upload=435893]: Segment reached optimal threshold of 26 pieces.
Nov 29 23:04:18.905784339 (495h0m17.45725481s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Nov 29 23:04:18.905833892 (495h0m17.457304364s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906246979 (495h0m17.45771745s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: read tcp 188.166.225.170:44936->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 29 23:04:18.906260154 (495h0m17.457730615s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906282096 (495h0m17.457752567s) [seg_pos={0 0}, upload=435893]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 29 23:04:18.906373140 (495h0m17.457843601s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 29 23:04:18.906380694 (495h0m17.457851165s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 29 23:04:19.169071817 (495h0m17.720542278s) [upload=435893]: Done uploading segments...
Nov 29 23:04:19.169097004 (495h0m17.720567465s) [upload=435893]: Upload finished. err: <nil>
Duration: 5.830839766s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
5.834340393s trace:
https://jaeger.dev.storj.io/trace/d24e282cae355a8
FAIL (2025-11-29 23:45:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
63204 (495h0m13.918633665s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367386489 (495h0m13.91885694s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367586149 (495h0m13.919056611s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.368368469 (495h0m13.91983893s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.370168877 (495h0m13.921639338s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.372146263 (495h0m13.923616714s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.373978502 (495h0m13.925448963s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.374415854 (495h0m13.925886596s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.375566746 (495h0m13.927037207s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.379743138 (495h0m13.931213599s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:16.193964208 (495h0m14.745434669s) [upload=435893]: Next returned nil segment
Nov 29 23:04:16.193980790 (495h0m14.745451241s) [upload=435893]: Waiting for error group managing segments...
Nov 29 23:04:16.588328531 (495h0m15.139798982s) [noise=true , address=185.167.204.205:4022 , piece_id=KQGAPJ7IJQDN6N4LEIQTD43THU2KPWLMYSFUYKPBBE23K5MPTXYA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.588450043 (495h0m15.139920504s) [noise=true , address=185.167.204.206:4061 , piece_id=R6OFY6MJVY5ENXOZZWHC2CKS73QNXJIWDRBKXTYJRXNOOQYTKDOA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.591055714 (495h0m15.142526175s) [noise=true , address=185.167.204.205:4015 , piece_id=BH4FVVQEWVY5OP3GHPVVHYXV7YXXL7VBEKVBNICNQIUMZOQMBSAA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.595531226 (495h0m15.147001677s) [noise=true , address=185.167.204.205:4005 , piece_id=YFK5HBNTOTKRSUS4XRZ3YRPAI4ZEK3DKBLXSIG56DZPOPCTXPOKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.596866599 (495h0m15.14833706s) [noise=true , address=185.167.204.205:4033 , piece_id=YP3HYJ5S3HAPYPPQ5X4BBKI7LERBP7LOVOKZHWMR5GTZC6QMWE3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600090748 (495h0m15.151561209s) [noise=true , address=185.167.204.206:4072 , piece_id=IQ4AAJG4NXO7I2JOJTSSDWF5KXZGLIN6H4BZVUOMVWRSWEIPQHRA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600437999 (495h0m15.15190846s) [noise=true , address=185.167.204.205:4021 , piece_id=GISPTI7P22CQBEETXZ7S4K4RKLTOCAGNKPEQNJK4SA6OZ3LSIE7Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.606498990 (495h0m15.157969441s) [noise=true , address=185.167.204.206:4055 , piece_id=B3BO65PLZH6WDE7YB4PNBRIZPKDWA7E2LIUQZL5WZB7MYJFXSIVQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607132467 (495h0m15.158602918s) [noise=true , address=185.167.204.206:4056 , piece_id=BS26JRUAU2EQAW4FY3IRCVHLH6W34RM55ZRD5HZQFEZ72MTOK7UA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607358097 (495h0m15.158828558s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.608394009 (495h0m15.15986447s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.609654600 (495h0m15.161125061s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610336178 (495h0m15.161806639s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610894210 (495h0m15.162364671s) [noise=true , address=185.167.204.206:4064 , piece_id=36FVLSJCAL36EI6RP2ZB2TRZ3DSBB2K2WIVYWTD6E2SJK2VMOR4Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.612907824 (495h0m15.164378285s) [noise=true , address=185.167.204.206:4040 , piece_id=JI3FSPBHYZXSTJSXXADXEZKO24UGVPYITM64Z7ORHFSPQQS7PE7A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.613654436 (495h0m15.165124887s) [noise=true , address=185.167.204.205:4020 , piece_id=P6XJ6EVG4HEEC4MNEFKCTOZOX55EJIMTTL4RSWPC5MTS77MVOA4A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.614271882 (495h0m15.165742343s) [noise=true , address=185.167.204.206:4062 , piece_id=H3SUGOYJRWVMUSGMLIG5GFW5PHWTVVM6M6XJOUJ6OSY7VAL2UM5A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615166645 (495h0m15.166637096s) [noise=true , address=185.167.204.206:4038 , piece_id=ZU7CEJCYELXC7FKN2QPJ5IAZP6EFPPV4J4J66RH3KCDJV23275RA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615702125 (495h0m15.167172586s) [noise=true , address=185.167.204.206:4071 , piece_id=IYOTAVZNF2NHM4EENETKXNZEDDOSQ2S5JM6Y6WU2C42XMEUEZSPQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.622348872 (495h0m15.173819323s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.623554238 (495h0m15.175024699s) [noise=true , address=185.167.204.206:4045 , piece_id=YSXBKASXLB4PWVBCXYKKZKFLWYDSCNLRLAZWTDLXK5RGM5JLIBQA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.625468773 (495h0m15.176939234s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.633697702 (495h0m15.185168163s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:17.952847920 (495h0m16.504318381s) [noise=true , address=89.149.201.147:4007 , piece_id=FYFK5AZQPRL5X34B5LH53Z2ONLLDNRHNBJ2Q4AU2APNX23BU5TBA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.168814250 (495h0m16.720284711s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905289666 (495h0m17.456760137s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905315666 (495h0m17.456786137s) [seg_pos={0 0}, upload=435893]: Segment reached optimal threshold of 26 pieces.
Nov 29 23:04:18.905784339 (495h0m17.45725481s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Nov 29 23:04:18.905833892 (495h0m17.457304364s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906246979 (495h0m17.45771745s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: read tcp 188.166.225.170:44936->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 29 23:04:18.906260154 (495h0m17.457730615s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906282096 (495h0m17.457752567s) [seg_pos={0 0}, upload=435893]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 29 23:04:18.906373140 (495h0m17.457843601s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 29 23:04:18.906380694 (495h0m17.457851165s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 29 23:04:19.169071817 (495h0m17.720542278s) [upload=435893]: Done uploading segments...
Nov 29 23:04:19.169097004 (495h0m17.720567465s) [upload=435893]: Upload finished. err: <nil>
Duration: 5.834368476s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
5.737005018s trace:
https://jaeger.dev.storj.io/trace/d24e282cae355a8
FAIL (2025-11-29 23:44:27 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
63204 (495h0m13.918633665s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367386489 (495h0m13.91885694s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367586149 (495h0m13.919056611s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.368368469 (495h0m13.91983893s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.370168877 (495h0m13.921639338s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.372146263 (495h0m13.923616714s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.373978502 (495h0m13.925448963s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.374415854 (495h0m13.925886596s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.375566746 (495h0m13.927037207s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.379743138 (495h0m13.931213599s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:16.193964208 (495h0m14.745434669s) [upload=435893]: Next returned nil segment
Nov 29 23:04:16.193980790 (495h0m14.745451241s) [upload=435893]: Waiting for error group managing segments...
Nov 29 23:04:16.588328531 (495h0m15.139798982s) [noise=true , address=185.167.204.205:4022 , piece_id=KQGAPJ7IJQDN6N4LEIQTD43THU2KPWLMYSFUYKPBBE23K5MPTXYA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.588450043 (495h0m15.139920504s) [noise=true , address=185.167.204.206:4061 , piece_id=R6OFY6MJVY5ENXOZZWHC2CKS73QNXJIWDRBKXTYJRXNOOQYTKDOA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.591055714 (495h0m15.142526175s) [noise=true , address=185.167.204.205:4015 , piece_id=BH4FVVQEWVY5OP3GHPVVHYXV7YXXL7VBEKVBNICNQIUMZOQMBSAA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.595531226 (495h0m15.147001677s) [noise=true , address=185.167.204.205:4005 , piece_id=YFK5HBNTOTKRSUS4XRZ3YRPAI4ZEK3DKBLXSIG56DZPOPCTXPOKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.596866599 (495h0m15.14833706s) [noise=true , address=185.167.204.205:4033 , piece_id=YP3HYJ5S3HAPYPPQ5X4BBKI7LERBP7LOVOKZHWMR5GTZC6QMWE3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600090748 (495h0m15.151561209s) [noise=true , address=185.167.204.206:4072 , piece_id=IQ4AAJG4NXO7I2JOJTSSDWF5KXZGLIN6H4BZVUOMVWRSWEIPQHRA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600437999 (495h0m15.15190846s) [noise=true , address=185.167.204.205:4021 , piece_id=GISPTI7P22CQBEETXZ7S4K4RKLTOCAGNKPEQNJK4SA6OZ3LSIE7Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.606498990 (495h0m15.157969441s) [noise=true , address=185.167.204.206:4055 , piece_id=B3BO65PLZH6WDE7YB4PNBRIZPKDWA7E2LIUQZL5WZB7MYJFXSIVQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607132467 (495h0m15.158602918s) [noise=true , address=185.167.204.206:4056 , piece_id=BS26JRUAU2EQAW4FY3IRCVHLH6W34RM55ZRD5HZQFEZ72MTOK7UA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607358097 (495h0m15.158828558s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.608394009 (495h0m15.15986447s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.609654600 (495h0m15.161125061s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610336178 (495h0m15.161806639s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610894210 (495h0m15.162364671s) [noise=true , address=185.167.204.206:4064 , piece_id=36FVLSJCAL36EI6RP2ZB2TRZ3DSBB2K2WIVYWTD6E2SJK2VMOR4Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.612907824 (495h0m15.164378285s) [noise=true , address=185.167.204.206:4040 , piece_id=JI3FSPBHYZXSTJSXXADXEZKO24UGVPYITM64Z7ORHFSPQQS7PE7A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.613654436 (495h0m15.165124887s) [noise=true , address=185.167.204.205:4020 , piece_id=P6XJ6EVG4HEEC4MNEFKCTOZOX55EJIMTTL4RSWPC5MTS77MVOA4A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.614271882 (495h0m15.165742343s) [noise=true , address=185.167.204.206:4062 , piece_id=H3SUGOYJRWVMUSGMLIG5GFW5PHWTVVM6M6XJOUJ6OSY7VAL2UM5A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615166645 (495h0m15.166637096s) [noise=true , address=185.167.204.206:4038 , piece_id=ZU7CEJCYELXC7FKN2QPJ5IAZP6EFPPV4J4J66RH3KCDJV23275RA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615702125 (495h0m15.167172586s) [noise=true , address=185.167.204.206:4071 , piece_id=IYOTAVZNF2NHM4EENETKXNZEDDOSQ2S5JM6Y6WU2C42XMEUEZSPQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.622348872 (495h0m15.173819323s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.623554238 (495h0m15.175024699s) [noise=true , address=185.167.204.206:4045 , piece_id=YSXBKASXLB4PWVBCXYKKZKFLWYDSCNLRLAZWTDLXK5RGM5JLIBQA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.625468773 (495h0m15.176939234s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.633697702 (495h0m15.185168163s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:17.952847920 (495h0m16.504318381s) [noise=true , address=89.149.201.147:4007 , piece_id=FYFK5AZQPRL5X34B5LH53Z2ONLLDNRHNBJ2Q4AU2APNX23BU5TBA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.168814250 (495h0m16.720284711s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905289666 (495h0m17.456760137s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905315666 (495h0m17.456786137s) [seg_pos={0 0}, upload=435893]: Segment reached optimal threshold of 26 pieces.
Nov 29 23:04:18.905784339 (495h0m17.45725481s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Nov 29 23:04:18.905833892 (495h0m17.457304364s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906246979 (495h0m17.45771745s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: read tcp 188.166.225.170:44936->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 29 23:04:18.906260154 (495h0m17.457730615s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906282096 (495h0m17.457752567s) [seg_pos={0 0}, upload=435893]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 29 23:04:18.906373140 (495h0m17.457843601s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 29 23:04:18.906380694 (495h0m17.457851165s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 29 23:04:19.169071817 (495h0m17.720542278s) [upload=435893]: Done uploading segments...
Nov 29 23:04:19.169097004 (495h0m17.720567465s) [upload=435893]: Upload finished. err: <nil>
Duration: 5.737099378s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
6.187816125s trace:
https://jaeger.dev.storj.io/trace/d24e282cae355a8
FAIL (2025-11-29 23:43:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
63204 (495h0m13.918633665s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367386489 (495h0m13.91885694s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367586149 (495h0m13.919056611s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.368368469 (495h0m13.91983893s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.370168877 (495h0m13.921639338s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.372146263 (495h0m13.923616714s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.373978502 (495h0m13.925448963s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.374415854 (495h0m13.925886596s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.375566746 (495h0m13.927037207s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.379743138 (495h0m13.931213599s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:16.193964208 (495h0m14.745434669s) [upload=435893]: Next returned nil segment
Nov 29 23:04:16.193980790 (495h0m14.745451241s) [upload=435893]: Waiting for error group managing segments...
Nov 29 23:04:16.588328531 (495h0m15.139798982s) [noise=true , address=185.167.204.205:4022 , piece_id=KQGAPJ7IJQDN6N4LEIQTD43THU2KPWLMYSFUYKPBBE23K5MPTXYA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.588450043 (495h0m15.139920504s) [noise=true , address=185.167.204.206:4061 , piece_id=R6OFY6MJVY5ENXOZZWHC2CKS73QNXJIWDRBKXTYJRXNOOQYTKDOA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.591055714 (495h0m15.142526175s) [noise=true , address=185.167.204.205:4015 , piece_id=BH4FVVQEWVY5OP3GHPVVHYXV7YXXL7VBEKVBNICNQIUMZOQMBSAA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.595531226 (495h0m15.147001677s) [noise=true , address=185.167.204.205:4005 , piece_id=YFK5HBNTOTKRSUS4XRZ3YRPAI4ZEK3DKBLXSIG56DZPOPCTXPOKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.596866599 (495h0m15.14833706s) [noise=true , address=185.167.204.205:4033 , piece_id=YP3HYJ5S3HAPYPPQ5X4BBKI7LERBP7LOVOKZHWMR5GTZC6QMWE3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600090748 (495h0m15.151561209s) [noise=true , address=185.167.204.206:4072 , piece_id=IQ4AAJG4NXO7I2JOJTSSDWF5KXZGLIN6H4BZVUOMVWRSWEIPQHRA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600437999 (495h0m15.15190846s) [noise=true , address=185.167.204.205:4021 , piece_id=GISPTI7P22CQBEETXZ7S4K4RKLTOCAGNKPEQNJK4SA6OZ3LSIE7Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.606498990 (495h0m15.157969441s) [noise=true , address=185.167.204.206:4055 , piece_id=B3BO65PLZH6WDE7YB4PNBRIZPKDWA7E2LIUQZL5WZB7MYJFXSIVQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607132467 (495h0m15.158602918s) [noise=true , address=185.167.204.206:4056 , piece_id=BS26JRUAU2EQAW4FY3IRCVHLH6W34RM55ZRD5HZQFEZ72MTOK7UA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607358097 (495h0m15.158828558s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.608394009 (495h0m15.15986447s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.609654600 (495h0m15.161125061s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610336178 (495h0m15.161806639s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610894210 (495h0m15.162364671s) [noise=true , address=185.167.204.206:4064 , piece_id=36FVLSJCAL36EI6RP2ZB2TRZ3DSBB2K2WIVYWTD6E2SJK2VMOR4Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.612907824 (495h0m15.164378285s) [noise=true , address=185.167.204.206:4040 , piece_id=JI3FSPBHYZXSTJSXXADXEZKO24UGVPYITM64Z7ORHFSPQQS7PE7A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.613654436 (495h0m15.165124887s) [noise=true , address=185.167.204.205:4020 , piece_id=P6XJ6EVG4HEEC4MNEFKCTOZOX55EJIMTTL4RSWPC5MTS77MVOA4A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.614271882 (495h0m15.165742343s) [noise=true , address=185.167.204.206:4062 , piece_id=H3SUGOYJRWVMUSGMLIG5GFW5PHWTVVM6M6XJOUJ6OSY7VAL2UM5A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615166645 (495h0m15.166637096s) [noise=true , address=185.167.204.206:4038 , piece_id=ZU7CEJCYELXC7FKN2QPJ5IAZP6EFPPV4J4J66RH3KCDJV23275RA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615702125 (495h0m15.167172586s) [noise=true , address=185.167.204.206:4071 , piece_id=IYOTAVZNF2NHM4EENETKXNZEDDOSQ2S5JM6Y6WU2C42XMEUEZSPQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.622348872 (495h0m15.173819323s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.623554238 (495h0m15.175024699s) [noise=true , address=185.167.204.206:4045 , piece_id=YSXBKASXLB4PWVBCXYKKZKFLWYDSCNLRLAZWTDLXK5RGM5JLIBQA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.625468773 (495h0m15.176939234s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.633697702 (495h0m15.185168163s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:17.952847920 (495h0m16.504318381s) [noise=true , address=89.149.201.147:4007 , piece_id=FYFK5AZQPRL5X34B5LH53Z2ONLLDNRHNBJ2Q4AU2APNX23BU5TBA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.168814250 (495h0m16.720284711s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905289666 (495h0m17.456760137s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905315666 (495h0m17.456786137s) [seg_pos={0 0}, upload=435893]: Segment reached optimal threshold of 26 pieces.
Nov 29 23:04:18.905784339 (495h0m17.45725481s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Nov 29 23:04:18.905833892 (495h0m17.457304364s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906246979 (495h0m17.45771745s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: read tcp 188.166.225.170:44936->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 29 23:04:18.906260154 (495h0m17.457730615s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906282096 (495h0m17.457752567s) [seg_pos={0 0}, upload=435893]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 29 23:04:18.906373140 (495h0m17.457843601s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 29 23:04:18.906380694 (495h0m17.457851165s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 29 23:04:19.169071817 (495h0m17.720542278s) [upload=435893]: Done uploading segments...
Nov 29 23:04:19.169097004 (495h0m17.720567465s) [upload=435893]: Upload finished. err: <nil>
Duration: 6.187843697s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
6.207909065s trace:
https://jaeger.dev.storj.io/trace/d24e282cae355a8
FAIL (2025-11-29 23:42:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
63204 (495h0m13.918633665s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367386489 (495h0m13.91885694s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367586149 (495h0m13.919056611s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.368368469 (495h0m13.91983893s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.370168877 (495h0m13.921639338s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.372146263 (495h0m13.923616714s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.373978502 (495h0m13.925448963s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.374415854 (495h0m13.925886596s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.375566746 (495h0m13.927037207s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.379743138 (495h0m13.931213599s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:16.193964208 (495h0m14.745434669s) [upload=435893]: Next returned nil segment
Nov 29 23:04:16.193980790 (495h0m14.745451241s) [upload=435893]: Waiting for error group managing segments...
Nov 29 23:04:16.588328531 (495h0m15.139798982s) [noise=true , address=185.167.204.205:4022 , piece_id=KQGAPJ7IJQDN6N4LEIQTD43THU2KPWLMYSFUYKPBBE23K5MPTXYA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.588450043 (495h0m15.139920504s) [noise=true , address=185.167.204.206:4061 , piece_id=R6OFY6MJVY5ENXOZZWHC2CKS73QNXJIWDRBKXTYJRXNOOQYTKDOA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.591055714 (495h0m15.142526175s) [noise=true , address=185.167.204.205:4015 , piece_id=BH4FVVQEWVY5OP3GHPVVHYXV7YXXL7VBEKVBNICNQIUMZOQMBSAA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.595531226 (495h0m15.147001677s) [noise=true , address=185.167.204.205:4005 , piece_id=YFK5HBNTOTKRSUS4XRZ3YRPAI4ZEK3DKBLXSIG56DZPOPCTXPOKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.596866599 (495h0m15.14833706s) [noise=true , address=185.167.204.205:4033 , piece_id=YP3HYJ5S3HAPYPPQ5X4BBKI7LERBP7LOVOKZHWMR5GTZC6QMWE3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600090748 (495h0m15.151561209s) [noise=true , address=185.167.204.206:4072 , piece_id=IQ4AAJG4NXO7I2JOJTSSDWF5KXZGLIN6H4BZVUOMVWRSWEIPQHRA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600437999 (495h0m15.15190846s) [noise=true , address=185.167.204.205:4021 , piece_id=GISPTI7P22CQBEETXZ7S4K4RKLTOCAGNKPEQNJK4SA6OZ3LSIE7Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.606498990 (495h0m15.157969441s) [noise=true , address=185.167.204.206:4055 , piece_id=B3BO65PLZH6WDE7YB4PNBRIZPKDWA7E2LIUQZL5WZB7MYJFXSIVQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607132467 (495h0m15.158602918s) [noise=true , address=185.167.204.206:4056 , piece_id=BS26JRUAU2EQAW4FY3IRCVHLH6W34RM55ZRD5HZQFEZ72MTOK7UA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607358097 (495h0m15.158828558s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.608394009 (495h0m15.15986447s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.609654600 (495h0m15.161125061s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610336178 (495h0m15.161806639s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610894210 (495h0m15.162364671s) [noise=true , address=185.167.204.206:4064 , piece_id=36FVLSJCAL36EI6RP2ZB2TRZ3DSBB2K2WIVYWTD6E2SJK2VMOR4Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.612907824 (495h0m15.164378285s) [noise=true , address=185.167.204.206:4040 , piece_id=JI3FSPBHYZXSTJSXXADXEZKO24UGVPYITM64Z7ORHFSPQQS7PE7A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.613654436 (495h0m15.165124887s) [noise=true , address=185.167.204.205:4020 , piece_id=P6XJ6EVG4HEEC4MNEFKCTOZOX55EJIMTTL4RSWPC5MTS77MVOA4A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.614271882 (495h0m15.165742343s) [noise=true , address=185.167.204.206:4062 , piece_id=H3SUGOYJRWVMUSGMLIG5GFW5PHWTVVM6M6XJOUJ6OSY7VAL2UM5A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615166645 (495h0m15.166637096s) [noise=true , address=185.167.204.206:4038 , piece_id=ZU7CEJCYELXC7FKN2QPJ5IAZP6EFPPV4J4J66RH3KCDJV23275RA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615702125 (495h0m15.167172586s) [noise=true , address=185.167.204.206:4071 , piece_id=IYOTAVZNF2NHM4EENETKXNZEDDOSQ2S5JM6Y6WU2C42XMEUEZSPQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.622348872 (495h0m15.173819323s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.623554238 (495h0m15.175024699s) [noise=true , address=185.167.204.206:4045 , piece_id=YSXBKASXLB4PWVBCXYKKZKFLWYDSCNLRLAZWTDLXK5RGM5JLIBQA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.625468773 (495h0m15.176939234s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.633697702 (495h0m15.185168163s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:17.952847920 (495h0m16.504318381s) [noise=true , address=89.149.201.147:4007 , piece_id=FYFK5AZQPRL5X34B5LH53Z2ONLLDNRHNBJ2Q4AU2APNX23BU5TBA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.168814250 (495h0m16.720284711s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905289666 (495h0m17.456760137s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905315666 (495h0m17.456786137s) [seg_pos={0 0}, upload=435893]: Segment reached optimal threshold of 26 pieces.
Nov 29 23:04:18.905784339 (495h0m17.45725481s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Nov 29 23:04:18.905833892 (495h0m17.457304364s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906246979 (495h0m17.45771745s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: read tcp 188.166.225.170:44936->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 29 23:04:18.906260154 (495h0m17.457730615s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906282096 (495h0m17.457752567s) [seg_pos={0 0}, upload=435893]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 29 23:04:18.906373140 (495h0m17.457843601s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 29 23:04:18.906380694 (495h0m17.457851165s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 29 23:04:19.169071817 (495h0m17.720542278s) [upload=435893]: Done uploading segments...
Nov 29 23:04:19.169097004 (495h0m17.720567465s) [upload=435893]: Upload finished. err: <nil>
Duration: 6.207942149s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
5.292192156s trace:
https://jaeger.dev.storj.io/trace/d24e282cae355a8
FAIL (2025-11-29 23:41:37 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
63204 (495h0m13.918633665s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367386489 (495h0m13.91885694s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367586149 (495h0m13.919056611s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.368368469 (495h0m13.91983893s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.370168877 (495h0m13.921639338s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.372146263 (495h0m13.923616714s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.373978502 (495h0m13.925448963s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.374415854 (495h0m13.925886596s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.375566746 (495h0m13.927037207s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.379743138 (495h0m13.931213599s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:16.193964208 (495h0m14.745434669s) [upload=435893]: Next returned nil segment
Nov 29 23:04:16.193980790 (495h0m14.745451241s) [upload=435893]: Waiting for error group managing segments...
Nov 29 23:04:16.588328531 (495h0m15.139798982s) [noise=true , address=185.167.204.205:4022 , piece_id=KQGAPJ7IJQDN6N4LEIQTD43THU2KPWLMYSFUYKPBBE23K5MPTXYA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.588450043 (495h0m15.139920504s) [noise=true , address=185.167.204.206:4061 , piece_id=R6OFY6MJVY5ENXOZZWHC2CKS73QNXJIWDRBKXTYJRXNOOQYTKDOA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.591055714 (495h0m15.142526175s) [noise=true , address=185.167.204.205:4015 , piece_id=BH4FVVQEWVY5OP3GHPVVHYXV7YXXL7VBEKVBNICNQIUMZOQMBSAA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.595531226 (495h0m15.147001677s) [noise=true , address=185.167.204.205:4005 , piece_id=YFK5HBNTOTKRSUS4XRZ3YRPAI4ZEK3DKBLXSIG56DZPOPCTXPOKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.596866599 (495h0m15.14833706s) [noise=true , address=185.167.204.205:4033 , piece_id=YP3HYJ5S3HAPYPPQ5X4BBKI7LERBP7LOVOKZHWMR5GTZC6QMWE3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600090748 (495h0m15.151561209s) [noise=true , address=185.167.204.206:4072 , piece_id=IQ4AAJG4NXO7I2JOJTSSDWF5KXZGLIN6H4BZVUOMVWRSWEIPQHRA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600437999 (495h0m15.15190846s) [noise=true , address=185.167.204.205:4021 , piece_id=GISPTI7P22CQBEETXZ7S4K4RKLTOCAGNKPEQNJK4SA6OZ3LSIE7Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.606498990 (495h0m15.157969441s) [noise=true , address=185.167.204.206:4055 , piece_id=B3BO65PLZH6WDE7YB4PNBRIZPKDWA7E2LIUQZL5WZB7MYJFXSIVQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607132467 (495h0m15.158602918s) [noise=true , address=185.167.204.206:4056 , piece_id=BS26JRUAU2EQAW4FY3IRCVHLH6W34RM55ZRD5HZQFEZ72MTOK7UA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607358097 (495h0m15.158828558s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.608394009 (495h0m15.15986447s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.609654600 (495h0m15.161125061s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610336178 (495h0m15.161806639s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610894210 (495h0m15.162364671s) [noise=true , address=185.167.204.206:4064 , piece_id=36FVLSJCAL36EI6RP2ZB2TRZ3DSBB2K2WIVYWTD6E2SJK2VMOR4Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.612907824 (495h0m15.164378285s) [noise=true , address=185.167.204.206:4040 , piece_id=JI3FSPBHYZXSTJSXXADXEZKO24UGVPYITM64Z7ORHFSPQQS7PE7A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.613654436 (495h0m15.165124887s) [noise=true , address=185.167.204.205:4020 , piece_id=P6XJ6EVG4HEEC4MNEFKCTOZOX55EJIMTTL4RSWPC5MTS77MVOA4A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.614271882 (495h0m15.165742343s) [noise=true , address=185.167.204.206:4062 , piece_id=H3SUGOYJRWVMUSGMLIG5GFW5PHWTVVM6M6XJOUJ6OSY7VAL2UM5A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615166645 (495h0m15.166637096s) [noise=true , address=185.167.204.206:4038 , piece_id=ZU7CEJCYELXC7FKN2QPJ5IAZP6EFPPV4J4J66RH3KCDJV23275RA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615702125 (495h0m15.167172586s) [noise=true , address=185.167.204.206:4071 , piece_id=IYOTAVZNF2NHM4EENETKXNZEDDOSQ2S5JM6Y6WU2C42XMEUEZSPQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.622348872 (495h0m15.173819323s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.623554238 (495h0m15.175024699s) [noise=true , address=185.167.204.206:4045 , piece_id=YSXBKASXLB4PWVBCXYKKZKFLWYDSCNLRLAZWTDLXK5RGM5JLIBQA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.625468773 (495h0m15.176939234s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.633697702 (495h0m15.185168163s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:17.952847920 (495h0m16.504318381s) [noise=true , address=89.149.201.147:4007 , piece_id=FYFK5AZQPRL5X34B5LH53Z2ONLLDNRHNBJ2Q4AU2APNX23BU5TBA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.168814250 (495h0m16.720284711s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905289666 (495h0m17.456760137s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905315666 (495h0m17.456786137s) [seg_pos={0 0}, upload=435893]: Segment reached optimal threshold of 26 pieces.
Nov 29 23:04:18.905784339 (495h0m17.45725481s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Nov 29 23:04:18.905833892 (495h0m17.457304364s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906246979 (495h0m17.45771745s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: read tcp 188.166.225.170:44936->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 29 23:04:18.906260154 (495h0m17.457730615s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906282096 (495h0m17.457752567s) [seg_pos={0 0}, upload=435893]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 29 23:04:18.906373140 (495h0m17.457843601s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 29 23:04:18.906380694 (495h0m17.457851165s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 29 23:04:19.169071817 (495h0m17.720542278s) [upload=435893]: Done uploading segments...
Nov 29 23:04:19.169097004 (495h0m17.720567465s) [upload=435893]: Upload finished. err: <nil>
Duration: 5.292224096s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
5.718257401s trace:
https://jaeger.dev.storj.io/trace/d24e282cae355a8
FAIL (2025-11-29 23:41:16 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
63204 (495h0m13.918633665s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367386489 (495h0m13.91885694s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367586149 (495h0m13.919056611s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.368368469 (495h0m13.91983893s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.370168877 (495h0m13.921639338s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.372146263 (495h0m13.923616714s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.373978502 (495h0m13.925448963s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.374415854 (495h0m13.925886596s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.375566746 (495h0m13.927037207s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.379743138 (495h0m13.931213599s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:16.193964208 (495h0m14.745434669s) [upload=435893]: Next returned nil segment
Nov 29 23:04:16.193980790 (495h0m14.745451241s) [upload=435893]: Waiting for error group managing segments...
Nov 29 23:04:16.588328531 (495h0m15.139798982s) [noise=true , address=185.167.204.205:4022 , piece_id=KQGAPJ7IJQDN6N4LEIQTD43THU2KPWLMYSFUYKPBBE23K5MPTXYA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.588450043 (495h0m15.139920504s) [noise=true , address=185.167.204.206:4061 , piece_id=R6OFY6MJVY5ENXOZZWHC2CKS73QNXJIWDRBKXTYJRXNOOQYTKDOA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.591055714 (495h0m15.142526175s) [noise=true , address=185.167.204.205:4015 , piece_id=BH4FVVQEWVY5OP3GHPVVHYXV7YXXL7VBEKVBNICNQIUMZOQMBSAA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.595531226 (495h0m15.147001677s) [noise=true , address=185.167.204.205:4005 , piece_id=YFK5HBNTOTKRSUS4XRZ3YRPAI4ZEK3DKBLXSIG56DZPOPCTXPOKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.596866599 (495h0m15.14833706s) [noise=true , address=185.167.204.205:4033 , piece_id=YP3HYJ5S3HAPYPPQ5X4BBKI7LERBP7LOVOKZHWMR5GTZC6QMWE3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600090748 (495h0m15.151561209s) [noise=true , address=185.167.204.206:4072 , piece_id=IQ4AAJG4NXO7I2JOJTSSDWF5KXZGLIN6H4BZVUOMVWRSWEIPQHRA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600437999 (495h0m15.15190846s) [noise=true , address=185.167.204.205:4021 , piece_id=GISPTI7P22CQBEETXZ7S4K4RKLTOCAGNKPEQNJK4SA6OZ3LSIE7Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.606498990 (495h0m15.157969441s) [noise=true , address=185.167.204.206:4055 , piece_id=B3BO65PLZH6WDE7YB4PNBRIZPKDWA7E2LIUQZL5WZB7MYJFXSIVQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607132467 (495h0m15.158602918s) [noise=true , address=185.167.204.206:4056 , piece_id=BS26JRUAU2EQAW4FY3IRCVHLH6W34RM55ZRD5HZQFEZ72MTOK7UA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607358097 (495h0m15.158828558s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.608394009 (495h0m15.15986447s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.609654600 (495h0m15.161125061s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610336178 (495h0m15.161806639s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610894210 (495h0m15.162364671s) [noise=true , address=185.167.204.206:4064 , piece_id=36FVLSJCAL36EI6RP2ZB2TRZ3DSBB2K2WIVYWTD6E2SJK2VMOR4Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.612907824 (495h0m15.164378285s) [noise=true , address=185.167.204.206:4040 , piece_id=JI3FSPBHYZXSTJSXXADXEZKO24UGVPYITM64Z7ORHFSPQQS7PE7A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.613654436 (495h0m15.165124887s) [noise=true , address=185.167.204.205:4020 , piece_id=P6XJ6EVG4HEEC4MNEFKCTOZOX55EJIMTTL4RSWPC5MTS77MVOA4A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.614271882 (495h0m15.165742343s) [noise=true , address=185.167.204.206:4062 , piece_id=H3SUGOYJRWVMUSGMLIG5GFW5PHWTVVM6M6XJOUJ6OSY7VAL2UM5A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615166645 (495h0m15.166637096s) [noise=true , address=185.167.204.206:4038 , piece_id=ZU7CEJCYELXC7FKN2QPJ5IAZP6EFPPV4J4J66RH3KCDJV23275RA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615702125 (495h0m15.167172586s) [noise=true , address=185.167.204.206:4071 , piece_id=IYOTAVZNF2NHM4EENETKXNZEDDOSQ2S5JM6Y6WU2C42XMEUEZSPQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.622348872 (495h0m15.173819323s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.623554238 (495h0m15.175024699s) [noise=true , address=185.167.204.206:4045 , piece_id=YSXBKASXLB4PWVBCXYKKZKFLWYDSCNLRLAZWTDLXK5RGM5JLIBQA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.625468773 (495h0m15.176939234s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.633697702 (495h0m15.185168163s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:17.952847920 (495h0m16.504318381s) [noise=true , address=89.149.201.147:4007 , piece_id=FYFK5AZQPRL5X34B5LH53Z2ONLLDNRHNBJ2Q4AU2APNX23BU5TBA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.168814250 (495h0m16.720284711s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905289666 (495h0m17.456760137s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905315666 (495h0m17.456786137s) [seg_pos={0 0}, upload=435893]: Segment reached optimal threshold of 26 pieces.
Nov 29 23:04:18.905784339 (495h0m17.45725481s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Nov 29 23:04:18.905833892 (495h0m17.457304364s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906246979 (495h0m17.45771745s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: read tcp 188.166.225.170:44936->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 29 23:04:18.906260154 (495h0m17.457730615s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906282096 (495h0m17.457752567s) [seg_pos={0 0}, upload=435893]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 29 23:04:18.906373140 (495h0m17.457843601s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 29 23:04:18.906380694 (495h0m17.457851165s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 29 23:04:19.169071817 (495h0m17.720542278s) [upload=435893]: Done uploading segments...
Nov 29 23:04:19.169097004 (495h0m17.720567465s) [upload=435893]: Upload finished. err: <nil>
Duration: 5.718284071s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
5.761259744s trace:
https://jaeger.dev.storj.io/trace/d24e282cae355a8
FAIL (2025-11-29 23:40:04 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
63204 (495h0m13.918633665s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367386489 (495h0m13.91885694s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367586149 (495h0m13.919056611s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.368368469 (495h0m13.91983893s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.370168877 (495h0m13.921639338s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.372146263 (495h0m13.923616714s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.373978502 (495h0m13.925448963s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.374415854 (495h0m13.925886596s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.375566746 (495h0m13.927037207s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.379743138 (495h0m13.931213599s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:16.193964208 (495h0m14.745434669s) [upload=435893]: Next returned nil segment
Nov 29 23:04:16.193980790 (495h0m14.745451241s) [upload=435893]: Waiting for error group managing segments...
Nov 29 23:04:16.588328531 (495h0m15.139798982s) [noise=true , address=185.167.204.205:4022 , piece_id=KQGAPJ7IJQDN6N4LEIQTD43THU2KPWLMYSFUYKPBBE23K5MPTXYA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.588450043 (495h0m15.139920504s) [noise=true , address=185.167.204.206:4061 , piece_id=R6OFY6MJVY5ENXOZZWHC2CKS73QNXJIWDRBKXTYJRXNOOQYTKDOA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.591055714 (495h0m15.142526175s) [noise=true , address=185.167.204.205:4015 , piece_id=BH4FVVQEWVY5OP3GHPVVHYXV7YXXL7VBEKVBNICNQIUMZOQMBSAA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.595531226 (495h0m15.147001677s) [noise=true , address=185.167.204.205:4005 , piece_id=YFK5HBNTOTKRSUS4XRZ3YRPAI4ZEK3DKBLXSIG56DZPOPCTXPOKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.596866599 (495h0m15.14833706s) [noise=true , address=185.167.204.205:4033 , piece_id=YP3HYJ5S3HAPYPPQ5X4BBKI7LERBP7LOVOKZHWMR5GTZC6QMWE3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600090748 (495h0m15.151561209s) [noise=true , address=185.167.204.206:4072 , piece_id=IQ4AAJG4NXO7I2JOJTSSDWF5KXZGLIN6H4BZVUOMVWRSWEIPQHRA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600437999 (495h0m15.15190846s) [noise=true , address=185.167.204.205:4021 , piece_id=GISPTI7P22CQBEETXZ7S4K4RKLTOCAGNKPEQNJK4SA6OZ3LSIE7Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.606498990 (495h0m15.157969441s) [noise=true , address=185.167.204.206:4055 , piece_id=B3BO65PLZH6WDE7YB4PNBRIZPKDWA7E2LIUQZL5WZB7MYJFXSIVQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607132467 (495h0m15.158602918s) [noise=true , address=185.167.204.206:4056 , piece_id=BS26JRUAU2EQAW4FY3IRCVHLH6W34RM55ZRD5HZQFEZ72MTOK7UA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607358097 (495h0m15.158828558s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.608394009 (495h0m15.15986447s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.609654600 (495h0m15.161125061s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610336178 (495h0m15.161806639s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610894210 (495h0m15.162364671s) [noise=true , address=185.167.204.206:4064 , piece_id=36FVLSJCAL36EI6RP2ZB2TRZ3DSBB2K2WIVYWTD6E2SJK2VMOR4Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.612907824 (495h0m15.164378285s) [noise=true , address=185.167.204.206:4040 , piece_id=JI3FSPBHYZXSTJSXXADXEZKO24UGVPYITM64Z7ORHFSPQQS7PE7A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.613654436 (495h0m15.165124887s) [noise=true , address=185.167.204.205:4020 , piece_id=P6XJ6EVG4HEEC4MNEFKCTOZOX55EJIMTTL4RSWPC5MTS77MVOA4A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.614271882 (495h0m15.165742343s) [noise=true , address=185.167.204.206:4062 , piece_id=H3SUGOYJRWVMUSGMLIG5GFW5PHWTVVM6M6XJOUJ6OSY7VAL2UM5A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615166645 (495h0m15.166637096s) [noise=true , address=185.167.204.206:4038 , piece_id=ZU7CEJCYELXC7FKN2QPJ5IAZP6EFPPV4J4J66RH3KCDJV23275RA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615702125 (495h0m15.167172586s) [noise=true , address=185.167.204.206:4071 , piece_id=IYOTAVZNF2NHM4EENETKXNZEDDOSQ2S5JM6Y6WU2C42XMEUEZSPQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.622348872 (495h0m15.173819323s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.623554238 (495h0m15.175024699s) [noise=true , address=185.167.204.206:4045 , piece_id=YSXBKASXLB4PWVBCXYKKZKFLWYDSCNLRLAZWTDLXK5RGM5JLIBQA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.625468773 (495h0m15.176939234s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.633697702 (495h0m15.185168163s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:17.952847920 (495h0m16.504318381s) [noise=true , address=89.149.201.147:4007 , piece_id=FYFK5AZQPRL5X34B5LH53Z2ONLLDNRHNBJ2Q4AU2APNX23BU5TBA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.168814250 (495h0m16.720284711s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905289666 (495h0m17.456760137s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905315666 (495h0m17.456786137s) [seg_pos={0 0}, upload=435893]: Segment reached optimal threshold of 26 pieces.
Nov 29 23:04:18.905784339 (495h0m17.45725481s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Nov 29 23:04:18.905833892 (495h0m17.457304364s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906246979 (495h0m17.45771745s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: read tcp 188.166.225.170:44936->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 29 23:04:18.906260154 (495h0m17.457730615s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906282096 (495h0m17.457752567s) [seg_pos={0 0}, upload=435893]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 29 23:04:18.906373140 (495h0m17.457843601s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 29 23:04:18.906380694 (495h0m17.457851165s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 29 23:04:19.169071817 (495h0m17.720542278s) [upload=435893]: Done uploading segments...
Nov 29 23:04:19.169097004 (495h0m17.720567465s) [upload=435893]: Upload finished. err: <nil>
Duration: 5.761288168s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
5.773904332s trace:
https://jaeger.dev.storj.io/trace/d24e282cae355a8
FAIL (2025-11-29 23:39:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
63204 (495h0m13.918633665s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367386489 (495h0m13.91885694s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367586149 (495h0m13.919056611s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.368368469 (495h0m13.91983893s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.370168877 (495h0m13.921639338s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.372146263 (495h0m13.923616714s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.373978502 (495h0m13.925448963s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.374415854 (495h0m13.925886596s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.375566746 (495h0m13.927037207s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.379743138 (495h0m13.931213599s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:16.193964208 (495h0m14.745434669s) [upload=435893]: Next returned nil segment
Nov 29 23:04:16.193980790 (495h0m14.745451241s) [upload=435893]: Waiting for error group managing segments...
Nov 29 23:04:16.588328531 (495h0m15.139798982s) [noise=true , address=185.167.204.205:4022 , piece_id=KQGAPJ7IJQDN6N4LEIQTD43THU2KPWLMYSFUYKPBBE23K5MPTXYA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.588450043 (495h0m15.139920504s) [noise=true , address=185.167.204.206:4061 , piece_id=R6OFY6MJVY5ENXOZZWHC2CKS73QNXJIWDRBKXTYJRXNOOQYTKDOA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.591055714 (495h0m15.142526175s) [noise=true , address=185.167.204.205:4015 , piece_id=BH4FVVQEWVY5OP3GHPVVHYXV7YXXL7VBEKVBNICNQIUMZOQMBSAA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.595531226 (495h0m15.147001677s) [noise=true , address=185.167.204.205:4005 , piece_id=YFK5HBNTOTKRSUS4XRZ3YRPAI4ZEK3DKBLXSIG56DZPOPCTXPOKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.596866599 (495h0m15.14833706s) [noise=true , address=185.167.204.205:4033 , piece_id=YP3HYJ5S3HAPYPPQ5X4BBKI7LERBP7LOVOKZHWMR5GTZC6QMWE3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600090748 (495h0m15.151561209s) [noise=true , address=185.167.204.206:4072 , piece_id=IQ4AAJG4NXO7I2JOJTSSDWF5KXZGLIN6H4BZVUOMVWRSWEIPQHRA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600437999 (495h0m15.15190846s) [noise=true , address=185.167.204.205:4021 , piece_id=GISPTI7P22CQBEETXZ7S4K4RKLTOCAGNKPEQNJK4SA6OZ3LSIE7Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.606498990 (495h0m15.157969441s) [noise=true , address=185.167.204.206:4055 , piece_id=B3BO65PLZH6WDE7YB4PNBRIZPKDWA7E2LIUQZL5WZB7MYJFXSIVQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607132467 (495h0m15.158602918s) [noise=true , address=185.167.204.206:4056 , piece_id=BS26JRUAU2EQAW4FY3IRCVHLH6W34RM55ZRD5HZQFEZ72MTOK7UA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607358097 (495h0m15.158828558s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.608394009 (495h0m15.15986447s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.609654600 (495h0m15.161125061s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610336178 (495h0m15.161806639s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610894210 (495h0m15.162364671s) [noise=true , address=185.167.204.206:4064 , piece_id=36FVLSJCAL36EI6RP2ZB2TRZ3DSBB2K2WIVYWTD6E2SJK2VMOR4Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.612907824 (495h0m15.164378285s) [noise=true , address=185.167.204.206:4040 , piece_id=JI3FSPBHYZXSTJSXXADXEZKO24UGVPYITM64Z7ORHFSPQQS7PE7A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.613654436 (495h0m15.165124887s) [noise=true , address=185.167.204.205:4020 , piece_id=P6XJ6EVG4HEEC4MNEFKCTOZOX55EJIMTTL4RSWPC5MTS77MVOA4A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.614271882 (495h0m15.165742343s) [noise=true , address=185.167.204.206:4062 , piece_id=H3SUGOYJRWVMUSGMLIG5GFW5PHWTVVM6M6XJOUJ6OSY7VAL2UM5A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615166645 (495h0m15.166637096s) [noise=true , address=185.167.204.206:4038 , piece_id=ZU7CEJCYELXC7FKN2QPJ5IAZP6EFPPV4J4J66RH3KCDJV23275RA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615702125 (495h0m15.167172586s) [noise=true , address=185.167.204.206:4071 , piece_id=IYOTAVZNF2NHM4EENETKXNZEDDOSQ2S5JM6Y6WU2C42XMEUEZSPQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.622348872 (495h0m15.173819323s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.623554238 (495h0m15.175024699s) [noise=true , address=185.167.204.206:4045 , piece_id=YSXBKASXLB4PWVBCXYKKZKFLWYDSCNLRLAZWTDLXK5RGM5JLIBQA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.625468773 (495h0m15.176939234s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.633697702 (495h0m15.185168163s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:17.952847920 (495h0m16.504318381s) [noise=true , address=89.149.201.147:4007 , piece_id=FYFK5AZQPRL5X34B5LH53Z2ONLLDNRHNBJ2Q4AU2APNX23BU5TBA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.168814250 (495h0m16.720284711s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905289666 (495h0m17.456760137s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905315666 (495h0m17.456786137s) [seg_pos={0 0}, upload=435893]: Segment reached optimal threshold of 26 pieces.
Nov 29 23:04:18.905784339 (495h0m17.45725481s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Nov 29 23:04:18.905833892 (495h0m17.457304364s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906246979 (495h0m17.45771745s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: read tcp 188.166.225.170:44936->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 29 23:04:18.906260154 (495h0m17.457730615s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906282096 (495h0m17.457752567s) [seg_pos={0 0}, upload=435893]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 29 23:04:18.906373140 (495h0m17.457843601s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 29 23:04:18.906380694 (495h0m17.457851165s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 29 23:04:19.169071817 (495h0m17.720542278s) [upload=435893]: Done uploading segments...
Nov 29 23:04:19.169097004 (495h0m17.720567465s) [upload=435893]: Upload finished. err: <nil>
Duration: 5.773942353s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
5.765631219s trace:
https://jaeger.dev.storj.io/trace/d24e282cae355a8
FAIL (2025-11-29 23:38:02 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
63204 (495h0m13.918633665s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367386489 (495h0m13.91885694s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367586149 (495h0m13.919056611s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.368368469 (495h0m13.91983893s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.370168877 (495h0m13.921639338s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.372146263 (495h0m13.923616714s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.373978502 (495h0m13.925448963s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.374415854 (495h0m13.925886596s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.375566746 (495h0m13.927037207s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.379743138 (495h0m13.931213599s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:16.193964208 (495h0m14.745434669s) [upload=435893]: Next returned nil segment
Nov 29 23:04:16.193980790 (495h0m14.745451241s) [upload=435893]: Waiting for error group managing segments...
Nov 29 23:04:16.588328531 (495h0m15.139798982s) [noise=true , address=185.167.204.205:4022 , piece_id=KQGAPJ7IJQDN6N4LEIQTD43THU2KPWLMYSFUYKPBBE23K5MPTXYA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.588450043 (495h0m15.139920504s) [noise=true , address=185.167.204.206:4061 , piece_id=R6OFY6MJVY5ENXOZZWHC2CKS73QNXJIWDRBKXTYJRXNOOQYTKDOA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.591055714 (495h0m15.142526175s) [noise=true , address=185.167.204.205:4015 , piece_id=BH4FVVQEWVY5OP3GHPVVHYXV7YXXL7VBEKVBNICNQIUMZOQMBSAA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.595531226 (495h0m15.147001677s) [noise=true , address=185.167.204.205:4005 , piece_id=YFK5HBNTOTKRSUS4XRZ3YRPAI4ZEK3DKBLXSIG56DZPOPCTXPOKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.596866599 (495h0m15.14833706s) [noise=true , address=185.167.204.205:4033 , piece_id=YP3HYJ5S3HAPYPPQ5X4BBKI7LERBP7LOVOKZHWMR5GTZC6QMWE3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600090748 (495h0m15.151561209s) [noise=true , address=185.167.204.206:4072 , piece_id=IQ4AAJG4NXO7I2JOJTSSDWF5KXZGLIN6H4BZVUOMVWRSWEIPQHRA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600437999 (495h0m15.15190846s) [noise=true , address=185.167.204.205:4021 , piece_id=GISPTI7P22CQBEETXZ7S4K4RKLTOCAGNKPEQNJK4SA6OZ3LSIE7Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.606498990 (495h0m15.157969441s) [noise=true , address=185.167.204.206:4055 , piece_id=B3BO65PLZH6WDE7YB4PNBRIZPKDWA7E2LIUQZL5WZB7MYJFXSIVQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607132467 (495h0m15.158602918s) [noise=true , address=185.167.204.206:4056 , piece_id=BS26JRUAU2EQAW4FY3IRCVHLH6W34RM55ZRD5HZQFEZ72MTOK7UA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607358097 (495h0m15.158828558s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.608394009 (495h0m15.15986447s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.609654600 (495h0m15.161125061s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610336178 (495h0m15.161806639s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610894210 (495h0m15.162364671s) [noise=true , address=185.167.204.206:4064 , piece_id=36FVLSJCAL36EI6RP2ZB2TRZ3DSBB2K2WIVYWTD6E2SJK2VMOR4Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.612907824 (495h0m15.164378285s) [noise=true , address=185.167.204.206:4040 , piece_id=JI3FSPBHYZXSTJSXXADXEZKO24UGVPYITM64Z7ORHFSPQQS7PE7A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.613654436 (495h0m15.165124887s) [noise=true , address=185.167.204.205:4020 , piece_id=P6XJ6EVG4HEEC4MNEFKCTOZOX55EJIMTTL4RSWPC5MTS77MVOA4A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.614271882 (495h0m15.165742343s) [noise=true , address=185.167.204.206:4062 , piece_id=H3SUGOYJRWVMUSGMLIG5GFW5PHWTVVM6M6XJOUJ6OSY7VAL2UM5A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615166645 (495h0m15.166637096s) [noise=true , address=185.167.204.206:4038 , piece_id=ZU7CEJCYELXC7FKN2QPJ5IAZP6EFPPV4J4J66RH3KCDJV23275RA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615702125 (495h0m15.167172586s) [noise=true , address=185.167.204.206:4071 , piece_id=IYOTAVZNF2NHM4EENETKXNZEDDOSQ2S5JM6Y6WU2C42XMEUEZSPQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.622348872 (495h0m15.173819323s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.623554238 (495h0m15.175024699s) [noise=true , address=185.167.204.206:4045 , piece_id=YSXBKASXLB4PWVBCXYKKZKFLWYDSCNLRLAZWTDLXK5RGM5JLIBQA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.625468773 (495h0m15.176939234s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.633697702 (495h0m15.185168163s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:17.952847920 (495h0m16.504318381s) [noise=true , address=89.149.201.147:4007 , piece_id=FYFK5AZQPRL5X34B5LH53Z2ONLLDNRHNBJ2Q4AU2APNX23BU5TBA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.168814250 (495h0m16.720284711s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905289666 (495h0m17.456760137s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905315666 (495h0m17.456786137s) [seg_pos={0 0}, upload=435893]: Segment reached optimal threshold of 26 pieces.
Nov 29 23:04:18.905784339 (495h0m17.45725481s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Nov 29 23:04:18.905833892 (495h0m17.457304364s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906246979 (495h0m17.45771745s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: read tcp 188.166.225.170:44936->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 29 23:04:18.906260154 (495h0m17.457730615s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906282096 (495h0m17.457752567s) [seg_pos={0 0}, upload=435893]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 29 23:04:18.906373140 (495h0m17.457843601s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 29 23:04:18.906380694 (495h0m17.457851165s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 29 23:04:19.169071817 (495h0m17.720542278s) [upload=435893]: Done uploading segments...
Nov 29 23:04:19.169097004 (495h0m17.720567465s) [upload=435893]: Upload finished. err: <nil>
Duration: 5.765661447s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
6.060009547s trace:
https://jaeger.dev.storj.io/trace/d24e282cae355a8
FAIL (2025-11-29 23:36:59 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
63204 (495h0m13.918633665s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367386489 (495h0m13.91885694s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367586149 (495h0m13.919056611s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.368368469 (495h0m13.91983893s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.370168877 (495h0m13.921639338s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.372146263 (495h0m13.923616714s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.373978502 (495h0m13.925448963s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.374415854 (495h0m13.925886596s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.375566746 (495h0m13.927037207s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.379743138 (495h0m13.931213599s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:16.193964208 (495h0m14.745434669s) [upload=435893]: Next returned nil segment
Nov 29 23:04:16.193980790 (495h0m14.745451241s) [upload=435893]: Waiting for error group managing segments...
Nov 29 23:04:16.588328531 (495h0m15.139798982s) [noise=true , address=185.167.204.205:4022 , piece_id=KQGAPJ7IJQDN6N4LEIQTD43THU2KPWLMYSFUYKPBBE23K5MPTXYA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.588450043 (495h0m15.139920504s) [noise=true , address=185.167.204.206:4061 , piece_id=R6OFY6MJVY5ENXOZZWHC2CKS73QNXJIWDRBKXTYJRXNOOQYTKDOA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.591055714 (495h0m15.142526175s) [noise=true , address=185.167.204.205:4015 , piece_id=BH4FVVQEWVY5OP3GHPVVHYXV7YXXL7VBEKVBNICNQIUMZOQMBSAA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.595531226 (495h0m15.147001677s) [noise=true , address=185.167.204.205:4005 , piece_id=YFK5HBNTOTKRSUS4XRZ3YRPAI4ZEK3DKBLXSIG56DZPOPCTXPOKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.596866599 (495h0m15.14833706s) [noise=true , address=185.167.204.205:4033 , piece_id=YP3HYJ5S3HAPYPPQ5X4BBKI7LERBP7LOVOKZHWMR5GTZC6QMWE3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600090748 (495h0m15.151561209s) [noise=true , address=185.167.204.206:4072 , piece_id=IQ4AAJG4NXO7I2JOJTSSDWF5KXZGLIN6H4BZVUOMVWRSWEIPQHRA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600437999 (495h0m15.15190846s) [noise=true , address=185.167.204.205:4021 , piece_id=GISPTI7P22CQBEETXZ7S4K4RKLTOCAGNKPEQNJK4SA6OZ3LSIE7Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.606498990 (495h0m15.157969441s) [noise=true , address=185.167.204.206:4055 , piece_id=B3BO65PLZH6WDE7YB4PNBRIZPKDWA7E2LIUQZL5WZB7MYJFXSIVQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607132467 (495h0m15.158602918s) [noise=true , address=185.167.204.206:4056 , piece_id=BS26JRUAU2EQAW4FY3IRCVHLH6W34RM55ZRD5HZQFEZ72MTOK7UA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607358097 (495h0m15.158828558s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.608394009 (495h0m15.15986447s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.609654600 (495h0m15.161125061s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610336178 (495h0m15.161806639s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610894210 (495h0m15.162364671s) [noise=true , address=185.167.204.206:4064 , piece_id=36FVLSJCAL36EI6RP2ZB2TRZ3DSBB2K2WIVYWTD6E2SJK2VMOR4Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.612907824 (495h0m15.164378285s) [noise=true , address=185.167.204.206:4040 , piece_id=JI3FSPBHYZXSTJSXXADXEZKO24UGVPYITM64Z7ORHFSPQQS7PE7A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.613654436 (495h0m15.165124887s) [noise=true , address=185.167.204.205:4020 , piece_id=P6XJ6EVG4HEEC4MNEFKCTOZOX55EJIMTTL4RSWPC5MTS77MVOA4A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.614271882 (495h0m15.165742343s) [noise=true , address=185.167.204.206:4062 , piece_id=H3SUGOYJRWVMUSGMLIG5GFW5PHWTVVM6M6XJOUJ6OSY7VAL2UM5A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615166645 (495h0m15.166637096s) [noise=true , address=185.167.204.206:4038 , piece_id=ZU7CEJCYELXC7FKN2QPJ5IAZP6EFPPV4J4J66RH3KCDJV23275RA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615702125 (495h0m15.167172586s) [noise=true , address=185.167.204.206:4071 , piece_id=IYOTAVZNF2NHM4EENETKXNZEDDOSQ2S5JM6Y6WU2C42XMEUEZSPQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.622348872 (495h0m15.173819323s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.623554238 (495h0m15.175024699s) [noise=true , address=185.167.204.206:4045 , piece_id=YSXBKASXLB4PWVBCXYKKZKFLWYDSCNLRLAZWTDLXK5RGM5JLIBQA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.625468773 (495h0m15.176939234s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.633697702 (495h0m15.185168163s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:17.952847920 (495h0m16.504318381s) [noise=true , address=89.149.201.147:4007 , piece_id=FYFK5AZQPRL5X34B5LH53Z2ONLLDNRHNBJ2Q4AU2APNX23BU5TBA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.168814250 (495h0m16.720284711s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905289666 (495h0m17.456760137s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905315666 (495h0m17.456786137s) [seg_pos={0 0}, upload=435893]: Segment reached optimal threshold of 26 pieces.
Nov 29 23:04:18.905784339 (495h0m17.45725481s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Nov 29 23:04:18.905833892 (495h0m17.457304364s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906246979 (495h0m17.45771745s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: read tcp 188.166.225.170:44936->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 29 23:04:18.906260154 (495h0m17.457730615s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906282096 (495h0m17.457752567s) [seg_pos={0 0}, upload=435893]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 29 23:04:18.906373140 (495h0m17.457843601s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 29 23:04:18.906380694 (495h0m17.457851165s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 29 23:04:19.169071817 (495h0m17.720542278s) [upload=435893]: Done uploading segments...
Nov 29 23:04:19.169097004 (495h0m17.720567465s) [upload=435893]: Upload finished. err: <nil>
Duration: 6.060036077s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
5.78636424s trace:
https://jaeger.dev.storj.io/trace/d24e282cae355a8
FAIL (2025-11-29 23:36:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
63204 (495h0m13.918633665s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367386489 (495h0m13.91885694s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367586149 (495h0m13.919056611s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.368368469 (495h0m13.91983893s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.370168877 (495h0m13.921639338s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.372146263 (495h0m13.923616714s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.373978502 (495h0m13.925448963s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.374415854 (495h0m13.925886596s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.375566746 (495h0m13.927037207s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.379743138 (495h0m13.931213599s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:16.193964208 (495h0m14.745434669s) [upload=435893]: Next returned nil segment
Nov 29 23:04:16.193980790 (495h0m14.745451241s) [upload=435893]: Waiting for error group managing segments...
Nov 29 23:04:16.588328531 (495h0m15.139798982s) [noise=true , address=185.167.204.205:4022 , piece_id=KQGAPJ7IJQDN6N4LEIQTD43THU2KPWLMYSFUYKPBBE23K5MPTXYA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.588450043 (495h0m15.139920504s) [noise=true , address=185.167.204.206:4061 , piece_id=R6OFY6MJVY5ENXOZZWHC2CKS73QNXJIWDRBKXTYJRXNOOQYTKDOA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.591055714 (495h0m15.142526175s) [noise=true , address=185.167.204.205:4015 , piece_id=BH4FVVQEWVY5OP3GHPVVHYXV7YXXL7VBEKVBNICNQIUMZOQMBSAA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.595531226 (495h0m15.147001677s) [noise=true , address=185.167.204.205:4005 , piece_id=YFK5HBNTOTKRSUS4XRZ3YRPAI4ZEK3DKBLXSIG56DZPOPCTXPOKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.596866599 (495h0m15.14833706s) [noise=true , address=185.167.204.205:4033 , piece_id=YP3HYJ5S3HAPYPPQ5X4BBKI7LERBP7LOVOKZHWMR5GTZC6QMWE3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600090748 (495h0m15.151561209s) [noise=true , address=185.167.204.206:4072 , piece_id=IQ4AAJG4NXO7I2JOJTSSDWF5KXZGLIN6H4BZVUOMVWRSWEIPQHRA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600437999 (495h0m15.15190846s) [noise=true , address=185.167.204.205:4021 , piece_id=GISPTI7P22CQBEETXZ7S4K4RKLTOCAGNKPEQNJK4SA6OZ3LSIE7Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.606498990 (495h0m15.157969441s) [noise=true , address=185.167.204.206:4055 , piece_id=B3BO65PLZH6WDE7YB4PNBRIZPKDWA7E2LIUQZL5WZB7MYJFXSIVQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607132467 (495h0m15.158602918s) [noise=true , address=185.167.204.206:4056 , piece_id=BS26JRUAU2EQAW4FY3IRCVHLH6W34RM55ZRD5HZQFEZ72MTOK7UA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607358097 (495h0m15.158828558s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.608394009 (495h0m15.15986447s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.609654600 (495h0m15.161125061s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610336178 (495h0m15.161806639s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610894210 (495h0m15.162364671s) [noise=true , address=185.167.204.206:4064 , piece_id=36FVLSJCAL36EI6RP2ZB2TRZ3DSBB2K2WIVYWTD6E2SJK2VMOR4Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.612907824 (495h0m15.164378285s) [noise=true , address=185.167.204.206:4040 , piece_id=JI3FSPBHYZXSTJSXXADXEZKO24UGVPYITM64Z7ORHFSPQQS7PE7A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.613654436 (495h0m15.165124887s) [noise=true , address=185.167.204.205:4020 , piece_id=P6XJ6EVG4HEEC4MNEFKCTOZOX55EJIMTTL4RSWPC5MTS77MVOA4A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.614271882 (495h0m15.165742343s) [noise=true , address=185.167.204.206:4062 , piece_id=H3SUGOYJRWVMUSGMLIG5GFW5PHWTVVM6M6XJOUJ6OSY7VAL2UM5A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615166645 (495h0m15.166637096s) [noise=true , address=185.167.204.206:4038 , piece_id=ZU7CEJCYELXC7FKN2QPJ5IAZP6EFPPV4J4J66RH3KCDJV23275RA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615702125 (495h0m15.167172586s) [noise=true , address=185.167.204.206:4071 , piece_id=IYOTAVZNF2NHM4EENETKXNZEDDOSQ2S5JM6Y6WU2C42XMEUEZSPQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.622348872 (495h0m15.173819323s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.623554238 (495h0m15.175024699s) [noise=true , address=185.167.204.206:4045 , piece_id=YSXBKASXLB4PWVBCXYKKZKFLWYDSCNLRLAZWTDLXK5RGM5JLIBQA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.625468773 (495h0m15.176939234s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.633697702 (495h0m15.185168163s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:17.952847920 (495h0m16.504318381s) [noise=true , address=89.149.201.147:4007 , piece_id=FYFK5AZQPRL5X34B5LH53Z2ONLLDNRHNBJ2Q4AU2APNX23BU5TBA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.168814250 (495h0m16.720284711s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905289666 (495h0m17.456760137s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905315666 (495h0m17.456786137s) [seg_pos={0 0}, upload=435893]: Segment reached optimal threshold of 26 pieces.
Nov 29 23:04:18.905784339 (495h0m17.45725481s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Nov 29 23:04:18.905833892 (495h0m17.457304364s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906246979 (495h0m17.45771745s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: read tcp 188.166.225.170:44936->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 29 23:04:18.906260154 (495h0m17.457730615s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906282096 (495h0m17.457752567s) [seg_pos={0 0}, upload=435893]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 29 23:04:18.906373140 (495h0m17.457843601s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 29 23:04:18.906380694 (495h0m17.457851165s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 29 23:04:19.169071817 (495h0m17.720542278s) [upload=435893]: Done uploading segments...
Nov 29 23:04:19.169097004 (495h0m17.720567465s) [upload=435893]: Upload finished. err: <nil>
Duration: 5.786385671s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
5.722007801s trace:
https://jaeger.dev.storj.io/trace/d24e282cae355a8
FAIL (2025-11-29 23:36:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
63204 (495h0m13.918633665s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367386489 (495h0m13.91885694s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367586149 (495h0m13.919056611s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.368368469 (495h0m13.91983893s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.370168877 (495h0m13.921639338s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.372146263 (495h0m13.923616714s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.373978502 (495h0m13.925448963s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.374415854 (495h0m13.925886596s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.375566746 (495h0m13.927037207s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.379743138 (495h0m13.931213599s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:16.193964208 (495h0m14.745434669s) [upload=435893]: Next returned nil segment
Nov 29 23:04:16.193980790 (495h0m14.745451241s) [upload=435893]: Waiting for error group managing segments...
Nov 29 23:04:16.588328531 (495h0m15.139798982s) [noise=true , address=185.167.204.205:4022 , piece_id=KQGAPJ7IJQDN6N4LEIQTD43THU2KPWLMYSFUYKPBBE23K5MPTXYA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.588450043 (495h0m15.139920504s) [noise=true , address=185.167.204.206:4061 , piece_id=R6OFY6MJVY5ENXOZZWHC2CKS73QNXJIWDRBKXTYJRXNOOQYTKDOA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.591055714 (495h0m15.142526175s) [noise=true , address=185.167.204.205:4015 , piece_id=BH4FVVQEWVY5OP3GHPVVHYXV7YXXL7VBEKVBNICNQIUMZOQMBSAA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.595531226 (495h0m15.147001677s) [noise=true , address=185.167.204.205:4005 , piece_id=YFK5HBNTOTKRSUS4XRZ3YRPAI4ZEK3DKBLXSIG56DZPOPCTXPOKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.596866599 (495h0m15.14833706s) [noise=true , address=185.167.204.205:4033 , piece_id=YP3HYJ5S3HAPYPPQ5X4BBKI7LERBP7LOVOKZHWMR5GTZC6QMWE3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600090748 (495h0m15.151561209s) [noise=true , address=185.167.204.206:4072 , piece_id=IQ4AAJG4NXO7I2JOJTSSDWF5KXZGLIN6H4BZVUOMVWRSWEIPQHRA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600437999 (495h0m15.15190846s) [noise=true , address=185.167.204.205:4021 , piece_id=GISPTI7P22CQBEETXZ7S4K4RKLTOCAGNKPEQNJK4SA6OZ3LSIE7Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.606498990 (495h0m15.157969441s) [noise=true , address=185.167.204.206:4055 , piece_id=B3BO65PLZH6WDE7YB4PNBRIZPKDWA7E2LIUQZL5WZB7MYJFXSIVQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607132467 (495h0m15.158602918s) [noise=true , address=185.167.204.206:4056 , piece_id=BS26JRUAU2EQAW4FY3IRCVHLH6W34RM55ZRD5HZQFEZ72MTOK7UA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607358097 (495h0m15.158828558s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.608394009 (495h0m15.15986447s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.609654600 (495h0m15.161125061s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610336178 (495h0m15.161806639s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610894210 (495h0m15.162364671s) [noise=true , address=185.167.204.206:4064 , piece_id=36FVLSJCAL36EI6RP2ZB2TRZ3DSBB2K2WIVYWTD6E2SJK2VMOR4Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.612907824 (495h0m15.164378285s) [noise=true , address=185.167.204.206:4040 , piece_id=JI3FSPBHYZXSTJSXXADXEZKO24UGVPYITM64Z7ORHFSPQQS7PE7A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.613654436 (495h0m15.165124887s) [noise=true , address=185.167.204.205:4020 , piece_id=P6XJ6EVG4HEEC4MNEFKCTOZOX55EJIMTTL4RSWPC5MTS77MVOA4A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.614271882 (495h0m15.165742343s) [noise=true , address=185.167.204.206:4062 , piece_id=H3SUGOYJRWVMUSGMLIG5GFW5PHWTVVM6M6XJOUJ6OSY7VAL2UM5A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615166645 (495h0m15.166637096s) [noise=true , address=185.167.204.206:4038 , piece_id=ZU7CEJCYELXC7FKN2QPJ5IAZP6EFPPV4J4J66RH3KCDJV23275RA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615702125 (495h0m15.167172586s) [noise=true , address=185.167.204.206:4071 , piece_id=IYOTAVZNF2NHM4EENETKXNZEDDOSQ2S5JM6Y6WU2C42XMEUEZSPQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.622348872 (495h0m15.173819323s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.623554238 (495h0m15.175024699s) [noise=true , address=185.167.204.206:4045 , piece_id=YSXBKASXLB4PWVBCXYKKZKFLWYDSCNLRLAZWTDLXK5RGM5JLIBQA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.625468773 (495h0m15.176939234s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.633697702 (495h0m15.185168163s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:17.952847920 (495h0m16.504318381s) [noise=true , address=89.149.201.147:4007 , piece_id=FYFK5AZQPRL5X34B5LH53Z2ONLLDNRHNBJ2Q4AU2APNX23BU5TBA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.168814250 (495h0m16.720284711s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905289666 (495h0m17.456760137s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905315666 (495h0m17.456786137s) [seg_pos={0 0}, upload=435893]: Segment reached optimal threshold of 26 pieces.
Nov 29 23:04:18.905784339 (495h0m17.45725481s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Nov 29 23:04:18.905833892 (495h0m17.457304364s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906246979 (495h0m17.45771745s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: read tcp 188.166.225.170:44936->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 29 23:04:18.906260154 (495h0m17.457730615s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906282096 (495h0m17.457752567s) [seg_pos={0 0}, upload=435893]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 29 23:04:18.906373140 (495h0m17.457843601s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 29 23:04:18.906380694 (495h0m17.457851165s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 29 23:04:19.169071817 (495h0m17.720542278s) [upload=435893]: Done uploading segments...
Nov 29 23:04:19.169097004 (495h0m17.720567465s) [upload=435893]: Upload finished. err: <nil>
Duration: 5.722039082s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
5.812114821s trace:
https://jaeger.dev.storj.io/trace/d24e282cae355a8
FAIL (2025-11-29 23:35:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
63204 (495h0m13.918633665s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367386489 (495h0m13.91885694s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367586149 (495h0m13.919056611s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.368368469 (495h0m13.91983893s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.370168877 (495h0m13.921639338s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.372146263 (495h0m13.923616714s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.373978502 (495h0m13.925448963s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.374415854 (495h0m13.925886596s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.375566746 (495h0m13.927037207s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.379743138 (495h0m13.931213599s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:16.193964208 (495h0m14.745434669s) [upload=435893]: Next returned nil segment
Nov 29 23:04:16.193980790 (495h0m14.745451241s) [upload=435893]: Waiting for error group managing segments...
Nov 29 23:04:16.588328531 (495h0m15.139798982s) [noise=true , address=185.167.204.205:4022 , piece_id=KQGAPJ7IJQDN6N4LEIQTD43THU2KPWLMYSFUYKPBBE23K5MPTXYA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.588450043 (495h0m15.139920504s) [noise=true , address=185.167.204.206:4061 , piece_id=R6OFY6MJVY5ENXOZZWHC2CKS73QNXJIWDRBKXTYJRXNOOQYTKDOA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.591055714 (495h0m15.142526175s) [noise=true , address=185.167.204.205:4015 , piece_id=BH4FVVQEWVY5OP3GHPVVHYXV7YXXL7VBEKVBNICNQIUMZOQMBSAA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.595531226 (495h0m15.147001677s) [noise=true , address=185.167.204.205:4005 , piece_id=YFK5HBNTOTKRSUS4XRZ3YRPAI4ZEK3DKBLXSIG56DZPOPCTXPOKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.596866599 (495h0m15.14833706s) [noise=true , address=185.167.204.205:4033 , piece_id=YP3HYJ5S3HAPYPPQ5X4BBKI7LERBP7LOVOKZHWMR5GTZC6QMWE3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600090748 (495h0m15.151561209s) [noise=true , address=185.167.204.206:4072 , piece_id=IQ4AAJG4NXO7I2JOJTSSDWF5KXZGLIN6H4BZVUOMVWRSWEIPQHRA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600437999 (495h0m15.15190846s) [noise=true , address=185.167.204.205:4021 , piece_id=GISPTI7P22CQBEETXZ7S4K4RKLTOCAGNKPEQNJK4SA6OZ3LSIE7Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.606498990 (495h0m15.157969441s) [noise=true , address=185.167.204.206:4055 , piece_id=B3BO65PLZH6WDE7YB4PNBRIZPKDWA7E2LIUQZL5WZB7MYJFXSIVQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607132467 (495h0m15.158602918s) [noise=true , address=185.167.204.206:4056 , piece_id=BS26JRUAU2EQAW4FY3IRCVHLH6W34RM55ZRD5HZQFEZ72MTOK7UA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607358097 (495h0m15.158828558s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.608394009 (495h0m15.15986447s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.609654600 (495h0m15.161125061s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610336178 (495h0m15.161806639s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610894210 (495h0m15.162364671s) [noise=true , address=185.167.204.206:4064 , piece_id=36FVLSJCAL36EI6RP2ZB2TRZ3DSBB2K2WIVYWTD6E2SJK2VMOR4Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.612907824 (495h0m15.164378285s) [noise=true , address=185.167.204.206:4040 , piece_id=JI3FSPBHYZXSTJSXXADXEZKO24UGVPYITM64Z7ORHFSPQQS7PE7A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.613654436 (495h0m15.165124887s) [noise=true , address=185.167.204.205:4020 , piece_id=P6XJ6EVG4HEEC4MNEFKCTOZOX55EJIMTTL4RSWPC5MTS77MVOA4A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.614271882 (495h0m15.165742343s) [noise=true , address=185.167.204.206:4062 , piece_id=H3SUGOYJRWVMUSGMLIG5GFW5PHWTVVM6M6XJOUJ6OSY7VAL2UM5A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615166645 (495h0m15.166637096s) [noise=true , address=185.167.204.206:4038 , piece_id=ZU7CEJCYELXC7FKN2QPJ5IAZP6EFPPV4J4J66RH3KCDJV23275RA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615702125 (495h0m15.167172586s) [noise=true , address=185.167.204.206:4071 , piece_id=IYOTAVZNF2NHM4EENETKXNZEDDOSQ2S5JM6Y6WU2C42XMEUEZSPQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.622348872 (495h0m15.173819323s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.623554238 (495h0m15.175024699s) [noise=true , address=185.167.204.206:4045 , piece_id=YSXBKASXLB4PWVBCXYKKZKFLWYDSCNLRLAZWTDLXK5RGM5JLIBQA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.625468773 (495h0m15.176939234s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.633697702 (495h0m15.185168163s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:17.952847920 (495h0m16.504318381s) [noise=true , address=89.149.201.147:4007 , piece_id=FYFK5AZQPRL5X34B5LH53Z2ONLLDNRHNBJ2Q4AU2APNX23BU5TBA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.168814250 (495h0m16.720284711s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905289666 (495h0m17.456760137s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905315666 (495h0m17.456786137s) [seg_pos={0 0}, upload=435893]: Segment reached optimal threshold of 26 pieces.
Nov 29 23:04:18.905784339 (495h0m17.45725481s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Nov 29 23:04:18.905833892 (495h0m17.457304364s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906246979 (495h0m17.45771745s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: read tcp 188.166.225.170:44936->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 29 23:04:18.906260154 (495h0m17.457730615s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906282096 (495h0m17.457752567s) [seg_pos={0 0}, upload=435893]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 29 23:04:18.906373140 (495h0m17.457843601s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 29 23:04:18.906380694 (495h0m17.457851165s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 29 23:04:19.169071817 (495h0m17.720542278s) [upload=435893]: Done uploading segments...
Nov 29 23:04:19.169097004 (495h0m17.720567465s) [upload=435893]: Upload finished. err: <nil>
Duration: 5.812139207s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
5.871798109s trace:
https://jaeger.dev.storj.io/trace/d24e282cae355a8
FAIL (2025-11-29 23:34:37 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
63204 (495h0m13.918633665s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367386489 (495h0m13.91885694s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.367586149 (495h0m13.919056611s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.368368469 (495h0m13.91983893s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.370168877 (495h0m13.921639338s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.372146263 (495h0m13.923616714s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.373978502 (495h0m13.925448963s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.374415854 (495h0m13.925886596s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.375566746 (495h0m13.927037207s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:15.379743138 (495h0m13.931213599s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Uploading piece...
Nov 29 23:04:16.193964208 (495h0m14.745434669s) [upload=435893]: Next returned nil segment
Nov 29 23:04:16.193980790 (495h0m14.745451241s) [upload=435893]: Waiting for error group managing segments...
Nov 29 23:04:16.588328531 (495h0m15.139798982s) [noise=true , address=185.167.204.205:4022 , piece_id=KQGAPJ7IJQDN6N4LEIQTD43THU2KPWLMYSFUYKPBBE23K5MPTXYA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.588450043 (495h0m15.139920504s) [noise=true , address=185.167.204.206:4061 , piece_id=R6OFY6MJVY5ENXOZZWHC2CKS73QNXJIWDRBKXTYJRXNOOQYTKDOA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.591055714 (495h0m15.142526175s) [noise=true , address=185.167.204.205:4015 , piece_id=BH4FVVQEWVY5OP3GHPVVHYXV7YXXL7VBEKVBNICNQIUMZOQMBSAA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.595531226 (495h0m15.147001677s) [noise=true , address=185.167.204.205:4005 , piece_id=YFK5HBNTOTKRSUS4XRZ3YRPAI4ZEK3DKBLXSIG56DZPOPCTXPOKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.596866599 (495h0m15.14833706s) [noise=true , address=185.167.204.205:4033 , piece_id=YP3HYJ5S3HAPYPPQ5X4BBKI7LERBP7LOVOKZHWMR5GTZC6QMWE3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600090748 (495h0m15.151561209s) [noise=true , address=185.167.204.206:4072 , piece_id=IQ4AAJG4NXO7I2JOJTSSDWF5KXZGLIN6H4BZVUOMVWRSWEIPQHRA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.600437999 (495h0m15.15190846s) [noise=true , address=185.167.204.205:4021 , piece_id=GISPTI7P22CQBEETXZ7S4K4RKLTOCAGNKPEQNJK4SA6OZ3LSIE7Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.606498990 (495h0m15.157969441s) [noise=true , address=185.167.204.206:4055 , piece_id=B3BO65PLZH6WDE7YB4PNBRIZPKDWA7E2LIUQZL5WZB7MYJFXSIVQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607132467 (495h0m15.158602918s) [noise=true , address=185.167.204.206:4056 , piece_id=BS26JRUAU2EQAW4FY3IRCVHLH6W34RM55ZRD5HZQFEZ72MTOK7UA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.607358097 (495h0m15.158828558s) [noise=true , address=185.167.204.206:4037 , piece_id=ROTQBBJ5FEBBTGFOYIS7DL4YWH4WEW3QAOS354UH7J5N2EBLIAAQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.608394009 (495h0m15.15986447s) [noise=true , address=185.167.204.205:4023 , piece_id=SMMT4AZUTPV5ILN5DNN6ORRJNNZUVHISOVW5NZYP5KL266V5J3PQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.609654600 (495h0m15.161125061s) [noise=true , address=185.167.204.205:4014 , piece_id=PETYMCW3E3SIYMDAG3HZRA4ITZAWFPEZVS6PQ2UEF22SLTKOIBWQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610336178 (495h0m15.161806639s) [noise=true , address=185.167.204.206:4041 , piece_id=UVQAYYJ6JBH2B7F3GF5PJBWNVKKWWPYCNAQ7EPAEVMOQ6QBFJ34A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.610894210 (495h0m15.162364671s) [noise=true , address=185.167.204.206:4064 , piece_id=36FVLSJCAL36EI6RP2ZB2TRZ3DSBB2K2WIVYWTD6E2SJK2VMOR4Q, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.612907824 (495h0m15.164378285s) [noise=true , address=185.167.204.206:4040 , piece_id=JI3FSPBHYZXSTJSXXADXEZKO24UGVPYITM64Z7ORHFSPQQS7PE7A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.613654436 (495h0m15.165124887s) [noise=true , address=185.167.204.205:4020 , piece_id=P6XJ6EVG4HEEC4MNEFKCTOZOX55EJIMTTL4RSWPC5MTS77MVOA4A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.614271882 (495h0m15.165742343s) [noise=true , address=185.167.204.206:4062 , piece_id=H3SUGOYJRWVMUSGMLIG5GFW5PHWTVVM6M6XJOUJ6OSY7VAL2UM5A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615166645 (495h0m15.166637096s) [noise=true , address=185.167.204.206:4038 , piece_id=ZU7CEJCYELXC7FKN2QPJ5IAZP6EFPPV4J4J66RH3KCDJV23275RA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.615702125 (495h0m15.167172586s) [noise=true , address=185.167.204.206:4071 , piece_id=IYOTAVZNF2NHM4EENETKXNZEDDOSQ2S5JM6Y6WU2C42XMEUEZSPQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.622348872 (495h0m15.173819323s) [noise=true , address=185.167.204.205:4036 , piece_id=NDGICHF2D2AAG4BTTH5HWCZL4S3WZS5MFEBJDTDVIOP7GGZ6EJ6A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.623554238 (495h0m15.175024699s) [noise=true , address=185.167.204.206:4045 , piece_id=YSXBKASXLB4PWVBCXYKKZKFLWYDSCNLRLAZWTDLXK5RGM5JLIBQA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.625468773 (495h0m15.176939234s) [noise=true , address=185.167.204.205:4011 , piece_id=LZEFBH7J46P5EMRPFCWE4YCLP3MP6N77IHQN3CW6CQS57O75MYKQ, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:16.633697702 (495h0m15.185168163s) [noise=true , address=185.167.204.206:4065 , piece_id=7BVM7XCIK6L3Y5PZHS4IWBI7SCQDGPZ6NHRMZ7BKKPPNEAZASP3A, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:17.952847920 (495h0m16.504318381s) [noise=true , address=89.149.201.147:4007 , piece_id=FYFK5AZQPRL5X34B5LH53Z2ONLLDNRHNBJ2Q4AU2APNX23BU5TBA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.168814250 (495h0m16.720284711s) [noise=true , address=81.171.14.70:4032 , piece_id=4MIVIZSF3NYEAJE26RP2WWY4YVDVBJCVGWEGVGE6DZUXBKNJUFWA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905289666 (495h0m17.456760137s) [noise=true , address=89.149.201.147:4016 , piece_id=GUK3X3E3WEMODEBKDKN2LBLLSANLIGR7TKZH2SCEIH54H5SYROMA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: <nil>
Nov 29 23:04:18.905315666 (495h0m17.456786137s) [seg_pos={0 0}, upload=435893]: Segment reached optimal threshold of 26 pieces.
Nov 29 23:04:18.905784339 (495h0m17.45725481s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Nov 29 23:04:18.905833892 (495h0m17.457304364s) [noise=true , address=81.171.14.70:4031 , piece_id=2D6GBD5N3VMLYPWEGIA7HBYBUETVEFPVADJ6N2DVVGXXOFDETJDA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906246979 (495h0m17.45771745s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: read tcp 188.166.225.170:44936->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 29 23:04:18.906260154 (495h0m17.457730615s) [noise=true , address=81.171.14.70:4026 , piece_id=LDE2MVOSRJ7PSKIQXMT2JXSTTZQSWE2N35BWZRA2I6NB77YU7CEA, seg_pos={0 0}, upload=435893]: Long tail cancellation due to optimal threshold
Nov 29 23:04:18.906282096 (495h0m17.457752567s) [seg_pos={0 0}, upload=435893]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 29 23:04:18.906373140 (495h0m17.457843601s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 29 23:04:18.906380694 (495h0m17.457851165s) [upload=435893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 29 23:04:19.169071817 (495h0m17.720542278s) [upload=435893]: Done uploading segments...
Nov 29 23:04:19.169097004 (495h0m17.720567465s) [upload=435893]: Upload finished. err: <nil>
Duration: 5.871823086s
core
uplink
eu-select-1
eu1-placement-15
|