Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
5.605814596s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:55:30 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.6058428s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
5.211950919s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:54:20 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.211991025s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
5.515359239s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:53:44 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.5153916s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
5.322758306s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:52:37 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.322780909s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
5.342893037s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:51:53 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.342970624s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
5.006820046s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:51:13 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.00685371s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
5.051599877s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:50:53 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.051630175s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
5.284558136s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:49:39 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.284591389s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
5.344832819s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:49:18 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.344890027s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
5.76337521s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:48:40 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.763405717s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
5.32329639s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:47:28 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.323332308s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
5.324490875s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:47:03 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.324524519s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
5.434877109s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:46:42 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.434905894s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
5.131925417s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:45:28 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.131979059s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
5.32838544s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:44:44 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.328419404s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
5.334790717s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:43:31 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.334825703s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
5.544184819s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:42:42 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.544211749s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
5.1913932s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:41:46 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.191419941s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
5.456416012s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:40:52 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.456434697s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
5.42128774s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:40:02 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.421319491s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
5.22025146s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:39:05 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.220288592s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
5.389790994s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:37:51 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.389822273s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
5.252366994s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:36:46 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.252397032s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
5.87000978s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:35:42 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.870038645s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
5.870327445s trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:35:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.87038217s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
5.734831267s trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:34:49 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.734858188s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
5.498730342s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:34:37 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.498768082s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
6.237643092s trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:34:26 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.237665545s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
5.32589722s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:34:18 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.325925074s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
5.54549443s trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:34:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.545527893s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
5.284345878s trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:33:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.2843787s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
6.361355413s trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:33:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.361456886s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
5.522791438s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:33:30 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.52282894s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
6.333396514s trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:33:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.333429757s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
6.648521694s trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:32:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.648555918s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
5.509010316s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:32:17 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.50903861s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
5.355697003s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:31:28 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.355722611s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
5.403758901s trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:31:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.403779109s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
5.818757519s trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:30:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.81878484s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
5.35548207s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:30:24 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.355514473s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.264368176s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:29:45 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.264397723s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
5.789615144s trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:29:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.789632787s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
5.784309561s trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:28:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.784427166s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.430637593s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:28:35 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.430746289s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.404331641s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:27:35 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.404361127s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
5.793735638s trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:27:30 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.793799959s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
6.250292602s trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:26:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.250329132s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.278990251s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:26:20 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.279066144s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
5.30718115s trace:
https://jaeger.dev.storj.io/trace/ecc9c100203cede
FAIL (2025-11-19 09:25:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Nov 19 08:50:17.789142705 (240h46m16.340613166s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.789736195 (240h46m16.341206656s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790370322 (240h46m16.341840783s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.790977588 (240h46m16.342448049s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.791602438 (240h46m16.343072899s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792207430 (240h46m16.343677881s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.792815468 (240h46m16.344285929s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.794386770 (240h46m16.345857231s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795216850 (240h46m16.346687311s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:17.795949345 (240h46m16.347419806s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Uploading piece...
Nov 19 08:50:19.010747975 (240h46m17.562218436s) [upload=212090]: Next returned nil segment
Nov 19 08:50:19.010768475 (240h46m17.562238936s) [upload=212090]: Waiting for error group managing segments...
Nov 19 08:50:19.580181611 (240h46m18.131652062s) [noise=true , address=81.171.14.70:4045 , piece_id=GHVPG65QMYPI7QT3JNRVWLQAVANW4J4S5GQZS6765MZBDH2OZQZA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.585161083 (240h46m18.136631544s) [noise=true , address=185.167.204.205:4035 , piece_id=I4O7OXI6OQZCZS44JNWXQC5WMLRR7C7J5J7CIPF4W33LSLPLDWVQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599428601 (240h46m18.150899062s) [noise=true , address=185.167.204.206:4047 , piece_id=O4NCU7A4PMLSWWW4ZRQVAN2TNFMKH2Q3YMDBDJTBFKIFSCZMSMEA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.599925777 (240h46m18.151396238s) [noise=true , address=81.171.14.70:4047 , piece_id=HYIAJAHPO6YNQUAOWNG7TDBU3V4XCMSR25EBO4MHSRYSIB55B56Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.600476777 (240h46m18.151947228s) [noise=true , address=81.171.14.70:4041 , piece_id=3ZPPZDH6RDQFDLWG5MSFZXFK6WRVS5PI3BFB5EHAPJ6B64AUQAWQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607494198 (240h46m18.158964659s) [noise=true , address=81.171.14.70:4032 , piece_id=KNUTZI3JIUVI7QM5SNZSAGX76VHA3L6BWHJ7P5MLRR2FIY6L6FSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.607734646 (240h46m18.159205107s) [noise=true , address=185.167.204.206:4041 , piece_id=2QG35AZJNTLODL5P4YJEIOAX773W4J5GOC2F7RGQPEQ3NEZC3XCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.608040439 (240h46m18.1595109s) [noise=true , address=185.167.204.206:4071 , piece_id=2BH2GFVSG67OMGR25JCGTMJFR4UGXKTPWHBABBOFFOFEMPRY7W4Q, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612375663 (240h46m18.163846134s) [noise=true , address=185.167.204.206:4044 , piece_id=TP5WZJ5XDNT5WSUFT5SOFYKUNXAGXDUQ7EAG6JDOC7442QMLWQFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.612457069 (240h46m18.16392754s) [noise=true , address=81.171.14.70:4033 , piece_id=RHTXDDY4EHEP2TUDW5UDGBKPLH6WLIKPHU6KCCOMUAUVMXU5KORA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614207943 (240h46m18.165678404s) [noise=true , address=81.171.14.70:4040 , piece_id=JSJ4N6FF7VVJF3TRHFBLVYW52JFXYQCHLO53BASBGG43QM6PG3LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.614968361 (240h46m18.166438832s) [noise=true , address=185.167.204.205:4006 , piece_id=AHCSZIOSJY7VM7YXSVDRY6MZCEWVGMVU4TJMZHU7CY73YUKEVJFA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.618749891 (240h46m18.170220362s) [noise=true , address=185.167.204.205:4020 , piece_id=YMDD2XGNSZIB3MLGZHBPGM4FTO5YLYOV4KZJ5OISOODDM5BHX4DQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.625294683 (240h46m18.176765154s) [noise=true , address=81.171.14.70:4029 , piece_id=OENOSXCFCP7KOGZWVVVVCJXSE3KC63K63FD43JZ7PT5VFHHM6VQA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.626935407 (240h46m18.178405868s) [noise=true , address=185.167.204.205:4008 , piece_id=SF4INS5LG65HO7BOEAQR2G7HBNEXNME4EFLZ7ITFOVEM5LNDDVPQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.632600385 (240h46m18.184070846s) [noise=true , address=185.167.204.206:4046 , piece_id=KYSO24JL5OHZYZF6ATTXPBW3WVNBEHKEC6IX5A65PRFTHCYAON2A, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.633532079 (240h46m18.18500254s) [noise=true , address=185.167.204.205:4016 , piece_id=CL6LLIGDIJBAZQQGIFRJXGPN4MRSOVADCOHDCFSA7HHSTLIWENBQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634042421 (240h46m18.185512892s) [noise=true , address=185.167.204.206:4060 , piece_id=STLRDZ7ECJBH6UE3C3IMJWSIMQHGZHHVJPLJZLVSTUHNNFE7LULQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.634509881 (240h46m18.185980352s) [noise=true , address=185.167.204.205:4009 , piece_id=FTMVPIOKFAQG7BRP3ITIZWKJAMTPD7YNFVZGRQ45A7AUK2AYBIJA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.647693084 (240h46m18.199163545s) [noise=true , address=185.167.204.206:4062 , piece_id=2LSV2UZZKW5MWN2QB6LG3KATKW5WYD67C7UJNI6PBUSAF47JOMCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.658580486 (240h46m18.210050947s) [noise=true , address=81.171.14.70:4038 , piece_id=4KM575RMFIACWJH2QAIOGA6L57US5JWUBZC4VLCWTO344NSSRBSQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:19.691344414 (240h46m18.242814885s) [noise=true , address=81.171.14.70:4028 , piece_id=56C4IJEAEJHFLQWSJRZJIOK4YMJKP7AFBASRDQ5LIFXCVJGPANVA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.093916608 (240h46m18.645387069s) [noise=true , address=81.171.14.70:4034 , piece_id=6OUZ3RG7KYP242ATASZ7YZJF3DVKMAHULYXLGHTMEM4O7KB6SQOA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.260008855 (240h46m18.811479316s) [noise=true , address=89.149.201.147:4009 , piece_id=UZASRUAHWEE24VK6HUJXGA7ZMCME3ZUHRQEI6PZB7JKSRAY7T5LQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.264111377 (240h46m18.815581848s) [noise=true , address=89.149.201.147:4002 , piece_id=6T2ZGPISKTHM2SGBM3GYYBF2WQC5YRWMHCQ7VTEAM2ZIYVPWP7CQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279244262 (240h46m18.830714713s) [noise=true , address=89.149.201.147:4015 , piece_id=PXOT4YUQORMYZELONX6PCNUJAR444QQMXWRVPMCHYVJFPFQSFIIQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: <nil>
Nov 19 08:50:20.279270913 (240h46m18.830741374s) [seg_pos={0 0}, upload=212090]: Segment reached optimal threshold of 26 pieces.
Nov 19 08:50:20.279529285 (240h46m18.830999766s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279539495 (240h46m18.831009956s) [noise=true , address=89.149.201.147:4018 , piece_id=MXBAUB2ZN2G5Q5UDC342CN2V26IRJ557GBY4HWAQP6CBV4CGDHCQ, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279903337 (240h46m18.831373808s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr): protocol: expected piece hash; context canceled; EOF
Nov 19 08:50:20.279914489 (240h46m18.83138495s) [noise=true , address=89.149.201.147:4004 , piece_id=MOFXNGMUJFG5A52TUJBR6T2VISYI3IYQEMCQY4USE4HVVEYMEAXA, seg_pos={0 0}, upload=212090]: Long tail cancellation due to optimal threshold
Nov 19 08:50:20.279945397 (240h46m18.831415858s) [seg_pos={0 0}, upload=212090]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 19 08:50:20.280038044 (240h46m18.831508515s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 19 08:50:20.280044757 (240h46m18.831515218s) [upload=212090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 19 08:52:06.264461555 (240h48m4.815932006s) [upload=212090]: Done uploading segments...
Nov 19 08:52:06.264545334 (240h48m4.816015786s) [upload=212090]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.307212499s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
5.548094743s trace:
https://jaeger.dev.storj.io/trace/3ad7b73c5f22defb
FAIL (2025-11-19 09:25:22 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.54813581s
core
uplink
eu1
|