Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [........XX..........X.......................................] duration:
3.836286116s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:56:50 UTC)
orbiter warning: context deadline exceeded
Duration: 3.83631034s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [.........XX..........X......................................] duration:
3.769665155s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:56:11 UTC)
orbiter warning: context deadline exceeded
Duration: 3.769684783s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
12 out of 60 is failed (threshold=3) [X.........XX........XX.X........X...........XX..X...X...X...] duration:
10.11899651s trace:
https://jaeger.dev.storj.io/trace/13f22f045f5e227
FAIL (2026-05-25 22:55:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 10.119011166s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
13 out of 60 is failed (threshold=3) [XX.........XX........XX.X........X...........XX..X...X...X..] duration:
42.654878605s trace:
https://jaeger.dev.storj.io/trace/13f22f045f5e227
FAIL (2026-05-25 22:55:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 42.654899555s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [..........XX..........X.....................................] duration:
3.662886589s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:55:17 UTC)
orbiter warning: context deadline exceeded
Duration: 3.662911387s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [...........XX..........X....................................] duration:
3.734186457s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:54:40 UTC)
orbiter warning: context deadline exceeded
Duration: 3.734201717s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
14 out of 60 is failed (threshold=3) [XXX.........XX........XX.X........X...........XX..X...X...X.] duration:
7.360159641s trace:
https://jaeger.dev.storj.io/trace/13f22f045f5e227
FAIL (2026-05-25 22:54:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.360181914s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
14 out of 60 is failed (threshold=3) [.XXX.........XX........XX.X........X...........XX..X...X...X] duration:
1m0.00151874s trace:
https://jaeger.dev.storj.io/trace/13f22f045f5e227
FAIL (2026-05-25 22:54:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.001540222s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [............XX..........X...................................] duration:
4.32363452s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:53:43 UTC)
orbiter warning: context deadline exceeded
Duration: 4.323654538s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [X............XX..........X..................................] duration:
3.718530671s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:53:15 UTC)
orbiter warning: context deadline exceeded
Duration: 3.718550649s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [.X............XX..........X.................................] duration:
3.783904635s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:52:59 UTC)
orbiter warning: context deadline exceeded
Duration: 3.783929273s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
14 out of 60 is failed (threshold=3) [X.XXX.........XX........XX.X........X...........XX..X...X...] duration:
6.720665829s trace:
https://jaeger.dev.storj.io/trace/3685d3154eb992bd
FAIL (2026-05-25 22:52:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.720689072s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [..X............XX..........X................................] duration:
3.678724571s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:52:07 UTC)
orbiter warning: context deadline exceeded
Duration: 3.678749639s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
15 out of 60 is failed (threshold=3) [XX.XXX.........XX........XX.X........X...........XX..X...X..] duration:
6.967570776s trace:
https://jaeger.dev.storj.io/trace/3685d3154eb992bd
FAIL (2026-05-25 22:51:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.967582769s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [...X............XX..........X...............................] duration:
3.896296225s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:51:31 UTC)
orbiter warning: context deadline exceeded
Duration: 3.896316854s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
16 out of 60 is failed (threshold=3) [XXX.XXX.........XX........XX.X........X...........XX..X...X.] duration:
6.745961288s trace:
https://jaeger.dev.storj.io/trace/3685d3154eb992bd
FAIL (2026-05-25 22:51:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.7459826s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [....X............XX..........X..............................] duration:
3.719086123s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:51:11 UTC)
orbiter warning: context deadline exceeded
Duration: 3.719094099s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
16 out of 60 is failed (threshold=3) [.XXX.XXX.........XX........XX.X........X...........XX..X...X] duration:
1m0.001165616s trace:
https://jaeger.dev.storj.io/trace/3685d3154eb992bd
FAIL (2026-05-25 22:50:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.001179323s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [.....X............XX..........X.............................] duration:
3.78117269s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:50:37 UTC)
orbiter warning: context deadline exceeded
Duration: 3.78119313s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [......X............XX..........X............................] duration:
3.821369676s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:50:14 UTC)
orbiter warning: context deadline exceeded
Duration: 3.821394223s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
15 out of 60 is failed (threshold=3) [..XXX.XXX.........XX........XX.X........X...........XX..X...] duration:
15.297614598s trace:
https://jaeger.dev.storj.io/trace/d5df9a0956dcf9e
FAIL (2026-05-25 22:49:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 15.297653512s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
16 out of 60 is failed (threshold=3) [X..XXX.XXX.........XX........XX.X........X...........XX..X..] duration:
36.55984597s trace:
https://jaeger.dev.storj.io/trace/d5df9a0956dcf9e
FAIL (2026-05-25 22:49:26 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 36.560040961s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [.......X............XX..........X...........................] duration:
3.974646841s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:49:11 UTC)
orbiter warning: context deadline exceeded
Duration: 3.974673311s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
16 out of 60 is failed (threshold=3) [.X..XXX.XXX.........XX........XX.X........X...........XX..X.] duration:
6.797853604s trace:
https://jaeger.dev.storj.io/trace/d5df9a0956dcf9e
FAIL (2026-05-25 22:48:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.797916355s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [........X............XX..........X..........................] duration:
3.834032556s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:48:02 UTC)
orbiter warning: context deadline exceeded
Duration: 3.834049869s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
16 out of 60 is failed (threshold=3) [..X..XXX.XXX.........XX........XX.X........X...........XX..X] duration:
1m0.000784185s trace:
https://jaeger.dev.storj.io/trace/d5df9a0956dcf9e
FAIL (2026-05-25 22:48:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.000815255s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [.........X............XX..........X.........................] duration:
3.696067941s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:47:38 UTC)
orbiter warning: context deadline exceeded
Duration: 3.696125921s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [..........X............XX..........X........................] duration:
3.79694924s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:47:04 UTC)
orbiter warning: context deadline exceeded
Duration: 3.796962765s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
16 out of 60 is failed (threshold=3) [X..X..XXX.XXX.........XX........XX.X........X...........XX..] duration:
6.514956293s trace:
https://jaeger.dev.storj.io/trace/eb50571a5814b27
FAIL (2026-05-25 22:46:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.514977322s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
8.343932557s trace:
https://jaeger.dev.storj.io/trace/5c964271d20d5817
FAIL (2026-05-25 22:46:26 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment
May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments...
May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces
May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments...
May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil>
Duration: 8.343953706s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
16 out of 60 is failed (threshold=3) [.X..X..XXX.XXX.........XX........XX.X........X...........XX.] duration:
7.065588864s trace:
https://jaeger.dev.storj.io/trace/eb50571a5814b27
FAIL (2026-05-25 22:46:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.065599775s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [...........X............XX..........X.......................] duration:
4.284851415s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:46:01 UTC)
orbiter warning: context deadline exceeded
Duration: 4.284872914s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
16 out of 60 is failed (threshold=3) [..X..X..XXX.XXX.........XX........XX.X........X...........XX] duration:
1m0.00132524s trace:
https://jaeger.dev.storj.io/trace/eb50571a5814b27
FAIL (2026-05-25 22:45:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.001367731s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [............X............XX..........X......................] duration:
4.855461541s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:45:27 UTC)
orbiter warning: context deadline exceeded
Duration: 4.855478034s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
5.008908904s trace:
https://jaeger.dev.storj.io/trace/5c964271d20d5817
FAIL (2026-05-25 22:45:19 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment
May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments...
May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces
May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments...
May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil>
Duration: 5.008929423s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
1m0.001249947s trace:
https://jaeger.dev.storj.io/trace/5c964271d20d5817
FAIL (2026-05-25 22:45:09 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment
May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments...
May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces
May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments...
May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil>
Duration: 1m0.001265686s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
15 out of 60 is failed (threshold=3) [...X..X..XXX.XXX.........XX........XX.X........X...........X] duration:
1m0.001387803s trace:
https://jaeger.dev.storj.io/trace/c91bde765f89fc7
FAIL (2026-05-25 22:44:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.001397631s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [.............X............XX..........X.....................] duration:
4.347091812s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:44:49 UTC)
orbiter warning: context deadline exceeded
Duration: 4.347103104s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [..............X............XX..........X....................] duration:
3.902608218s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:43:57 UTC)
orbiter warning: context deadline exceeded
Duration: 3.902617535s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
7.344412739s trace:
https://jaeger.dev.storj.io/trace/5c964271d20d5817
FAIL (2026-05-25 22:43:50 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment
May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments...
May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces
May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments...
May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil>
Duration: 7.34445471s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
14 out of 60 is failed (threshold=3) [....X..X..XXX.XXX.........XX........XX.X........X...........] duration:
33.813554783s trace:
https://jaeger.dev.storj.io/trace/48ee0d1111a97208
FAIL (2026-05-25 22:43:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 33.813580583s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [...............X............XX..........X...................] duration:
3.966197928s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:43:31 UTC)
orbiter warning: context deadline exceeded
Duration: 3.966220981s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
4.083599945s trace:
https://jaeger.dev.storj.io/trace/5c964271d20d5817
FAIL (2026-05-25 22:43:03 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment
May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments...
May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces
May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments...
May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil>
Duration: 4.083621577s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
4.201091437s trace:
https://jaeger.dev.storj.io/trace/5c964271d20d5817
FAIL (2026-05-25 22:42:48 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment
May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments...
May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces
May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments...
May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil>
Duration: 4.201112477s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
14 out of 60 is failed (threshold=3) [.....X..X..XXX.XXX.........XX........XX.X........X..........] duration:
12.354436254s trace:
https://jaeger.dev.storj.io/trace/48ee0d1111a97208
FAIL (2026-05-25 22:42:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 12.354499525s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [................X............XX..........X..................] duration:
4.610378493s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:42:40 UTC)
orbiter warning: context deadline exceeded
Duration: 4.610392089s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
3.914792916s trace:
https://jaeger.dev.storj.io/trace/5c964271d20d5817
FAIL (2026-05-25 22:41:46 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment
May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments...
May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces
May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments...
May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil>
Duration: 3.914818776s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [.................X............XX..........X.................] duration:
3.687725034s trace:
https://jaeger.dev.storj.io/trace/e2041c22ff5061f
FAIL (2026-05-25 22:41:35 UTC)
orbiter warning: context deadline exceeded
Duration: 3.687750242s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
14 out of 60 is failed (threshold=3) [......X..X..XXX.XXX.........XX........XX.X........X.........] duration:
6.627369234s trace:
https://jaeger.dev.storj.io/trace/48ee0d1111a97208
FAIL (2026-05-25 22:41:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.627397146s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
5.352589502s trace:
https://jaeger.dev.storj.io/trace/5c964271d20d5817
FAIL (2026-05-25 22:41:21 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece...
May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment
May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments...
May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil>
May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces
May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF
May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold
May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments...
May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil>
Duration: 5.352612766s
core
uplink
uk-select-1
uk1-placement-17
|