Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................................X..........................] duration:
3.729342405s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:59:42 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.729363235s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................................X.........................] duration:
3.854024571s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:58:43 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.854085267s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................................X........................] duration:
3.822394767s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:57:47 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.822417831s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................................X.......................] duration:
3.715103117s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:57:03 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.715123625s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................................X......................] duration:
3.814739808s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:55:51 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.814763112s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................................X.....................] duration:
3.912774296s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:55:23 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.912796889s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......................................X....................] duration:
4.756573416s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:54:10 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 4.756593857s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................................X...................] duration:
3.800387404s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:53:05 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.800408363s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................................X..................] duration:
3.687785514s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:51:56 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.687797717s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................................X.................] duration:
4.746561893s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:51:14 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 4.746586159s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................................X................] duration:
3.755079326s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:50:27 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.755100117s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............................................X...............] duration:
3.821701269s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:49:24 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.821721869s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............................................X..............] duration:
3.714340919s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:48:48 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.714358743s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............................................X.............] duration:
3.692259457s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:48:15 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.69228684s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............................................X............] duration:
3.79972468s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:47:50 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.799781399s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................................................X...........] duration:
3.647622104s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:46:53 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.647644396s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................................................X..........] duration:
3.712901014s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:46:16 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.712925733s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................................................X.........] duration:
3.612623757s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:45:17 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.612643567s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................................................X........] duration:
3.74319375s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:44:27 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.743208297s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................................................X.......] duration:
3.731661448s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:43:23 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.731684202s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................................................X......] duration:
3.61618349s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:42:33 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.616202355s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................................................X.....] duration:
3.742180817s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:41:44 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.742206035s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......................................................X....] duration:
3.731109775s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:40:54 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.731131286s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................................................X...] duration:
3.820801938s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:39:48 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.820818953s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................................................X..] duration:
3.724822572s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:39:25 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.72483775s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................................................X.] duration:
3.702952026s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:39:04 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.70297563s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................................................X] duration:
5.000467264s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:38:24 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 5.000485368s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
3.71236188s trace:
https://jaeger.dev.storj.io/trace/2f0b656030b9f519
FAIL (2026-05-26 05:09:25 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.712383231s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.X..........................................................] duration:
3.734781084s trace:
https://jaeger.dev.storj.io/trace/2f0b656030b9f519
FAIL (2026-05-26 05:08:23 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.734798177s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..X.........................................................] duration:
3.870376713s trace:
https://jaeger.dev.storj.io/trace/2f0b656030b9f519
FAIL (2026-05-26 05:07:53 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.870394728s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...X........................................................] duration:
3.80538543s trace:
https://jaeger.dev.storj.io/trace/2f0b656030b9f519
FAIL (2026-05-26 05:07:12 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.805404597s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....X.......................................................] duration:
3.727402797s trace:
https://jaeger.dev.storj.io/trace/2f0b656030b9f519
FAIL (2026-05-26 05:06:15 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.727425921s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....X......................................................] duration:
3.815612256s trace:
https://jaeger.dev.storj.io/trace/2f0b656030b9f519
FAIL (2026-05-26 05:05:14 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.815636562s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......X.....................................................] duration:
3.812141444s trace:
https://jaeger.dev.storj.io/trace/2f0b656030b9f519
FAIL (2026-05-26 05:04:50 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.812201068s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......X....................................................] duration:
3.760955078s trace:
https://jaeger.dev.storj.io/trace/2f0b656030b9f519
FAIL (2026-05-26 05:03:57 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.76097195s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........X...................................................] duration:
4.052676194s trace:
https://jaeger.dev.storj.io/trace/2f0b656030b9f519
FAIL (2026-05-26 05:03:28 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.05269567s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........X..................................................] duration:
3.845699483s trace:
https://jaeger.dev.storj.io/trace/2f0b656030b9f519
FAIL (2026-05-26 05:02:50 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.845733889s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........X.................................................] duration:
3.64841659s trace:
https://jaeger.dev.storj.io/trace/2f0b656030b9f519
FAIL (2026-05-26 05:01:47 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.648436928s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........X................................................] duration:
3.703805646s trace:
https://jaeger.dev.storj.io/trace/2f0b656030b9f519
FAIL (2026-05-26 05:01:28 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.703827547s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
6.833343866s trace:
https://jaeger.dev.storj.io/trace/20840979a8f7088f
FAIL (2026-05-26 05:01:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
25083]: Uploading piece...
May 26 04:17:28.318973560 (26h13m14.10231366s) [noise=true , address=212.102.52.217:4420 , piece_id=PQM3W3VAO5T2BBPQEREGSHGZ3EYBGJ7LFORGCKUY6NTUP2NNE5PA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.319026442 (26h13m14.102366541s) [noise=true , address=212.102.52.216:4397 , piece_id=5UNX4TPU63Q4AG726PSLVBFWX7ZZJL766ULEHEIIU3S4LG3EUGDA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.319245079 (26h13m14.102585178s) [noise=true , address=212.102.52.213:4343 , piece_id=AUT3LEUM7MPZIL33QGT47V7QOOZTHR3A2W2S6EMKJBY4B3AUA4ZA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.319586399 (26h13m14.102926499s) [noise=true , address=212.102.52.216:4402 , piece_id=VNTORDVWCQPSO5C2QUQUI76CBCTFB7TIQSEL7MWCCYRJ22T4WIBA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.319879910 (26h13m14.103220009s) [noise=true , address=212.102.52.217:4436 , piece_id=SWQCVL47FBVYZFZIQVYNAD4NYDQLBBJL3S2EYVNHGS2Y54RRAN6A, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.320133124 (26h13m14.103473223s) [noise=true , address=212.102.52.215:4379 , piece_id=FBM4P5FPAP6OCVSHW5QYJOJWRXCO63HY2I6K3EYZKL6BRIUMME5Q, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.320357862 (26h13m14.103697961s) [noise=true , address=212.102.52.214:4362 , piece_id=LB7JGSWGNGU7BQX4FZQLVA2IUDQJT7ZP5PFXOQV4NLYXH7JAFRHA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.320571960 (26h13m14.103912059s) [noise=true , address=212.102.52.216:4408 , piece_id=23VTNWQ4FKNZ4O552CZQERQ5KMMHSCP4Y46PNSMWU4HGHSDFLIOA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.320588152 (26h13m14.103928251s) [noise=true , address=212.102.52.213:4344 , piece_id=UEGMZ7I63LXBAKRWSFQDHBZBXPCHG2NMZSGW4PFVHFQORZLRMQYA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.321070803 (26h13m14.104410912s) [noise=true , address=212.102.52.217:4433 , piece_id=FGN6M3NBSA3ZOLHYPT3THZV4THHNFYSI2R6BDB4AWSQZRCZ2M7TQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.321436691 (26h13m14.10477679s) [noise=true , address=212.102.52.215:4380 , piece_id=6XJ45LCPGAIOCFHI35GODZRUNRS2Z63RF6WIKFUXV5R3GMSH7YJQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.321852404 (26h13m14.105192503s) [noise=true , address=212.102.52.213:4333 , piece_id=O4MDU2BWFAOHKWNQ3KS24KNT6VYDQ4MGLBGCWW4WZZTPMVBT4OCQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.322253419 (26h13m14.105593518s) [noise=true , address=212.102.52.214:4347 , piece_id=VPYOK5SVHEPZ36OOB7PYDAAINGIOUACK4FVDZBMJLWKMWC2D4NXQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.322652791 (26h13m14.1059929s) [noise=true , address=212.102.52.213:4331 , piece_id=LTU5YKIGVWFRQXGCECWGW656T6JMUDM7RRK6QD5CRGBB5IKMZXTQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.324215282 (26h13m14.107555381s) [noise=true , address=212.102.52.214:4349 , piece_id=HH47IVRCTHTDW4RHMJTEXGNB4ZK62NU6LDP5AS4FVXWPFINGHFNQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:29.390980339 (26h13m15.174320438s) [upload=25083]: Next returned nil segment
May 26 04:17:29.390993564 (26h13m15.174333663s) [upload=25083]: Waiting for error group managing segments...
May 26 04:17:29.673854379 (26h13m15.457194479s) [noise=true , address=212.102.52.215:4381 , piece_id=5UZ45SYYXIOMUYBHLRRP6NECZCQ5JW2RIK5MQIV2LMYQBVOON4ZA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.674402245 (26h13m15.457742344s) [noise=true , address=212.102.52.217:4433 , piece_id=FGN6M3NBSA3ZOLHYPT3THZV4THHNFYSI2R6BDB4AWSQZRCZ2M7TQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.677827470 (26h13m15.461167569s) [noise=true , address=212.102.52.213:4344 , piece_id=UEGMZ7I63LXBAKRWSFQDHBZBXPCHG2NMZSGW4PFVHFQORZLRMQYA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.678368041 (26h13m15.46170814s) [noise=true , address=212.102.52.215:4379 , piece_id=FBM4P5FPAP6OCVSHW5QYJOJWRXCO63HY2I6K3EYZKL6BRIUMME5Q, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.680215035 (26h13m15.463555134s) [noise=true , address=212.102.52.216:4402 , piece_id=VNTORDVWCQPSO5C2QUQUI76CBCTFB7TIQSEL7MWCCYRJ22T4WIBA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.682230351 (26h13m15.46557045s) [noise=true , address=212.102.52.217:4420 , piece_id=PQM3W3VAO5T2BBPQEREGSHGZ3EYBGJ7LFORGCKUY6NTUP2NNE5PA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.685255182 (26h13m15.468595281s) [noise=true , address=212.102.52.216:4405 , piece_id=65IGD4H7EMWEDYW2TFH643JJ5QW2BKHVFZA6D77MCHRYA6T6ESGQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.686472445 (26h13m15.469812544s) [noise=true , address=212.102.52.214:4362 , piece_id=LB7JGSWGNGU7BQX4FZQLVA2IUDQJT7ZP5PFXOQV4NLYXH7JAFRHA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.689410080 (26h13m15.472750179s) [noise=true , address=212.102.52.217:4436 , piece_id=SWQCVL47FBVYZFZIQVYNAD4NYDQLBBJL3S2EYVNHGS2Y54RRAN6A, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.689953157 (26h13m15.473293256s) [noise=true , address=212.102.52.214:4355 , piece_id=RKSUNVZS66X4A7ZY7WEUQXSWOTK2H5VAR7TBDICVC7MGVHA7LTGA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.694371046 (26h13m15.477711155s) [noise=true , address=212.102.52.214:4347 , piece_id=VPYOK5SVHEPZ36OOB7PYDAAINGIOUACK4FVDZBMJLWKMWC2D4NXQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.698718109 (26h13m15.482058208s) [noise=true , address=212.102.52.214:4349 , piece_id=HH47IVRCTHTDW4RHMJTEXGNB4ZK62NU6LDP5AS4FVXWPFINGHFNQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.699290191 (26h13m15.48263029s) [noise=true , address=212.102.52.215:4389 , piece_id=2OTWYJIV6A2646HAW5TWBTSQVT25V2PBKVANLGGK5SWNVHE3WGWA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.701256312 (26h13m15.484596411s) [noise=true , address=212.102.52.216:4397 , piece_id=5UNX4TPU63Q4AG726PSLVBFWX7ZZJL766ULEHEIIU3S4LG3EUGDA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.735255313 (26h13m15.518595412s) [noise=true , address=212.102.52.213:4331 , piece_id=LTU5YKIGVWFRQXGCECWGW656T6JMUDM7RRK6QD5CRGBB5IKMZXTQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.738998335 (26h13m15.522338434s) [noise=true , address=212.102.52.215:4380 , piece_id=6XJ45LCPGAIOCFHI35GODZRUNRS2Z63RF6WIKFUXV5R3GMSH7YJQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.739008105 (26h13m15.522348204s) [seg_pos={0 0}, upload=25083]: Satisfied cohort requirements after 16 pieces
May 26 04:17:29.739201553 (26h13m15.522541652s) [noise=true , address=212.102.52.217:4423 , piece_id=2KWQV3P3UYSFMBJ5BJNIHGVNZZXSCD3DEJXUV7SYVDALJSXIJAPA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TgGtX5XRdWH1qn6V5fZpQ8cY5oA2NyZx1AM17XANmr99AG9oh): protocol: expected piece hash; context canceled; EOF
May 26 04:17:29.739208446 (26h13m15.522548545s) [noise=true , address=212.102.52.217:4423 , piece_id=2KWQV3P3UYSFMBJ5BJNIHGVNZZXSCD3DEJXUV7SYVDALJSXIJAPA, seg_pos={0 0}, upload=25083]: Long tail cancellation due to optimal threshold
May 26 04:17:29.739277749 (26h13m15.522617858s) [noise=true , address=212.102.52.213:4343 , piece_id=AUT3LEUM7MPZIL33QGT47V7QOOZTHR3A2W2S6EMKJBY4B3AUA4ZA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129SbAN2aTSXzo8JLELV2ssdkmT5k7kbTcvxSZE4sFsVaKw1Aok): protocol: expected piece hash; context canceled; EOF
May 26 04:17:29.739288459 (26h13m15.522628598s) [noise=true , address=212.102.52.213:4343 , piece_id=AUT3LEUM7MPZIL33QGT47V7QOOZTHR3A2W2S6EMKJBY4B3AUA4ZA, seg_pos={0 0}, upload=25083]: Long tail cancellation due to optimal threshold
May 26 04:17:29.739324538 (26h13m15.522664637s) [noise=true , address=212.102.52.216:4408 , piece_id=23VTNWQ4FKNZ4O552CZQERQ5KMMHSCP4Y46PNSMWU4HGHSDFLIOA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BsdeZy1odVCAgcjxU6KdveXhUUTJKviRrrHLNCUuVergW6zVk): protocol: expected piece hash; context canceled; EOF
May 26 04:17:29.739330078 (26h13m15.522670177s) [noise=true , address=212.102.52.216:4408 , piece_id=23VTNWQ4FKNZ4O552CZQERQ5KMMHSCP4Y46PNSMWU4HGHSDFLIOA, seg_pos={0 0}, upload=25083]: Long tail cancellation due to optimal threshold
May 26 04:17:29.739420791 (26h13m15.52276089s) [noise=true , address=212.102.52.213:4333 , piece_id=O4MDU2BWFAOHKWNQ3KS24KNT6VYDQ4MGLBGCWW4WZZTPMVBT4OCQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Gm3eZxZPxPeHqLQ32kpXMpCgnwRoP8epBYtiFF1EH3U9LEazY): protocol: expected piece hash; context canceled; EOF
May 26 04:17:29.739426021 (26h13m15.52276612s) [noise=true , address=212.102.52.213:4333 , piece_id=O4MDU2BWFAOHKWNQ3KS24KNT6VYDQ4MGLBGCWW4WZZTPMVBT4OCQ, seg_pos={0 0}, upload=25083]: Long tail cancellation due to optimal threshold
May 26 04:17:29.739475536 (26h13m15.522815635s) [seg_pos={0 0}, upload=25083]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 04:17:29.739535340 (26h13m15.522875439s) [upload=25083]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 04:17:29.739552654 (26h13m15.522892753s) [upload=25083]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 04:17:39.024892360 (26h13m24.808232459s) [upload=25083]: Done uploading segments...
May 26 04:17:39.024959289 (26h13m24.808299388s) [upload=25083]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.833365108s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............X...............................................] duration:
4.751008271s trace:
https://jaeger.dev.storj.io/trace/2f0b656030b9f519
FAIL (2026-05-26 05:00:44 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.751028952s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............X..............................................] duration:
3.897418966s trace:
https://jaeger.dev.storj.io/trace/2f0b656030b9f519
FAIL (2026-05-26 05:00:04 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.897444464s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
4.384884571s trace:
https://jaeger.dev.storj.io/trace/20840979a8f7088f
FAIL (2026-05-26 05:00:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
25083]: Uploading piece...
May 26 04:17:28.318973560 (26h13m14.10231366s) [noise=true , address=212.102.52.217:4420 , piece_id=PQM3W3VAO5T2BBPQEREGSHGZ3EYBGJ7LFORGCKUY6NTUP2NNE5PA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.319026442 (26h13m14.102366541s) [noise=true , address=212.102.52.216:4397 , piece_id=5UNX4TPU63Q4AG726PSLVBFWX7ZZJL766ULEHEIIU3S4LG3EUGDA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.319245079 (26h13m14.102585178s) [noise=true , address=212.102.52.213:4343 , piece_id=AUT3LEUM7MPZIL33QGT47V7QOOZTHR3A2W2S6EMKJBY4B3AUA4ZA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.319586399 (26h13m14.102926499s) [noise=true , address=212.102.52.216:4402 , piece_id=VNTORDVWCQPSO5C2QUQUI76CBCTFB7TIQSEL7MWCCYRJ22T4WIBA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.319879910 (26h13m14.103220009s) [noise=true , address=212.102.52.217:4436 , piece_id=SWQCVL47FBVYZFZIQVYNAD4NYDQLBBJL3S2EYVNHGS2Y54RRAN6A, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.320133124 (26h13m14.103473223s) [noise=true , address=212.102.52.215:4379 , piece_id=FBM4P5FPAP6OCVSHW5QYJOJWRXCO63HY2I6K3EYZKL6BRIUMME5Q, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.320357862 (26h13m14.103697961s) [noise=true , address=212.102.52.214:4362 , piece_id=LB7JGSWGNGU7BQX4FZQLVA2IUDQJT7ZP5PFXOQV4NLYXH7JAFRHA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.320571960 (26h13m14.103912059s) [noise=true , address=212.102.52.216:4408 , piece_id=23VTNWQ4FKNZ4O552CZQERQ5KMMHSCP4Y46PNSMWU4HGHSDFLIOA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.320588152 (26h13m14.103928251s) [noise=true , address=212.102.52.213:4344 , piece_id=UEGMZ7I63LXBAKRWSFQDHBZBXPCHG2NMZSGW4PFVHFQORZLRMQYA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.321070803 (26h13m14.104410912s) [noise=true , address=212.102.52.217:4433 , piece_id=FGN6M3NBSA3ZOLHYPT3THZV4THHNFYSI2R6BDB4AWSQZRCZ2M7TQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.321436691 (26h13m14.10477679s) [noise=true , address=212.102.52.215:4380 , piece_id=6XJ45LCPGAIOCFHI35GODZRUNRS2Z63RF6WIKFUXV5R3GMSH7YJQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.321852404 (26h13m14.105192503s) [noise=true , address=212.102.52.213:4333 , piece_id=O4MDU2BWFAOHKWNQ3KS24KNT6VYDQ4MGLBGCWW4WZZTPMVBT4OCQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.322253419 (26h13m14.105593518s) [noise=true , address=212.102.52.214:4347 , piece_id=VPYOK5SVHEPZ36OOB7PYDAAINGIOUACK4FVDZBMJLWKMWC2D4NXQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.322652791 (26h13m14.1059929s) [noise=true , address=212.102.52.213:4331 , piece_id=LTU5YKIGVWFRQXGCECWGW656T6JMUDM7RRK6QD5CRGBB5IKMZXTQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.324215282 (26h13m14.107555381s) [noise=true , address=212.102.52.214:4349 , piece_id=HH47IVRCTHTDW4RHMJTEXGNB4ZK62NU6LDP5AS4FVXWPFINGHFNQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:29.390980339 (26h13m15.174320438s) [upload=25083]: Next returned nil segment
May 26 04:17:29.390993564 (26h13m15.174333663s) [upload=25083]: Waiting for error group managing segments...
May 26 04:17:29.673854379 (26h13m15.457194479s) [noise=true , address=212.102.52.215:4381 , piece_id=5UZ45SYYXIOMUYBHLRRP6NECZCQ5JW2RIK5MQIV2LMYQBVOON4ZA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.674402245 (26h13m15.457742344s) [noise=true , address=212.102.52.217:4433 , piece_id=FGN6M3NBSA3ZOLHYPT3THZV4THHNFYSI2R6BDB4AWSQZRCZ2M7TQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.677827470 (26h13m15.461167569s) [noise=true , address=212.102.52.213:4344 , piece_id=UEGMZ7I63LXBAKRWSFQDHBZBXPCHG2NMZSGW4PFVHFQORZLRMQYA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.678368041 (26h13m15.46170814s) [noise=true , address=212.102.52.215:4379 , piece_id=FBM4P5FPAP6OCVSHW5QYJOJWRXCO63HY2I6K3EYZKL6BRIUMME5Q, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.680215035 (26h13m15.463555134s) [noise=true , address=212.102.52.216:4402 , piece_id=VNTORDVWCQPSO5C2QUQUI76CBCTFB7TIQSEL7MWCCYRJ22T4WIBA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.682230351 (26h13m15.46557045s) [noise=true , address=212.102.52.217:4420 , piece_id=PQM3W3VAO5T2BBPQEREGSHGZ3EYBGJ7LFORGCKUY6NTUP2NNE5PA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.685255182 (26h13m15.468595281s) [noise=true , address=212.102.52.216:4405 , piece_id=65IGD4H7EMWEDYW2TFH643JJ5QW2BKHVFZA6D77MCHRYA6T6ESGQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.686472445 (26h13m15.469812544s) [noise=true , address=212.102.52.214:4362 , piece_id=LB7JGSWGNGU7BQX4FZQLVA2IUDQJT7ZP5PFXOQV4NLYXH7JAFRHA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.689410080 (26h13m15.472750179s) [noise=true , address=212.102.52.217:4436 , piece_id=SWQCVL47FBVYZFZIQVYNAD4NYDQLBBJL3S2EYVNHGS2Y54RRAN6A, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.689953157 (26h13m15.473293256s) [noise=true , address=212.102.52.214:4355 , piece_id=RKSUNVZS66X4A7ZY7WEUQXSWOTK2H5VAR7TBDICVC7MGVHA7LTGA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.694371046 (26h13m15.477711155s) [noise=true , address=212.102.52.214:4347 , piece_id=VPYOK5SVHEPZ36OOB7PYDAAINGIOUACK4FVDZBMJLWKMWC2D4NXQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.698718109 (26h13m15.482058208s) [noise=true , address=212.102.52.214:4349 , piece_id=HH47IVRCTHTDW4RHMJTEXGNB4ZK62NU6LDP5AS4FVXWPFINGHFNQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.699290191 (26h13m15.48263029s) [noise=true , address=212.102.52.215:4389 , piece_id=2OTWYJIV6A2646HAW5TWBTSQVT25V2PBKVANLGGK5SWNVHE3WGWA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.701256312 (26h13m15.484596411s) [noise=true , address=212.102.52.216:4397 , piece_id=5UNX4TPU63Q4AG726PSLVBFWX7ZZJL766ULEHEIIU3S4LG3EUGDA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.735255313 (26h13m15.518595412s) [noise=true , address=212.102.52.213:4331 , piece_id=LTU5YKIGVWFRQXGCECWGW656T6JMUDM7RRK6QD5CRGBB5IKMZXTQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.738998335 (26h13m15.522338434s) [noise=true , address=212.102.52.215:4380 , piece_id=6XJ45LCPGAIOCFHI35GODZRUNRS2Z63RF6WIKFUXV5R3GMSH7YJQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.739008105 (26h13m15.522348204s) [seg_pos={0 0}, upload=25083]: Satisfied cohort requirements after 16 pieces
May 26 04:17:29.739201553 (26h13m15.522541652s) [noise=true , address=212.102.52.217:4423 , piece_id=2KWQV3P3UYSFMBJ5BJNIHGVNZZXSCD3DEJXUV7SYVDALJSXIJAPA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TgGtX5XRdWH1qn6V5fZpQ8cY5oA2NyZx1AM17XANmr99AG9oh): protocol: expected piece hash; context canceled; EOF
May 26 04:17:29.739208446 (26h13m15.522548545s) [noise=true , address=212.102.52.217:4423 , piece_id=2KWQV3P3UYSFMBJ5BJNIHGVNZZXSCD3DEJXUV7SYVDALJSXIJAPA, seg_pos={0 0}, upload=25083]: Long tail cancellation due to optimal threshold
May 26 04:17:29.739277749 (26h13m15.522617858s) [noise=true , address=212.102.52.213:4343 , piece_id=AUT3LEUM7MPZIL33QGT47V7QOOZTHR3A2W2S6EMKJBY4B3AUA4ZA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129SbAN2aTSXzo8JLELV2ssdkmT5k7kbTcvxSZE4sFsVaKw1Aok): protocol: expected piece hash; context canceled; EOF
May 26 04:17:29.739288459 (26h13m15.522628598s) [noise=true , address=212.102.52.213:4343 , piece_id=AUT3LEUM7MPZIL33QGT47V7QOOZTHR3A2W2S6EMKJBY4B3AUA4ZA, seg_pos={0 0}, upload=25083]: Long tail cancellation due to optimal threshold
May 26 04:17:29.739324538 (26h13m15.522664637s) [noise=true , address=212.102.52.216:4408 , piece_id=23VTNWQ4FKNZ4O552CZQERQ5KMMHSCP4Y46PNSMWU4HGHSDFLIOA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BsdeZy1odVCAgcjxU6KdveXhUUTJKviRrrHLNCUuVergW6zVk): protocol: expected piece hash; context canceled; EOF
May 26 04:17:29.739330078 (26h13m15.522670177s) [noise=true , address=212.102.52.216:4408 , piece_id=23VTNWQ4FKNZ4O552CZQERQ5KMMHSCP4Y46PNSMWU4HGHSDFLIOA, seg_pos={0 0}, upload=25083]: Long tail cancellation due to optimal threshold
May 26 04:17:29.739420791 (26h13m15.52276089s) [noise=true , address=212.102.52.213:4333 , piece_id=O4MDU2BWFAOHKWNQ3KS24KNT6VYDQ4MGLBGCWW4WZZTPMVBT4OCQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Gm3eZxZPxPeHqLQ32kpXMpCgnwRoP8epBYtiFF1EH3U9LEazY): protocol: expected piece hash; context canceled; EOF
May 26 04:17:29.739426021 (26h13m15.52276612s) [noise=true , address=212.102.52.213:4333 , piece_id=O4MDU2BWFAOHKWNQ3KS24KNT6VYDQ4MGLBGCWW4WZZTPMVBT4OCQ, seg_pos={0 0}, upload=25083]: Long tail cancellation due to optimal threshold
May 26 04:17:29.739475536 (26h13m15.522815635s) [seg_pos={0 0}, upload=25083]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 04:17:29.739535340 (26h13m15.522875439s) [upload=25083]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 04:17:29.739552654 (26h13m15.522892753s) [upload=25083]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 04:17:39.024892360 (26h13m24.808232459s) [upload=25083]: Done uploading segments...
May 26 04:17:39.024959289 (26h13m24.808299388s) [upload=25083]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.384906611s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............X.............................................] duration:
3.845186906s trace:
https://jaeger.dev.storj.io/trace/2f0b656030b9f519
FAIL (2026-05-26 04:59:24 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.845212295s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
3.976057657s trace:
https://jaeger.dev.storj.io/trace/20840979a8f7088f
FAIL (2026-05-26 04:58:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
25083]: Uploading piece...
May 26 04:17:28.318973560 (26h13m14.10231366s) [noise=true , address=212.102.52.217:4420 , piece_id=PQM3W3VAO5T2BBPQEREGSHGZ3EYBGJ7LFORGCKUY6NTUP2NNE5PA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.319026442 (26h13m14.102366541s) [noise=true , address=212.102.52.216:4397 , piece_id=5UNX4TPU63Q4AG726PSLVBFWX7ZZJL766ULEHEIIU3S4LG3EUGDA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.319245079 (26h13m14.102585178s) [noise=true , address=212.102.52.213:4343 , piece_id=AUT3LEUM7MPZIL33QGT47V7QOOZTHR3A2W2S6EMKJBY4B3AUA4ZA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.319586399 (26h13m14.102926499s) [noise=true , address=212.102.52.216:4402 , piece_id=VNTORDVWCQPSO5C2QUQUI76CBCTFB7TIQSEL7MWCCYRJ22T4WIBA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.319879910 (26h13m14.103220009s) [noise=true , address=212.102.52.217:4436 , piece_id=SWQCVL47FBVYZFZIQVYNAD4NYDQLBBJL3S2EYVNHGS2Y54RRAN6A, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.320133124 (26h13m14.103473223s) [noise=true , address=212.102.52.215:4379 , piece_id=FBM4P5FPAP6OCVSHW5QYJOJWRXCO63HY2I6K3EYZKL6BRIUMME5Q, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.320357862 (26h13m14.103697961s) [noise=true , address=212.102.52.214:4362 , piece_id=LB7JGSWGNGU7BQX4FZQLVA2IUDQJT7ZP5PFXOQV4NLYXH7JAFRHA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.320571960 (26h13m14.103912059s) [noise=true , address=212.102.52.216:4408 , piece_id=23VTNWQ4FKNZ4O552CZQERQ5KMMHSCP4Y46PNSMWU4HGHSDFLIOA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.320588152 (26h13m14.103928251s) [noise=true , address=212.102.52.213:4344 , piece_id=UEGMZ7I63LXBAKRWSFQDHBZBXPCHG2NMZSGW4PFVHFQORZLRMQYA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.321070803 (26h13m14.104410912s) [noise=true , address=212.102.52.217:4433 , piece_id=FGN6M3NBSA3ZOLHYPT3THZV4THHNFYSI2R6BDB4AWSQZRCZ2M7TQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.321436691 (26h13m14.10477679s) [noise=true , address=212.102.52.215:4380 , piece_id=6XJ45LCPGAIOCFHI35GODZRUNRS2Z63RF6WIKFUXV5R3GMSH7YJQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.321852404 (26h13m14.105192503s) [noise=true , address=212.102.52.213:4333 , piece_id=O4MDU2BWFAOHKWNQ3KS24KNT6VYDQ4MGLBGCWW4WZZTPMVBT4OCQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.322253419 (26h13m14.105593518s) [noise=true , address=212.102.52.214:4347 , piece_id=VPYOK5SVHEPZ36OOB7PYDAAINGIOUACK4FVDZBMJLWKMWC2D4NXQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.322652791 (26h13m14.1059929s) [noise=true , address=212.102.52.213:4331 , piece_id=LTU5YKIGVWFRQXGCECWGW656T6JMUDM7RRK6QD5CRGBB5IKMZXTQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.324215282 (26h13m14.107555381s) [noise=true , address=212.102.52.214:4349 , piece_id=HH47IVRCTHTDW4RHMJTEXGNB4ZK62NU6LDP5AS4FVXWPFINGHFNQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:29.390980339 (26h13m15.174320438s) [upload=25083]: Next returned nil segment
May 26 04:17:29.390993564 (26h13m15.174333663s) [upload=25083]: Waiting for error group managing segments...
May 26 04:17:29.673854379 (26h13m15.457194479s) [noise=true , address=212.102.52.215:4381 , piece_id=5UZ45SYYXIOMUYBHLRRP6NECZCQ5JW2RIK5MQIV2LMYQBVOON4ZA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.674402245 (26h13m15.457742344s) [noise=true , address=212.102.52.217:4433 , piece_id=FGN6M3NBSA3ZOLHYPT3THZV4THHNFYSI2R6BDB4AWSQZRCZ2M7TQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.677827470 (26h13m15.461167569s) [noise=true , address=212.102.52.213:4344 , piece_id=UEGMZ7I63LXBAKRWSFQDHBZBXPCHG2NMZSGW4PFVHFQORZLRMQYA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.678368041 (26h13m15.46170814s) [noise=true , address=212.102.52.215:4379 , piece_id=FBM4P5FPAP6OCVSHW5QYJOJWRXCO63HY2I6K3EYZKL6BRIUMME5Q, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.680215035 (26h13m15.463555134s) [noise=true , address=212.102.52.216:4402 , piece_id=VNTORDVWCQPSO5C2QUQUI76CBCTFB7TIQSEL7MWCCYRJ22T4WIBA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.682230351 (26h13m15.46557045s) [noise=true , address=212.102.52.217:4420 , piece_id=PQM3W3VAO5T2BBPQEREGSHGZ3EYBGJ7LFORGCKUY6NTUP2NNE5PA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.685255182 (26h13m15.468595281s) [noise=true , address=212.102.52.216:4405 , piece_id=65IGD4H7EMWEDYW2TFH643JJ5QW2BKHVFZA6D77MCHRYA6T6ESGQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.686472445 (26h13m15.469812544s) [noise=true , address=212.102.52.214:4362 , piece_id=LB7JGSWGNGU7BQX4FZQLVA2IUDQJT7ZP5PFXOQV4NLYXH7JAFRHA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.689410080 (26h13m15.472750179s) [noise=true , address=212.102.52.217:4436 , piece_id=SWQCVL47FBVYZFZIQVYNAD4NYDQLBBJL3S2EYVNHGS2Y54RRAN6A, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.689953157 (26h13m15.473293256s) [noise=true , address=212.102.52.214:4355 , piece_id=RKSUNVZS66X4A7ZY7WEUQXSWOTK2H5VAR7TBDICVC7MGVHA7LTGA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.694371046 (26h13m15.477711155s) [noise=true , address=212.102.52.214:4347 , piece_id=VPYOK5SVHEPZ36OOB7PYDAAINGIOUACK4FVDZBMJLWKMWC2D4NXQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.698718109 (26h13m15.482058208s) [noise=true , address=212.102.52.214:4349 , piece_id=HH47IVRCTHTDW4RHMJTEXGNB4ZK62NU6LDP5AS4FVXWPFINGHFNQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.699290191 (26h13m15.48263029s) [noise=true , address=212.102.52.215:4389 , piece_id=2OTWYJIV6A2646HAW5TWBTSQVT25V2PBKVANLGGK5SWNVHE3WGWA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.701256312 (26h13m15.484596411s) [noise=true , address=212.102.52.216:4397 , piece_id=5UNX4TPU63Q4AG726PSLVBFWX7ZZJL766ULEHEIIU3S4LG3EUGDA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.735255313 (26h13m15.518595412s) [noise=true , address=212.102.52.213:4331 , piece_id=LTU5YKIGVWFRQXGCECWGW656T6JMUDM7RRK6QD5CRGBB5IKMZXTQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.738998335 (26h13m15.522338434s) [noise=true , address=212.102.52.215:4380 , piece_id=6XJ45LCPGAIOCFHI35GODZRUNRS2Z63RF6WIKFUXV5R3GMSH7YJQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.739008105 (26h13m15.522348204s) [seg_pos={0 0}, upload=25083]: Satisfied cohort requirements after 16 pieces
May 26 04:17:29.739201553 (26h13m15.522541652s) [noise=true , address=212.102.52.217:4423 , piece_id=2KWQV3P3UYSFMBJ5BJNIHGVNZZXSCD3DEJXUV7SYVDALJSXIJAPA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TgGtX5XRdWH1qn6V5fZpQ8cY5oA2NyZx1AM17XANmr99AG9oh): protocol: expected piece hash; context canceled; EOF
May 26 04:17:29.739208446 (26h13m15.522548545s) [noise=true , address=212.102.52.217:4423 , piece_id=2KWQV3P3UYSFMBJ5BJNIHGVNZZXSCD3DEJXUV7SYVDALJSXIJAPA, seg_pos={0 0}, upload=25083]: Long tail cancellation due to optimal threshold
May 26 04:17:29.739277749 (26h13m15.522617858s) [noise=true , address=212.102.52.213:4343 , piece_id=AUT3LEUM7MPZIL33QGT47V7QOOZTHR3A2W2S6EMKJBY4B3AUA4ZA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129SbAN2aTSXzo8JLELV2ssdkmT5k7kbTcvxSZE4sFsVaKw1Aok): protocol: expected piece hash; context canceled; EOF
May 26 04:17:29.739288459 (26h13m15.522628598s) [noise=true , address=212.102.52.213:4343 , piece_id=AUT3LEUM7MPZIL33QGT47V7QOOZTHR3A2W2S6EMKJBY4B3AUA4ZA, seg_pos={0 0}, upload=25083]: Long tail cancellation due to optimal threshold
May 26 04:17:29.739324538 (26h13m15.522664637s) [noise=true , address=212.102.52.216:4408 , piece_id=23VTNWQ4FKNZ4O552CZQERQ5KMMHSCP4Y46PNSMWU4HGHSDFLIOA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BsdeZy1odVCAgcjxU6KdveXhUUTJKviRrrHLNCUuVergW6zVk): protocol: expected piece hash; context canceled; EOF
May 26 04:17:29.739330078 (26h13m15.522670177s) [noise=true , address=212.102.52.216:4408 , piece_id=23VTNWQ4FKNZ4O552CZQERQ5KMMHSCP4Y46PNSMWU4HGHSDFLIOA, seg_pos={0 0}, upload=25083]: Long tail cancellation due to optimal threshold
May 26 04:17:29.739420791 (26h13m15.52276089s) [noise=true , address=212.102.52.213:4333 , piece_id=O4MDU2BWFAOHKWNQ3KS24KNT6VYDQ4MGLBGCWW4WZZTPMVBT4OCQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Gm3eZxZPxPeHqLQ32kpXMpCgnwRoP8epBYtiFF1EH3U9LEazY): protocol: expected piece hash; context canceled; EOF
May 26 04:17:29.739426021 (26h13m15.52276612s) [noise=true , address=212.102.52.213:4333 , piece_id=O4MDU2BWFAOHKWNQ3KS24KNT6VYDQ4MGLBGCWW4WZZTPMVBT4OCQ, seg_pos={0 0}, upload=25083]: Long tail cancellation due to optimal threshold
May 26 04:17:29.739475536 (26h13m15.522815635s) [seg_pos={0 0}, upload=25083]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 04:17:29.739535340 (26h13m15.522875439s) [upload=25083]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 04:17:29.739552654 (26h13m15.522892753s) [upload=25083]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 04:17:39.024892360 (26h13m24.808232459s) [upload=25083]: Done uploading segments...
May 26 04:17:39.024959289 (26h13m24.808299388s) [upload=25083]: Upload finished. err: metaclient: context deadline exceeded
Duration: 3.976084288s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............X............................................] duration:
3.762938273s trace:
https://jaeger.dev.storj.io/trace/2f0b656030b9f519
FAIL (2026-05-26 04:58:43 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.762960645s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
7.249567095s trace:
https://jaeger.dev.storj.io/trace/20840979a8f7088f
FAIL (2026-05-26 04:58:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
25083]: Uploading piece...
May 26 04:17:28.318973560 (26h13m14.10231366s) [noise=true , address=212.102.52.217:4420 , piece_id=PQM3W3VAO5T2BBPQEREGSHGZ3EYBGJ7LFORGCKUY6NTUP2NNE5PA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.319026442 (26h13m14.102366541s) [noise=true , address=212.102.52.216:4397 , piece_id=5UNX4TPU63Q4AG726PSLVBFWX7ZZJL766ULEHEIIU3S4LG3EUGDA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.319245079 (26h13m14.102585178s) [noise=true , address=212.102.52.213:4343 , piece_id=AUT3LEUM7MPZIL33QGT47V7QOOZTHR3A2W2S6EMKJBY4B3AUA4ZA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.319586399 (26h13m14.102926499s) [noise=true , address=212.102.52.216:4402 , piece_id=VNTORDVWCQPSO5C2QUQUI76CBCTFB7TIQSEL7MWCCYRJ22T4WIBA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.319879910 (26h13m14.103220009s) [noise=true , address=212.102.52.217:4436 , piece_id=SWQCVL47FBVYZFZIQVYNAD4NYDQLBBJL3S2EYVNHGS2Y54RRAN6A, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.320133124 (26h13m14.103473223s) [noise=true , address=212.102.52.215:4379 , piece_id=FBM4P5FPAP6OCVSHW5QYJOJWRXCO63HY2I6K3EYZKL6BRIUMME5Q, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.320357862 (26h13m14.103697961s) [noise=true , address=212.102.52.214:4362 , piece_id=LB7JGSWGNGU7BQX4FZQLVA2IUDQJT7ZP5PFXOQV4NLYXH7JAFRHA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.320571960 (26h13m14.103912059s) [noise=true , address=212.102.52.216:4408 , piece_id=23VTNWQ4FKNZ4O552CZQERQ5KMMHSCP4Y46PNSMWU4HGHSDFLIOA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.320588152 (26h13m14.103928251s) [noise=true , address=212.102.52.213:4344 , piece_id=UEGMZ7I63LXBAKRWSFQDHBZBXPCHG2NMZSGW4PFVHFQORZLRMQYA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.321070803 (26h13m14.104410912s) [noise=true , address=212.102.52.217:4433 , piece_id=FGN6M3NBSA3ZOLHYPT3THZV4THHNFYSI2R6BDB4AWSQZRCZ2M7TQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.321436691 (26h13m14.10477679s) [noise=true , address=212.102.52.215:4380 , piece_id=6XJ45LCPGAIOCFHI35GODZRUNRS2Z63RF6WIKFUXV5R3GMSH7YJQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.321852404 (26h13m14.105192503s) [noise=true , address=212.102.52.213:4333 , piece_id=O4MDU2BWFAOHKWNQ3KS24KNT6VYDQ4MGLBGCWW4WZZTPMVBT4OCQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.322253419 (26h13m14.105593518s) [noise=true , address=212.102.52.214:4347 , piece_id=VPYOK5SVHEPZ36OOB7PYDAAINGIOUACK4FVDZBMJLWKMWC2D4NXQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.322652791 (26h13m14.1059929s) [noise=true , address=212.102.52.213:4331 , piece_id=LTU5YKIGVWFRQXGCECWGW656T6JMUDM7RRK6QD5CRGBB5IKMZXTQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.324215282 (26h13m14.107555381s) [noise=true , address=212.102.52.214:4349 , piece_id=HH47IVRCTHTDW4RHMJTEXGNB4ZK62NU6LDP5AS4FVXWPFINGHFNQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:29.390980339 (26h13m15.174320438s) [upload=25083]: Next returned nil segment
May 26 04:17:29.390993564 (26h13m15.174333663s) [upload=25083]: Waiting for error group managing segments...
May 26 04:17:29.673854379 (26h13m15.457194479s) [noise=true , address=212.102.52.215:4381 , piece_id=5UZ45SYYXIOMUYBHLRRP6NECZCQ5JW2RIK5MQIV2LMYQBVOON4ZA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.674402245 (26h13m15.457742344s) [noise=true , address=212.102.52.217:4433 , piece_id=FGN6M3NBSA3ZOLHYPT3THZV4THHNFYSI2R6BDB4AWSQZRCZ2M7TQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.677827470 (26h13m15.461167569s) [noise=true , address=212.102.52.213:4344 , piece_id=UEGMZ7I63LXBAKRWSFQDHBZBXPCHG2NMZSGW4PFVHFQORZLRMQYA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.678368041 (26h13m15.46170814s) [noise=true , address=212.102.52.215:4379 , piece_id=FBM4P5FPAP6OCVSHW5QYJOJWRXCO63HY2I6K3EYZKL6BRIUMME5Q, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.680215035 (26h13m15.463555134s) [noise=true , address=212.102.52.216:4402 , piece_id=VNTORDVWCQPSO5C2QUQUI76CBCTFB7TIQSEL7MWCCYRJ22T4WIBA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.682230351 (26h13m15.46557045s) [noise=true , address=212.102.52.217:4420 , piece_id=PQM3W3VAO5T2BBPQEREGSHGZ3EYBGJ7LFORGCKUY6NTUP2NNE5PA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.685255182 (26h13m15.468595281s) [noise=true , address=212.102.52.216:4405 , piece_id=65IGD4H7EMWEDYW2TFH643JJ5QW2BKHVFZA6D77MCHRYA6T6ESGQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.686472445 (26h13m15.469812544s) [noise=true , address=212.102.52.214:4362 , piece_id=LB7JGSWGNGU7BQX4FZQLVA2IUDQJT7ZP5PFXOQV4NLYXH7JAFRHA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.689410080 (26h13m15.472750179s) [noise=true , address=212.102.52.217:4436 , piece_id=SWQCVL47FBVYZFZIQVYNAD4NYDQLBBJL3S2EYVNHGS2Y54RRAN6A, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.689953157 (26h13m15.473293256s) [noise=true , address=212.102.52.214:4355 , piece_id=RKSUNVZS66X4A7ZY7WEUQXSWOTK2H5VAR7TBDICVC7MGVHA7LTGA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.694371046 (26h13m15.477711155s) [noise=true , address=212.102.52.214:4347 , piece_id=VPYOK5SVHEPZ36OOB7PYDAAINGIOUACK4FVDZBMJLWKMWC2D4NXQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.698718109 (26h13m15.482058208s) [noise=true , address=212.102.52.214:4349 , piece_id=HH47IVRCTHTDW4RHMJTEXGNB4ZK62NU6LDP5AS4FVXWPFINGHFNQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.699290191 (26h13m15.48263029s) [noise=true , address=212.102.52.215:4389 , piece_id=2OTWYJIV6A2646HAW5TWBTSQVT25V2PBKVANLGGK5SWNVHE3WGWA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.701256312 (26h13m15.484596411s) [noise=true , address=212.102.52.216:4397 , piece_id=5UNX4TPU63Q4AG726PSLVBFWX7ZZJL766ULEHEIIU3S4LG3EUGDA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.735255313 (26h13m15.518595412s) [noise=true , address=212.102.52.213:4331 , piece_id=LTU5YKIGVWFRQXGCECWGW656T6JMUDM7RRK6QD5CRGBB5IKMZXTQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.738998335 (26h13m15.522338434s) [noise=true , address=212.102.52.215:4380 , piece_id=6XJ45LCPGAIOCFHI35GODZRUNRS2Z63RF6WIKFUXV5R3GMSH7YJQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.739008105 (26h13m15.522348204s) [seg_pos={0 0}, upload=25083]: Satisfied cohort requirements after 16 pieces
May 26 04:17:29.739201553 (26h13m15.522541652s) [noise=true , address=212.102.52.217:4423 , piece_id=2KWQV3P3UYSFMBJ5BJNIHGVNZZXSCD3DEJXUV7SYVDALJSXIJAPA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TgGtX5XRdWH1qn6V5fZpQ8cY5oA2NyZx1AM17XANmr99AG9oh): protocol: expected piece hash; context canceled; EOF
May 26 04:17:29.739208446 (26h13m15.522548545s) [noise=true , address=212.102.52.217:4423 , piece_id=2KWQV3P3UYSFMBJ5BJNIHGVNZZXSCD3DEJXUV7SYVDALJSXIJAPA, seg_pos={0 0}, upload=25083]: Long tail cancellation due to optimal threshold
May 26 04:17:29.739277749 (26h13m15.522617858s) [noise=true , address=212.102.52.213:4343 , piece_id=AUT3LEUM7MPZIL33QGT47V7QOOZTHR3A2W2S6EMKJBY4B3AUA4ZA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129SbAN2aTSXzo8JLELV2ssdkmT5k7kbTcvxSZE4sFsVaKw1Aok): protocol: expected piece hash; context canceled; EOF
May 26 04:17:29.739288459 (26h13m15.522628598s) [noise=true , address=212.102.52.213:4343 , piece_id=AUT3LEUM7MPZIL33QGT47V7QOOZTHR3A2W2S6EMKJBY4B3AUA4ZA, seg_pos={0 0}, upload=25083]: Long tail cancellation due to optimal threshold
May 26 04:17:29.739324538 (26h13m15.522664637s) [noise=true , address=212.102.52.216:4408 , piece_id=23VTNWQ4FKNZ4O552CZQERQ5KMMHSCP4Y46PNSMWU4HGHSDFLIOA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BsdeZy1odVCAgcjxU6KdveXhUUTJKviRrrHLNCUuVergW6zVk): protocol: expected piece hash; context canceled; EOF
May 26 04:17:29.739330078 (26h13m15.522670177s) [noise=true , address=212.102.52.216:4408 , piece_id=23VTNWQ4FKNZ4O552CZQERQ5KMMHSCP4Y46PNSMWU4HGHSDFLIOA, seg_pos={0 0}, upload=25083]: Long tail cancellation due to optimal threshold
May 26 04:17:29.739420791 (26h13m15.52276089s) [noise=true , address=212.102.52.213:4333 , piece_id=O4MDU2BWFAOHKWNQ3KS24KNT6VYDQ4MGLBGCWW4WZZTPMVBT4OCQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Gm3eZxZPxPeHqLQ32kpXMpCgnwRoP8epBYtiFF1EH3U9LEazY): protocol: expected piece hash; context canceled; EOF
May 26 04:17:29.739426021 (26h13m15.52276612s) [noise=true , address=212.102.52.213:4333 , piece_id=O4MDU2BWFAOHKWNQ3KS24KNT6VYDQ4MGLBGCWW4WZZTPMVBT4OCQ, seg_pos={0 0}, upload=25083]: Long tail cancellation due to optimal threshold
May 26 04:17:29.739475536 (26h13m15.522815635s) [seg_pos={0 0}, upload=25083]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 04:17:29.739535340 (26h13m15.522875439s) [upload=25083]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 04:17:29.739552654 (26h13m15.522892753s) [upload=25083]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 04:17:39.024892360 (26h13m24.808232459s) [upload=25083]: Done uploading segments...
May 26 04:17:39.024959289 (26h13m24.808299388s) [upload=25083]: Upload finished. err: metaclient: context deadline exceeded
Duration: 7.249589908s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................X...........................................] duration:
3.879900268s trace:
https://jaeger.dev.storj.io/trace/2f0b656030b9f519
FAIL (2026-05-26 04:58:13 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.879923772s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
4.07430885s trace:
https://jaeger.dev.storj.io/trace/20840979a8f7088f
FAIL (2026-05-26 04:57:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
25083]: Uploading piece...
May 26 04:17:28.318973560 (26h13m14.10231366s) [noise=true , address=212.102.52.217:4420 , piece_id=PQM3W3VAO5T2BBPQEREGSHGZ3EYBGJ7LFORGCKUY6NTUP2NNE5PA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.319026442 (26h13m14.102366541s) [noise=true , address=212.102.52.216:4397 , piece_id=5UNX4TPU63Q4AG726PSLVBFWX7ZZJL766ULEHEIIU3S4LG3EUGDA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.319245079 (26h13m14.102585178s) [noise=true , address=212.102.52.213:4343 , piece_id=AUT3LEUM7MPZIL33QGT47V7QOOZTHR3A2W2S6EMKJBY4B3AUA4ZA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.319586399 (26h13m14.102926499s) [noise=true , address=212.102.52.216:4402 , piece_id=VNTORDVWCQPSO5C2QUQUI76CBCTFB7TIQSEL7MWCCYRJ22T4WIBA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.319879910 (26h13m14.103220009s) [noise=true , address=212.102.52.217:4436 , piece_id=SWQCVL47FBVYZFZIQVYNAD4NYDQLBBJL3S2EYVNHGS2Y54RRAN6A, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.320133124 (26h13m14.103473223s) [noise=true , address=212.102.52.215:4379 , piece_id=FBM4P5FPAP6OCVSHW5QYJOJWRXCO63HY2I6K3EYZKL6BRIUMME5Q, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.320357862 (26h13m14.103697961s) [noise=true , address=212.102.52.214:4362 , piece_id=LB7JGSWGNGU7BQX4FZQLVA2IUDQJT7ZP5PFXOQV4NLYXH7JAFRHA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.320571960 (26h13m14.103912059s) [noise=true , address=212.102.52.216:4408 , piece_id=23VTNWQ4FKNZ4O552CZQERQ5KMMHSCP4Y46PNSMWU4HGHSDFLIOA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.320588152 (26h13m14.103928251s) [noise=true , address=212.102.52.213:4344 , piece_id=UEGMZ7I63LXBAKRWSFQDHBZBXPCHG2NMZSGW4PFVHFQORZLRMQYA, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.321070803 (26h13m14.104410912s) [noise=true , address=212.102.52.217:4433 , piece_id=FGN6M3NBSA3ZOLHYPT3THZV4THHNFYSI2R6BDB4AWSQZRCZ2M7TQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.321436691 (26h13m14.10477679s) [noise=true , address=212.102.52.215:4380 , piece_id=6XJ45LCPGAIOCFHI35GODZRUNRS2Z63RF6WIKFUXV5R3GMSH7YJQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.321852404 (26h13m14.105192503s) [noise=true , address=212.102.52.213:4333 , piece_id=O4MDU2BWFAOHKWNQ3KS24KNT6VYDQ4MGLBGCWW4WZZTPMVBT4OCQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.322253419 (26h13m14.105593518s) [noise=true , address=212.102.52.214:4347 , piece_id=VPYOK5SVHEPZ36OOB7PYDAAINGIOUACK4FVDZBMJLWKMWC2D4NXQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.322652791 (26h13m14.1059929s) [noise=true , address=212.102.52.213:4331 , piece_id=LTU5YKIGVWFRQXGCECWGW656T6JMUDM7RRK6QD5CRGBB5IKMZXTQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:28.324215282 (26h13m14.107555381s) [noise=true , address=212.102.52.214:4349 , piece_id=HH47IVRCTHTDW4RHMJTEXGNB4ZK62NU6LDP5AS4FVXWPFINGHFNQ, seg_pos={0 0}, upload=25083]: Uploading piece...
May 26 04:17:29.390980339 (26h13m15.174320438s) [upload=25083]: Next returned nil segment
May 26 04:17:29.390993564 (26h13m15.174333663s) [upload=25083]: Waiting for error group managing segments...
May 26 04:17:29.673854379 (26h13m15.457194479s) [noise=true , address=212.102.52.215:4381 , piece_id=5UZ45SYYXIOMUYBHLRRP6NECZCQ5JW2RIK5MQIV2LMYQBVOON4ZA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.674402245 (26h13m15.457742344s) [noise=true , address=212.102.52.217:4433 , piece_id=FGN6M3NBSA3ZOLHYPT3THZV4THHNFYSI2R6BDB4AWSQZRCZ2M7TQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.677827470 (26h13m15.461167569s) [noise=true , address=212.102.52.213:4344 , piece_id=UEGMZ7I63LXBAKRWSFQDHBZBXPCHG2NMZSGW4PFVHFQORZLRMQYA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.678368041 (26h13m15.46170814s) [noise=true , address=212.102.52.215:4379 , piece_id=FBM4P5FPAP6OCVSHW5QYJOJWRXCO63HY2I6K3EYZKL6BRIUMME5Q, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.680215035 (26h13m15.463555134s) [noise=true , address=212.102.52.216:4402 , piece_id=VNTORDVWCQPSO5C2QUQUI76CBCTFB7TIQSEL7MWCCYRJ22T4WIBA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.682230351 (26h13m15.46557045s) [noise=true , address=212.102.52.217:4420 , piece_id=PQM3W3VAO5T2BBPQEREGSHGZ3EYBGJ7LFORGCKUY6NTUP2NNE5PA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.685255182 (26h13m15.468595281s) [noise=true , address=212.102.52.216:4405 , piece_id=65IGD4H7EMWEDYW2TFH643JJ5QW2BKHVFZA6D77MCHRYA6T6ESGQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.686472445 (26h13m15.469812544s) [noise=true , address=212.102.52.214:4362 , piece_id=LB7JGSWGNGU7BQX4FZQLVA2IUDQJT7ZP5PFXOQV4NLYXH7JAFRHA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.689410080 (26h13m15.472750179s) [noise=true , address=212.102.52.217:4436 , piece_id=SWQCVL47FBVYZFZIQVYNAD4NYDQLBBJL3S2EYVNHGS2Y54RRAN6A, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.689953157 (26h13m15.473293256s) [noise=true , address=212.102.52.214:4355 , piece_id=RKSUNVZS66X4A7ZY7WEUQXSWOTK2H5VAR7TBDICVC7MGVHA7LTGA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.694371046 (26h13m15.477711155s) [noise=true , address=212.102.52.214:4347 , piece_id=VPYOK5SVHEPZ36OOB7PYDAAINGIOUACK4FVDZBMJLWKMWC2D4NXQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.698718109 (26h13m15.482058208s) [noise=true , address=212.102.52.214:4349 , piece_id=HH47IVRCTHTDW4RHMJTEXGNB4ZK62NU6LDP5AS4FVXWPFINGHFNQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.699290191 (26h13m15.48263029s) [noise=true , address=212.102.52.215:4389 , piece_id=2OTWYJIV6A2646HAW5TWBTSQVT25V2PBKVANLGGK5SWNVHE3WGWA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.701256312 (26h13m15.484596411s) [noise=true , address=212.102.52.216:4397 , piece_id=5UNX4TPU63Q4AG726PSLVBFWX7ZZJL766ULEHEIIU3S4LG3EUGDA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.735255313 (26h13m15.518595412s) [noise=true , address=212.102.52.213:4331 , piece_id=LTU5YKIGVWFRQXGCECWGW656T6JMUDM7RRK6QD5CRGBB5IKMZXTQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.738998335 (26h13m15.522338434s) [noise=true , address=212.102.52.215:4380 , piece_id=6XJ45LCPGAIOCFHI35GODZRUNRS2Z63RF6WIKFUXV5R3GMSH7YJQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: <nil>
May 26 04:17:29.739008105 (26h13m15.522348204s) [seg_pos={0 0}, upload=25083]: Satisfied cohort requirements after 16 pieces
May 26 04:17:29.739201553 (26h13m15.522541652s) [noise=true , address=212.102.52.217:4423 , piece_id=2KWQV3P3UYSFMBJ5BJNIHGVNZZXSCD3DEJXUV7SYVDALJSXIJAPA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TgGtX5XRdWH1qn6V5fZpQ8cY5oA2NyZx1AM17XANmr99AG9oh): protocol: expected piece hash; context canceled; EOF
May 26 04:17:29.739208446 (26h13m15.522548545s) [noise=true , address=212.102.52.217:4423 , piece_id=2KWQV3P3UYSFMBJ5BJNIHGVNZZXSCD3DEJXUV7SYVDALJSXIJAPA, seg_pos={0 0}, upload=25083]: Long tail cancellation due to optimal threshold
May 26 04:17:29.739277749 (26h13m15.522617858s) [noise=true , address=212.102.52.213:4343 , piece_id=AUT3LEUM7MPZIL33QGT47V7QOOZTHR3A2W2S6EMKJBY4B3AUA4ZA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129SbAN2aTSXzo8JLELV2ssdkmT5k7kbTcvxSZE4sFsVaKw1Aok): protocol: expected piece hash; context canceled; EOF
May 26 04:17:29.739288459 (26h13m15.522628598s) [noise=true , address=212.102.52.213:4343 , piece_id=AUT3LEUM7MPZIL33QGT47V7QOOZTHR3A2W2S6EMKJBY4B3AUA4ZA, seg_pos={0 0}, upload=25083]: Long tail cancellation due to optimal threshold
May 26 04:17:29.739324538 (26h13m15.522664637s) [noise=true , address=212.102.52.216:4408 , piece_id=23VTNWQ4FKNZ4O552CZQERQ5KMMHSCP4Y46PNSMWU4HGHSDFLIOA, seg_pos={0 0}, upload=25083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BsdeZy1odVCAgcjxU6KdveXhUUTJKviRrrHLNCUuVergW6zVk): protocol: expected piece hash; context canceled; EOF
May 26 04:17:29.739330078 (26h13m15.522670177s) [noise=true , address=212.102.52.216:4408 , piece_id=23VTNWQ4FKNZ4O552CZQERQ5KMMHSCP4Y46PNSMWU4HGHSDFLIOA, seg_pos={0 0}, upload=25083]: Long tail cancellation due to optimal threshold
May 26 04:17:29.739420791 (26h13m15.52276089s) [noise=true , address=212.102.52.213:4333 , piece_id=O4MDU2BWFAOHKWNQ3KS24KNT6VYDQ4MGLBGCWW4WZZTPMVBT4OCQ, seg_pos={0 0}, upload=25083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Gm3eZxZPxPeHqLQ32kpXMpCgnwRoP8epBYtiFF1EH3U9LEazY): protocol: expected piece hash; context canceled; EOF
May 26 04:17:29.739426021 (26h13m15.52276612s) [noise=true , address=212.102.52.213:4333 , piece_id=O4MDU2BWFAOHKWNQ3KS24KNT6VYDQ4MGLBGCWW4WZZTPMVBT4OCQ, seg_pos={0 0}, upload=25083]: Long tail cancellation due to optimal threshold
May 26 04:17:29.739475536 (26h13m15.522815635s) [seg_pos={0 0}, upload=25083]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 04:17:29.739535340 (26h13m15.522875439s) [upload=25083]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 04:17:29.739552654 (26h13m15.522892753s) [upload=25083]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 04:17:39.024892360 (26h13m24.808232459s) [upload=25083]: Done uploading segments...
May 26 04:17:39.024959289 (26h13m24.808299388s) [upload=25083]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.074328567s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................X..........................................] duration:
3.827747538s trace:
https://jaeger.dev.storj.io/trace/2f0b656030b9f519
FAIL (2026-05-26 04:57:12 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.827768669s
core
uplink
us-select-1
us1-placement-20
|