Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 849358 reports (Page 11904 of 16988)
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.................X..........................................]
duration:
3.335688596s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:45:53 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.335715898s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [..................X.........................................]
duration:
3.710629681s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:44:40 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.710651373s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [...................X........................................]
duration:
4.279018909s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:43:42 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.279047846s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [....................X.......................................]
duration:
5.032187281s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:42:34 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.032233789s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.....................X......................................]
duration:
3.750671611s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:41:36 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.750733089s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [......................X.....................................]
duration:
3.798515543s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:41:07 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.798539358s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.......................X....................................]
duration:
3.677136136s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:40:21 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.67720159s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [........................X...................................]
duration:
3.61825891s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:39:24 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.618289179s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.........................X..................................]
duration:
3.820364957s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:39:03 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.820395146s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [..........................X.................................]
duration:
3.755327366s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:38:48 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.755357893s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [...........................X................................]
duration:
3.727648791s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:38:21 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.727676323s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [............................X...............................]
duration:
3.739418089s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:37:53 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.739448487s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.............................X..............................]
duration:
3.535969147s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:37:02 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.536248347s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [..............................X.............................]
duration:
3.728800533s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:36:27 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.728896175s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [...............................X............................]
duration:
3.557756991s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:35:58 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.55779273s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [................................X...........................]
duration:
3.686482159s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:35:18 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.686523638s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.................................X..........................]
duration:
3.411801208s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:34:32 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.411831686s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [..................................X.........................]
duration:
3.560818654s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:33:45 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.560835787s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [...................................X........................]
duration:
3.695734971s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:33:28 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.695761832s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [....................................X.......................]
duration:
4.571456072s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:33:07 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.571495378s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.....................................X......................]
duration:
3.485822388s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:31:58 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.485853948s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [......................................X.....................]
duration:
3.58014302s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:31:15 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.58017415s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.......................................X....................]
duration:
3.385064871s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:30:50 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.38516877s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [........................................X...................]
duration:
3.494595239s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:30:28 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.494631658s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.........................................X..................]
duration:
3.51195137s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:29:21 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.51197814s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [..........................................X.................]
duration:
3.470928984s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:29:02 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.470955985s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [...........................................X................]
duration:
3.592543933s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:28:17 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.592610889s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [............................................X...............]
duration:
3.7002942s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:27:14 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.700318938s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.............................................X..............]
duration:
3.657612316s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:26:46 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.657640468s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [..............................................X.............]
duration:
3.456094555s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:25:48 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.456187132s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [...............................................X............]
duration:
3.444274018s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:24:46 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.444304635s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [................................................X...........]
duration:
3.777184094s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:24:17 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.777211104s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.................................................X..........]
duration:
3.416597866s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:23:26 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.416624008s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [..................................................X.........]
duration:
4.82607122s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:22:25 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.826367325s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [...................................................X........]
duration:
3.528075705s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:21:53 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.528129728s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [....................................................X.......]
duration:
3.560044365s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:20:39 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.560097185s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.....................................................X......]
duration:
3.489025924s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:20:12 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.489058236s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [......................................................X.....]
duration:
3.476537573s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:19:36 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.476568352s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.......................................................X....]
duration:
3.373122316s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:19:11 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.373165628s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [........................................................X...]
duration:
3.494714856s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:18:23 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.494745814s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.........................................................X..]
duration:
3.468300538s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:17:43 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.468326377s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [..........................................................X.]
duration:
3.471960777s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:17:17 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.471985825s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [...........................................................X]
duration:
5.001955425s
trace:
https://jaeger.dev.storj.io/trace/412d3bdb8ce8fccd
FAIL (2025-11-19 12:16:04 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001978711s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
3.909682701s
trace:
https://jaeger.dev.storj.io/trace/1826fc12eb97ad6d
FAIL (2025-11-19 12:11:20 UTC)
orbiter warning: operation: sync2.Copy
uplink: piecestore: (Node ID: 12VpHQ9agBBm65AWhdMWSPDNzqJyiHsPYfQV1KDL1eMv1hk8cwN, Piece ID: JEJRXJ4ODOL3JXRRX3KNXHLNSEFJJWKBMMAB5TP2HSKEYOWRYZLQ) context deadline exceeded; piecestore: (Node ID: 128bohZvc8pUuRBLDosNFjtmirJeXZnAeFmLS8Uf67xAcv1i6dQ, Piece ID: UWWNJVCFWPTZRE4RRJEOVALYKEW3EXACJJULMVUDSTJ7OCCPGURA) context deadline exceeded; piecestore: (Node ID: 12gGjjeKkFD1uMfqccQCTJnQoUZ8CztSvFYottRkghGrbAhwxqj, Piece ID: XQSUQFZSCKJV45MBXZGZ52KO3QR3HNFR3W6X3A7G7NWGCXQ62VPQ) context deadline exceeded; piecestore: (Node ID: 1qMvhA9gakN3pyukerUWue2TfBeLiBTEDDWULCxdN5LcBFaSdn, Piece ID: F4Z74T5CUL5L37SGJLZJ354FNCRY22YN3LHWXMR3CSD3B6QG7Y2A) context deadline exceeded; piecestore: (Node ID: 12dn15Yr9N1nA1STdMKmX2dVLNKeTHshDaqAWzGF8gb59u1K9Ve, Piece ID: B6X3KT4VKEKUPFDT3EMKNCF5ZFWYBSPADUYTWZ2SM7TZJJZYNBZA) context deadline exceeded; piecestore: (Node ID: 1WPr7TRD3As3kHeYcsgzJuyzkNN7ktxumophSqbfPveHnyq9y8, Piece ID: MKA4DODJT6BB2VEPFMQGM4VYXPI7ZWOVTVL2Q5VBO3OSLFHIAI2A) context deadline exceeded; piecestore: (Node ID: 12NzWsxJe1qKVubZPwzkF6XorMp35Ri4nra1hUMkdeG4p3z7h4s, Piece ID: FUVVLL3R3BJRBEFLC5TXFZN3MDJG3GO5MWCXG4Q4ZFELN6OW3CFQ) context deadline exceeded; piecestore: (Node ID: 1gVnpQu7bWogHfd8KrAmytkaNHeUHykcBWuSpk5TbMy86moqju, Piece ID: WM3XVPJWEGP674YDPL3MEA36TBS6KG4HZZBC2QLZ3FFVK36JFXZQ) context deadline exceeded; piecestore: (Node ID: 12oBKFEUdCh7UkuZsesS4e43L18ocZTv9FeZwr1vznuEWPDETQP, Piece ID: 344IJDH33LDZ5AQWY4Y5BB5SDH5ALHPYWZSQY27NVCC4ZWUDKVTQ) context deadline exceeded; piecestore: (Node ID: 1tyoTVSF9udrfYpVx9fVmCgxN2T3qijzUVchzqXqbuq6rthBhs, Piece ID: HEPZDMAUXP7LWBCOTIKIU34UFWEIBCP4A7IEYDP7YKY4JJC3B3YA) context deadline exceeded; piecestore: (Node ID: 1ga5fKb8hWQFKK1MYdt8miZf8cfNPdk1kKUBCrrhuGPXPVpbDH, Piece ID: AAH7CGMFK3UXN6SSTDKIXZV6KLG3DTXQF72CN6RW6RAW4LXFNUMQ) context deadline exceeded; piecestore: (Node ID: 14zjhX7pamGsetyiEXPUmvjCFAxVVJeirWhbnABUySTHUCimGg, Piece ID: 3OP2J62KYOJISM64TF4GRRWNGFQPMR3VWNWUMJBW7QJKYPLLXSRQ) context deadline exceeded; piecestore: (Node ID: 12bcXTBAWidFQdAcAmTmPsHFrNb3KaicnKQoqtcnSyYPs8MfMR8, Piece ID: X2EKLRU6NCXKJWRCO6KBKGMAJWKAOYTWP6Y2HCANSD46WRNHBELQ) context deadline exceeded; piecestore: (Node ID: 12HtAGLF74ponLBttyfAin8MZV7oFBYvVCT1Jd5yKJG99anSVVC, Piece ID: GKFDL3UDEC2ML2DVSDCZVS3KQAEZ55AA7XGTVGO4PZ5XECCWPMZQ) context deadline exceeded; piecestore: (Node ID: 1Lbp5Ch18UPFNLALhockFsFSB7YPtbTmasHjFWcVXRVkPyp2q9, Piece ID: FTNIZAAK2HA6KOXWATPMEY6RI6CPKW4EUAQ4W2DA3AWSDE6K2LFA) context deadline exceeded
Duration: 3.909735793s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
3.790846298s
trace:
https://jaeger.dev.storj.io/trace/1826fc12eb97ad6d
FAIL (2025-11-19 12:10:18 UTC)
orbiter warning: operation: sync2.Copy
uplink: piecestore: (Node ID: 12VpHQ9agBBm65AWhdMWSPDNzqJyiHsPYfQV1KDL1eMv1hk8cwN, Piece ID: JEJRXJ4ODOL3JXRRX3KNXHLNSEFJJWKBMMAB5TP2HSKEYOWRYZLQ) context deadline exceeded; piecestore: (Node ID: 128bohZvc8pUuRBLDosNFjtmirJeXZnAeFmLS8Uf67xAcv1i6dQ, Piece ID: UWWNJVCFWPTZRE4RRJEOVALYKEW3EXACJJULMVUDSTJ7OCCPGURA) context deadline exceeded; piecestore: (Node ID: 12gGjjeKkFD1uMfqccQCTJnQoUZ8CztSvFYottRkghGrbAhwxqj, Piece ID: XQSUQFZSCKJV45MBXZGZ52KO3QR3HNFR3W6X3A7G7NWGCXQ62VPQ) context deadline exceeded; piecestore: (Node ID: 1qMvhA9gakN3pyukerUWue2TfBeLiBTEDDWULCxdN5LcBFaSdn, Piece ID: F4Z74T5CUL5L37SGJLZJ354FNCRY22YN3LHWXMR3CSD3B6QG7Y2A) context deadline exceeded; piecestore: (Node ID: 12dn15Yr9N1nA1STdMKmX2dVLNKeTHshDaqAWzGF8gb59u1K9Ve, Piece ID: B6X3KT4VKEKUPFDT3EMKNCF5ZFWYBSPADUYTWZ2SM7TZJJZYNBZA) context deadline exceeded; piecestore: (Node ID: 1WPr7TRD3As3kHeYcsgzJuyzkNN7ktxumophSqbfPveHnyq9y8, Piece ID: MKA4DODJT6BB2VEPFMQGM4VYXPI7ZWOVTVL2Q5VBO3OSLFHIAI2A) context deadline exceeded; piecestore: (Node ID: 12NzWsxJe1qKVubZPwzkF6XorMp35Ri4nra1hUMkdeG4p3z7h4s, Piece ID: FUVVLL3R3BJRBEFLC5TXFZN3MDJG3GO5MWCXG4Q4ZFELN6OW3CFQ) context deadline exceeded; piecestore: (Node ID: 1gVnpQu7bWogHfd8KrAmytkaNHeUHykcBWuSpk5TbMy86moqju, Piece ID: WM3XVPJWEGP674YDPL3MEA36TBS6KG4HZZBC2QLZ3FFVK36JFXZQ) context deadline exceeded; piecestore: (Node ID: 12oBKFEUdCh7UkuZsesS4e43L18ocZTv9FeZwr1vznuEWPDETQP, Piece ID: 344IJDH33LDZ5AQWY4Y5BB5SDH5ALHPYWZSQY27NVCC4ZWUDKVTQ) context deadline exceeded; piecestore: (Node ID: 1tyoTVSF9udrfYpVx9fVmCgxN2T3qijzUVchzqXqbuq6rthBhs, Piece ID: HEPZDMAUXP7LWBCOTIKIU34UFWEIBCP4A7IEYDP7YKY4JJC3B3YA) context deadline exceeded; piecestore: (Node ID: 1ga5fKb8hWQFKK1MYdt8miZf8cfNPdk1kKUBCrrhuGPXPVpbDH, Piece ID: AAH7CGMFK3UXN6SSTDKIXZV6KLG3DTXQF72CN6RW6RAW4LXFNUMQ) context deadline exceeded; piecestore: (Node ID: 14zjhX7pamGsetyiEXPUmvjCFAxVVJeirWhbnABUySTHUCimGg, Piece ID: 3OP2J62KYOJISM64TF4GRRWNGFQPMR3VWNWUMJBW7QJKYPLLXSRQ) context deadline exceeded; piecestore: (Node ID: 12bcXTBAWidFQdAcAmTmPsHFrNb3KaicnKQoqtcnSyYPs8MfMR8, Piece ID: X2EKLRU6NCXKJWRCO6KBKGMAJWKAOYTWP6Y2HCANSD46WRNHBELQ) context deadline exceeded; piecestore: (Node ID: 12HtAGLF74ponLBttyfAin8MZV7oFBYvVCT1Jd5yKJG99anSVVC, Piece ID: GKFDL3UDEC2ML2DVSDCZVS3KQAEZ55AA7XGTVGO4PZ5XECCWPMZQ) context deadline exceeded; piecestore: (Node ID: 1Lbp5Ch18UPFNLALhockFsFSB7YPtbTmasHjFWcVXRVkPyp2q9, Piece ID: FTNIZAAK2HA6KOXWATPMEY6RI6CPKW4EUAQ4W2DA3AWSDE6K2LFA) context deadline exceeded
Duration: 3.790874611s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
6.314431051s
trace:
https://jaeger.dev.storj.io/trace/4a8bdfd70deab53a
FAIL (2025-11-19 12:09:59 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 6.314463722s core uplink us1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration:
3.694762377s
trace:
https://jaeger.dev.storj.io/trace/1826fc12eb97ad6d
FAIL (2025-11-19 12:09:14 UTC)
orbiter warning: operation: sync2.Copy
uplink: piecestore: (Node ID: 12VpHQ9agBBm65AWhdMWSPDNzqJyiHsPYfQV1KDL1eMv1hk8cwN, Piece ID: JEJRXJ4ODOL3JXRRX3KNXHLNSEFJJWKBMMAB5TP2HSKEYOWRYZLQ) context deadline exceeded; piecestore: (Node ID: 128bohZvc8pUuRBLDosNFjtmirJeXZnAeFmLS8Uf67xAcv1i6dQ, Piece ID: UWWNJVCFWPTZRE4RRJEOVALYKEW3EXACJJULMVUDSTJ7OCCPGURA) context deadline exceeded; piecestore: (Node ID: 12gGjjeKkFD1uMfqccQCTJnQoUZ8CztSvFYottRkghGrbAhwxqj, Piece ID: XQSUQFZSCKJV45MBXZGZ52KO3QR3HNFR3W6X3A7G7NWGCXQ62VPQ) context deadline exceeded; piecestore: (Node ID: 1qMvhA9gakN3pyukerUWue2TfBeLiBTEDDWULCxdN5LcBFaSdn, Piece ID: F4Z74T5CUL5L37SGJLZJ354FNCRY22YN3LHWXMR3CSD3B6QG7Y2A) context deadline exceeded; piecestore: (Node ID: 12dn15Yr9N1nA1STdMKmX2dVLNKeTHshDaqAWzGF8gb59u1K9Ve, Piece ID: B6X3KT4VKEKUPFDT3EMKNCF5ZFWYBSPADUYTWZ2SM7TZJJZYNBZA) context deadline exceeded; piecestore: (Node ID: 1WPr7TRD3As3kHeYcsgzJuyzkNN7ktxumophSqbfPveHnyq9y8, Piece ID: MKA4DODJT6BB2VEPFMQGM4VYXPI7ZWOVTVL2Q5VBO3OSLFHIAI2A) context deadline exceeded; piecestore: (Node ID: 12NzWsxJe1qKVubZPwzkF6XorMp35Ri4nra1hUMkdeG4p3z7h4s, Piece ID: FUVVLL3R3BJRBEFLC5TXFZN3MDJG3GO5MWCXG4Q4ZFELN6OW3CFQ) context deadline exceeded; piecestore: (Node ID: 1gVnpQu7bWogHfd8KrAmytkaNHeUHykcBWuSpk5TbMy86moqju, Piece ID: WM3XVPJWEGP674YDPL3MEA36TBS6KG4HZZBC2QLZ3FFVK36JFXZQ) context deadline exceeded; piecestore: (Node ID: 12oBKFEUdCh7UkuZsesS4e43L18ocZTv9FeZwr1vznuEWPDETQP, Piece ID: 344IJDH33LDZ5AQWY4Y5BB5SDH5ALHPYWZSQY27NVCC4ZWUDKVTQ) context deadline exceeded; piecestore: (Node ID: 1tyoTVSF9udrfYpVx9fVmCgxN2T3qijzUVchzqXqbuq6rthBhs, Piece ID: HEPZDMAUXP7LWBCOTIKIU34UFWEIBCP4A7IEYDP7YKY4JJC3B3YA) context deadline exceeded; piecestore: (Node ID: 1ga5fKb8hWQFKK1MYdt8miZf8cfNPdk1kKUBCrrhuGPXPVpbDH, Piece ID: AAH7CGMFK3UXN6SSTDKIXZV6KLG3DTXQF72CN6RW6RAW4LXFNUMQ) context deadline exceeded; piecestore: (Node ID: 14zjhX7pamGsetyiEXPUmvjCFAxVVJeirWhbnABUySTHUCimGg, Piece ID: 3OP2J62KYOJISM64TF4GRRWNGFQPMR3VWNWUMJBW7QJKYPLLXSRQ) context deadline exceeded; piecestore: (Node ID: 12bcXTBAWidFQdAcAmTmPsHFrNb3KaicnKQoqtcnSyYPs8MfMR8, Piece ID: X2EKLRU6NCXKJWRCO6KBKGMAJWKAOYTWP6Y2HCANSD46WRNHBELQ) context deadline exceeded; piecestore: (Node ID: 12HtAGLF74ponLBttyfAin8MZV7oFBYvVCT1Jd5yKJG99anSVVC, Piece ID: GKFDL3UDEC2ML2DVSDCZVS3KQAEZ55AA7XGTVGO4PZ5XECCWPMZQ) context deadline exceeded; piecestore: (Node ID: 1Lbp5Ch18UPFNLALhockFsFSB7YPtbTmasHjFWcVXRVkPyp2q9, Piece ID: FTNIZAAK2HA6KOXWATPMEY6RI6CPKW4EUAQ4W2DA3AWSDE6K2LFA) context deadline exceeded
Duration: 3.694792183s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................]
duration:
3.598576041s
trace:
https://jaeger.dev.storj.io/trace/1826fc12eb97ad6d
FAIL (2025-11-19 12:08:59 UTC)
orbiter warning: operation: sync2.Copy
uplink: piecestore: (Node ID: 12VpHQ9agBBm65AWhdMWSPDNzqJyiHsPYfQV1KDL1eMv1hk8cwN, Piece ID: JEJRXJ4ODOL3JXRRX3KNXHLNSEFJJWKBMMAB5TP2HSKEYOWRYZLQ) context deadline exceeded; piecestore: (Node ID: 128bohZvc8pUuRBLDosNFjtmirJeXZnAeFmLS8Uf67xAcv1i6dQ, Piece ID: UWWNJVCFWPTZRE4RRJEOVALYKEW3EXACJJULMVUDSTJ7OCCPGURA) context deadline exceeded; piecestore: (Node ID: 12gGjjeKkFD1uMfqccQCTJnQoUZ8CztSvFYottRkghGrbAhwxqj, Piece ID: XQSUQFZSCKJV45MBXZGZ52KO3QR3HNFR3W6X3A7G7NWGCXQ62VPQ) context deadline exceeded; piecestore: (Node ID: 1qMvhA9gakN3pyukerUWue2TfBeLiBTEDDWULCxdN5LcBFaSdn, Piece ID: F4Z74T5CUL5L37SGJLZJ354FNCRY22YN3LHWXMR3CSD3B6QG7Y2A) context deadline exceeded; piecestore: (Node ID: 12dn15Yr9N1nA1STdMKmX2dVLNKeTHshDaqAWzGF8gb59u1K9Ve, Piece ID: B6X3KT4VKEKUPFDT3EMKNCF5ZFWYBSPADUYTWZ2SM7TZJJZYNBZA) context deadline exceeded; piecestore: (Node ID: 1WPr7TRD3As3kHeYcsgzJuyzkNN7ktxumophSqbfPveHnyq9y8, Piece ID: MKA4DODJT6BB2VEPFMQGM4VYXPI7ZWOVTVL2Q5VBO3OSLFHIAI2A) context deadline exceeded; piecestore: (Node ID: 12NzWsxJe1qKVubZPwzkF6XorMp35Ri4nra1hUMkdeG4p3z7h4s, Piece ID: FUVVLL3R3BJRBEFLC5TXFZN3MDJG3GO5MWCXG4Q4ZFELN6OW3CFQ) context deadline exceeded; piecestore: (Node ID: 1gVnpQu7bWogHfd8KrAmytkaNHeUHykcBWuSpk5TbMy86moqju, Piece ID: WM3XVPJWEGP674YDPL3MEA36TBS6KG4HZZBC2QLZ3FFVK36JFXZQ) context deadline exceeded; piecestore: (Node ID: 12oBKFEUdCh7UkuZsesS4e43L18ocZTv9FeZwr1vznuEWPDETQP, Piece ID: 344IJDH33LDZ5AQWY4Y5BB5SDH5ALHPYWZSQY27NVCC4ZWUDKVTQ) context deadline exceeded; piecestore: (Node ID: 1tyoTVSF9udrfYpVx9fVmCgxN2T3qijzUVchzqXqbuq6rthBhs, Piece ID: HEPZDMAUXP7LWBCOTIKIU34UFWEIBCP4A7IEYDP7YKY4JJC3B3YA) context deadline exceeded; piecestore: (Node ID: 1ga5fKb8hWQFKK1MYdt8miZf8cfNPdk1kKUBCrrhuGPXPVpbDH, Piece ID: AAH7CGMFK3UXN6SSTDKIXZV6KLG3DTXQF72CN6RW6RAW4LXFNUMQ) context deadline exceeded; piecestore: (Node ID: 14zjhX7pamGsetyiEXPUmvjCFAxVVJeirWhbnABUySTHUCimGg, Piece ID: 3OP2J62KYOJISM64TF4GRRWNGFQPMR3VWNWUMJBW7QJKYPLLXSRQ) context deadline exceeded; piecestore: (Node ID: 12bcXTBAWidFQdAcAmTmPsHFrNb3KaicnKQoqtcnSyYPs8MfMR8, Piece ID: X2EKLRU6NCXKJWRCO6KBKGMAJWKAOYTWP6Y2HCANSD46WRNHBELQ) context deadline exceeded; piecestore: (Node ID: 12HtAGLF74ponLBttyfAin8MZV7oFBYvVCT1Jd5yKJG99anSVVC, Piece ID: GKFDL3UDEC2ML2DVSDCZVS3KQAEZ55AA7XGTVGO4PZ5XECCWPMZQ) context deadline exceeded; piecestore: (Node ID: 1Lbp5Ch18UPFNLALhockFsFSB7YPtbTmasHjFWcVXRVkPyp2q9, Piece ID: FTNIZAAK2HA6KOXWATPMEY6RI6CPKW4EUAQ4W2DA3AWSDE6K2LFA) context deadline exceeded
Duration: 3.5986069s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
5.904573223s
trace:
https://jaeger.dev.storj.io/trace/54d7555c2a2ae5e6
FAIL (2025-11-19 12:08:57 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
170707 (243h19m57.402641168s) [upload=214324]: Starting upload
Nov 19 11:23:58.851267412 (243h19m57.402737873s) [upload=214324]: Done starting upload
Nov 19 11:23:58.851359157 (243h19m57.402829618s) [upload=214324]: Uploading segments...
Nov 19 11:23:58.851533098 (243h19m57.403003549s) [upload=214324]: Got next segment. Inline: false
Nov 19 11:23:58.851579085 (243h19m57.403049546s) [upload=214324]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov 19 11:23:58.851586489 (243h19m57.40305695s) [upload=214324]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov 19 11:24:09.346928285 (243h20m7.898398746s) [seg_pos={0 0}, upload=214324]: Begin upload segment...
Nov 19 11:24:09.346971878 (243h20m7.898442329s) [seg_pos={0 0}, upload=214324]: Done begin upload segment.
Nov 19 11:24:09.346997186 (243h20m7.898467647s) [noise=true , address=45.91.116.11:4119    , piece_id=6WCEXY2DXFSAY6YCG3KXBLR3WR33RDSQVMGCW3ZSQH77VJ5T7G5A, seg_pos={0 0}, upload=214324]: Uploading piece...
Nov 19 11:24:09.347899535 (243h20m7.899369996s) [noise=true , address=77.90.31.13:4626     , piece_id=VMTG572TS7QO3QNDFWECEX2Z5W7GKPLJK7WQZJSJYOQATYUQD4OA, seg_pos={0 0}, upload=214324]: Uploading piece...
Nov 19 11:24:09.348751847 (243h20m7.900222338s) [noise=true , address=45.91.116.12:4225    , piece_id=H6D4TZI5TGNSEJOJYCBQWC6XQ6DLDJOBSET2I72QWE2BAFZ7XYCA, seg_pos={0 0}, upload=214324]: Uploading piece...
Nov 19 11:24:09.349253423 (243h20m7.900723884s) [noise=true , address=45.91.116.7:4009     , piece_id=VXQYDDRZX56SG6ALDXZHSYDMS5KR2IRFRQI4X64KF6CEOEFLMU6Q, seg_pos={0 0}, upload=214324]: Uploading piece...
Nov 19 11:24:09.349722666 (243h20m7.901193117s) [noise=true , address=45.91.116.14:4191    , piece_id=FPXHDVQGASXOT4P33BD3BZHWIAYZGJXCJ53AFVFBTGHDWPP6SKGA, seg_pos={0 0}, upload=214324]: Uploading piece...
Nov 19 11:24:09.349744538 (243h20m7.901214999s) [noise=true , address=145.79.227.14:4837   , piece_id=A7S6LDPJW4D4YOBBHBQ2LPCTRDV7GFS5PGHIP66PAATQMGLSDJAQ, seg_pos={0 0}, upload=214324]: Uploading piece...
Nov 19 11:24:09.350164648 (243h20m7.901635109s) [noise=true , address=145.79.227.25:4618   , piece_id=TU7M5ZK6A7ZRZONBSNK3VDMHLGNB4LARMZOQSSSNKZ5AOWNMZHOQ, seg_pos={0 0}, upload=214324]: Uploading piece...
Nov 19 11:24:09.350298463 (243h20m7.901768924s) [noise=true , address=145.79.227.23:4546   , piece_id=QXF7RXRVDWVBX6JANYV5GNJ63SHJJS6B6Y2BPYZCBAAT4MWZQBCA, seg_pos={0 0}, upload=214324]: Uploading piece...
Nov 19 11:24:09.350985580 (243h20m7.902456041s) [noise=true , address=145.79.227.32:4836   , piece_id=C3PB7TPO5UBCAWLA3T6HXDED6QYFBI2RWLXCJYVP5O3ER57JCALQ, seg_pos={0 0}, upload=214324]: Uploading piece...
Nov 19 11:24:09.351646960 (243h20m7.903117421s) [noise=true , address=145.79.227.31:4797   , piece_id=4WSJOYT5PUJRVDRTVWO4TQ6UE5HVEETY2HHB7QITWWT424T6VW6Q, seg_pos={0 0}, upload=214324]: Uploading piece...
Nov 19 11:24:09.352106045 (243h20m7.903576496s) [noise=true , address=145.79.227.28:4726   , piece_id=VPY57YYX3AIUDGJOBYUYSGEC7IBCOJPJGOCS5SBDC6Y4ABD5B6JA, seg_pos={0 0}, upload=214324]: Uploading piece...
Nov 19 11:24:09.352226704 (243h20m7.903697165s) [noise=true , address=45.91.116.10:4082    , piece_id=3CDP62UO2AOLDQJE6LQRRVVQTLFNQWJYLSAX5ETOBSXA7XHWNQ7A, seg_pos={0 0}, upload=214324]: Uploading piece...
Nov 19 11:24:09.352502589 (243h20m7.903973051s) [noise=true , address=145.79.227.8:4330    , piece_id=GAFAWMMGASFCFNJXTO4IV4AUFRXKCZXGCHW7FKNXQET2RNQ2KEDQ, seg_pos={0 0}, upload=214324]: Uploading piece...
Nov 19 11:24:09.352808733 (243h20m7.904279194s) [noise=true , address=45.91.116.13:4154    , piece_id=3H63BGHT2WK734HWVE3RINT3BLLZB6KJYD7O4EAYFHNSFNPMT2IQ, seg_pos={0 0}, upload=214324]: Uploading piece...
Nov 19 11:24:09.353355172 (243h20m7.904825633s) [noise=true , address=45.91.116.6:4973     , piece_id=DLZMOXUEJVXSVCLKRUK2U65MWVW73OJAX4X233ACRCPMZMM36EVQ, seg_pos={0 0}, upload=214324]: Uploading piece...
Nov 19 11:24:09.353960826 (243h20m7.905431287s) [noise=true , address=77.90.31.17:4770     , piece_id=XBAPK4DJH5LTPMMCDUKDF32EMS46MCHDGW5NIOJVJ26PWCQVVMMA, seg_pos={0 0}, upload=214324]: Uploading piece...
Nov 19 11:24:11.079870614 (243h20m9.631341075s) [upload=214324]: Next returned nil segment
Nov 19 11:24:11.079888597 (243h20m9.631359088s) [upload=214324]: Waiting for error group managing segments...
Nov 19 11:24:11.370368685 (243h20m9.921839136s) [noise=true , address=145.79.227.23:4546   , piece_id=QXF7RXRVDWVBX6JANYV5GNJ63SHJJS6B6Y2BPYZCBAAT4MWZQBCA, seg_pos={0 0}, upload=214324]: Done uploading piece. err: <nil>
Nov 19 11:24:11.393957131 (243h20m9.945427582s) [noise=true , address=145.79.227.32:4836   , piece_id=C3PB7TPO5UBCAWLA3T6HXDED6QYFBI2RWLXCJYVP5O3ER57JCALQ, seg_pos={0 0}, upload=214324]: Done uploading piece. err: <nil>
Nov 19 11:24:11.396900396 (243h20m9.948370857s) [noise=true , address=145.79.227.14:4837   , piece_id=A7S6LDPJW4D4YOBBHBQ2LPCTRDV7GFS5PGHIP66PAATQMGLSDJAQ, seg_pos={0 0}, upload=214324]: Done uploading piece. err: <nil>
Nov 19 11:24:11.406555350 (243h20m9.958025811s) [noise=true , address=145.79.227.8:4330    , piece_id=GAFAWMMGASFCFNJXTO4IV4AUFRXKCZXGCHW7FKNXQET2RNQ2KEDQ, seg_pos={0 0}, upload=214324]: Done uploading piece. err: <nil>
Nov 19 11:24:11.408203239 (243h20m9.9596737s) [noise=true , address=145.79.227.28:4726   , piece_id=VPY57YYX3AIUDGJOBYUYSGEC7IBCOJPJGOCS5SBDC6Y4ABD5B6JA, seg_pos={0 0}, upload=214324]: Done uploading piece. err: <nil>
Nov 19 11:24:11.427732886 (243h20m9.979203348s) [noise=true , address=145.79.227.25:4618   , piece_id=TU7M5ZK6A7ZRZONBSNK3VDMHLGNB4LARMZOQSSSNKZ5AOWNMZHOQ, seg_pos={0 0}, upload=214324]: Done uploading piece. err: <nil>
Nov 19 11:24:11.434574545 (243h20m9.986045006s) [noise=true , address=145.79.227.31:4797   , piece_id=4WSJOYT5PUJRVDRTVWO4TQ6UE5HVEETY2HHB7QITWWT424T6VW6Q, seg_pos={0 0}, upload=214324]: Done uploading piece. err: <nil>
Nov 19 11:24:11.965623448 (243h20m10.517093909s) [noise=true , address=45.91.116.6:4973     , piece_id=DLZMOXUEJVXSVCLKRUK2U65MWVW73OJAX4X233ACRCPMZMM36EVQ, seg_pos={0 0}, upload=214324]: Done uploading piece. err: <nil>
Nov 19 11:24:12.704244297 (243h20m11.255714758s) [noise=true , address=45.91.116.13:4154    , piece_id=3H63BGHT2WK734HWVE3RINT3BLLZB6KJYD7O4EAYFHNSFNPMT2IQ, seg_pos={0 0}, upload=214324]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: expected piece hash; context deadline exceeded; EOF
Nov 19 11:24:12.704310923 (243h20m11.255781395s) [noise=true , address=77.90.31.17:4770     , piece_id=XBAPK4DJH5LTPMMCDUKDF32EMS46MCHDGW5NIOJVJ26PWCQVVMMA, seg_pos={0 0}, upload=214324]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: expected piece hash; context deadline exceeded; EOF
Nov 19 11:24:12.704530301 (243h20m11.256000762s) [noise=true , address=45.91.116.11:4119    , piece_id=6WCEXY2DXFSAY6YCG3KXBLR3WR33RDSQVMGCW3ZSQH77VJ5T7G5A, seg_pos={0 0}, upload=214324]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 188.166.225.170:46214->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 19 11:24:12.704554738 (243h20m11.256025199s) [noise=true , address=77.90.31.13:4626     , piece_id=VMTG572TS7QO3QNDFWECEX2Z5W7GKPLJK7WQZJSJYOQATYUQD4OA, seg_pos={0 0}, upload=214324]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: expected piece hash; context deadline exceeded; EOF
Nov 19 11:24:12.704718500 (243h20m11.256188951s) [noise=true , address=45.91.116.14:4191    , piece_id=FPXHDVQGASXOT4P33BD3BZHWIAYZGJXCJ53AFVFBTGHDWPP6SKGA, seg_pos={0 0}, upload=214324]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 188.166.225.170:59364->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 19 11:24:12.704860580 (243h20m11.256331041s) [noise=true , address=45.91.116.12:4225    , piece_id=H6D4TZI5TGNSEJOJYCBQWC6XQ6DLDJOBSET2I72QWE2BAFZ7XYCA, seg_pos={0 0}, upload=214324]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 188.166.225.170:35728->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 19 11:24:12.705105717 (243h20m11.256576178s) [noise=true , address=45.91.116.7:4009     , piece_id=VXQYDDRZX56SG6ALDXZHSYDMS5KR2IRFRQI4X64KF6CEOEFLMU6Q, seg_pos={0 0}, upload=214324]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 188.166.225.170:33754->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 19 11:24:12.705230465 (243h20m11.256700926s) [noise=true , address=45.91.116.10:4082    , piece_id=3CDP62UO2AOLDQJE6LQRRVVQTLFNQWJYLSAX5ETOBSXA7XHWNQ7A, seg_pos={0 0}, upload=214324]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: read tcp 188.166.225.170:53058->45.91.116.10:4082: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 19 11:24:12.705281462 (243h20m11.256751923s) [seg_pos={0 0}, upload=214324]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Nov 19 11:24:13.954848295 (243h20m12.506318746s) [upload=214324]: Done uploading segments...
Nov 19 11:24:13.954922786 (243h20m12.506393257s) [upload=214324]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.90460354s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
6.675005206s
trace:
https://jaeger.dev.storj.io/trace/4a8bdfd70deab53a
FAIL (2025-11-19 12:08:56 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 6.675036055s core uplink us1