Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 7 out of 60 is failed (threshold=3) [X...................X.......X..X......X..XX.................] duration: 5.737270733s trace: https://jaeger.dev.storj.io/trace/2f7ddf40a87b31df FAIL (2026-05-14 00:54:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.737281634s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 7 out of 60 is failed (threshold=3) [.X...................X.......X..X......X..XX................] duration: 5.729757979s trace: https://jaeger.dev.storj.io/trace/2f7ddf40a87b31df FAIL (2026-05-14 00:53:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.729781534s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 7 out of 60 is failed (threshold=3) [..X...................X.......X..X......X..XX...............] duration: 5.647823273s trace: https://jaeger.dev.storj.io/trace/2f7ddf40a87b31df FAIL (2026-05-14 00:52:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.647834343s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 7 out of 60 is failed (threshold=3) [...X...................X.......X..X......X..XX..............] duration: 5.690935074s trace: https://jaeger.dev.storj.io/trace/2f7ddf40a87b31df FAIL (2026-05-14 00:52:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.69095969s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 7 out of 60 is failed (threshold=3) [....X...................X.......X..X......X..XX.............] duration: 5.795542733s trace: https://jaeger.dev.storj.io/trace/2f7ddf40a87b31df FAIL (2026-05-14 00:51:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.795566549s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 7 out of 60 is failed (threshold=3) [.....X...................X.......X..X......X..XX............] duration: 5.733679228s trace: https://jaeger.dev.storj.io/trace/2f7ddf40a87b31df FAIL (2026-05-14 00:50:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.733709616s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 7 out of 60 is failed (threshold=3) [......X...................X.......X..X......X..XX...........] duration: 6.456236503s trace: https://jaeger.dev.storj.io/trace/2f7ddf40a87b31df FAIL (2026-05-14 00:48:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.456274427s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 7 out of 60 is failed (threshold=3) [.......X...................X.......X..X......X..XX..........] duration: 56.418972302s trace: https://jaeger.dev.storj.io/trace/2f7ddf40a87b31df FAIL (2026-05-14 00:48:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 56.419007059s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 3.741941522s trace: https://jaeger.dev.storj.io/trace/2786f877eb009a88 FAIL (2026-05-14 00:47:53 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.741965508s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.X..........................................................] duration: 3.689192983s trace: https://jaeger.dev.storj.io/trace/2786f877eb009a88 FAIL (2026-05-14 00:47:21 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.689216117s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [X.......X...................X.......X..X......X..XX.........] duration: 6.591879633s trace: https://jaeger.dev.storj.io/trace/2f7ddf40a87b31df FAIL (2026-05-14 00:46:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.59189964s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..X.........................................................] duration: 3.760375002s trace: https://jaeger.dev.storj.io/trace/2786f877eb009a88 FAIL (2026-05-14 00:46:48 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.760399178s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [XX.......X...................X.......X..X......X..XX........] duration: 6.760501645s trace: https://jaeger.dev.storj.io/trace/2f7ddf40a87b31df FAIL (2026-05-14 00:46:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.760519238s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...X........................................................] duration: 3.739696766s trace: https://jaeger.dev.storj.io/trace/2786f877eb009a88 FAIL (2026-05-14 00:45:40 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.739726793s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....X.......................................................] duration: 3.768867435s trace: https://jaeger.dev.storj.io/trace/2786f877eb009a88 FAIL (2026-05-14 00:45:14 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.768887966s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [.XX.......X...................X.......X..X......X..XX.......] duration: 6.552397507s trace: https://jaeger.dev.storj.io/trace/2f7ddf40a87b31df FAIL (2026-05-14 00:45:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.552421161s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [X....X......................................................] duration: 3.531658288s trace: https://jaeger.dev.storj.io/trace/2786f877eb009a88 FAIL (2026-05-14 00:44:05 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.531684359s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [..XX.......X...................X.......X..X......X..XX......] duration: 6.527077235s trace: https://jaeger.dev.storj.io/trace/2f7ddf40a87b31df FAIL (2026-05-14 00:44:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.527099607s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [XX....X.....................................................] duration: 3.537190306s trace: https://jaeger.dev.storj.io/trace/2786f877eb009a88 FAIL (2026-05-14 00:43:23 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.537207128s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [...XX.......X...................X.......X..X......X..XX.....] duration: 6.561981093s trace: https://jaeger.dev.storj.io/trace/2f7ddf40a87b31df FAIL (2026-05-14 00:43:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.562003245s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [XXX....X....................................................] duration: 3.668943384s trace: https://jaeger.dev.storj.io/trace/2786f877eb009a88 FAIL (2026-05-14 00:42:43 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.668989411s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [XXXX....X...................................................] duration: 3.686520993s trace: https://jaeger.dev.storj.io/trace/2786f877eb009a88 FAIL (2026-05-14 00:42:15 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.686626505s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [X...XX.......X...................X.......X..X......X..XX....] duration: 6.475525681s trace: https://jaeger.dev.storj.io/trace/2f7ddf40a87b31df FAIL (2026-05-14 00:42:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.475551451s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [XX...XX.......X...................X.......X..X......X..XX...] duration: 6.436339118s trace: https://jaeger.dev.storj.io/trace/2f7ddf40a87b31df FAIL (2026-05-14 00:41:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.436364166s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 6 out of 60 is failed (threshold=6) [XXXXX....X..................................................] duration: 3.574738625s trace: https://jaeger.dev.storj.io/trace/2786f877eb009a88 FAIL (2026-05-14 00:41:13 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.57475728s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [XXX...XX.......X...................X.......X..X......X..XX..] duration: 6.596387908s trace: https://jaeger.dev.storj.io/trace/2f7ddf40a87b31df FAIL (2026-05-14 00:40:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.596440198s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 7 out of 60 is failed (threshold=6) [XXXXXX....X.................................................] duration: 3.726914065s trace: https://jaeger.dev.storj.io/trace/2786f877eb009a88 FAIL (2026-05-14 00:40:07 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.726930376s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [.XXX...XX.......X...................X.......X..X......X..XX.] duration: 6.341427667s trace: https://jaeger.dev.storj.io/trace/2f7ddf40a87b31df FAIL (2026-05-14 00:39:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.341438867s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 13 out of 60 is failed (threshold=3) [X.XXX...XX.......X...................X.......X..X......X..XX] duration: 1m0.000694708s trace: https://jaeger.dev.storj.io/trace/2f7ddf40a87b31df FAIL (2026-05-14 00:39:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000707102s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 8 out of 60 is failed (threshold=6) [XXXXXXX....X................................................] duration: 3.676547138s trace: https://jaeger.dev.storj.io/trace/2786f877eb009a88 FAIL (2026-05-14 00:39:13 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.676571023s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 9 out of 60 is failed (threshold=6) [XXXXXXXX....X...............................................] duration: 3.643692915s trace: https://jaeger.dev.storj.io/trace/2786f877eb009a88 FAIL (2026-05-14 00:38:51 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.643720238s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 7.486324701s trace: https://jaeger.dev.storj.io/trace/1cb3ad1e3120325 FAIL (2026-05-14 00:38:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, Piece ID: W3LN7Y3TQ6QZHFMFQ3I47EYX5O4EUEPGQE6VCTHCRB3QJCSVGCFQ) context deadline exceeded; piecestore: (Node ID: 12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, Piece ID: ZAZIJR7MONOZTYDGRB45EJHI4AT4AO2HICUFTNEQ5M4NK5RJSEYA) context deadline exceeded ======LOGS====== May 13 23:54:09.101041394 (317h6m19.621865139s) [upload=303759]: Starting upload May 13 23:54:09.101150321 (317h6m19.621974066s) [upload=303759]: Done starting upload May 13 23:54:09.101523945 (317h6m19.62234769s) [upload=303759]: Uploading segments... May 13 23:54:09.101671446 (317h6m19.622495191s) [upload=303759]: Got next segment. Inline: false May 13 23:54:09.101764053 (317h6m19.622587788s) [upload=303759]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 13 23:54:09.101813186 (317h6m19.622636931s) [upload=303759]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 13 23:54:09.342652473 (317h6m19.863476219s) [seg_pos={0 0}, upload=303759]: Begin upload segment... May 13 23:54:09.342708981 (317h6m19.863532726s) [seg_pos={0 0}, upload=303759]: Done begin upload segment. May 13 23:54:09.342734078 (317h6m19.863557824s) [noise=true , address=145.79.227.44:4197 , piece_id=YGQORIGW76DRF4XFAKRYP64242S7EM43ED73OLUQ2WMGLPWKRMXQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.342806718 (317h6m19.863630463s) [noise=true , address=45.91.116.5:4299 , piece_id=Z3I66FUKFYFVRK5QISCU3VO3WSQGADV7VI45HWPKKCC4Y7R5JJGQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.343405821 (317h6m19.864229556s) [noise=true , address=145.79.227.29:4941 , piece_id=I6NEQI2B72T2XC37GD5XX2UUUISF6K6ZMBQPNKY3WZ73ZEM7F7LA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.343736492 (317h6m19.864560257s) [noise=true , address=77.90.31.11:4555 , piece_id=2TQNISXX4GF43FVAZBQLXIDV3VIQFQYWVNSWNRNBVF4RHXQGWB3A, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.344273326 (317h6m19.865097072s) [noise=true , address=145.79.227.48:4306 , piece_id=GOM6KEXBA3I6VU3NYSG3JBEFIO5YWGEWM6STZOLCQQONXBEFORKA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.344684090 (317h6m19.865507835s) [noise=true , address=145.79.227.13:4804 , piece_id=CK6FOK2W7YIUAE3YJ6XAY3NR6FIQZ7BYKTBEELIFHBASPV3IK6GA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.344692727 (317h6m19.865516472s) [noise=true , address=145.79.227.20:4437 , piece_id=6BTVPMO5EYNPTLX5CJUQLETFI4W3WNVKLOUTOQZNOFCFMCEAC2FQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345011675 (317h6m19.86583542s) [noise=true , address=77.90.31.13:4626 , piece_id=ZAZIJR7MONOZTYDGRB45EJHI4AT4AO2HICUFTNEQ5M4NK5RJSEYA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345015542 (317h6m19.865839287s) [noise=true , address=145.79.227.4:4188 , piece_id=LSJSOJIL7GFMQRRVSYBSCYZ34MJK4K3M2XRBHTTXUAOPGRNKJTRA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345336104 (317h6m19.866159849s) [noise=true , address=145.79.227.45:4234 , piece_id=WQINO2KZFCOKCUR2LKD63QGYU4U7QXO7DZ5Y4K65ZIE6NGRHTHSA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345446635 (317h6m19.86627038s) [noise=true , address=145.79.227.2:4117 , piece_id=B7N34ENGOW346JAOQ4TP2R7UURBRRCNSI2VJK3CJDDDSF7ZUBVCA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345625066 (317h6m19.866448811s) [noise=true , address=45.91.116.4:4940 , piece_id=4FP6TLZHKHWVV5YYI44P7X4B23X3MBYP4HWDGAPN4P723FVO7FMA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345928595 (317h6m19.86675234s) [noise=true , address=145.79.227.12:4770 , piece_id=IML2LWFBEHA7QOC4H7WZYZ4PMEK5RSTHFPRGPGY7N2HLKIXGJWJQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.346196556 (317h6m19.867020301s) [noise=true , address=145.79.227.42:4124 , piece_id=T5F3Z57TZ5CRE2PAKUEF5BTQH2VENBAZIOUEVHR23HRO5RPBATZA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.346515965 (317h6m19.86733971s) [noise=true , address=77.90.31.21:4879 , piece_id=W3LN7Y3TQ6QZHFMFQ3I47EYX5O4EUEPGQE6VCTHCRB3QJCSVGCFQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.346596399 (317h6m19.867420134s) [noise=true , address=145.79.227.15:4878 , piece_id=GOZMXBY3FYWFDQ6X45JGBWHKJT36LFBUVS4XJIOQTVGBO3ZI2DWQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:11.479134008 (317h6m21.999957743s) [upload=303759]: Next returned nil segment May 13 23:54:11.479176098 (317h6m21.999999833s) [upload=303759]: Waiting for error group managing segments... May 13 23:54:11.875349259 (317h6m22.396173004s) [noise=true , address=45.91.116.5:4299 , piece_id=Z3I66FUKFYFVRK5QISCU3VO3WSQGADV7VI45HWPKKCC4Y7R5JJGQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:11.929014675 (317h6m22.44983842s) [noise=true , address=45.91.116.4:4940 , piece_id=4FP6TLZHKHWVV5YYI44P7X4B23X3MBYP4HWDGAPN4P723FVO7FMA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.522398786 (317h6m27.043222531s) [noise=true , address=77.90.31.11:4555 , piece_id=2TQNISXX4GF43FVAZBQLXIDV3VIQFQYWVNSWNRNBVF4RHXQGWB3A, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.677455972 (317h6m27.198279717s) [noise=true , address=145.79.227.12:4770 , piece_id=IML2LWFBEHA7QOC4H7WZYZ4PMEK5RSTHFPRGPGY7N2HLKIXGJWJQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.904600146 (317h6m27.425423891s) [noise=true , address=145.79.227.42:4124 , piece_id=T5F3Z57TZ5CRE2PAKUEF5BTQH2VENBAZIOUEVHR23HRO5RPBATZA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.962748155 (317h6m27.4835719s) [noise=true , address=145.79.227.13:4804 , piece_id=CK6FOK2W7YIUAE3YJ6XAY3NR6FIQZ7BYKTBEELIFHBASPV3IK6GA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:19.824741116 (317h6m30.345564861s) [noise=true , address=145.79.227.29:4941 , piece_id=I6NEQI2B72T2XC37GD5XX2UUUISF6K6ZMBQPNKY3WZ73ZEM7F7LA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:23.318972131 (317h6m33.839795876s) [noise=true , address=145.79.227.20:4437 , piece_id=6BTVPMO5EYNPTLX5CJUQLETFI4W3WNVKLOUTOQZNOFCFMCEAC2FQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:28.699626931 (317h6m39.220450676s) [noise=true , address=145.79.227.45:4234 , piece_id=WQINO2KZFCOKCUR2LKD63QGYU4U7QXO7DZ5Y4K65ZIE6NGRHTHSA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:30.580138066 (317h6m41.100961811s) [noise=true , address=145.79.227.4:4188 , piece_id=LSJSOJIL7GFMQRRVSYBSCYZ34MJK4K3M2XRBHTTXUAOPGRNKJTRA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:31.614065620 (317h6m42.134889355s) [noise=true , address=77.90.31.13:4626 , piece_id=ZAZIJR7MONOZTYDGRB45EJHI4AT4AO2HICUFTNEQ5M4NK5RJSEYA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:34.869340665 (317h6m45.39016441s) [noise=true , address=145.79.227.2:4117 , piece_id=B7N34ENGOW346JAOQ4TP2R7UURBRRCNSI2VJK3CJDDDSF7ZUBVCA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:35.539227446 (317h6m46.060051201s) [noise=true , address=77.90.31.21:4879 , piece_id=W3LN7Y3TQ6QZHFMFQ3I47EYX5O4EUEPGQE6VCTHCRB3QJCSVGCFQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:35.539249819 (317h6m46.060073574s) [seg_pos={0 0}, upload=303759]: Satisfied cohort requirements after 13 pieces May 13 23:54:35.539509113 (317h6m46.060332848s) [noise=true , address=145.79.227.48:4306 , piece_id=GOM6KEXBA3I6VU3NYSG3JBEFIO5YWGEWM6STZOLCQQONXBEFORKA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF May 13 23:54:35.539517068 (317h6m46.060340813s) [noise=true , address=145.79.227.48:4306 , piece_id=GOM6KEXBA3I6VU3NYSG3JBEFIO5YWGEWM6STZOLCQQONXBEFORKA, seg_pos={0 0}, upload=303759]: Long tail cancellation due to optimal threshold May 13 23:54:35.539532217 (317h6m46.060355962s) [noise=true , address=145.79.227.15:4878 , piece_id=GOZMXBY3FYWFDQ6X45JGBWHKJT36LFBUVS4XJIOQTVGBO3ZI2DWQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126ZeAKnpjpxa3MgCBU3KZKBDdn8MfZgiixE4zR5fZpPwaQj9NC): protocol: write tcp 188.166.225.170:52152->145.79.227.15:4878: use of closed network connection; write tcp 188.166.225.170:52152->145.79.227.15:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52152->145.79.227.15:4878: use of closed network connection May 13 23:54:35.539539841 (317h6m46.060363587s) [noise=true , address=145.79.227.15:4878 , piece_id=GOZMXBY3FYWFDQ6X45JGBWHKJT36LFBUVS4XJIOQTVGBO3ZI2DWQ, seg_pos={0 0}, upload=303759]: Long tail cancellation due to optimal threshold May 13 23:54:35.539679248 (317h6m46.060502993s) [noise=true , address=145.79.227.44:4197 , piece_id=YGQORIGW76DRF4XFAKRYP64242S7EM43ED73OLUQ2WMGLPWKRMXQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12niHLkT5pbmYSbarHZGeeCRtwjZRXtvEtHMGAb7ja4a7Xuuvfi): protocol: expected piece hash; context canceled; EOF May 13 23:54:35.539685650 (317h6m46.060509395s) [noise=true , address=145.79.227.44:4197 , piece_id=YGQORIGW76DRF4XFAKRYP64242S7EM43ED73OLUQ2WMGLPWKRMXQ, seg_pos={0 0}, upload=303759]: Long tail cancellation due to optimal threshold May 13 23:54:35.539760081 (317h6m46.060583826s) [seg_pos={0 0}, upload=303759]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 13 23:54:35.539831719 (317h6m46.060655464s) [upload=303759]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 13 23:54:35.539836608 (317h6m46.060660353s) [upload=303759]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 13 23:54:35.834703623 (317h6m46.355527358s) [upload=303759]: Done uploading segments... May 13 23:54:35.834721307 (317h6m46.355545042s) [upload=303759]: Upload finished. err: <nil> Duration: 7.486349787s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [XXXXXXXXX....X..............................................] duration: 3.928295469s trace: https://jaeger.dev.storj.io/trace/2786f877eb009a88 FAIL (2026-05-14 00:38:31 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.92831747s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [.X.XXX...XX.......X...................X.......X..X......X..X] duration: 1m0.001331999s trace: https://jaeger.dev.storj.io/trace/4cd692cca9f78da9 FAIL (2026-05-14 00:38:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001354512s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 5.803709548s trace: https://jaeger.dev.storj.io/trace/1cb3ad1e3120325 FAIL (2026-05-14 00:38:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, Piece ID: W3LN7Y3TQ6QZHFMFQ3I47EYX5O4EUEPGQE6VCTHCRB3QJCSVGCFQ) context deadline exceeded; piecestore: (Node ID: 12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, Piece ID: ZAZIJR7MONOZTYDGRB45EJHI4AT4AO2HICUFTNEQ5M4NK5RJSEYA) context deadline exceeded ======LOGS====== May 13 23:54:09.101041394 (317h6m19.621865139s) [upload=303759]: Starting upload May 13 23:54:09.101150321 (317h6m19.621974066s) [upload=303759]: Done starting upload May 13 23:54:09.101523945 (317h6m19.62234769s) [upload=303759]: Uploading segments... May 13 23:54:09.101671446 (317h6m19.622495191s) [upload=303759]: Got next segment. Inline: false May 13 23:54:09.101764053 (317h6m19.622587788s) [upload=303759]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 13 23:54:09.101813186 (317h6m19.622636931s) [upload=303759]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 13 23:54:09.342652473 (317h6m19.863476219s) [seg_pos={0 0}, upload=303759]: Begin upload segment... May 13 23:54:09.342708981 (317h6m19.863532726s) [seg_pos={0 0}, upload=303759]: Done begin upload segment. May 13 23:54:09.342734078 (317h6m19.863557824s) [noise=true , address=145.79.227.44:4197 , piece_id=YGQORIGW76DRF4XFAKRYP64242S7EM43ED73OLUQ2WMGLPWKRMXQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.342806718 (317h6m19.863630463s) [noise=true , address=45.91.116.5:4299 , piece_id=Z3I66FUKFYFVRK5QISCU3VO3WSQGADV7VI45HWPKKCC4Y7R5JJGQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.343405821 (317h6m19.864229556s) [noise=true , address=145.79.227.29:4941 , piece_id=I6NEQI2B72T2XC37GD5XX2UUUISF6K6ZMBQPNKY3WZ73ZEM7F7LA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.343736492 (317h6m19.864560257s) [noise=true , address=77.90.31.11:4555 , piece_id=2TQNISXX4GF43FVAZBQLXIDV3VIQFQYWVNSWNRNBVF4RHXQGWB3A, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.344273326 (317h6m19.865097072s) [noise=true , address=145.79.227.48:4306 , piece_id=GOM6KEXBA3I6VU3NYSG3JBEFIO5YWGEWM6STZOLCQQONXBEFORKA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.344684090 (317h6m19.865507835s) [noise=true , address=145.79.227.13:4804 , piece_id=CK6FOK2W7YIUAE3YJ6XAY3NR6FIQZ7BYKTBEELIFHBASPV3IK6GA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.344692727 (317h6m19.865516472s) [noise=true , address=145.79.227.20:4437 , piece_id=6BTVPMO5EYNPTLX5CJUQLETFI4W3WNVKLOUTOQZNOFCFMCEAC2FQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345011675 (317h6m19.86583542s) [noise=true , address=77.90.31.13:4626 , piece_id=ZAZIJR7MONOZTYDGRB45EJHI4AT4AO2HICUFTNEQ5M4NK5RJSEYA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345015542 (317h6m19.865839287s) [noise=true , address=145.79.227.4:4188 , piece_id=LSJSOJIL7GFMQRRVSYBSCYZ34MJK4K3M2XRBHTTXUAOPGRNKJTRA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345336104 (317h6m19.866159849s) [noise=true , address=145.79.227.45:4234 , piece_id=WQINO2KZFCOKCUR2LKD63QGYU4U7QXO7DZ5Y4K65ZIE6NGRHTHSA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345446635 (317h6m19.86627038s) [noise=true , address=145.79.227.2:4117 , piece_id=B7N34ENGOW346JAOQ4TP2R7UURBRRCNSI2VJK3CJDDDSF7ZUBVCA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345625066 (317h6m19.866448811s) [noise=true , address=45.91.116.4:4940 , piece_id=4FP6TLZHKHWVV5YYI44P7X4B23X3MBYP4HWDGAPN4P723FVO7FMA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345928595 (317h6m19.86675234s) [noise=true , address=145.79.227.12:4770 , piece_id=IML2LWFBEHA7QOC4H7WZYZ4PMEK5RSTHFPRGPGY7N2HLKIXGJWJQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.346196556 (317h6m19.867020301s) [noise=true , address=145.79.227.42:4124 , piece_id=T5F3Z57TZ5CRE2PAKUEF5BTQH2VENBAZIOUEVHR23HRO5RPBATZA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.346515965 (317h6m19.86733971s) [noise=true , address=77.90.31.21:4879 , piece_id=W3LN7Y3TQ6QZHFMFQ3I47EYX5O4EUEPGQE6VCTHCRB3QJCSVGCFQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.346596399 (317h6m19.867420134s) [noise=true , address=145.79.227.15:4878 , piece_id=GOZMXBY3FYWFDQ6X45JGBWHKJT36LFBUVS4XJIOQTVGBO3ZI2DWQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:11.479134008 (317h6m21.999957743s) [upload=303759]: Next returned nil segment May 13 23:54:11.479176098 (317h6m21.999999833s) [upload=303759]: Waiting for error group managing segments... May 13 23:54:11.875349259 (317h6m22.396173004s) [noise=true , address=45.91.116.5:4299 , piece_id=Z3I66FUKFYFVRK5QISCU3VO3WSQGADV7VI45HWPKKCC4Y7R5JJGQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:11.929014675 (317h6m22.44983842s) [noise=true , address=45.91.116.4:4940 , piece_id=4FP6TLZHKHWVV5YYI44P7X4B23X3MBYP4HWDGAPN4P723FVO7FMA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.522398786 (317h6m27.043222531s) [noise=true , address=77.90.31.11:4555 , piece_id=2TQNISXX4GF43FVAZBQLXIDV3VIQFQYWVNSWNRNBVF4RHXQGWB3A, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.677455972 (317h6m27.198279717s) [noise=true , address=145.79.227.12:4770 , piece_id=IML2LWFBEHA7QOC4H7WZYZ4PMEK5RSTHFPRGPGY7N2HLKIXGJWJQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.904600146 (317h6m27.425423891s) [noise=true , address=145.79.227.42:4124 , piece_id=T5F3Z57TZ5CRE2PAKUEF5BTQH2VENBAZIOUEVHR23HRO5RPBATZA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.962748155 (317h6m27.4835719s) [noise=true , address=145.79.227.13:4804 , piece_id=CK6FOK2W7YIUAE3YJ6XAY3NR6FIQZ7BYKTBEELIFHBASPV3IK6GA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:19.824741116 (317h6m30.345564861s) [noise=true , address=145.79.227.29:4941 , piece_id=I6NEQI2B72T2XC37GD5XX2UUUISF6K6ZMBQPNKY3WZ73ZEM7F7LA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:23.318972131 (317h6m33.839795876s) [noise=true , address=145.79.227.20:4437 , piece_id=6BTVPMO5EYNPTLX5CJUQLETFI4W3WNVKLOUTOQZNOFCFMCEAC2FQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:28.699626931 (317h6m39.220450676s) [noise=true , address=145.79.227.45:4234 , piece_id=WQINO2KZFCOKCUR2LKD63QGYU4U7QXO7DZ5Y4K65ZIE6NGRHTHSA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:30.580138066 (317h6m41.100961811s) [noise=true , address=145.79.227.4:4188 , piece_id=LSJSOJIL7GFMQRRVSYBSCYZ34MJK4K3M2XRBHTTXUAOPGRNKJTRA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:31.614065620 (317h6m42.134889355s) [noise=true , address=77.90.31.13:4626 , piece_id=ZAZIJR7MONOZTYDGRB45EJHI4AT4AO2HICUFTNEQ5M4NK5RJSEYA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:34.869340665 (317h6m45.39016441s) [noise=true , address=145.79.227.2:4117 , piece_id=B7N34ENGOW346JAOQ4TP2R7UURBRRCNSI2VJK3CJDDDSF7ZUBVCA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:35.539227446 (317h6m46.060051201s) [noise=true , address=77.90.31.21:4879 , piece_id=W3LN7Y3TQ6QZHFMFQ3I47EYX5O4EUEPGQE6VCTHCRB3QJCSVGCFQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:35.539249819 (317h6m46.060073574s) [seg_pos={0 0}, upload=303759]: Satisfied cohort requirements after 13 pieces May 13 23:54:35.539509113 (317h6m46.060332848s) [noise=true , address=145.79.227.48:4306 , piece_id=GOM6KEXBA3I6VU3NYSG3JBEFIO5YWGEWM6STZOLCQQONXBEFORKA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF May 13 23:54:35.539517068 (317h6m46.060340813s) [noise=true , address=145.79.227.48:4306 , piece_id=GOM6KEXBA3I6VU3NYSG3JBEFIO5YWGEWM6STZOLCQQONXBEFORKA, seg_pos={0 0}, upload=303759]: Long tail cancellation due to optimal threshold May 13 23:54:35.539532217 (317h6m46.060355962s) [noise=true , address=145.79.227.15:4878 , piece_id=GOZMXBY3FYWFDQ6X45JGBWHKJT36LFBUVS4XJIOQTVGBO3ZI2DWQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126ZeAKnpjpxa3MgCBU3KZKBDdn8MfZgiixE4zR5fZpPwaQj9NC): protocol: write tcp 188.166.225.170:52152->145.79.227.15:4878: use of closed network connection; write tcp 188.166.225.170:52152->145.79.227.15:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52152->145.79.227.15:4878: use of closed network connection May 13 23:54:35.539539841 (317h6m46.060363587s) [noise=true , address=145.79.227.15:4878 , piece_id=GOZMXBY3FYWFDQ6X45JGBWHKJT36LFBUVS4XJIOQTVGBO3ZI2DWQ, seg_pos={0 0}, upload=303759]: Long tail cancellation due to optimal threshold May 13 23:54:35.539679248 (317h6m46.060502993s) [noise=true , address=145.79.227.44:4197 , piece_id=YGQORIGW76DRF4XFAKRYP64242S7EM43ED73OLUQ2WMGLPWKRMXQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12niHLkT5pbmYSbarHZGeeCRtwjZRXtvEtHMGAb7ja4a7Xuuvfi): protocol: expected piece hash; context canceled; EOF May 13 23:54:35.539685650 (317h6m46.060509395s) [noise=true , address=145.79.227.44:4197 , piece_id=YGQORIGW76DRF4XFAKRYP64242S7EM43ED73OLUQ2WMGLPWKRMXQ, seg_pos={0 0}, upload=303759]: Long tail cancellation due to optimal threshold May 13 23:54:35.539760081 (317h6m46.060583826s) [seg_pos={0 0}, upload=303759]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 13 23:54:35.539831719 (317h6m46.060655464s) [upload=303759]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 13 23:54:35.539836608 (317h6m46.060660353s) [upload=303759]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 13 23:54:35.834703623 (317h6m46.355527358s) [upload=303759]: Done uploading segments... May 13 23:54:35.834721307 (317h6m46.355545042s) [upload=303759]: Upload finished. err: <nil> Duration: 5.803751809s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 11 out of 60 is failed (threshold=6) [XXXXXXXXXX....X.............................................] duration: 3.761805495s trace: https://jaeger.dev.storj.io/trace/2786f877eb009a88 FAIL (2026-05-14 00:38:00 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.761829051s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [XXX.........................................................] duration: 5.779833078s trace: https://jaeger.dev.storj.io/trace/1cb3ad1e3120325 FAIL (2026-05-14 00:37:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, Piece ID: W3LN7Y3TQ6QZHFMFQ3I47EYX5O4EUEPGQE6VCTHCRB3QJCSVGCFQ) context deadline exceeded; piecestore: (Node ID: 12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, Piece ID: ZAZIJR7MONOZTYDGRB45EJHI4AT4AO2HICUFTNEQ5M4NK5RJSEYA) context deadline exceeded ======LOGS====== May 13 23:54:09.101041394 (317h6m19.621865139s) [upload=303759]: Starting upload May 13 23:54:09.101150321 (317h6m19.621974066s) [upload=303759]: Done starting upload May 13 23:54:09.101523945 (317h6m19.62234769s) [upload=303759]: Uploading segments... May 13 23:54:09.101671446 (317h6m19.622495191s) [upload=303759]: Got next segment. Inline: false May 13 23:54:09.101764053 (317h6m19.622587788s) [upload=303759]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 13 23:54:09.101813186 (317h6m19.622636931s) [upload=303759]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 13 23:54:09.342652473 (317h6m19.863476219s) [seg_pos={0 0}, upload=303759]: Begin upload segment... May 13 23:54:09.342708981 (317h6m19.863532726s) [seg_pos={0 0}, upload=303759]: Done begin upload segment. May 13 23:54:09.342734078 (317h6m19.863557824s) [noise=true , address=145.79.227.44:4197 , piece_id=YGQORIGW76DRF4XFAKRYP64242S7EM43ED73OLUQ2WMGLPWKRMXQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.342806718 (317h6m19.863630463s) [noise=true , address=45.91.116.5:4299 , piece_id=Z3I66FUKFYFVRK5QISCU3VO3WSQGADV7VI45HWPKKCC4Y7R5JJGQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.343405821 (317h6m19.864229556s) [noise=true , address=145.79.227.29:4941 , piece_id=I6NEQI2B72T2XC37GD5XX2UUUISF6K6ZMBQPNKY3WZ73ZEM7F7LA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.343736492 (317h6m19.864560257s) [noise=true , address=77.90.31.11:4555 , piece_id=2TQNISXX4GF43FVAZBQLXIDV3VIQFQYWVNSWNRNBVF4RHXQGWB3A, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.344273326 (317h6m19.865097072s) [noise=true , address=145.79.227.48:4306 , piece_id=GOM6KEXBA3I6VU3NYSG3JBEFIO5YWGEWM6STZOLCQQONXBEFORKA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.344684090 (317h6m19.865507835s) [noise=true , address=145.79.227.13:4804 , piece_id=CK6FOK2W7YIUAE3YJ6XAY3NR6FIQZ7BYKTBEELIFHBASPV3IK6GA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.344692727 (317h6m19.865516472s) [noise=true , address=145.79.227.20:4437 , piece_id=6BTVPMO5EYNPTLX5CJUQLETFI4W3WNVKLOUTOQZNOFCFMCEAC2FQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345011675 (317h6m19.86583542s) [noise=true , address=77.90.31.13:4626 , piece_id=ZAZIJR7MONOZTYDGRB45EJHI4AT4AO2HICUFTNEQ5M4NK5RJSEYA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345015542 (317h6m19.865839287s) [noise=true , address=145.79.227.4:4188 , piece_id=LSJSOJIL7GFMQRRVSYBSCYZ34MJK4K3M2XRBHTTXUAOPGRNKJTRA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345336104 (317h6m19.866159849s) [noise=true , address=145.79.227.45:4234 , piece_id=WQINO2KZFCOKCUR2LKD63QGYU4U7QXO7DZ5Y4K65ZIE6NGRHTHSA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345446635 (317h6m19.86627038s) [noise=true , address=145.79.227.2:4117 , piece_id=B7N34ENGOW346JAOQ4TP2R7UURBRRCNSI2VJK3CJDDDSF7ZUBVCA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345625066 (317h6m19.866448811s) [noise=true , address=45.91.116.4:4940 , piece_id=4FP6TLZHKHWVV5YYI44P7X4B23X3MBYP4HWDGAPN4P723FVO7FMA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345928595 (317h6m19.86675234s) [noise=true , address=145.79.227.12:4770 , piece_id=IML2LWFBEHA7QOC4H7WZYZ4PMEK5RSTHFPRGPGY7N2HLKIXGJWJQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.346196556 (317h6m19.867020301s) [noise=true , address=145.79.227.42:4124 , piece_id=T5F3Z57TZ5CRE2PAKUEF5BTQH2VENBAZIOUEVHR23HRO5RPBATZA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.346515965 (317h6m19.86733971s) [noise=true , address=77.90.31.21:4879 , piece_id=W3LN7Y3TQ6QZHFMFQ3I47EYX5O4EUEPGQE6VCTHCRB3QJCSVGCFQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.346596399 (317h6m19.867420134s) [noise=true , address=145.79.227.15:4878 , piece_id=GOZMXBY3FYWFDQ6X45JGBWHKJT36LFBUVS4XJIOQTVGBO3ZI2DWQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:11.479134008 (317h6m21.999957743s) [upload=303759]: Next returned nil segment May 13 23:54:11.479176098 (317h6m21.999999833s) [upload=303759]: Waiting for error group managing segments... May 13 23:54:11.875349259 (317h6m22.396173004s) [noise=true , address=45.91.116.5:4299 , piece_id=Z3I66FUKFYFVRK5QISCU3VO3WSQGADV7VI45HWPKKCC4Y7R5JJGQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:11.929014675 (317h6m22.44983842s) [noise=true , address=45.91.116.4:4940 , piece_id=4FP6TLZHKHWVV5YYI44P7X4B23X3MBYP4HWDGAPN4P723FVO7FMA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.522398786 (317h6m27.043222531s) [noise=true , address=77.90.31.11:4555 , piece_id=2TQNISXX4GF43FVAZBQLXIDV3VIQFQYWVNSWNRNBVF4RHXQGWB3A, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.677455972 (317h6m27.198279717s) [noise=true , address=145.79.227.12:4770 , piece_id=IML2LWFBEHA7QOC4H7WZYZ4PMEK5RSTHFPRGPGY7N2HLKIXGJWJQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.904600146 (317h6m27.425423891s) [noise=true , address=145.79.227.42:4124 , piece_id=T5F3Z57TZ5CRE2PAKUEF5BTQH2VENBAZIOUEVHR23HRO5RPBATZA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.962748155 (317h6m27.4835719s) [noise=true , address=145.79.227.13:4804 , piece_id=CK6FOK2W7YIUAE3YJ6XAY3NR6FIQZ7BYKTBEELIFHBASPV3IK6GA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:19.824741116 (317h6m30.345564861s) [noise=true , address=145.79.227.29:4941 , piece_id=I6NEQI2B72T2XC37GD5XX2UUUISF6K6ZMBQPNKY3WZ73ZEM7F7LA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:23.318972131 (317h6m33.839795876s) [noise=true , address=145.79.227.20:4437 , piece_id=6BTVPMO5EYNPTLX5CJUQLETFI4W3WNVKLOUTOQZNOFCFMCEAC2FQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:28.699626931 (317h6m39.220450676s) [noise=true , address=145.79.227.45:4234 , piece_id=WQINO2KZFCOKCUR2LKD63QGYU4U7QXO7DZ5Y4K65ZIE6NGRHTHSA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:30.580138066 (317h6m41.100961811s) [noise=true , address=145.79.227.4:4188 , piece_id=LSJSOJIL7GFMQRRVSYBSCYZ34MJK4K3M2XRBHTTXUAOPGRNKJTRA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:31.614065620 (317h6m42.134889355s) [noise=true , address=77.90.31.13:4626 , piece_id=ZAZIJR7MONOZTYDGRB45EJHI4AT4AO2HICUFTNEQ5M4NK5RJSEYA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:34.869340665 (317h6m45.39016441s) [noise=true , address=145.79.227.2:4117 , piece_id=B7N34ENGOW346JAOQ4TP2R7UURBRRCNSI2VJK3CJDDDSF7ZUBVCA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:35.539227446 (317h6m46.060051201s) [noise=true , address=77.90.31.21:4879 , piece_id=W3LN7Y3TQ6QZHFMFQ3I47EYX5O4EUEPGQE6VCTHCRB3QJCSVGCFQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:35.539249819 (317h6m46.060073574s) [seg_pos={0 0}, upload=303759]: Satisfied cohort requirements after 13 pieces May 13 23:54:35.539509113 (317h6m46.060332848s) [noise=true , address=145.79.227.48:4306 , piece_id=GOM6KEXBA3I6VU3NYSG3JBEFIO5YWGEWM6STZOLCQQONXBEFORKA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF May 13 23:54:35.539517068 (317h6m46.060340813s) [noise=true , address=145.79.227.48:4306 , piece_id=GOM6KEXBA3I6VU3NYSG3JBEFIO5YWGEWM6STZOLCQQONXBEFORKA, seg_pos={0 0}, upload=303759]: Long tail cancellation due to optimal threshold May 13 23:54:35.539532217 (317h6m46.060355962s) [noise=true , address=145.79.227.15:4878 , piece_id=GOZMXBY3FYWFDQ6X45JGBWHKJT36LFBUVS4XJIOQTVGBO3ZI2DWQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126ZeAKnpjpxa3MgCBU3KZKBDdn8MfZgiixE4zR5fZpPwaQj9NC): protocol: write tcp 188.166.225.170:52152->145.79.227.15:4878: use of closed network connection; write tcp 188.166.225.170:52152->145.79.227.15:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52152->145.79.227.15:4878: use of closed network connection May 13 23:54:35.539539841 (317h6m46.060363587s) [noise=true , address=145.79.227.15:4878 , piece_id=GOZMXBY3FYWFDQ6X45JGBWHKJT36LFBUVS4XJIOQTVGBO3ZI2DWQ, seg_pos={0 0}, upload=303759]: Long tail cancellation due to optimal threshold May 13 23:54:35.539679248 (317h6m46.060502993s) [noise=true , address=145.79.227.44:4197 , piece_id=YGQORIGW76DRF4XFAKRYP64242S7EM43ED73OLUQ2WMGLPWKRMXQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12niHLkT5pbmYSbarHZGeeCRtwjZRXtvEtHMGAb7ja4a7Xuuvfi): protocol: expected piece hash; context canceled; EOF May 13 23:54:35.539685650 (317h6m46.060509395s) [noise=true , address=145.79.227.44:4197 , piece_id=YGQORIGW76DRF4XFAKRYP64242S7EM43ED73OLUQ2WMGLPWKRMXQ, seg_pos={0 0}, upload=303759]: Long tail cancellation due to optimal threshold May 13 23:54:35.539760081 (317h6m46.060583826s) [seg_pos={0 0}, upload=303759]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 13 23:54:35.539831719 (317h6m46.060655464s) [upload=303759]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 13 23:54:35.539836608 (317h6m46.060660353s) [upload=303759]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 13 23:54:35.834703623 (317h6m46.355527358s) [upload=303759]: Done uploading segments... May 13 23:54:35.834721307 (317h6m46.355545042s) [upload=303759]: Upload finished. err: <nil> Duration: 5.779856673s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [X.X.XXX...XX.......X...................X.......X..X......X..] duration: 6.493698847s trace: https://jaeger.dev.storj.io/trace/75a4e7e075e00ee5 FAIL (2026-05-14 00:37:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.493720399s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 12 out of 60 is failed (threshold=6) [XXXXXXXXXXX....X............................................] duration: 3.859802333s trace: https://jaeger.dev.storj.io/trace/2786f877eb009a88 FAIL (2026-05-14 00:36:46 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.859825117s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [.X.X.XXX...XX.......X...................X.......X..X......X.] duration: 6.707513185s trace: https://jaeger.dev.storj.io/trace/75a4e7e075e00ee5 FAIL (2026-05-14 00:36:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.707528425s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 13 out of 60 is failed (threshold=3) [X.X.X.XXX...XX.......X...................X.......X..X......X] duration: 1m0.000521875s trace: https://jaeger.dev.storj.io/trace/75a4e7e075e00ee5 FAIL (2026-05-14 00:36:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.0005405s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.XXX........................................................] duration: 5.77255834s trace: https://jaeger.dev.storj.io/trace/1cb3ad1e3120325 FAIL (2026-05-14 00:36:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, Piece ID: W3LN7Y3TQ6QZHFMFQ3I47EYX5O4EUEPGQE6VCTHCRB3QJCSVGCFQ) context deadline exceeded; piecestore: (Node ID: 12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, Piece ID: ZAZIJR7MONOZTYDGRB45EJHI4AT4AO2HICUFTNEQ5M4NK5RJSEYA) context deadline exceeded ======LOGS====== May 13 23:54:09.101041394 (317h6m19.621865139s) [upload=303759]: Starting upload May 13 23:54:09.101150321 (317h6m19.621974066s) [upload=303759]: Done starting upload May 13 23:54:09.101523945 (317h6m19.62234769s) [upload=303759]: Uploading segments... May 13 23:54:09.101671446 (317h6m19.622495191s) [upload=303759]: Got next segment. Inline: false May 13 23:54:09.101764053 (317h6m19.622587788s) [upload=303759]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 13 23:54:09.101813186 (317h6m19.622636931s) [upload=303759]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 13 23:54:09.342652473 (317h6m19.863476219s) [seg_pos={0 0}, upload=303759]: Begin upload segment... May 13 23:54:09.342708981 (317h6m19.863532726s) [seg_pos={0 0}, upload=303759]: Done begin upload segment. May 13 23:54:09.342734078 (317h6m19.863557824s) [noise=true , address=145.79.227.44:4197 , piece_id=YGQORIGW76DRF4XFAKRYP64242S7EM43ED73OLUQ2WMGLPWKRMXQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.342806718 (317h6m19.863630463s) [noise=true , address=45.91.116.5:4299 , piece_id=Z3I66FUKFYFVRK5QISCU3VO3WSQGADV7VI45HWPKKCC4Y7R5JJGQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.343405821 (317h6m19.864229556s) [noise=true , address=145.79.227.29:4941 , piece_id=I6NEQI2B72T2XC37GD5XX2UUUISF6K6ZMBQPNKY3WZ73ZEM7F7LA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.343736492 (317h6m19.864560257s) [noise=true , address=77.90.31.11:4555 , piece_id=2TQNISXX4GF43FVAZBQLXIDV3VIQFQYWVNSWNRNBVF4RHXQGWB3A, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.344273326 (317h6m19.865097072s) [noise=true , address=145.79.227.48:4306 , piece_id=GOM6KEXBA3I6VU3NYSG3JBEFIO5YWGEWM6STZOLCQQONXBEFORKA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.344684090 (317h6m19.865507835s) [noise=true , address=145.79.227.13:4804 , piece_id=CK6FOK2W7YIUAE3YJ6XAY3NR6FIQZ7BYKTBEELIFHBASPV3IK6GA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.344692727 (317h6m19.865516472s) [noise=true , address=145.79.227.20:4437 , piece_id=6BTVPMO5EYNPTLX5CJUQLETFI4W3WNVKLOUTOQZNOFCFMCEAC2FQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345011675 (317h6m19.86583542s) [noise=true , address=77.90.31.13:4626 , piece_id=ZAZIJR7MONOZTYDGRB45EJHI4AT4AO2HICUFTNEQ5M4NK5RJSEYA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345015542 (317h6m19.865839287s) [noise=true , address=145.79.227.4:4188 , piece_id=LSJSOJIL7GFMQRRVSYBSCYZ34MJK4K3M2XRBHTTXUAOPGRNKJTRA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345336104 (317h6m19.866159849s) [noise=true , address=145.79.227.45:4234 , piece_id=WQINO2KZFCOKCUR2LKD63QGYU4U7QXO7DZ5Y4K65ZIE6NGRHTHSA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345446635 (317h6m19.86627038s) [noise=true , address=145.79.227.2:4117 , piece_id=B7N34ENGOW346JAOQ4TP2R7UURBRRCNSI2VJK3CJDDDSF7ZUBVCA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345625066 (317h6m19.866448811s) [noise=true , address=45.91.116.4:4940 , piece_id=4FP6TLZHKHWVV5YYI44P7X4B23X3MBYP4HWDGAPN4P723FVO7FMA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345928595 (317h6m19.86675234s) [noise=true , address=145.79.227.12:4770 , piece_id=IML2LWFBEHA7QOC4H7WZYZ4PMEK5RSTHFPRGPGY7N2HLKIXGJWJQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.346196556 (317h6m19.867020301s) [noise=true , address=145.79.227.42:4124 , piece_id=T5F3Z57TZ5CRE2PAKUEF5BTQH2VENBAZIOUEVHR23HRO5RPBATZA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.346515965 (317h6m19.86733971s) [noise=true , address=77.90.31.21:4879 , piece_id=W3LN7Y3TQ6QZHFMFQ3I47EYX5O4EUEPGQE6VCTHCRB3QJCSVGCFQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.346596399 (317h6m19.867420134s) [noise=true , address=145.79.227.15:4878 , piece_id=GOZMXBY3FYWFDQ6X45JGBWHKJT36LFBUVS4XJIOQTVGBO3ZI2DWQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:11.479134008 (317h6m21.999957743s) [upload=303759]: Next returned nil segment May 13 23:54:11.479176098 (317h6m21.999999833s) [upload=303759]: Waiting for error group managing segments... May 13 23:54:11.875349259 (317h6m22.396173004s) [noise=true , address=45.91.116.5:4299 , piece_id=Z3I66FUKFYFVRK5QISCU3VO3WSQGADV7VI45HWPKKCC4Y7R5JJGQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:11.929014675 (317h6m22.44983842s) [noise=true , address=45.91.116.4:4940 , piece_id=4FP6TLZHKHWVV5YYI44P7X4B23X3MBYP4HWDGAPN4P723FVO7FMA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.522398786 (317h6m27.043222531s) [noise=true , address=77.90.31.11:4555 , piece_id=2TQNISXX4GF43FVAZBQLXIDV3VIQFQYWVNSWNRNBVF4RHXQGWB3A, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.677455972 (317h6m27.198279717s) [noise=true , address=145.79.227.12:4770 , piece_id=IML2LWFBEHA7QOC4H7WZYZ4PMEK5RSTHFPRGPGY7N2HLKIXGJWJQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.904600146 (317h6m27.425423891s) [noise=true , address=145.79.227.42:4124 , piece_id=T5F3Z57TZ5CRE2PAKUEF5BTQH2VENBAZIOUEVHR23HRO5RPBATZA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.962748155 (317h6m27.4835719s) [noise=true , address=145.79.227.13:4804 , piece_id=CK6FOK2W7YIUAE3YJ6XAY3NR6FIQZ7BYKTBEELIFHBASPV3IK6GA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:19.824741116 (317h6m30.345564861s) [noise=true , address=145.79.227.29:4941 , piece_id=I6NEQI2B72T2XC37GD5XX2UUUISF6K6ZMBQPNKY3WZ73ZEM7F7LA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:23.318972131 (317h6m33.839795876s) [noise=true , address=145.79.227.20:4437 , piece_id=6BTVPMO5EYNPTLX5CJUQLETFI4W3WNVKLOUTOQZNOFCFMCEAC2FQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:28.699626931 (317h6m39.220450676s) [noise=true , address=145.79.227.45:4234 , piece_id=WQINO2KZFCOKCUR2LKD63QGYU4U7QXO7DZ5Y4K65ZIE6NGRHTHSA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:30.580138066 (317h6m41.100961811s) [noise=true , address=145.79.227.4:4188 , piece_id=LSJSOJIL7GFMQRRVSYBSCYZ34MJK4K3M2XRBHTTXUAOPGRNKJTRA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:31.614065620 (317h6m42.134889355s) [noise=true , address=77.90.31.13:4626 , piece_id=ZAZIJR7MONOZTYDGRB45EJHI4AT4AO2HICUFTNEQ5M4NK5RJSEYA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:34.869340665 (317h6m45.39016441s) [noise=true , address=145.79.227.2:4117 , piece_id=B7N34ENGOW346JAOQ4TP2R7UURBRRCNSI2VJK3CJDDDSF7ZUBVCA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:35.539227446 (317h6m46.060051201s) [noise=true , address=77.90.31.21:4879 , piece_id=W3LN7Y3TQ6QZHFMFQ3I47EYX5O4EUEPGQE6VCTHCRB3QJCSVGCFQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:35.539249819 (317h6m46.060073574s) [seg_pos={0 0}, upload=303759]: Satisfied cohort requirements after 13 pieces May 13 23:54:35.539509113 (317h6m46.060332848s) [noise=true , address=145.79.227.48:4306 , piece_id=GOM6KEXBA3I6VU3NYSG3JBEFIO5YWGEWM6STZOLCQQONXBEFORKA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF May 13 23:54:35.539517068 (317h6m46.060340813s) [noise=true , address=145.79.227.48:4306 , piece_id=GOM6KEXBA3I6VU3NYSG3JBEFIO5YWGEWM6STZOLCQQONXBEFORKA, seg_pos={0 0}, upload=303759]: Long tail cancellation due to optimal threshold May 13 23:54:35.539532217 (317h6m46.060355962s) [noise=true , address=145.79.227.15:4878 , piece_id=GOZMXBY3FYWFDQ6X45JGBWHKJT36LFBUVS4XJIOQTVGBO3ZI2DWQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126ZeAKnpjpxa3MgCBU3KZKBDdn8MfZgiixE4zR5fZpPwaQj9NC): protocol: write tcp 188.166.225.170:52152->145.79.227.15:4878: use of closed network connection; write tcp 188.166.225.170:52152->145.79.227.15:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52152->145.79.227.15:4878: use of closed network connection May 13 23:54:35.539539841 (317h6m46.060363587s) [noise=true , address=145.79.227.15:4878 , piece_id=GOZMXBY3FYWFDQ6X45JGBWHKJT36LFBUVS4XJIOQTVGBO3ZI2DWQ, seg_pos={0 0}, upload=303759]: Long tail cancellation due to optimal threshold May 13 23:54:35.539679248 (317h6m46.060502993s) [noise=true , address=145.79.227.44:4197 , piece_id=YGQORIGW76DRF4XFAKRYP64242S7EM43ED73OLUQ2WMGLPWKRMXQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12niHLkT5pbmYSbarHZGeeCRtwjZRXtvEtHMGAb7ja4a7Xuuvfi): protocol: expected piece hash; context canceled; EOF May 13 23:54:35.539685650 (317h6m46.060509395s) [noise=true , address=145.79.227.44:4197 , piece_id=YGQORIGW76DRF4XFAKRYP64242S7EM43ED73OLUQ2WMGLPWKRMXQ, seg_pos={0 0}, upload=303759]: Long tail cancellation due to optimal threshold May 13 23:54:35.539760081 (317h6m46.060583826s) [seg_pos={0 0}, upload=303759]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 13 23:54:35.539831719 (317h6m46.060655464s) [upload=303759]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 13 23:54:35.539836608 (317h6m46.060660353s) [upload=303759]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 13 23:54:35.834703623 (317h6m46.355527358s) [upload=303759]: Done uploading segments... May 13 23:54:35.834721307 (317h6m46.355545042s) [upload=303759]: Upload finished. err: <nil> Duration: 5.772580382s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [X.XXX.......................................................] duration: 6.60530895s trace: https://jaeger.dev.storj.io/trace/1cb3ad1e3120325 FAIL (2026-05-14 00:36:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, Piece ID: W3LN7Y3TQ6QZHFMFQ3I47EYX5O4EUEPGQE6VCTHCRB3QJCSVGCFQ) context deadline exceeded; piecestore: (Node ID: 12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, Piece ID: ZAZIJR7MONOZTYDGRB45EJHI4AT4AO2HICUFTNEQ5M4NK5RJSEYA) context deadline exceeded ======LOGS====== May 13 23:54:09.101041394 (317h6m19.621865139s) [upload=303759]: Starting upload May 13 23:54:09.101150321 (317h6m19.621974066s) [upload=303759]: Done starting upload May 13 23:54:09.101523945 (317h6m19.62234769s) [upload=303759]: Uploading segments... May 13 23:54:09.101671446 (317h6m19.622495191s) [upload=303759]: Got next segment. Inline: false May 13 23:54:09.101764053 (317h6m19.622587788s) [upload=303759]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 13 23:54:09.101813186 (317h6m19.622636931s) [upload=303759]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 13 23:54:09.342652473 (317h6m19.863476219s) [seg_pos={0 0}, upload=303759]: Begin upload segment... May 13 23:54:09.342708981 (317h6m19.863532726s) [seg_pos={0 0}, upload=303759]: Done begin upload segment. May 13 23:54:09.342734078 (317h6m19.863557824s) [noise=true , address=145.79.227.44:4197 , piece_id=YGQORIGW76DRF4XFAKRYP64242S7EM43ED73OLUQ2WMGLPWKRMXQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.342806718 (317h6m19.863630463s) [noise=true , address=45.91.116.5:4299 , piece_id=Z3I66FUKFYFVRK5QISCU3VO3WSQGADV7VI45HWPKKCC4Y7R5JJGQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.343405821 (317h6m19.864229556s) [noise=true , address=145.79.227.29:4941 , piece_id=I6NEQI2B72T2XC37GD5XX2UUUISF6K6ZMBQPNKY3WZ73ZEM7F7LA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.343736492 (317h6m19.864560257s) [noise=true , address=77.90.31.11:4555 , piece_id=2TQNISXX4GF43FVAZBQLXIDV3VIQFQYWVNSWNRNBVF4RHXQGWB3A, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.344273326 (317h6m19.865097072s) [noise=true , address=145.79.227.48:4306 , piece_id=GOM6KEXBA3I6VU3NYSG3JBEFIO5YWGEWM6STZOLCQQONXBEFORKA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.344684090 (317h6m19.865507835s) [noise=true , address=145.79.227.13:4804 , piece_id=CK6FOK2W7YIUAE3YJ6XAY3NR6FIQZ7BYKTBEELIFHBASPV3IK6GA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.344692727 (317h6m19.865516472s) [noise=true , address=145.79.227.20:4437 , piece_id=6BTVPMO5EYNPTLX5CJUQLETFI4W3WNVKLOUTOQZNOFCFMCEAC2FQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345011675 (317h6m19.86583542s) [noise=true , address=77.90.31.13:4626 , piece_id=ZAZIJR7MONOZTYDGRB45EJHI4AT4AO2HICUFTNEQ5M4NK5RJSEYA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345015542 (317h6m19.865839287s) [noise=true , address=145.79.227.4:4188 , piece_id=LSJSOJIL7GFMQRRVSYBSCYZ34MJK4K3M2XRBHTTXUAOPGRNKJTRA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345336104 (317h6m19.866159849s) [noise=true , address=145.79.227.45:4234 , piece_id=WQINO2KZFCOKCUR2LKD63QGYU4U7QXO7DZ5Y4K65ZIE6NGRHTHSA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345446635 (317h6m19.86627038s) [noise=true , address=145.79.227.2:4117 , piece_id=B7N34ENGOW346JAOQ4TP2R7UURBRRCNSI2VJK3CJDDDSF7ZUBVCA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345625066 (317h6m19.866448811s) [noise=true , address=45.91.116.4:4940 , piece_id=4FP6TLZHKHWVV5YYI44P7X4B23X3MBYP4HWDGAPN4P723FVO7FMA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345928595 (317h6m19.86675234s) [noise=true , address=145.79.227.12:4770 , piece_id=IML2LWFBEHA7QOC4H7WZYZ4PMEK5RSTHFPRGPGY7N2HLKIXGJWJQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.346196556 (317h6m19.867020301s) [noise=true , address=145.79.227.42:4124 , piece_id=T5F3Z57TZ5CRE2PAKUEF5BTQH2VENBAZIOUEVHR23HRO5RPBATZA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.346515965 (317h6m19.86733971s) [noise=true , address=77.90.31.21:4879 , piece_id=W3LN7Y3TQ6QZHFMFQ3I47EYX5O4EUEPGQE6VCTHCRB3QJCSVGCFQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.346596399 (317h6m19.867420134s) [noise=true , address=145.79.227.15:4878 , piece_id=GOZMXBY3FYWFDQ6X45JGBWHKJT36LFBUVS4XJIOQTVGBO3ZI2DWQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:11.479134008 (317h6m21.999957743s) [upload=303759]: Next returned nil segment May 13 23:54:11.479176098 (317h6m21.999999833s) [upload=303759]: Waiting for error group managing segments... May 13 23:54:11.875349259 (317h6m22.396173004s) [noise=true , address=45.91.116.5:4299 , piece_id=Z3I66FUKFYFVRK5QISCU3VO3WSQGADV7VI45HWPKKCC4Y7R5JJGQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:11.929014675 (317h6m22.44983842s) [noise=true , address=45.91.116.4:4940 , piece_id=4FP6TLZHKHWVV5YYI44P7X4B23X3MBYP4HWDGAPN4P723FVO7FMA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.522398786 (317h6m27.043222531s) [noise=true , address=77.90.31.11:4555 , piece_id=2TQNISXX4GF43FVAZBQLXIDV3VIQFQYWVNSWNRNBVF4RHXQGWB3A, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.677455972 (317h6m27.198279717s) [noise=true , address=145.79.227.12:4770 , piece_id=IML2LWFBEHA7QOC4H7WZYZ4PMEK5RSTHFPRGPGY7N2HLKIXGJWJQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.904600146 (317h6m27.425423891s) [noise=true , address=145.79.227.42:4124 , piece_id=T5F3Z57TZ5CRE2PAKUEF5BTQH2VENBAZIOUEVHR23HRO5RPBATZA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.962748155 (317h6m27.4835719s) [noise=true , address=145.79.227.13:4804 , piece_id=CK6FOK2W7YIUAE3YJ6XAY3NR6FIQZ7BYKTBEELIFHBASPV3IK6GA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:19.824741116 (317h6m30.345564861s) [noise=true , address=145.79.227.29:4941 , piece_id=I6NEQI2B72T2XC37GD5XX2UUUISF6K6ZMBQPNKY3WZ73ZEM7F7LA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:23.318972131 (317h6m33.839795876s) [noise=true , address=145.79.227.20:4437 , piece_id=6BTVPMO5EYNPTLX5CJUQLETFI4W3WNVKLOUTOQZNOFCFMCEAC2FQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:28.699626931 (317h6m39.220450676s) [noise=true , address=145.79.227.45:4234 , piece_id=WQINO2KZFCOKCUR2LKD63QGYU4U7QXO7DZ5Y4K65ZIE6NGRHTHSA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:30.580138066 (317h6m41.100961811s) [noise=true , address=145.79.227.4:4188 , piece_id=LSJSOJIL7GFMQRRVSYBSCYZ34MJK4K3M2XRBHTTXUAOPGRNKJTRA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:31.614065620 (317h6m42.134889355s) [noise=true , address=77.90.31.13:4626 , piece_id=ZAZIJR7MONOZTYDGRB45EJHI4AT4AO2HICUFTNEQ5M4NK5RJSEYA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:34.869340665 (317h6m45.39016441s) [noise=true , address=145.79.227.2:4117 , piece_id=B7N34ENGOW346JAOQ4TP2R7UURBRRCNSI2VJK3CJDDDSF7ZUBVCA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:35.539227446 (317h6m46.060051201s) [noise=true , address=77.90.31.21:4879 , piece_id=W3LN7Y3TQ6QZHFMFQ3I47EYX5O4EUEPGQE6VCTHCRB3QJCSVGCFQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:35.539249819 (317h6m46.060073574s) [seg_pos={0 0}, upload=303759]: Satisfied cohort requirements after 13 pieces May 13 23:54:35.539509113 (317h6m46.060332848s) [noise=true , address=145.79.227.48:4306 , piece_id=GOM6KEXBA3I6VU3NYSG3JBEFIO5YWGEWM6STZOLCQQONXBEFORKA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF May 13 23:54:35.539517068 (317h6m46.060340813s) [noise=true , address=145.79.227.48:4306 , piece_id=GOM6KEXBA3I6VU3NYSG3JBEFIO5YWGEWM6STZOLCQQONXBEFORKA, seg_pos={0 0}, upload=303759]: Long tail cancellation due to optimal threshold May 13 23:54:35.539532217 (317h6m46.060355962s) [noise=true , address=145.79.227.15:4878 , piece_id=GOZMXBY3FYWFDQ6X45JGBWHKJT36LFBUVS4XJIOQTVGBO3ZI2DWQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126ZeAKnpjpxa3MgCBU3KZKBDdn8MfZgiixE4zR5fZpPwaQj9NC): protocol: write tcp 188.166.225.170:52152->145.79.227.15:4878: use of closed network connection; write tcp 188.166.225.170:52152->145.79.227.15:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52152->145.79.227.15:4878: use of closed network connection May 13 23:54:35.539539841 (317h6m46.060363587s) [noise=true , address=145.79.227.15:4878 , piece_id=GOZMXBY3FYWFDQ6X45JGBWHKJT36LFBUVS4XJIOQTVGBO3ZI2DWQ, seg_pos={0 0}, upload=303759]: Long tail cancellation due to optimal threshold May 13 23:54:35.539679248 (317h6m46.060502993s) [noise=true , address=145.79.227.44:4197 , piece_id=YGQORIGW76DRF4XFAKRYP64242S7EM43ED73OLUQ2WMGLPWKRMXQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12niHLkT5pbmYSbarHZGeeCRtwjZRXtvEtHMGAb7ja4a7Xuuvfi): protocol: expected piece hash; context canceled; EOF May 13 23:54:35.539685650 (317h6m46.060509395s) [noise=true , address=145.79.227.44:4197 , piece_id=YGQORIGW76DRF4XFAKRYP64242S7EM43ED73OLUQ2WMGLPWKRMXQ, seg_pos={0 0}, upload=303759]: Long tail cancellation due to optimal threshold May 13 23:54:35.539760081 (317h6m46.060583826s) [seg_pos={0 0}, upload=303759]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 13 23:54:35.539831719 (317h6m46.060655464s) [upload=303759]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 13 23:54:35.539836608 (317h6m46.060660353s) [upload=303759]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 13 23:54:35.834703623 (317h6m46.355527358s) [upload=303759]: Done uploading segments... May 13 23:54:35.834721307 (317h6m46.355545042s) [upload=303759]: Upload finished. err: <nil> Duration: 6.605337636s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 13 out of 60 is failed (threshold=6) [XXXXXXXXXXXX....X...........................................] duration: 3.720765787s trace: https://jaeger.dev.storj.io/trace/2786f877eb009a88 FAIL (2026-05-14 00:35:40 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.720794454s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [XX.XXX......................................................] duration: 6.394233349s trace: https://jaeger.dev.storj.io/trace/1cb3ad1e3120325 FAIL (2026-05-14 00:35:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, Piece ID: W3LN7Y3TQ6QZHFMFQ3I47EYX5O4EUEPGQE6VCTHCRB3QJCSVGCFQ) context deadline exceeded; piecestore: (Node ID: 12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, Piece ID: ZAZIJR7MONOZTYDGRB45EJHI4AT4AO2HICUFTNEQ5M4NK5RJSEYA) context deadline exceeded ======LOGS====== May 13 23:54:09.101041394 (317h6m19.621865139s) [upload=303759]: Starting upload May 13 23:54:09.101150321 (317h6m19.621974066s) [upload=303759]: Done starting upload May 13 23:54:09.101523945 (317h6m19.62234769s) [upload=303759]: Uploading segments... May 13 23:54:09.101671446 (317h6m19.622495191s) [upload=303759]: Got next segment. Inline: false May 13 23:54:09.101764053 (317h6m19.622587788s) [upload=303759]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 13 23:54:09.101813186 (317h6m19.622636931s) [upload=303759]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 13 23:54:09.342652473 (317h6m19.863476219s) [seg_pos={0 0}, upload=303759]: Begin upload segment... May 13 23:54:09.342708981 (317h6m19.863532726s) [seg_pos={0 0}, upload=303759]: Done begin upload segment. May 13 23:54:09.342734078 (317h6m19.863557824s) [noise=true , address=145.79.227.44:4197 , piece_id=YGQORIGW76DRF4XFAKRYP64242S7EM43ED73OLUQ2WMGLPWKRMXQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.342806718 (317h6m19.863630463s) [noise=true , address=45.91.116.5:4299 , piece_id=Z3I66FUKFYFVRK5QISCU3VO3WSQGADV7VI45HWPKKCC4Y7R5JJGQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.343405821 (317h6m19.864229556s) [noise=true , address=145.79.227.29:4941 , piece_id=I6NEQI2B72T2XC37GD5XX2UUUISF6K6ZMBQPNKY3WZ73ZEM7F7LA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.343736492 (317h6m19.864560257s) [noise=true , address=77.90.31.11:4555 , piece_id=2TQNISXX4GF43FVAZBQLXIDV3VIQFQYWVNSWNRNBVF4RHXQGWB3A, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.344273326 (317h6m19.865097072s) [noise=true , address=145.79.227.48:4306 , piece_id=GOM6KEXBA3I6VU3NYSG3JBEFIO5YWGEWM6STZOLCQQONXBEFORKA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.344684090 (317h6m19.865507835s) [noise=true , address=145.79.227.13:4804 , piece_id=CK6FOK2W7YIUAE3YJ6XAY3NR6FIQZ7BYKTBEELIFHBASPV3IK6GA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.344692727 (317h6m19.865516472s) [noise=true , address=145.79.227.20:4437 , piece_id=6BTVPMO5EYNPTLX5CJUQLETFI4W3WNVKLOUTOQZNOFCFMCEAC2FQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345011675 (317h6m19.86583542s) [noise=true , address=77.90.31.13:4626 , piece_id=ZAZIJR7MONOZTYDGRB45EJHI4AT4AO2HICUFTNEQ5M4NK5RJSEYA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345015542 (317h6m19.865839287s) [noise=true , address=145.79.227.4:4188 , piece_id=LSJSOJIL7GFMQRRVSYBSCYZ34MJK4K3M2XRBHTTXUAOPGRNKJTRA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345336104 (317h6m19.866159849s) [noise=true , address=145.79.227.45:4234 , piece_id=WQINO2KZFCOKCUR2LKD63QGYU4U7QXO7DZ5Y4K65ZIE6NGRHTHSA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345446635 (317h6m19.86627038s) [noise=true , address=145.79.227.2:4117 , piece_id=B7N34ENGOW346JAOQ4TP2R7UURBRRCNSI2VJK3CJDDDSF7ZUBVCA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345625066 (317h6m19.866448811s) [noise=true , address=45.91.116.4:4940 , piece_id=4FP6TLZHKHWVV5YYI44P7X4B23X3MBYP4HWDGAPN4P723FVO7FMA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345928595 (317h6m19.86675234s) [noise=true , address=145.79.227.12:4770 , piece_id=IML2LWFBEHA7QOC4H7WZYZ4PMEK5RSTHFPRGPGY7N2HLKIXGJWJQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.346196556 (317h6m19.867020301s) [noise=true , address=145.79.227.42:4124 , piece_id=T5F3Z57TZ5CRE2PAKUEF5BTQH2VENBAZIOUEVHR23HRO5RPBATZA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.346515965 (317h6m19.86733971s) [noise=true , address=77.90.31.21:4879 , piece_id=W3LN7Y3TQ6QZHFMFQ3I47EYX5O4EUEPGQE6VCTHCRB3QJCSVGCFQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.346596399 (317h6m19.867420134s) [noise=true , address=145.79.227.15:4878 , piece_id=GOZMXBY3FYWFDQ6X45JGBWHKJT36LFBUVS4XJIOQTVGBO3ZI2DWQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:11.479134008 (317h6m21.999957743s) [upload=303759]: Next returned nil segment May 13 23:54:11.479176098 (317h6m21.999999833s) [upload=303759]: Waiting for error group managing segments... May 13 23:54:11.875349259 (317h6m22.396173004s) [noise=true , address=45.91.116.5:4299 , piece_id=Z3I66FUKFYFVRK5QISCU3VO3WSQGADV7VI45HWPKKCC4Y7R5JJGQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:11.929014675 (317h6m22.44983842s) [noise=true , address=45.91.116.4:4940 , piece_id=4FP6TLZHKHWVV5YYI44P7X4B23X3MBYP4HWDGAPN4P723FVO7FMA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.522398786 (317h6m27.043222531s) [noise=true , address=77.90.31.11:4555 , piece_id=2TQNISXX4GF43FVAZBQLXIDV3VIQFQYWVNSWNRNBVF4RHXQGWB3A, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.677455972 (317h6m27.198279717s) [noise=true , address=145.79.227.12:4770 , piece_id=IML2LWFBEHA7QOC4H7WZYZ4PMEK5RSTHFPRGPGY7N2HLKIXGJWJQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.904600146 (317h6m27.425423891s) [noise=true , address=145.79.227.42:4124 , piece_id=T5F3Z57TZ5CRE2PAKUEF5BTQH2VENBAZIOUEVHR23HRO5RPBATZA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.962748155 (317h6m27.4835719s) [noise=true , address=145.79.227.13:4804 , piece_id=CK6FOK2W7YIUAE3YJ6XAY3NR6FIQZ7BYKTBEELIFHBASPV3IK6GA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:19.824741116 (317h6m30.345564861s) [noise=true , address=145.79.227.29:4941 , piece_id=I6NEQI2B72T2XC37GD5XX2UUUISF6K6ZMBQPNKY3WZ73ZEM7F7LA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:23.318972131 (317h6m33.839795876s) [noise=true , address=145.79.227.20:4437 , piece_id=6BTVPMO5EYNPTLX5CJUQLETFI4W3WNVKLOUTOQZNOFCFMCEAC2FQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:28.699626931 (317h6m39.220450676s) [noise=true , address=145.79.227.45:4234 , piece_id=WQINO2KZFCOKCUR2LKD63QGYU4U7QXO7DZ5Y4K65ZIE6NGRHTHSA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:30.580138066 (317h6m41.100961811s) [noise=true , address=145.79.227.4:4188 , piece_id=LSJSOJIL7GFMQRRVSYBSCYZ34MJK4K3M2XRBHTTXUAOPGRNKJTRA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:31.614065620 (317h6m42.134889355s) [noise=true , address=77.90.31.13:4626 , piece_id=ZAZIJR7MONOZTYDGRB45EJHI4AT4AO2HICUFTNEQ5M4NK5RJSEYA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:34.869340665 (317h6m45.39016441s) [noise=true , address=145.79.227.2:4117 , piece_id=B7N34ENGOW346JAOQ4TP2R7UURBRRCNSI2VJK3CJDDDSF7ZUBVCA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:35.539227446 (317h6m46.060051201s) [noise=true , address=77.90.31.21:4879 , piece_id=W3LN7Y3TQ6QZHFMFQ3I47EYX5O4EUEPGQE6VCTHCRB3QJCSVGCFQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:35.539249819 (317h6m46.060073574s) [seg_pos={0 0}, upload=303759]: Satisfied cohort requirements after 13 pieces May 13 23:54:35.539509113 (317h6m46.060332848s) [noise=true , address=145.79.227.48:4306 , piece_id=GOM6KEXBA3I6VU3NYSG3JBEFIO5YWGEWM6STZOLCQQONXBEFORKA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF May 13 23:54:35.539517068 (317h6m46.060340813s) [noise=true , address=145.79.227.48:4306 , piece_id=GOM6KEXBA3I6VU3NYSG3JBEFIO5YWGEWM6STZOLCQQONXBEFORKA, seg_pos={0 0}, upload=303759]: Long tail cancellation due to optimal threshold May 13 23:54:35.539532217 (317h6m46.060355962s) [noise=true , address=145.79.227.15:4878 , piece_id=GOZMXBY3FYWFDQ6X45JGBWHKJT36LFBUVS4XJIOQTVGBO3ZI2DWQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126ZeAKnpjpxa3MgCBU3KZKBDdn8MfZgiixE4zR5fZpPwaQj9NC): protocol: write tcp 188.166.225.170:52152->145.79.227.15:4878: use of closed network connection; write tcp 188.166.225.170:52152->145.79.227.15:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52152->145.79.227.15:4878: use of closed network connection May 13 23:54:35.539539841 (317h6m46.060363587s) [noise=true , address=145.79.227.15:4878 , piece_id=GOZMXBY3FYWFDQ6X45JGBWHKJT36LFBUVS4XJIOQTVGBO3ZI2DWQ, seg_pos={0 0}, upload=303759]: Long tail cancellation due to optimal threshold May 13 23:54:35.539679248 (317h6m46.060502993s) [noise=true , address=145.79.227.44:4197 , piece_id=YGQORIGW76DRF4XFAKRYP64242S7EM43ED73OLUQ2WMGLPWKRMXQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12niHLkT5pbmYSbarHZGeeCRtwjZRXtvEtHMGAb7ja4a7Xuuvfi): protocol: expected piece hash; context canceled; EOF May 13 23:54:35.539685650 (317h6m46.060509395s) [noise=true , address=145.79.227.44:4197 , piece_id=YGQORIGW76DRF4XFAKRYP64242S7EM43ED73OLUQ2WMGLPWKRMXQ, seg_pos={0 0}, upload=303759]: Long tail cancellation due to optimal threshold May 13 23:54:35.539760081 (317h6m46.060583826s) [seg_pos={0 0}, upload=303759]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 13 23:54:35.539831719 (317h6m46.060655464s) [upload=303759]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 13 23:54:35.539836608 (317h6m46.060660353s) [upload=303759]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 13 23:54:35.834703623 (317h6m46.355527358s) [upload=303759]: Done uploading segments... May 13 23:54:35.834721307 (317h6m46.355545042s) [upload=303759]: Upload finished. err: <nil> Duration: 6.394256773s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 13 out of 60 is failed (threshold=3) [XX.X.X.XXX...XX.......X...................X.......X..X......] duration: 6.728044145s trace: https://jaeger.dev.storj.io/trace/667ea420927a5c4e FAIL (2026-05-14 00:35:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.728070164s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [XXX.XXX.....................................................] duration: 6.316143979s trace: https://jaeger.dev.storj.io/trace/1cb3ad1e3120325 FAIL (2026-05-14 00:34:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, Piece ID: W3LN7Y3TQ6QZHFMFQ3I47EYX5O4EUEPGQE6VCTHCRB3QJCSVGCFQ) context deadline exceeded; piecestore: (Node ID: 12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, Piece ID: ZAZIJR7MONOZTYDGRB45EJHI4AT4AO2HICUFTNEQ5M4NK5RJSEYA) context deadline exceeded ======LOGS====== May 13 23:54:09.101041394 (317h6m19.621865139s) [upload=303759]: Starting upload May 13 23:54:09.101150321 (317h6m19.621974066s) [upload=303759]: Done starting upload May 13 23:54:09.101523945 (317h6m19.62234769s) [upload=303759]: Uploading segments... May 13 23:54:09.101671446 (317h6m19.622495191s) [upload=303759]: Got next segment. Inline: false May 13 23:54:09.101764053 (317h6m19.622587788s) [upload=303759]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 13 23:54:09.101813186 (317h6m19.622636931s) [upload=303759]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 13 23:54:09.342652473 (317h6m19.863476219s) [seg_pos={0 0}, upload=303759]: Begin upload segment... May 13 23:54:09.342708981 (317h6m19.863532726s) [seg_pos={0 0}, upload=303759]: Done begin upload segment. May 13 23:54:09.342734078 (317h6m19.863557824s) [noise=true , address=145.79.227.44:4197 , piece_id=YGQORIGW76DRF4XFAKRYP64242S7EM43ED73OLUQ2WMGLPWKRMXQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.342806718 (317h6m19.863630463s) [noise=true , address=45.91.116.5:4299 , piece_id=Z3I66FUKFYFVRK5QISCU3VO3WSQGADV7VI45HWPKKCC4Y7R5JJGQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.343405821 (317h6m19.864229556s) [noise=true , address=145.79.227.29:4941 , piece_id=I6NEQI2B72T2XC37GD5XX2UUUISF6K6ZMBQPNKY3WZ73ZEM7F7LA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.343736492 (317h6m19.864560257s) [noise=true , address=77.90.31.11:4555 , piece_id=2TQNISXX4GF43FVAZBQLXIDV3VIQFQYWVNSWNRNBVF4RHXQGWB3A, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.344273326 (317h6m19.865097072s) [noise=true , address=145.79.227.48:4306 , piece_id=GOM6KEXBA3I6VU3NYSG3JBEFIO5YWGEWM6STZOLCQQONXBEFORKA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.344684090 (317h6m19.865507835s) [noise=true , address=145.79.227.13:4804 , piece_id=CK6FOK2W7YIUAE3YJ6XAY3NR6FIQZ7BYKTBEELIFHBASPV3IK6GA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.344692727 (317h6m19.865516472s) [noise=true , address=145.79.227.20:4437 , piece_id=6BTVPMO5EYNPTLX5CJUQLETFI4W3WNVKLOUTOQZNOFCFMCEAC2FQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345011675 (317h6m19.86583542s) [noise=true , address=77.90.31.13:4626 , piece_id=ZAZIJR7MONOZTYDGRB45EJHI4AT4AO2HICUFTNEQ5M4NK5RJSEYA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345015542 (317h6m19.865839287s) [noise=true , address=145.79.227.4:4188 , piece_id=LSJSOJIL7GFMQRRVSYBSCYZ34MJK4K3M2XRBHTTXUAOPGRNKJTRA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345336104 (317h6m19.866159849s) [noise=true , address=145.79.227.45:4234 , piece_id=WQINO2KZFCOKCUR2LKD63QGYU4U7QXO7DZ5Y4K65ZIE6NGRHTHSA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345446635 (317h6m19.86627038s) [noise=true , address=145.79.227.2:4117 , piece_id=B7N34ENGOW346JAOQ4TP2R7UURBRRCNSI2VJK3CJDDDSF7ZUBVCA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345625066 (317h6m19.866448811s) [noise=true , address=45.91.116.4:4940 , piece_id=4FP6TLZHKHWVV5YYI44P7X4B23X3MBYP4HWDGAPN4P723FVO7FMA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.345928595 (317h6m19.86675234s) [noise=true , address=145.79.227.12:4770 , piece_id=IML2LWFBEHA7QOC4H7WZYZ4PMEK5RSTHFPRGPGY7N2HLKIXGJWJQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.346196556 (317h6m19.867020301s) [noise=true , address=145.79.227.42:4124 , piece_id=T5F3Z57TZ5CRE2PAKUEF5BTQH2VENBAZIOUEVHR23HRO5RPBATZA, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.346515965 (317h6m19.86733971s) [noise=true , address=77.90.31.21:4879 , piece_id=W3LN7Y3TQ6QZHFMFQ3I47EYX5O4EUEPGQE6VCTHCRB3QJCSVGCFQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:09.346596399 (317h6m19.867420134s) [noise=true , address=145.79.227.15:4878 , piece_id=GOZMXBY3FYWFDQ6X45JGBWHKJT36LFBUVS4XJIOQTVGBO3ZI2DWQ, seg_pos={0 0}, upload=303759]: Uploading piece... May 13 23:54:11.479134008 (317h6m21.999957743s) [upload=303759]: Next returned nil segment May 13 23:54:11.479176098 (317h6m21.999999833s) [upload=303759]: Waiting for error group managing segments... May 13 23:54:11.875349259 (317h6m22.396173004s) [noise=true , address=45.91.116.5:4299 , piece_id=Z3I66FUKFYFVRK5QISCU3VO3WSQGADV7VI45HWPKKCC4Y7R5JJGQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:11.929014675 (317h6m22.44983842s) [noise=true , address=45.91.116.4:4940 , piece_id=4FP6TLZHKHWVV5YYI44P7X4B23X3MBYP4HWDGAPN4P723FVO7FMA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.522398786 (317h6m27.043222531s) [noise=true , address=77.90.31.11:4555 , piece_id=2TQNISXX4GF43FVAZBQLXIDV3VIQFQYWVNSWNRNBVF4RHXQGWB3A, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.677455972 (317h6m27.198279717s) [noise=true , address=145.79.227.12:4770 , piece_id=IML2LWFBEHA7QOC4H7WZYZ4PMEK5RSTHFPRGPGY7N2HLKIXGJWJQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.904600146 (317h6m27.425423891s) [noise=true , address=145.79.227.42:4124 , piece_id=T5F3Z57TZ5CRE2PAKUEF5BTQH2VENBAZIOUEVHR23HRO5RPBATZA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:16.962748155 (317h6m27.4835719s) [noise=true , address=145.79.227.13:4804 , piece_id=CK6FOK2W7YIUAE3YJ6XAY3NR6FIQZ7BYKTBEELIFHBASPV3IK6GA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:19.824741116 (317h6m30.345564861s) [noise=true , address=145.79.227.29:4941 , piece_id=I6NEQI2B72T2XC37GD5XX2UUUISF6K6ZMBQPNKY3WZ73ZEM7F7LA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:23.318972131 (317h6m33.839795876s) [noise=true , address=145.79.227.20:4437 , piece_id=6BTVPMO5EYNPTLX5CJUQLETFI4W3WNVKLOUTOQZNOFCFMCEAC2FQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:28.699626931 (317h6m39.220450676s) [noise=true , address=145.79.227.45:4234 , piece_id=WQINO2KZFCOKCUR2LKD63QGYU4U7QXO7DZ5Y4K65ZIE6NGRHTHSA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:30.580138066 (317h6m41.100961811s) [noise=true , address=145.79.227.4:4188 , piece_id=LSJSOJIL7GFMQRRVSYBSCYZ34MJK4K3M2XRBHTTXUAOPGRNKJTRA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:31.614065620 (317h6m42.134889355s) [noise=true , address=77.90.31.13:4626 , piece_id=ZAZIJR7MONOZTYDGRB45EJHI4AT4AO2HICUFTNEQ5M4NK5RJSEYA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:34.869340665 (317h6m45.39016441s) [noise=true , address=145.79.227.2:4117 , piece_id=B7N34ENGOW346JAOQ4TP2R7UURBRRCNSI2VJK3CJDDDSF7ZUBVCA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:35.539227446 (317h6m46.060051201s) [noise=true , address=77.90.31.21:4879 , piece_id=W3LN7Y3TQ6QZHFMFQ3I47EYX5O4EUEPGQE6VCTHCRB3QJCSVGCFQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: <nil> May 13 23:54:35.539249819 (317h6m46.060073574s) [seg_pos={0 0}, upload=303759]: Satisfied cohort requirements after 13 pieces May 13 23:54:35.539509113 (317h6m46.060332848s) [noise=true , address=145.79.227.48:4306 , piece_id=GOM6KEXBA3I6VU3NYSG3JBEFIO5YWGEWM6STZOLCQQONXBEFORKA, seg_pos={0 0}, upload=303759]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF May 13 23:54:35.539517068 (317h6m46.060340813s) [noise=true , address=145.79.227.48:4306 , piece_id=GOM6KEXBA3I6VU3NYSG3JBEFIO5YWGEWM6STZOLCQQONXBEFORKA, seg_pos={0 0}, upload=303759]: Long tail cancellation due to optimal threshold May 13 23:54:35.539532217 (317h6m46.060355962s) [noise=true , address=145.79.227.15:4878 , piece_id=GOZMXBY3FYWFDQ6X45JGBWHKJT36LFBUVS4XJIOQTVGBO3ZI2DWQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126ZeAKnpjpxa3MgCBU3KZKBDdn8MfZgiixE4zR5fZpPwaQj9NC): protocol: write tcp 188.166.225.170:52152->145.79.227.15:4878: use of closed network connection; write tcp 188.166.225.170:52152->145.79.227.15:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52152->145.79.227.15:4878: use of closed network connection May 13 23:54:35.539539841 (317h6m46.060363587s) [noise=true , address=145.79.227.15:4878 , piece_id=GOZMXBY3FYWFDQ6X45JGBWHKJT36LFBUVS4XJIOQTVGBO3ZI2DWQ, seg_pos={0 0}, upload=303759]: Long tail cancellation due to optimal threshold May 13 23:54:35.539679248 (317h6m46.060502993s) [noise=true , address=145.79.227.44:4197 , piece_id=YGQORIGW76DRF4XFAKRYP64242S7EM43ED73OLUQ2WMGLPWKRMXQ, seg_pos={0 0}, upload=303759]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12niHLkT5pbmYSbarHZGeeCRtwjZRXtvEtHMGAb7ja4a7Xuuvfi): protocol: expected piece hash; context canceled; EOF May 13 23:54:35.539685650 (317h6m46.060509395s) [noise=true , address=145.79.227.44:4197 , piece_id=YGQORIGW76DRF4XFAKRYP64242S7EM43ED73OLUQ2WMGLPWKRMXQ, seg_pos={0 0}, upload=303759]: Long tail cancellation due to optimal threshold May 13 23:54:35.539760081 (317h6m46.060583826s) [seg_pos={0 0}, upload=303759]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 13 23:54:35.539831719 (317h6m46.060655464s) [upload=303759]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 13 23:54:35.539836608 (317h6m46.060660353s) [upload=303759]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 13 23:54:35.834703623 (317h6m46.355527358s) [upload=303759]: Done uploading segments... May 13 23:54:35.834721307 (317h6m46.355545042s) [upload=303759]: Upload finished. err: <nil> Duration: 6.316171041s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 14 out of 60 is failed (threshold=6) [XXXXXXXXXXXXX....X..........................................] duration: 3.73511275s trace: https://jaeger.dev.storj.io/trace/2786f877eb009a88 FAIL (2026-05-14 00:34:46 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.735132567s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 14 out of 60 is failed (threshold=3) [XXX.X.X.XXX...XX.......X...................X.......X..X.....] duration: 6.505861396s trace: https://jaeger.dev.storj.io/trace/667ea420927a5c4e FAIL (2026-05-14 00:34:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.505888017s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 15 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXX....X.........................................] duration: 3.717207995s trace: https://jaeger.dev.storj.io/trace/2786f877eb009a88 FAIL (2026-05-14 00:34:14 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.717230438s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)