Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 518812 reports (Page 5354 of 10377)
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [X........X..X.....X..XX...X......X....X.X...................]
duration:
3.545600947s
trace:
https://jaeger.dev.storj.io/trace/6a0e3c716501503f
FAIL (2025-11-16 14:47:18 UTC)
orbiter warning: context deadline exceeded
Duration: 3.545626236s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [.X........X..X.....X..XX...X......X....X.X..................]
duration:
3.459938428s
trace:
https://jaeger.dev.storj.io/trace/6a0e3c716501503f
FAIL (2025-11-16 14:46:54 UTC)
orbiter warning: context deadline exceeded
Duration: 3.459965179s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
6.485220104s
trace:
https://jaeger.dev.storj.io/trace/5abd325dfee3c7f8
FAIL (2025-11-16 14:46:29 UTC)
orbiter warning: context deadline exceeded
Duration: 6.485245054s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [..X........X..X.....X..XX...X......X....X.X.................]
duration:
3.527311812s
trace:
https://jaeger.dev.storj.io/trace/6a0e3c716501503f
FAIL (2025-11-16 14:46:29 UTC)
orbiter warning: context deadline exceeded
Duration: 3.527334796s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
9.237604185s
trace:
https://jaeger.dev.storj.io/trace/5abd325dfee3c7f8
FAIL (2025-11-16 14:46:10 UTC)
orbiter warning: context deadline exceeded
Duration: 9.237634573s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [...X........X..X.....X..XX...X......X....X.X................]
duration:
3.934241055s
trace:
https://jaeger.dev.storj.io/trace/6a0e3c716501503f
FAIL (2025-11-16 14:46:07 UTC)
orbiter warning: context deadline exceeded
Duration: 3.934270411s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [....X........X..X.....X..XX...X......X....X.X...............]
duration:
3.49986513s
trace:
https://jaeger.dev.storj.io/trace/6a0e3c716501503f
FAIL (2025-11-16 14:45:11 UTC)
orbiter warning: context deadline exceeded
Duration: 3.499891823s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
7.155267875s
trace:
https://jaeger.dev.storj.io/trace/5abd325dfee3c7f8
FAIL (2025-11-16 14:45:06 UTC)
orbiter warning: context deadline exceeded
Duration: 7.155299865s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [.....X........X..X.....X..XX...X......X....X.X..............]
duration:
3.57695319s
trace:
https://jaeger.dev.storj.io/trace/6a0e3c716501503f
FAIL (2025-11-16 14:44:19 UTC)
orbiter warning: context deadline exceeded
Duration: 3.576968579s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
6.636965291s
trace:
https://jaeger.dev.storj.io/trace/5abd325dfee3c7f8
FAIL (2025-11-16 14:43:53 UTC)
orbiter warning: context deadline exceeded
Duration: 6.637045094s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [......X........X..X.....X..XX...X......X....X.X.............]
duration:
3.511714864s
trace:
https://jaeger.dev.storj.io/trace/6a0e3c716501503f
FAIL (2025-11-16 14:43:51 UTC)
orbiter warning: context deadline exceeded
Duration: 3.511749359s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [.......X........X..X.....X..XX...X......X....X.X............]
duration:
3.471585715s
trace:
https://jaeger.dev.storj.io/trace/6a0e3c716501503f
FAIL (2025-11-16 14:43:08 UTC)
orbiter warning: context deadline exceeded
Duration: 3.471619789s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
11.934300038s
trace:
https://jaeger.dev.storj.io/trace/5abd325dfee3c7f8
FAIL (2025-11-16 14:42:44 UTC)
orbiter warning: context deadline exceeded
Duration: 11.934375702s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [........X........X..X.....X..XX...X......X....X.X...........]
duration:
3.562865991s
trace:
https://jaeger.dev.storj.io/trace/6a0e3c716501503f
FAIL (2025-11-16 14:42:43 UTC)
orbiter warning: context deadline exceeded
Duration: 3.562971132s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
12.476802114s
trace:
https://jaeger.dev.storj.io/trace/5abd325dfee3c7f8
FAIL (2025-11-16 14:42:29 UTC)
orbiter warning: context deadline exceeded
Duration: 12.476835797s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [.........X........X..X.....X..XX...X......X....X.X..........]
duration:
3.589750147s
trace:
https://jaeger.dev.storj.io/trace/6a0e3c716501503f
FAIL (2025-11-16 14:42:11 UTC)
orbiter warning: context deadline exceeded
Duration: 3.589782288s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
12.441765448s
trace:
https://jaeger.dev.storj.io/trace/5abd325dfee3c7f8
FAIL (2025-11-16 14:41:43 UTC)
orbiter warning: context deadline exceeded
Duration: 12.44180251s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [..........X........X..X.....X..XX...X......X....X.X.........]
duration:
3.48811853s
trace:
https://jaeger.dev.storj.io/trace/6a0e3c716501503f
FAIL (2025-11-16 14:41:35 UTC)
orbiter warning: context deadline exceeded
Duration: 3.488173815s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [...........X........X..X.....X..XX...X......X....X.X........]
duration:
3.449374s
trace:
https://jaeger.dev.storj.io/trace/6a0e3c716501503f
FAIL (2025-11-16 14:40:48 UTC)
orbiter warning: context deadline exceeded
Duration: 3.449401503s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
7.433598008s
trace:
https://jaeger.dev.storj.io/trace/5abd325dfee3c7f8
FAIL (2025-11-16 14:40:39 UTC)
orbiter warning: context deadline exceeded
Duration: 7.433628346s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [............X........X..X.....X..XX...X......X....X.X.......]
duration:
3.649782616s
trace:
https://jaeger.dev.storj.io/trace/6a0e3c716501503f
FAIL (2025-11-16 14:39:55 UTC)
orbiter warning: context deadline exceeded
Duration: 3.649809828s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
9.106548614s
trace:
https://jaeger.dev.storj.io/trace/5abd325dfee3c7f8
FAIL (2025-11-16 14:39:29 UTC)
orbiter warning: context deadline exceeded
Duration: 9.106579141s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
15.132461949s
trace:
https://jaeger.dev.storj.io/trace/5abd325dfee3c7f8
FAIL (2025-11-16 14:39:17 UTC)
orbiter warning: context deadline exceeded
Duration: 15.1325572s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [.............X........X..X.....X..XX...X......X....X.X......]
duration:
3.539222216s
trace:
https://jaeger.dev.storj.io/trace/6a0e3c716501503f
FAIL (2025-11-16 14:39:02 UTC)
orbiter warning: context deadline exceeded
Duration: 3.53924554s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [..............X........X..X.....X..XX...X......X....X.X.....]
duration:
3.416819519s
trace:
https://jaeger.dev.storj.io/trace/6a0e3c716501503f
FAIL (2025-11-16 14:38:41 UTC)
orbiter warning: context deadline exceeded
Duration: 3.416874142s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
12.780830237s
trace:
https://jaeger.dev.storj.io/trace/5abd325dfee3c7f8
FAIL (2025-11-16 14:38:38 UTC)
orbiter warning: context deadline exceeded
Duration: 12.780859854s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [...............X........X..X.....X..XX...X......X....X.X....]
duration:
3.646655359s
trace:
https://jaeger.dev.storj.io/trace/6a0e3c716501503f
FAIL (2025-11-16 14:38:08 UTC)
orbiter warning: context deadline exceeded
Duration: 3.646687771s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
8.411294277s
trace:
https://jaeger.dev.storj.io/trace/5abd325dfee3c7f8
FAIL (2025-11-16 14:37:25 UTC)
orbiter warning: context deadline exceeded
Duration: 8.411342569s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [................X........X..X.....X..XX...X......X....X.X...]
duration:
3.650799139s
trace:
https://jaeger.dev.storj.io/trace/6a0e3c716501503f
FAIL (2025-11-16 14:37:07 UTC)
orbiter warning: context deadline exceeded
Duration: 3.650832522s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
11.406791174s
trace:
https://jaeger.dev.storj.io/trace/5abd325dfee3c7f8
FAIL (2025-11-16 14:36:53 UTC)
orbiter warning: context deadline exceeded
Duration: 11.406824648s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [.................X........X..X.....X..XX...X......X....X.X..]
duration:
3.99575363s
trace:
https://jaeger.dev.storj.io/trace/6a0e3c716501503f
FAIL (2025-11-16 14:36:51 UTC)
orbiter warning: context deadline exceeded
Duration: 3.995796481s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
15.379050372s
trace:
https://jaeger.dev.storj.io/trace/5abd325dfee3c7f8
FAIL (2025-11-16 14:36:34 UTC)
orbiter warning: context deadline exceeded
Duration: 15.379079408s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
30.000778326s
trace:
https://jaeger.dev.storj.io/trace/5abd325dfee3c7f8
FAIL (2025-11-16 14:36:10 UTC)
orbiter warning: context deadline exceeded
Duration: 30.000793475s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [..................X........X..X.....X..XX...X......X....X.X.]
duration:
4.670891004s
trace:
https://jaeger.dev.storj.io/trace/6a0e3c716501503f
FAIL (2025-11-16 14:36:08 UTC)
orbiter warning: context deadline exceeded
Duration: 4.670932283s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [...................X........X..X.....X..XX...X......X....X.X]
duration:
5.000711286s
trace:
https://jaeger.dev.storj.io/trace/6a0e3c716501503f
FAIL (2025-11-16 14:35:39 UTC)
orbiter warning: context deadline exceeded
Duration: 5.000739299s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
9 out of 60 is failed (threshold=6) [....................X........X..X.....X..XX...X......X....X.]
duration:
4.993241994s
trace:
https://jaeger.dev.storj.io/trace/27ae638f531a5e3
FAIL (2025-11-16 14:35:21 UTC)
orbiter warning: context deadline exceeded
Duration: 4.993271449s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
9 out of 60 is failed (threshold=6) [.....................X........X..X.....X..XX...X......X....X]
duration:
5.001921018s
trace:
https://jaeger.dev.storj.io/trace/27ae638f531a5e3
FAIL (2025-11-16 14:34:14 UTC)
orbiter warning: context deadline exceeded
Duration: 5.001946367s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
8 out of 60 is failed (threshold=6) [......................X........X..X.....X..XX...X......X....]
duration:
3.716075405s
trace:
https://jaeger.dev.storj.io/trace/3a9f99f64cf4b966
FAIL (2025-11-16 14:33:07 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.716105813s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
9 out of 60 is failed (threshold=6) [X......................X........X..X.....X..XX...X......X...]
duration:
3.578387957s
trace:
https://jaeger.dev.storj.io/trace/3a9f99f64cf4b966
FAIL (2025-11-16 14:32:19 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.578420149s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
9 out of 60 is failed (threshold=6) [.X......................X........X..X.....X..XX...X......X..]
duration:
4.31192702s
trace:
https://jaeger.dev.storj.io/trace/3a9f99f64cf4b966
FAIL (2025-11-16 14:31:52 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.311957077s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
9 out of 60 is failed (threshold=6) [..X......................X........X..X.....X..XX...X......X.]
duration:
3.445772834s
trace:
https://jaeger.dev.storj.io/trace/3a9f99f64cf4b966
FAIL (2025-11-16 14:30:48 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.445819834s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
9 out of 60 is failed (threshold=6) [...X......................X........X..X.....X..XX...X......X]
duration:
5.000843508s
trace:
https://jaeger.dev.storj.io/trace/3a9f99f64cf4b966
FAIL (2025-11-16 14:30:23 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000867303s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
8 out of 60 is failed (threshold=6) [....X......................X........X..X.....X..XX...X......]
duration:
3.566952612s
trace:
https://jaeger.dev.storj.io/trace/4fb8f2cf6fee9d8c
FAIL (2025-11-16 14:29:58 UTC)
orbiter warning: context deadline exceeded
Duration: 3.566979824s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
6.15422808s
trace:
https://jaeger.dev.storj.io/trace/3c77028f820d12f9
FAIL (2025-11-16 14:29:40 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1VwwhXQqXCHcgP37bcQAUA6urv5YGVt7NCpRNrqMKSSE5AScK9, Piece ID: UKP3MHXBSALCWFIHCTSR5JFFXEWWAWGDS4JYUYS2JEREQQKTPJSA) context deadline exceeded; piecestore: (Node ID: 12CMKNUtKvidnZpTfnYPxDCPUdvaSUs5mAx9oFFd2bWfuocTT4u, Piece ID: DNT5QVAMRO5OMBNVTDRRUKACMM7M5472LD5E4ASKYIBKBNWYAVRA) context deadline exceeded; piecestore: (Node ID: 17Ski7oMzbGroPGgWRrbUiqC1NiLPBBsvYuU4pCZ53xhNKkeBZ, Piece ID: DPLALMJC4JPC5D7BOK5SOSDFDJFDDPGSJWP4XDDQE22AMFNAKATQ) context deadline exceeded
======LOGS======
gment. Inline: false
Nov 16 13:42:52.666975419 (173h38m51.21844588s) [upload=152907]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov 16 13:42:52.666980539 (173h38m51.21845099s) [upload=152907]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov 16 13:42:53.024947049 (173h38m51.5764175s) [seg_pos={0 0}, upload=152907]: Begin upload segment...
Nov 16 13:42:53.025007074 (173h38m51.576477535s) [seg_pos={0 0}, upload=152907]: Done begin upload segment.
Nov 16 13:42:53.025087707 (173h38m51.576558158s) [noise=true , address=77.90.31.14:4662     , piece_id=S5PPMCKIKSOCLUJ4CEH7ZDW3TVUZ7GTFFEIPCQK6FX25UIOUQHHQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.025098377 (173h38m51.576568828s) [noise=true , address=145.79.227.31:4797   , piece_id=UKP3MHXBSALCWFIHCTSR5JFFXEWWAWGDS4JYUYS2JEREQQKTPJSA, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.025961451 (173h38m51.577431912s) [noise=true , address=45.91.116.6:4974     , piece_id=ZTS3H7E6A3VJECLRRKRKSVX5PH3VSH7F2HAUPQSPH56NCI6RTFBQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.026101888 (173h38m51.577572339s) [noise=true , address=145.79.227.10:4402   , piece_id=DNT5QVAMRO5OMBNVTDRRUKACMM7M5472LD5E4ASKYIBKBNWYAVRA, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.026397721 (173h38m51.577868182s) [noise=true , address=145.79.227.11:4732   , piece_id=GR6SASHNUTHAEOUPK7DWKVPHRGMG72FQMF4RINJ5NTIQQGFCVZZQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.026543650 (173h38m51.578014111s) [noise=true , address=145.79.227.20:4437   , piece_id=G5P6OYXVAAQDZKTPPHDNZLMYTT6L2TFWKH7N4F7L6742BWHOQGBQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.026887915 (173h38m51.578358366s) [noise=true , address=45.91.116.14:4189    , piece_id=NUMS6Q3F2OUAQ2PSKE2CZK2WKRQLZUZPWVBA3UA6UNKDQACPYSJQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.027039624 (173h38m51.578510085s) [noise=true , address=145.79.227.27:4691   , piece_id=NSX5S2D7ZSA5I57B4EAQEQXEVUMPKNMRKRV3RHWGWJ2DN7SWUPGQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.027374482 (173h38m51.578844973s) [noise=true , address=145.79.227.31:4798   , piece_id=DPLALMJC4JPC5D7BOK5SOSDFDJFDDPGSJWP4XDDQE22AMFNAKATQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.027472337 (173h38m51.578942798s) [noise=true , address=45.91.116.7:4010     , piece_id=EO7IEOCWEJAMZZU4BLIB5ALFACWTWZE3QCXU3FUY4FKC4P444ORA, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.027920821 (173h38m51.579391283s) [noise=true , address=145.79.227.23:4547   , piece_id=P4WX2ZDHV2Z6BFMF6IACIYW4DXKYFVSULUTF7EK2EMRO5OA5X5RQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.028194272 (173h38m51.579664743s) [noise=true , address=145.79.227.32:4834   , piece_id=CBK2UQ252EPFQDTOYS2X5WAUTJN4L2DTHGIOJXFZXWBOLGPRETXQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.028430262 (173h38m51.579900723s) [noise=true , address=145.79.227.9:4366    , piece_id=YFWF2YL2YPYVMP5DHJKRUGVUUS2ALG4DRJ3HUZCDZM4N3N676FNQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.029687726 (173h38m51.581158177s) [noise=true , address=145.79.227.20:4438   , piece_id=6HY2HDNJAZ552ZKXFJ7VNTQNBAQU5ZQLNKAG2NZZWZQHN6EEDG6Q, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.031784128 (173h38m51.583254589s) [noise=true , address=45.91.116.5:4298     , piece_id=ARGPAZE6CTMM6UXSMPSVHDBEQWKVGKY7WXOVLPB7UH3JZYMDB7JQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.034100830 (173h38m51.585571291s) [noise=true , address=77.90.31.10:4518     , piece_id=MSKQ66KE4WANAE4AWOD2IKY3PQN2YGZ5N4W3NXGKXSOLE7B6H6WQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:54.850200282 (173h38m53.401670733s) [upload=152907]: Next returned nil segment
Nov 16 13:42:54.850219118 (173h38m53.401689569s) [upload=152907]: Waiting for error group managing segments...
Nov 16 13:42:55.154333032 (173h38m53.705803493s) [noise=true , address=45.91.116.7:4010     , piece_id=EO7IEOCWEJAMZZU4BLIB5ALFACWTWZE3QCXU3FUY4FKC4P444ORA, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:42:55.201689040 (173h38m53.753159501s) [noise=true , address=77.90.31.10:4518     , piece_id=MSKQ66KE4WANAE4AWOD2IKY3PQN2YGZ5N4W3NXGKXSOLE7B6H6WQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:42:55.232313345 (173h38m53.783783816s) [noise=true , address=45.91.116.5:4298     , piece_id=ARGPAZE6CTMM6UXSMPSVHDBEQWKVGKY7WXOVLPB7UH3JZYMDB7JQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:42:55.260281393 (173h38m53.811751854s) [noise=true , address=45.91.116.6:4974     , piece_id=ZTS3H7E6A3VJECLRRKRKSVX5PH3VSH7F2HAUPQSPH56NCI6RTFBQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:00.229127085 (173h38m58.780597546s) [noise=true , address=145.79.227.20:4438   , piece_id=6HY2HDNJAZ552ZKXFJ7VNTQNBAQU5ZQLNKAG2NZZWZQHN6EEDG6Q, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:00.358241119 (173h38m58.909711581s) [noise=true , address=145.79.227.32:4834   , piece_id=CBK2UQ252EPFQDTOYS2X5WAUTJN4L2DTHGIOJXFZXWBOLGPRETXQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:00.646958215 (173h38m59.198428676s) [noise=true , address=145.79.227.31:4798   , piece_id=DPLALMJC4JPC5D7BOK5SOSDFDJFDDPGSJWP4XDDQE22AMFNAKATQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:00.908824080 (173h38m59.460294541s) [noise=true , address=145.79.227.23:4547   , piece_id=P4WX2ZDHV2Z6BFMF6IACIYW4DXKYFVSULUTF7EK2EMRO5OA5X5RQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:01.155346527 (173h38m59.706816989s) [noise=true , address=45.91.116.14:4189    , piece_id=NUMS6Q3F2OUAQ2PSKE2CZK2WKRQLZUZPWVBA3UA6UNKDQACPYSJQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:01.839444794 (173h39m0.390915255s) [noise=true , address=145.79.227.11:4732   , piece_id=GR6SASHNUTHAEOUPK7DWKVPHRGMG72FQMF4RINJ5NTIQQGFCVZZQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:02.591249579 (173h39m1.14272004s) [noise=true , address=145.79.227.10:4402   , piece_id=DNT5QVAMRO5OMBNVTDRRUKACMM7M5472LD5E4ASKYIBKBNWYAVRA, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:02.616126740 (173h39m1.167597202s) [noise=true , address=145.79.227.31:4797   , piece_id=UKP3MHXBSALCWFIHCTSR5JFFXEWWAWGDS4JYUYS2JEREQQKTPJSA, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:02.734605482 (173h39m1.286075943s) [noise=true , address=145.79.227.27:4691   , piece_id=NSX5S2D7ZSA5I57B4EAQEQXEVUMPKNMRKRV3RHWGWJ2DN7SWUPGQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:02.734638004 (173h39m1.286108475s) [seg_pos={0 0}, upload=152907]: Segment reached optimal threshold of 13 pieces.
Nov 16 13:43:02.735049748 (173h39m1.286520209s) [noise=true , address=145.79.227.9:4366    , piece_id=YFWF2YL2YPYVMP5DHJKRUGVUUS2ALG4DRJ3HUZCDZM4N3N676FNQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1evHXReGUBYNCZaGnZ2PwmN4xZH1ABzorfhP7w61sHq4EK8Cpy): protocol: write tcp 188.166.225.170:60100->145.79.227.9:4366: use of closed network connection; write tcp 188.166.225.170:60100->145.79.227.9:4366: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60100->145.79.227.9:4366: use of closed network connection
Nov 16 13:43:02.735060949 (173h39m1.28653141s) [noise=true , address=145.79.227.9:4366    , piece_id=YFWF2YL2YPYVMP5DHJKRUGVUUS2ALG4DRJ3HUZCDZM4N3N676FNQ, seg_pos={0 0}, upload=152907]: Long tail cancellation due to optimal threshold
Nov 16 13:43:02.735509193 (173h39m1.286979654s) [noise=true , address=77.90.31.14:4662     , piece_id=S5PPMCKIKSOCLUJ4CEH7ZDW3TVUZ7GTFFEIPCQK6FX25UIOUQHHQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:50196->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:50196->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50196->77.90.31.14:4662: use of closed network connection
Nov 16 13:43:02.735518792 (173h39m1.286989253s) [noise=true , address=77.90.31.14:4662     , piece_id=S5PPMCKIKSOCLUJ4CEH7ZDW3TVUZ7GTFFEIPCQK6FX25UIOUQHHQ, seg_pos={0 0}, upload=152907]: Long tail cancellation due to optimal threshold
Nov 16 13:43:02.736224335 (173h39m1.287694796s) [noise=true , address=145.79.227.20:4437   , piece_id=G5P6OYXVAAQDZKTPPHDNZLMYTT6L2TFWKH7N4F7L6742BWHOQGBQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: read tcp 188.166.225.170:35300->145.79.227.20:4437: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 16 13:43:02.736239203 (173h39m1.287709654s) [noise=true , address=145.79.227.20:4437   , piece_id=G5P6OYXVAAQDZKTPPHDNZLMYTT6L2TFWKH7N4F7L6742BWHOQGBQ, seg_pos={0 0}, upload=152907]: Long tail cancellation due to optimal threshold
Nov 16 13:43:02.736270833 (173h39m1.287741294s) [seg_pos={0 0}, upload=152907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Nov 16 13:43:02.736437060 (173h39m1.287907521s) [upload=152907]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 13:43:02.736444273 (173h39m1.287914735s) [upload=152907]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 13:43:05.031396865 (173h39m3.582867336s) [upload=152907]: Done uploading segments...
Nov 16 13:43:05.031422193 (173h39m3.582892654s) [upload=152907]: Upload finished. err: <nil>
Duration: 6.154370982s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
9 out of 60 is failed (threshold=6) [X....X......................X........X..X.....X..XX...X.....]
duration:
3.54964313s
trace:
https://jaeger.dev.storj.io/trace/4fb8f2cf6fee9d8c
FAIL (2025-11-16 14:29:23 UTC)
orbiter warning: context deadline exceeded
Duration: 3.549673628s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
6.083823069s
trace:
https://jaeger.dev.storj.io/trace/3c77028f820d12f9
FAIL (2025-11-16 14:29:14 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1VwwhXQqXCHcgP37bcQAUA6urv5YGVt7NCpRNrqMKSSE5AScK9, Piece ID: UKP3MHXBSALCWFIHCTSR5JFFXEWWAWGDS4JYUYS2JEREQQKTPJSA) context deadline exceeded; piecestore: (Node ID: 12CMKNUtKvidnZpTfnYPxDCPUdvaSUs5mAx9oFFd2bWfuocTT4u, Piece ID: DNT5QVAMRO5OMBNVTDRRUKACMM7M5472LD5E4ASKYIBKBNWYAVRA) context deadline exceeded; piecestore: (Node ID: 17Ski7oMzbGroPGgWRrbUiqC1NiLPBBsvYuU4pCZ53xhNKkeBZ, Piece ID: DPLALMJC4JPC5D7BOK5SOSDFDJFDDPGSJWP4XDDQE22AMFNAKATQ) context deadline exceeded
======LOGS======
gment. Inline: false
Nov 16 13:42:52.666975419 (173h38m51.21844588s) [upload=152907]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov 16 13:42:52.666980539 (173h38m51.21845099s) [upload=152907]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov 16 13:42:53.024947049 (173h38m51.5764175s) [seg_pos={0 0}, upload=152907]: Begin upload segment...
Nov 16 13:42:53.025007074 (173h38m51.576477535s) [seg_pos={0 0}, upload=152907]: Done begin upload segment.
Nov 16 13:42:53.025087707 (173h38m51.576558158s) [noise=true , address=77.90.31.14:4662     , piece_id=S5PPMCKIKSOCLUJ4CEH7ZDW3TVUZ7GTFFEIPCQK6FX25UIOUQHHQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.025098377 (173h38m51.576568828s) [noise=true , address=145.79.227.31:4797   , piece_id=UKP3MHXBSALCWFIHCTSR5JFFXEWWAWGDS4JYUYS2JEREQQKTPJSA, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.025961451 (173h38m51.577431912s) [noise=true , address=45.91.116.6:4974     , piece_id=ZTS3H7E6A3VJECLRRKRKSVX5PH3VSH7F2HAUPQSPH56NCI6RTFBQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.026101888 (173h38m51.577572339s) [noise=true , address=145.79.227.10:4402   , piece_id=DNT5QVAMRO5OMBNVTDRRUKACMM7M5472LD5E4ASKYIBKBNWYAVRA, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.026397721 (173h38m51.577868182s) [noise=true , address=145.79.227.11:4732   , piece_id=GR6SASHNUTHAEOUPK7DWKVPHRGMG72FQMF4RINJ5NTIQQGFCVZZQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.026543650 (173h38m51.578014111s) [noise=true , address=145.79.227.20:4437   , piece_id=G5P6OYXVAAQDZKTPPHDNZLMYTT6L2TFWKH7N4F7L6742BWHOQGBQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.026887915 (173h38m51.578358366s) [noise=true , address=45.91.116.14:4189    , piece_id=NUMS6Q3F2OUAQ2PSKE2CZK2WKRQLZUZPWVBA3UA6UNKDQACPYSJQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.027039624 (173h38m51.578510085s) [noise=true , address=145.79.227.27:4691   , piece_id=NSX5S2D7ZSA5I57B4EAQEQXEVUMPKNMRKRV3RHWGWJ2DN7SWUPGQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.027374482 (173h38m51.578844973s) [noise=true , address=145.79.227.31:4798   , piece_id=DPLALMJC4JPC5D7BOK5SOSDFDJFDDPGSJWP4XDDQE22AMFNAKATQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.027472337 (173h38m51.578942798s) [noise=true , address=45.91.116.7:4010     , piece_id=EO7IEOCWEJAMZZU4BLIB5ALFACWTWZE3QCXU3FUY4FKC4P444ORA, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.027920821 (173h38m51.579391283s) [noise=true , address=145.79.227.23:4547   , piece_id=P4WX2ZDHV2Z6BFMF6IACIYW4DXKYFVSULUTF7EK2EMRO5OA5X5RQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.028194272 (173h38m51.579664743s) [noise=true , address=145.79.227.32:4834   , piece_id=CBK2UQ252EPFQDTOYS2X5WAUTJN4L2DTHGIOJXFZXWBOLGPRETXQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.028430262 (173h38m51.579900723s) [noise=true , address=145.79.227.9:4366    , piece_id=YFWF2YL2YPYVMP5DHJKRUGVUUS2ALG4DRJ3HUZCDZM4N3N676FNQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.029687726 (173h38m51.581158177s) [noise=true , address=145.79.227.20:4438   , piece_id=6HY2HDNJAZ552ZKXFJ7VNTQNBAQU5ZQLNKAG2NZZWZQHN6EEDG6Q, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.031784128 (173h38m51.583254589s) [noise=true , address=45.91.116.5:4298     , piece_id=ARGPAZE6CTMM6UXSMPSVHDBEQWKVGKY7WXOVLPB7UH3JZYMDB7JQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.034100830 (173h38m51.585571291s) [noise=true , address=77.90.31.10:4518     , piece_id=MSKQ66KE4WANAE4AWOD2IKY3PQN2YGZ5N4W3NXGKXSOLE7B6H6WQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:54.850200282 (173h38m53.401670733s) [upload=152907]: Next returned nil segment
Nov 16 13:42:54.850219118 (173h38m53.401689569s) [upload=152907]: Waiting for error group managing segments...
Nov 16 13:42:55.154333032 (173h38m53.705803493s) [noise=true , address=45.91.116.7:4010     , piece_id=EO7IEOCWEJAMZZU4BLIB5ALFACWTWZE3QCXU3FUY4FKC4P444ORA, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:42:55.201689040 (173h38m53.753159501s) [noise=true , address=77.90.31.10:4518     , piece_id=MSKQ66KE4WANAE4AWOD2IKY3PQN2YGZ5N4W3NXGKXSOLE7B6H6WQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:42:55.232313345 (173h38m53.783783816s) [noise=true , address=45.91.116.5:4298     , piece_id=ARGPAZE6CTMM6UXSMPSVHDBEQWKVGKY7WXOVLPB7UH3JZYMDB7JQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:42:55.260281393 (173h38m53.811751854s) [noise=true , address=45.91.116.6:4974     , piece_id=ZTS3H7E6A3VJECLRRKRKSVX5PH3VSH7F2HAUPQSPH56NCI6RTFBQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:00.229127085 (173h38m58.780597546s) [noise=true , address=145.79.227.20:4438   , piece_id=6HY2HDNJAZ552ZKXFJ7VNTQNBAQU5ZQLNKAG2NZZWZQHN6EEDG6Q, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:00.358241119 (173h38m58.909711581s) [noise=true , address=145.79.227.32:4834   , piece_id=CBK2UQ252EPFQDTOYS2X5WAUTJN4L2DTHGIOJXFZXWBOLGPRETXQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:00.646958215 (173h38m59.198428676s) [noise=true , address=145.79.227.31:4798   , piece_id=DPLALMJC4JPC5D7BOK5SOSDFDJFDDPGSJWP4XDDQE22AMFNAKATQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:00.908824080 (173h38m59.460294541s) [noise=true , address=145.79.227.23:4547   , piece_id=P4WX2ZDHV2Z6BFMF6IACIYW4DXKYFVSULUTF7EK2EMRO5OA5X5RQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:01.155346527 (173h38m59.706816989s) [noise=true , address=45.91.116.14:4189    , piece_id=NUMS6Q3F2OUAQ2PSKE2CZK2WKRQLZUZPWVBA3UA6UNKDQACPYSJQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:01.839444794 (173h39m0.390915255s) [noise=true , address=145.79.227.11:4732   , piece_id=GR6SASHNUTHAEOUPK7DWKVPHRGMG72FQMF4RINJ5NTIQQGFCVZZQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:02.591249579 (173h39m1.14272004s) [noise=true , address=145.79.227.10:4402   , piece_id=DNT5QVAMRO5OMBNVTDRRUKACMM7M5472LD5E4ASKYIBKBNWYAVRA, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:02.616126740 (173h39m1.167597202s) [noise=true , address=145.79.227.31:4797   , piece_id=UKP3MHXBSALCWFIHCTSR5JFFXEWWAWGDS4JYUYS2JEREQQKTPJSA, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:02.734605482 (173h39m1.286075943s) [noise=true , address=145.79.227.27:4691   , piece_id=NSX5S2D7ZSA5I57B4EAQEQXEVUMPKNMRKRV3RHWGWJ2DN7SWUPGQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:02.734638004 (173h39m1.286108475s) [seg_pos={0 0}, upload=152907]: Segment reached optimal threshold of 13 pieces.
Nov 16 13:43:02.735049748 (173h39m1.286520209s) [noise=true , address=145.79.227.9:4366    , piece_id=YFWF2YL2YPYVMP5DHJKRUGVUUS2ALG4DRJ3HUZCDZM4N3N676FNQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1evHXReGUBYNCZaGnZ2PwmN4xZH1ABzorfhP7w61sHq4EK8Cpy): protocol: write tcp 188.166.225.170:60100->145.79.227.9:4366: use of closed network connection; write tcp 188.166.225.170:60100->145.79.227.9:4366: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60100->145.79.227.9:4366: use of closed network connection
Nov 16 13:43:02.735060949 (173h39m1.28653141s) [noise=true , address=145.79.227.9:4366    , piece_id=YFWF2YL2YPYVMP5DHJKRUGVUUS2ALG4DRJ3HUZCDZM4N3N676FNQ, seg_pos={0 0}, upload=152907]: Long tail cancellation due to optimal threshold
Nov 16 13:43:02.735509193 (173h39m1.286979654s) [noise=true , address=77.90.31.14:4662     , piece_id=S5PPMCKIKSOCLUJ4CEH7ZDW3TVUZ7GTFFEIPCQK6FX25UIOUQHHQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:50196->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:50196->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50196->77.90.31.14:4662: use of closed network connection
Nov 16 13:43:02.735518792 (173h39m1.286989253s) [noise=true , address=77.90.31.14:4662     , piece_id=S5PPMCKIKSOCLUJ4CEH7ZDW3TVUZ7GTFFEIPCQK6FX25UIOUQHHQ, seg_pos={0 0}, upload=152907]: Long tail cancellation due to optimal threshold
Nov 16 13:43:02.736224335 (173h39m1.287694796s) [noise=true , address=145.79.227.20:4437   , piece_id=G5P6OYXVAAQDZKTPPHDNZLMYTT6L2TFWKH7N4F7L6742BWHOQGBQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: read tcp 188.166.225.170:35300->145.79.227.20:4437: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 16 13:43:02.736239203 (173h39m1.287709654s) [noise=true , address=145.79.227.20:4437   , piece_id=G5P6OYXVAAQDZKTPPHDNZLMYTT6L2TFWKH7N4F7L6742BWHOQGBQ, seg_pos={0 0}, upload=152907]: Long tail cancellation due to optimal threshold
Nov 16 13:43:02.736270833 (173h39m1.287741294s) [seg_pos={0 0}, upload=152907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Nov 16 13:43:02.736437060 (173h39m1.287907521s) [upload=152907]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 13:43:02.736444273 (173h39m1.287914735s) [upload=152907]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 13:43:05.031396865 (173h39m3.582867336s) [upload=152907]: Done uploading segments...
Nov 16 13:43:05.031422193 (173h39m3.582892654s) [upload=152907]: Upload finished. err: <nil>
Duration: 6.08385936s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration:
6.148804103s
trace:
https://jaeger.dev.storj.io/trace/3c77028f820d12f9
FAIL (2025-11-16 14:28:11 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1VwwhXQqXCHcgP37bcQAUA6urv5YGVt7NCpRNrqMKSSE5AScK9, Piece ID: UKP3MHXBSALCWFIHCTSR5JFFXEWWAWGDS4JYUYS2JEREQQKTPJSA) context deadline exceeded; piecestore: (Node ID: 12CMKNUtKvidnZpTfnYPxDCPUdvaSUs5mAx9oFFd2bWfuocTT4u, Piece ID: DNT5QVAMRO5OMBNVTDRRUKACMM7M5472LD5E4ASKYIBKBNWYAVRA) context deadline exceeded; piecestore: (Node ID: 17Ski7oMzbGroPGgWRrbUiqC1NiLPBBsvYuU4pCZ53xhNKkeBZ, Piece ID: DPLALMJC4JPC5D7BOK5SOSDFDJFDDPGSJWP4XDDQE22AMFNAKATQ) context deadline exceeded
======LOGS======
gment. Inline: false
Nov 16 13:42:52.666975419 (173h38m51.21844588s) [upload=152907]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov 16 13:42:52.666980539 (173h38m51.21845099s) [upload=152907]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov 16 13:42:53.024947049 (173h38m51.5764175s) [seg_pos={0 0}, upload=152907]: Begin upload segment...
Nov 16 13:42:53.025007074 (173h38m51.576477535s) [seg_pos={0 0}, upload=152907]: Done begin upload segment.
Nov 16 13:42:53.025087707 (173h38m51.576558158s) [noise=true , address=77.90.31.14:4662     , piece_id=S5PPMCKIKSOCLUJ4CEH7ZDW3TVUZ7GTFFEIPCQK6FX25UIOUQHHQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.025098377 (173h38m51.576568828s) [noise=true , address=145.79.227.31:4797   , piece_id=UKP3MHXBSALCWFIHCTSR5JFFXEWWAWGDS4JYUYS2JEREQQKTPJSA, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.025961451 (173h38m51.577431912s) [noise=true , address=45.91.116.6:4974     , piece_id=ZTS3H7E6A3VJECLRRKRKSVX5PH3VSH7F2HAUPQSPH56NCI6RTFBQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.026101888 (173h38m51.577572339s) [noise=true , address=145.79.227.10:4402   , piece_id=DNT5QVAMRO5OMBNVTDRRUKACMM7M5472LD5E4ASKYIBKBNWYAVRA, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.026397721 (173h38m51.577868182s) [noise=true , address=145.79.227.11:4732   , piece_id=GR6SASHNUTHAEOUPK7DWKVPHRGMG72FQMF4RINJ5NTIQQGFCVZZQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.026543650 (173h38m51.578014111s) [noise=true , address=145.79.227.20:4437   , piece_id=G5P6OYXVAAQDZKTPPHDNZLMYTT6L2TFWKH7N4F7L6742BWHOQGBQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.026887915 (173h38m51.578358366s) [noise=true , address=45.91.116.14:4189    , piece_id=NUMS6Q3F2OUAQ2PSKE2CZK2WKRQLZUZPWVBA3UA6UNKDQACPYSJQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.027039624 (173h38m51.578510085s) [noise=true , address=145.79.227.27:4691   , piece_id=NSX5S2D7ZSA5I57B4EAQEQXEVUMPKNMRKRV3RHWGWJ2DN7SWUPGQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.027374482 (173h38m51.578844973s) [noise=true , address=145.79.227.31:4798   , piece_id=DPLALMJC4JPC5D7BOK5SOSDFDJFDDPGSJWP4XDDQE22AMFNAKATQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.027472337 (173h38m51.578942798s) [noise=true , address=45.91.116.7:4010     , piece_id=EO7IEOCWEJAMZZU4BLIB5ALFACWTWZE3QCXU3FUY4FKC4P444ORA, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.027920821 (173h38m51.579391283s) [noise=true , address=145.79.227.23:4547   , piece_id=P4WX2ZDHV2Z6BFMF6IACIYW4DXKYFVSULUTF7EK2EMRO5OA5X5RQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.028194272 (173h38m51.579664743s) [noise=true , address=145.79.227.32:4834   , piece_id=CBK2UQ252EPFQDTOYS2X5WAUTJN4L2DTHGIOJXFZXWBOLGPRETXQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.028430262 (173h38m51.579900723s) [noise=true , address=145.79.227.9:4366    , piece_id=YFWF2YL2YPYVMP5DHJKRUGVUUS2ALG4DRJ3HUZCDZM4N3N676FNQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.029687726 (173h38m51.581158177s) [noise=true , address=145.79.227.20:4438   , piece_id=6HY2HDNJAZ552ZKXFJ7VNTQNBAQU5ZQLNKAG2NZZWZQHN6EEDG6Q, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.031784128 (173h38m51.583254589s) [noise=true , address=45.91.116.5:4298     , piece_id=ARGPAZE6CTMM6UXSMPSVHDBEQWKVGKY7WXOVLPB7UH3JZYMDB7JQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.034100830 (173h38m51.585571291s) [noise=true , address=77.90.31.10:4518     , piece_id=MSKQ66KE4WANAE4AWOD2IKY3PQN2YGZ5N4W3NXGKXSOLE7B6H6WQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:54.850200282 (173h38m53.401670733s) [upload=152907]: Next returned nil segment
Nov 16 13:42:54.850219118 (173h38m53.401689569s) [upload=152907]: Waiting for error group managing segments...
Nov 16 13:42:55.154333032 (173h38m53.705803493s) [noise=true , address=45.91.116.7:4010     , piece_id=EO7IEOCWEJAMZZU4BLIB5ALFACWTWZE3QCXU3FUY4FKC4P444ORA, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:42:55.201689040 (173h38m53.753159501s) [noise=true , address=77.90.31.10:4518     , piece_id=MSKQ66KE4WANAE4AWOD2IKY3PQN2YGZ5N4W3NXGKXSOLE7B6H6WQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:42:55.232313345 (173h38m53.783783816s) [noise=true , address=45.91.116.5:4298     , piece_id=ARGPAZE6CTMM6UXSMPSVHDBEQWKVGKY7WXOVLPB7UH3JZYMDB7JQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:42:55.260281393 (173h38m53.811751854s) [noise=true , address=45.91.116.6:4974     , piece_id=ZTS3H7E6A3VJECLRRKRKSVX5PH3VSH7F2HAUPQSPH56NCI6RTFBQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:00.229127085 (173h38m58.780597546s) [noise=true , address=145.79.227.20:4438   , piece_id=6HY2HDNJAZ552ZKXFJ7VNTQNBAQU5ZQLNKAG2NZZWZQHN6EEDG6Q, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:00.358241119 (173h38m58.909711581s) [noise=true , address=145.79.227.32:4834   , piece_id=CBK2UQ252EPFQDTOYS2X5WAUTJN4L2DTHGIOJXFZXWBOLGPRETXQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:00.646958215 (173h38m59.198428676s) [noise=true , address=145.79.227.31:4798   , piece_id=DPLALMJC4JPC5D7BOK5SOSDFDJFDDPGSJWP4XDDQE22AMFNAKATQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:00.908824080 (173h38m59.460294541s) [noise=true , address=145.79.227.23:4547   , piece_id=P4WX2ZDHV2Z6BFMF6IACIYW4DXKYFVSULUTF7EK2EMRO5OA5X5RQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:01.155346527 (173h38m59.706816989s) [noise=true , address=45.91.116.14:4189    , piece_id=NUMS6Q3F2OUAQ2PSKE2CZK2WKRQLZUZPWVBA3UA6UNKDQACPYSJQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:01.839444794 (173h39m0.390915255s) [noise=true , address=145.79.227.11:4732   , piece_id=GR6SASHNUTHAEOUPK7DWKVPHRGMG72FQMF4RINJ5NTIQQGFCVZZQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:02.591249579 (173h39m1.14272004s) [noise=true , address=145.79.227.10:4402   , piece_id=DNT5QVAMRO5OMBNVTDRRUKACMM7M5472LD5E4ASKYIBKBNWYAVRA, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:02.616126740 (173h39m1.167597202s) [noise=true , address=145.79.227.31:4797   , piece_id=UKP3MHXBSALCWFIHCTSR5JFFXEWWAWGDS4JYUYS2JEREQQKTPJSA, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:02.734605482 (173h39m1.286075943s) [noise=true , address=145.79.227.27:4691   , piece_id=NSX5S2D7ZSA5I57B4EAQEQXEVUMPKNMRKRV3RHWGWJ2DN7SWUPGQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:02.734638004 (173h39m1.286108475s) [seg_pos={0 0}, upload=152907]: Segment reached optimal threshold of 13 pieces.
Nov 16 13:43:02.735049748 (173h39m1.286520209s) [noise=true , address=145.79.227.9:4366    , piece_id=YFWF2YL2YPYVMP5DHJKRUGVUUS2ALG4DRJ3HUZCDZM4N3N676FNQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1evHXReGUBYNCZaGnZ2PwmN4xZH1ABzorfhP7w61sHq4EK8Cpy): protocol: write tcp 188.166.225.170:60100->145.79.227.9:4366: use of closed network connection; write tcp 188.166.225.170:60100->145.79.227.9:4366: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60100->145.79.227.9:4366: use of closed network connection
Nov 16 13:43:02.735060949 (173h39m1.28653141s) [noise=true , address=145.79.227.9:4366    , piece_id=YFWF2YL2YPYVMP5DHJKRUGVUUS2ALG4DRJ3HUZCDZM4N3N676FNQ, seg_pos={0 0}, upload=152907]: Long tail cancellation due to optimal threshold
Nov 16 13:43:02.735509193 (173h39m1.286979654s) [noise=true , address=77.90.31.14:4662     , piece_id=S5PPMCKIKSOCLUJ4CEH7ZDW3TVUZ7GTFFEIPCQK6FX25UIOUQHHQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:50196->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:50196->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50196->77.90.31.14:4662: use of closed network connection
Nov 16 13:43:02.735518792 (173h39m1.286989253s) [noise=true , address=77.90.31.14:4662     , piece_id=S5PPMCKIKSOCLUJ4CEH7ZDW3TVUZ7GTFFEIPCQK6FX25UIOUQHHQ, seg_pos={0 0}, upload=152907]: Long tail cancellation due to optimal threshold
Nov 16 13:43:02.736224335 (173h39m1.287694796s) [noise=true , address=145.79.227.20:4437   , piece_id=G5P6OYXVAAQDZKTPPHDNZLMYTT6L2TFWKH7N4F7L6742BWHOQGBQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: read tcp 188.166.225.170:35300->145.79.227.20:4437: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 16 13:43:02.736239203 (173h39m1.287709654s) [noise=true , address=145.79.227.20:4437   , piece_id=G5P6OYXVAAQDZKTPPHDNZLMYTT6L2TFWKH7N4F7L6742BWHOQGBQ, seg_pos={0 0}, upload=152907]: Long tail cancellation due to optimal threshold
Nov 16 13:43:02.736270833 (173h39m1.287741294s) [seg_pos={0 0}, upload=152907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Nov 16 13:43:02.736437060 (173h39m1.287907521s) [upload=152907]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 13:43:02.736444273 (173h39m1.287914735s) [upload=152907]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 13:43:05.031396865 (173h39m3.582867336s) [upload=152907]: Done uploading segments...
Nov 16 13:43:05.031422193 (173h39m3.582892654s) [upload=152907]: Upload finished. err: <nil>
Duration: 6.148833899s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [XX....X......................X........X..X.....X..XX...X....]
duration:
4.546602259s
trace:
https://jaeger.dev.storj.io/trace/4fb8f2cf6fee9d8c
FAIL (2025-11-16 14:28:11 UTC)
orbiter warning: context deadline exceeded
Duration: 4.546632475s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [.XX....X......................X........X..X.....X..XX...X...]
duration:
5.001493355s
trace:
https://jaeger.dev.storj.io/trace/4fb8f2cf6fee9d8c
FAIL (2025-11-16 14:27:51 UTC)
orbiter warning: context deadline exceeded
Duration: 5.00151757s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................]
duration:
6.130207429s
trace:
https://jaeger.dev.storj.io/trace/3c77028f820d12f9
FAIL (2025-11-16 14:27:48 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1VwwhXQqXCHcgP37bcQAUA6urv5YGVt7NCpRNrqMKSSE5AScK9, Piece ID: UKP3MHXBSALCWFIHCTSR5JFFXEWWAWGDS4JYUYS2JEREQQKTPJSA) context deadline exceeded; piecestore: (Node ID: 12CMKNUtKvidnZpTfnYPxDCPUdvaSUs5mAx9oFFd2bWfuocTT4u, Piece ID: DNT5QVAMRO5OMBNVTDRRUKACMM7M5472LD5E4ASKYIBKBNWYAVRA) context deadline exceeded; piecestore: (Node ID: 17Ski7oMzbGroPGgWRrbUiqC1NiLPBBsvYuU4pCZ53xhNKkeBZ, Piece ID: DPLALMJC4JPC5D7BOK5SOSDFDJFDDPGSJWP4XDDQE22AMFNAKATQ) context deadline exceeded
======LOGS======
gment. Inline: false
Nov 16 13:42:52.666975419 (173h38m51.21844588s) [upload=152907]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov 16 13:42:52.666980539 (173h38m51.21845099s) [upload=152907]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov 16 13:42:53.024947049 (173h38m51.5764175s) [seg_pos={0 0}, upload=152907]: Begin upload segment...
Nov 16 13:42:53.025007074 (173h38m51.576477535s) [seg_pos={0 0}, upload=152907]: Done begin upload segment.
Nov 16 13:42:53.025087707 (173h38m51.576558158s) [noise=true , address=77.90.31.14:4662     , piece_id=S5PPMCKIKSOCLUJ4CEH7ZDW3TVUZ7GTFFEIPCQK6FX25UIOUQHHQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.025098377 (173h38m51.576568828s) [noise=true , address=145.79.227.31:4797   , piece_id=UKP3MHXBSALCWFIHCTSR5JFFXEWWAWGDS4JYUYS2JEREQQKTPJSA, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.025961451 (173h38m51.577431912s) [noise=true , address=45.91.116.6:4974     , piece_id=ZTS3H7E6A3VJECLRRKRKSVX5PH3VSH7F2HAUPQSPH56NCI6RTFBQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.026101888 (173h38m51.577572339s) [noise=true , address=145.79.227.10:4402   , piece_id=DNT5QVAMRO5OMBNVTDRRUKACMM7M5472LD5E4ASKYIBKBNWYAVRA, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.026397721 (173h38m51.577868182s) [noise=true , address=145.79.227.11:4732   , piece_id=GR6SASHNUTHAEOUPK7DWKVPHRGMG72FQMF4RINJ5NTIQQGFCVZZQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.026543650 (173h38m51.578014111s) [noise=true , address=145.79.227.20:4437   , piece_id=G5P6OYXVAAQDZKTPPHDNZLMYTT6L2TFWKH7N4F7L6742BWHOQGBQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.026887915 (173h38m51.578358366s) [noise=true , address=45.91.116.14:4189    , piece_id=NUMS6Q3F2OUAQ2PSKE2CZK2WKRQLZUZPWVBA3UA6UNKDQACPYSJQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.027039624 (173h38m51.578510085s) [noise=true , address=145.79.227.27:4691   , piece_id=NSX5S2D7ZSA5I57B4EAQEQXEVUMPKNMRKRV3RHWGWJ2DN7SWUPGQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.027374482 (173h38m51.578844973s) [noise=true , address=145.79.227.31:4798   , piece_id=DPLALMJC4JPC5D7BOK5SOSDFDJFDDPGSJWP4XDDQE22AMFNAKATQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.027472337 (173h38m51.578942798s) [noise=true , address=45.91.116.7:4010     , piece_id=EO7IEOCWEJAMZZU4BLIB5ALFACWTWZE3QCXU3FUY4FKC4P444ORA, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.027920821 (173h38m51.579391283s) [noise=true , address=145.79.227.23:4547   , piece_id=P4WX2ZDHV2Z6BFMF6IACIYW4DXKYFVSULUTF7EK2EMRO5OA5X5RQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.028194272 (173h38m51.579664743s) [noise=true , address=145.79.227.32:4834   , piece_id=CBK2UQ252EPFQDTOYS2X5WAUTJN4L2DTHGIOJXFZXWBOLGPRETXQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.028430262 (173h38m51.579900723s) [noise=true , address=145.79.227.9:4366    , piece_id=YFWF2YL2YPYVMP5DHJKRUGVUUS2ALG4DRJ3HUZCDZM4N3N676FNQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.029687726 (173h38m51.581158177s) [noise=true , address=145.79.227.20:4438   , piece_id=6HY2HDNJAZ552ZKXFJ7VNTQNBAQU5ZQLNKAG2NZZWZQHN6EEDG6Q, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.031784128 (173h38m51.583254589s) [noise=true , address=45.91.116.5:4298     , piece_id=ARGPAZE6CTMM6UXSMPSVHDBEQWKVGKY7WXOVLPB7UH3JZYMDB7JQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:53.034100830 (173h38m51.585571291s) [noise=true , address=77.90.31.10:4518     , piece_id=MSKQ66KE4WANAE4AWOD2IKY3PQN2YGZ5N4W3NXGKXSOLE7B6H6WQ, seg_pos={0 0}, upload=152907]: Uploading piece...
Nov 16 13:42:54.850200282 (173h38m53.401670733s) [upload=152907]: Next returned nil segment
Nov 16 13:42:54.850219118 (173h38m53.401689569s) [upload=152907]: Waiting for error group managing segments...
Nov 16 13:42:55.154333032 (173h38m53.705803493s) [noise=true , address=45.91.116.7:4010     , piece_id=EO7IEOCWEJAMZZU4BLIB5ALFACWTWZE3QCXU3FUY4FKC4P444ORA, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:42:55.201689040 (173h38m53.753159501s) [noise=true , address=77.90.31.10:4518     , piece_id=MSKQ66KE4WANAE4AWOD2IKY3PQN2YGZ5N4W3NXGKXSOLE7B6H6WQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:42:55.232313345 (173h38m53.783783816s) [noise=true , address=45.91.116.5:4298     , piece_id=ARGPAZE6CTMM6UXSMPSVHDBEQWKVGKY7WXOVLPB7UH3JZYMDB7JQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:42:55.260281393 (173h38m53.811751854s) [noise=true , address=45.91.116.6:4974     , piece_id=ZTS3H7E6A3VJECLRRKRKSVX5PH3VSH7F2HAUPQSPH56NCI6RTFBQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:00.229127085 (173h38m58.780597546s) [noise=true , address=145.79.227.20:4438   , piece_id=6HY2HDNJAZ552ZKXFJ7VNTQNBAQU5ZQLNKAG2NZZWZQHN6EEDG6Q, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:00.358241119 (173h38m58.909711581s) [noise=true , address=145.79.227.32:4834   , piece_id=CBK2UQ252EPFQDTOYS2X5WAUTJN4L2DTHGIOJXFZXWBOLGPRETXQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:00.646958215 (173h38m59.198428676s) [noise=true , address=145.79.227.31:4798   , piece_id=DPLALMJC4JPC5D7BOK5SOSDFDJFDDPGSJWP4XDDQE22AMFNAKATQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:00.908824080 (173h38m59.460294541s) [noise=true , address=145.79.227.23:4547   , piece_id=P4WX2ZDHV2Z6BFMF6IACIYW4DXKYFVSULUTF7EK2EMRO5OA5X5RQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:01.155346527 (173h38m59.706816989s) [noise=true , address=45.91.116.14:4189    , piece_id=NUMS6Q3F2OUAQ2PSKE2CZK2WKRQLZUZPWVBA3UA6UNKDQACPYSJQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:01.839444794 (173h39m0.390915255s) [noise=true , address=145.79.227.11:4732   , piece_id=GR6SASHNUTHAEOUPK7DWKVPHRGMG72FQMF4RINJ5NTIQQGFCVZZQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:02.591249579 (173h39m1.14272004s) [noise=true , address=145.79.227.10:4402   , piece_id=DNT5QVAMRO5OMBNVTDRRUKACMM7M5472LD5E4ASKYIBKBNWYAVRA, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:02.616126740 (173h39m1.167597202s) [noise=true , address=145.79.227.31:4797   , piece_id=UKP3MHXBSALCWFIHCTSR5JFFXEWWAWGDS4JYUYS2JEREQQKTPJSA, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:02.734605482 (173h39m1.286075943s) [noise=true , address=145.79.227.27:4691   , piece_id=NSX5S2D7ZSA5I57B4EAQEQXEVUMPKNMRKRV3RHWGWJ2DN7SWUPGQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: <nil>
Nov 16 13:43:02.734638004 (173h39m1.286108475s) [seg_pos={0 0}, upload=152907]: Segment reached optimal threshold of 13 pieces.
Nov 16 13:43:02.735049748 (173h39m1.286520209s) [noise=true , address=145.79.227.9:4366    , piece_id=YFWF2YL2YPYVMP5DHJKRUGVUUS2ALG4DRJ3HUZCDZM4N3N676FNQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1evHXReGUBYNCZaGnZ2PwmN4xZH1ABzorfhP7w61sHq4EK8Cpy): protocol: write tcp 188.166.225.170:60100->145.79.227.9:4366: use of closed network connection; write tcp 188.166.225.170:60100->145.79.227.9:4366: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60100->145.79.227.9:4366: use of closed network connection
Nov 16 13:43:02.735060949 (173h39m1.28653141s) [noise=true , address=145.79.227.9:4366    , piece_id=YFWF2YL2YPYVMP5DHJKRUGVUUS2ALG4DRJ3HUZCDZM4N3N676FNQ, seg_pos={0 0}, upload=152907]: Long tail cancellation due to optimal threshold
Nov 16 13:43:02.735509193 (173h39m1.286979654s) [noise=true , address=77.90.31.14:4662     , piece_id=S5PPMCKIKSOCLUJ4CEH7ZDW3TVUZ7GTFFEIPCQK6FX25UIOUQHHQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:50196->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:50196->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50196->77.90.31.14:4662: use of closed network connection
Nov 16 13:43:02.735518792 (173h39m1.286989253s) [noise=true , address=77.90.31.14:4662     , piece_id=S5PPMCKIKSOCLUJ4CEH7ZDW3TVUZ7GTFFEIPCQK6FX25UIOUQHHQ, seg_pos={0 0}, upload=152907]: Long tail cancellation due to optimal threshold
Nov 16 13:43:02.736224335 (173h39m1.287694796s) [noise=true , address=145.79.227.20:4437   , piece_id=G5P6OYXVAAQDZKTPPHDNZLMYTT6L2TFWKH7N4F7L6742BWHOQGBQ, seg_pos={0 0}, upload=152907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: read tcp 188.166.225.170:35300->145.79.227.20:4437: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 16 13:43:02.736239203 (173h39m1.287709654s) [noise=true , address=145.79.227.20:4437   , piece_id=G5P6OYXVAAQDZKTPPHDNZLMYTT6L2TFWKH7N4F7L6742BWHOQGBQ, seg_pos={0 0}, upload=152907]: Long tail cancellation due to optimal threshold
Nov 16 13:43:02.736270833 (173h39m1.287741294s) [seg_pos={0 0}, upload=152907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Nov 16 13:43:02.736437060 (173h39m1.287907521s) [upload=152907]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 13:43:02.736444273 (173h39m1.287914735s) [upload=152907]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 13:43:05.031396865 (173h39m3.582867336s) [upload=152907]: Done uploading segments...
Nov 16 13:43:05.031422193 (173h39m3.582892654s) [upload=152907]: Upload finished. err: <nil>
Duration: 6.130236814s core uplink us-select-1