Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 495681 reports (Page 5665 of 9914)
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration: 
6.266125418s
FAIL (2025-10-10 08:23:03 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.26615769s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration: 
6.315003998s
FAIL (2025-10-10 08:22:44 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.315034727s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [......................................X.....................]
duration: 
6.273549826s
FAIL (2025-10-10 08:22:06 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.273581237s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.......................................X....................]
duration: 
6.168773624s
FAIL (2025-10-10 08:21:13 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.168803641s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [........................................X...................]
duration: 
6.139037549s
FAIL (2025-10-10 08:20:49 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.139066413s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration: 
6.26281697s
FAIL (2025-10-10 08:20:14 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.262852929s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration: 
6.312836425s
FAIL (2025-10-10 08:19:27 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.312941493s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...........................................X................]
duration: 
6.341974943s
FAIL (2025-10-10 08:18:21 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.341996204s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [............................................X...............]
duration: 
6.377796634s
FAIL (2025-10-10 08:17:59 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.377822813s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration: 
6.093707503s
FAIL (2025-10-10 08:17:13 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.09373789s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration: 
6.285244206s
FAIL (2025-10-10 08:16:33 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.285354276s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...............................................X............]
duration: 
6.290446643s
FAIL (2025-10-10 08:16:16 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.290476199s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [................................................X...........]
duration: 
6.539932109s
FAIL (2025-10-10 08:15:34 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.539968779s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration: 
6.53435578s
FAIL (2025-10-10 08:15:03 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.534384004s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration: 
6.601207799s
FAIL (2025-10-10 08:14:40 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.601230341s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...................................................X........]
duration: 
6.296154159s
FAIL (2025-10-10 08:14:24 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.296216929s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration: 
6.177310288s
FAIL (2025-10-10 08:13:29 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.177342318s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration: 
6.18265863s
FAIL (2025-10-10 08:12:25 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.182686282s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration: 
6.121675837s
FAIL (2025-10-10 08:11:17 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.121705885s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration: 
6.193121963s
FAIL (2025-10-10 08:10:54 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.193145578s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [........................................................X...]
duration: 
6.338676617s
FAIL (2025-10-10 08:10:18 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.338752391s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration: 
6.410222059s
FAIL (2025-10-10 08:09:23 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.410249572s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration: 
24.92583082s
FAIL (2025-10-10 08:09:08 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 24.925847211s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...........................................................X]
duration: 
30.002323797s
FAIL (2025-10-10 08:08:43 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.002361187s edge gateway us-select-1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
1 out of 15 is failed (threshold=6) [X..............]
duration: 
419.361493ms
remote: 
"tcp:13.203.125.58:443"
response headers: 
Content-Length=164
X-Cluster-Name=ap-south-1-prod-hosting-red
Date=Fri, 10 Oct 2025 03:55:32 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-10-10 04:05:17 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 419.473756ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
1 out of 15 is failed (threshold=6) [.X.............]
duration: 
717.227486ms
remote: 
"tcp:13.203.125.58:443"
response headers: 
Content-Length=164
X-Cluster-Name=ap-south-1-prod-hosting-red
Date=Fri, 10 Oct 2025 03:55:32 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-10-10 04:04:54 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 717.254567ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
1 out of 15 is failed (threshold=6) [..X............]
duration: 
416.515072ms
remote: 
"tcp:13.203.125.58:443"
response headers: 
Content-Length=164
X-Cluster-Name=ap-south-1-prod-hosting-red
Date=Fri, 10 Oct 2025 03:55:32 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-10-10 04:03:44 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 416.56069ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
1 out of 15 is failed (threshold=6) [...X...........]
duration: 
675.268077ms
remote: 
"tcp:13.203.125.58:443"
response headers: 
Content-Length=164
X-Cluster-Name=ap-south-1-prod-hosting-red
Date=Fri, 10 Oct 2025 03:55:32 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-10-10 04:03:12 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 675.2913ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
1 out of 15 is failed (threshold=6) [....X..........]
duration: 
376.845013ms
remote: 
"tcp:13.203.125.58:443"
response headers: 
Content-Length=164
X-Cluster-Name=ap-south-1-prod-hosting-red
Date=Fri, 10 Oct 2025 03:55:32 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-10-10 04:02:17 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 376.863498ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
1 out of 15 is failed (threshold=6) [.....X.........]
duration: 
587.206913ms
remote: 
"tcp:13.203.125.58:443"
response headers: 
Content-Length=164
X-Cluster-Name=ap-south-1-prod-hosting-red
Date=Fri, 10 Oct 2025 03:55:32 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-10-10 04:01:28 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 587.315269ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
1 out of 15 is failed (threshold=6) [......X........]
duration: 
374.284949ms
remote: 
"tcp:13.203.125.58:443"
response headers: 
Content-Length=164
X-Cluster-Name=ap-south-1-prod-hosting-red
Date=Fri, 10 Oct 2025 03:55:32 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-10-10 04:00:30 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 374.338289ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
1 out of 15 is failed (threshold=6) [.......X.......]
duration: 
385.078552ms
remote: 
"tcp:13.203.125.58:443"
response headers: 
Content-Length=164
X-Cluster-Name=ap-south-1-prod-hosting-red
Date=Fri, 10 Oct 2025 03:55:32 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-10-10 03:59:30 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 385.108118ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
1 out of 15 is failed (threshold=6) [........X......]
duration: 
484.269781ms
remote: 
"tcp:13.203.125.58:443"
response headers: 
Content-Length=164
X-Cluster-Name=ap-south-1-prod-hosting-red
Date=Fri, 10 Oct 2025 03:55:32 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-10-10 03:59:09 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 484.297032ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
1 out of 15 is failed (threshold=6) [.........X.....]
duration: 
352.890468ms
remote: 
"tcp:13.203.125.58:443"
response headers: 
Content-Length=164
X-Cluster-Name=ap-south-1-prod-hosting-red
Date=Fri, 10 Oct 2025 03:55:32 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-10-10 03:58:10 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 352.919163ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
1 out of 15 is failed (threshold=6) [..........X....]
duration: 
380.485746ms
remote: 
"tcp:13.203.125.58:443"
response headers: 
Content-Length=164
X-Cluster-Name=ap-south-1-prod-hosting-red
Date=Fri, 10 Oct 2025 03:55:32 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-10-10 03:57:46 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 380.514982ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
1 out of 15 is failed (threshold=6) [...........X...]
duration: 
374.813777ms
remote: 
"tcp:13.203.125.58:443"
response headers: 
Content-Length=164
X-Cluster-Name=ap-south-1-prod-hosting-red
Date=Fri, 10 Oct 2025 03:55:32 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-10-10 03:57:26 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 374.845387ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
1 out of 15 is failed (threshold=6) [............X..]
duration: 
370.686384ms
remote: 
"tcp:13.203.125.58:443"
response headers: 
Content-Length=164
X-Cluster-Name=ap-south-1-prod-hosting-red
Date=Fri, 10 Oct 2025 03:55:32 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-10-10 03:57:03 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 370.719427ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
1 out of 15 is failed (threshold=6) [.............X.]
duration: 
396.095169ms
remote: 
"tcp:13.203.125.58:443"
response headers: 
Content-Length=164
X-Cluster-Name=ap-south-1-prod-hosting-red
Date=Fri, 10 Oct 2025 03:55:32 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-10-10 03:56:20 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 396.115006ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
1 out of 15 is failed (threshold=6) [..............X]
duration: 
20.254324833s
remote: 
"tcp:13.203.125.58:443"
response headers: 
Content-Length=164
X-Cluster-Name=ap-south-1-prod-hosting-red
Date=Fri, 10 Oct 2025 03:55:32 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-10-10 03:55:32 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 20.25434986s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [X...........................................................]
duration: 
6.294007935s
FAIL (2025-10-09 16:18:56 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, Piece ID: NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q) context deadline exceeded; piecestore: (Node ID: 12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, Piece ID: 3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ) context deadline exceeded
======LOGS======
Oct  9 15:37:02.242123523 (386h5m47.704215996s) [upload=339720]: Starting upload
Oct  9 15:37:02.242222231 (386h5m47.704314714s) [upload=339720]: Done starting upload
Oct  9 15:37:02.242341397 (386h5m47.70443388s) [upload=339720]: Uploading segments...
Oct  9 15:37:02.242462188 (386h5m47.704554671s) [upload=339720]: Got next segment. Inline: false
Oct  9 15:37:02.242528735 (386h5m47.704621218s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct  9 15:37:02.242536409 (386h5m47.704628892s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct  9 15:37:02.504197156 (386h5m47.966289629s) [seg_pos={0 0}, upload=339720]: Begin upload segment...
Oct  9 15:37:02.504256378 (386h5m47.966348861s) [seg_pos={0 0}, upload=339720]: Done begin upload segment.
Oct  9 15:37:02.504284772 (386h5m47.966377255s) [noise=true , address=145.79.227.13:4804   , piece_id=FUN5LPTLV2JQNLJB4JGNFWZIAVQTGEBJZULLVEP73PSHFSM3NZAA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.506016159 (386h5m47.968108642s) [noise=true , address=145.79.227.4:4185    , piece_id=UTDL5IOQ6GMNGPDMB3NQ4HCAYVODWE3JIOXBOK5H7OSKLON4FCQQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.506805693 (386h5m47.968898176s) [noise=true , address=145.79.227.12:4767   , piece_id=EHEIO5WX5PQKX5ZDHPZ2XMAZTCTZAAII4L2Q4DJAI3GG2DX3XUXQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.507381258 (386h5m47.969473751s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.508983771 (386h5m47.971076254s) [noise=true , address=77.90.31.17:4770     , piece_id=TCKYBCAFTDTNTLJCQRVEFCCHKT3DLNYILNR7MVOWFI4YHYBKPR6A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.509265788 (386h5m47.971358281s) [noise=true , address=77.90.31.21:4877     , piece_id=3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.510802103 (386h5m47.972894586s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.510991884 (386h5m47.973084377s) [noise=true , address=145.79.227.11:4730   , piece_id=HBZCZVD5H27SWWTMVDWWNHOJZCVQC2YI6DX4DY2A3GDOQ54PMD2A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.512377853 (386h5m47.974470336s) [noise=true , address=45.91.116.10:4083    , piece_id=WWFIBCZ4S3SYN3NOUWPO276LIQJ7BM7X42G6Z2UY2O3EJDP5GGRA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.512884819 (386h5m47.974977312s) [noise=true , address=145.79.227.17:4970   , piece_id=2F5TXHEN3LIB2XN4DTSQN6W75BSTZYK3EL5JDKOMWI7VL27PTARA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.513772208 (386h5m47.975864691s) [noise=true , address=77.90.31.19:4842     , piece_id=5GRKUSGWRVZZNJSQ7AVDAFRB2YRIOF3PQRCEMNENLLZMKAPIRT7Q, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.514679907 (386h5m47.97677239s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.515172375 (386h5m47.977264858s) [noise=true , address=145.79.227.7:4295    , piece_id=DXIJ26ILOHWTMS75FPHW7RRVB4CHHTWPRNQ5TQEE42GGH2TJVS2A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.516618288 (386h5m47.978710771s) [noise=true , address=77.90.31.21:4878     , piece_id=NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.516681799 (386h5m47.978774282s) [noise=true , address=77.90.31.18:4807     , piece_id=3MVQ72K2DFLN2SZHDDGB5EK6WSKBIEOQAYKQKQQQLNQRIMZEEZOQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.519789937 (386h5m47.98188243s) [noise=true , address=45.91.116.5:4299     , piece_id=EOURFB5N5DEUK6PRMWDZI7TCLXDK2DCY36DIR4ETE5FI67KCJ37A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:04.342892789 (386h5m49.804985272s) [upload=339720]: Next returned nil segment
Oct  9 15:37:04.342934217 (386h5m49.8050267s) [upload=339720]: Waiting for error group managing segments...
Oct  9 15:37:04.771607028 (386h5m50.233699511s) [noise=true , address=45.91.116.10:4083    , piece_id=WWFIBCZ4S3SYN3NOUWPO276LIQJ7BM7X42G6Z2UY2O3EJDP5GGRA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.808771606 (386h5m50.270864089s) [noise=true , address=77.90.31.18:4807     , piece_id=3MVQ72K2DFLN2SZHDDGB5EK6WSKBIEOQAYKQKQQQLNQRIMZEEZOQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.911015099 (386h5m50.373107582s) [noise=true , address=77.90.31.19:4842     , piece_id=5GRKUSGWRVZZNJSQ7AVDAFRB2YRIOF3PQRCEMNENLLZMKAPIRT7Q, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.937504590 (386h5m50.399597073s) [noise=true , address=45.91.116.5:4299     , piece_id=EOURFB5N5DEUK6PRMWDZI7TCLXDK2DCY36DIR4ETE5FI67KCJ37A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.014747387 (386h5m50.47683987s) [noise=true , address=77.90.31.21:4878     , piece_id=NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.181525045 (386h5m50.643617528s) [noise=true , address=77.90.31.17:4770     , piece_id=TCKYBCAFTDTNTLJCQRVEFCCHKT3DLNYILNR7MVOWFI4YHYBKPR6A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.385017486 (386h5m50.847109969s) [noise=true , address=145.79.227.7:4295    , piece_id=DXIJ26ILOHWTMS75FPHW7RRVB4CHHTWPRNQ5TQEE42GGH2TJVS2A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.404928321 (386h5m50.867020804s) [noise=true , address=145.79.227.4:4185    , piece_id=UTDL5IOQ6GMNGPDMB3NQ4HCAYVODWE3JIOXBOK5H7OSKLON4FCQQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.456562682 (386h5m50.918655175s) [noise=true , address=145.79.227.11:4730   , piece_id=HBZCZVD5H27SWWTMVDWWNHOJZCVQC2YI6DX4DY2A3GDOQ54PMD2A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.515032722 (386h5m50.977125205s) [noise=true , address=77.90.31.21:4877     , piece_id=3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.926564111 (386h5m51.388656595s) [noise=true , address=145.79.227.12:4767   , piece_id=EHEIO5WX5PQKX5ZDHPZ2XMAZTCTZAAII4L2Q4DJAI3GG2DX3XUXQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.373844666 (386h5m51.835937149s) [noise=true , address=145.79.227.13:4804   , piece_id=FUN5LPTLV2JQNLJB4JGNFWZIAVQTGEBJZULLVEP73PSHFSM3NZAA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.736384436 (386h5m52.198476909s) [noise=true , address=145.79.227.17:4970   , piece_id=2F5TXHEN3LIB2XN4DTSQN6W75BSTZYK3EL5JDKOMWI7VL27PTARA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.736427608 (386h5m52.198520091s) [seg_pos={0 0}, upload=339720]: Segment reached optimal threshold of 13 pieces.
Oct  9 15:37:06.736566292 (386h5m52.198658775s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736576751 (386h5m52.198669234s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736597040 (386h5m52.198689543s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736607961 (386h5m52.198700444s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736799205 (386h5m52.198891699s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736808032 (386h5m52.198900505s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736843279 (386h5m52.198935762s) [seg_pos={0 0}, upload=339720]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct  9 15:37:06.736970692 (386h5m52.199063185s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct  9 15:37:06.736978837 (386h5m52.19907132s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct  9 15:37:07.042768755 (386h5m52.504861238s) [upload=339720]: Done uploading segments...
Oct  9 15:37:07.042792771 (386h5m52.504885254s) [upload=339720]: Upload finished. err: <nil>
Duration: 6.294055325s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration: 
7.379476217s
FAIL (2025-10-09 16:18:00 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, Piece ID: NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q) context deadline exceeded; piecestore: (Node ID: 12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, Piece ID: 3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ) context deadline exceeded
======LOGS======
Oct  9 15:37:02.242123523 (386h5m47.704215996s) [upload=339720]: Starting upload
Oct  9 15:37:02.242222231 (386h5m47.704314714s) [upload=339720]: Done starting upload
Oct  9 15:37:02.242341397 (386h5m47.70443388s) [upload=339720]: Uploading segments...
Oct  9 15:37:02.242462188 (386h5m47.704554671s) [upload=339720]: Got next segment. Inline: false
Oct  9 15:37:02.242528735 (386h5m47.704621218s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct  9 15:37:02.242536409 (386h5m47.704628892s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct  9 15:37:02.504197156 (386h5m47.966289629s) [seg_pos={0 0}, upload=339720]: Begin upload segment...
Oct  9 15:37:02.504256378 (386h5m47.966348861s) [seg_pos={0 0}, upload=339720]: Done begin upload segment.
Oct  9 15:37:02.504284772 (386h5m47.966377255s) [noise=true , address=145.79.227.13:4804   , piece_id=FUN5LPTLV2JQNLJB4JGNFWZIAVQTGEBJZULLVEP73PSHFSM3NZAA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.506016159 (386h5m47.968108642s) [noise=true , address=145.79.227.4:4185    , piece_id=UTDL5IOQ6GMNGPDMB3NQ4HCAYVODWE3JIOXBOK5H7OSKLON4FCQQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.506805693 (386h5m47.968898176s) [noise=true , address=145.79.227.12:4767   , piece_id=EHEIO5WX5PQKX5ZDHPZ2XMAZTCTZAAII4L2Q4DJAI3GG2DX3XUXQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.507381258 (386h5m47.969473751s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.508983771 (386h5m47.971076254s) [noise=true , address=77.90.31.17:4770     , piece_id=TCKYBCAFTDTNTLJCQRVEFCCHKT3DLNYILNR7MVOWFI4YHYBKPR6A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.509265788 (386h5m47.971358281s) [noise=true , address=77.90.31.21:4877     , piece_id=3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.510802103 (386h5m47.972894586s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.510991884 (386h5m47.973084377s) [noise=true , address=145.79.227.11:4730   , piece_id=HBZCZVD5H27SWWTMVDWWNHOJZCVQC2YI6DX4DY2A3GDOQ54PMD2A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.512377853 (386h5m47.974470336s) [noise=true , address=45.91.116.10:4083    , piece_id=WWFIBCZ4S3SYN3NOUWPO276LIQJ7BM7X42G6Z2UY2O3EJDP5GGRA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.512884819 (386h5m47.974977312s) [noise=true , address=145.79.227.17:4970   , piece_id=2F5TXHEN3LIB2XN4DTSQN6W75BSTZYK3EL5JDKOMWI7VL27PTARA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.513772208 (386h5m47.975864691s) [noise=true , address=77.90.31.19:4842     , piece_id=5GRKUSGWRVZZNJSQ7AVDAFRB2YRIOF3PQRCEMNENLLZMKAPIRT7Q, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.514679907 (386h5m47.97677239s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.515172375 (386h5m47.977264858s) [noise=true , address=145.79.227.7:4295    , piece_id=DXIJ26ILOHWTMS75FPHW7RRVB4CHHTWPRNQ5TQEE42GGH2TJVS2A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.516618288 (386h5m47.978710771s) [noise=true , address=77.90.31.21:4878     , piece_id=NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.516681799 (386h5m47.978774282s) [noise=true , address=77.90.31.18:4807     , piece_id=3MVQ72K2DFLN2SZHDDGB5EK6WSKBIEOQAYKQKQQQLNQRIMZEEZOQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.519789937 (386h5m47.98188243s) [noise=true , address=45.91.116.5:4299     , piece_id=EOURFB5N5DEUK6PRMWDZI7TCLXDK2DCY36DIR4ETE5FI67KCJ37A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:04.342892789 (386h5m49.804985272s) [upload=339720]: Next returned nil segment
Oct  9 15:37:04.342934217 (386h5m49.8050267s) [upload=339720]: Waiting for error group managing segments...
Oct  9 15:37:04.771607028 (386h5m50.233699511s) [noise=true , address=45.91.116.10:4083    , piece_id=WWFIBCZ4S3SYN3NOUWPO276LIQJ7BM7X42G6Z2UY2O3EJDP5GGRA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.808771606 (386h5m50.270864089s) [noise=true , address=77.90.31.18:4807     , piece_id=3MVQ72K2DFLN2SZHDDGB5EK6WSKBIEOQAYKQKQQQLNQRIMZEEZOQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.911015099 (386h5m50.373107582s) [noise=true , address=77.90.31.19:4842     , piece_id=5GRKUSGWRVZZNJSQ7AVDAFRB2YRIOF3PQRCEMNENLLZMKAPIRT7Q, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.937504590 (386h5m50.399597073s) [noise=true , address=45.91.116.5:4299     , piece_id=EOURFB5N5DEUK6PRMWDZI7TCLXDK2DCY36DIR4ETE5FI67KCJ37A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.014747387 (386h5m50.47683987s) [noise=true , address=77.90.31.21:4878     , piece_id=NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.181525045 (386h5m50.643617528s) [noise=true , address=77.90.31.17:4770     , piece_id=TCKYBCAFTDTNTLJCQRVEFCCHKT3DLNYILNR7MVOWFI4YHYBKPR6A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.385017486 (386h5m50.847109969s) [noise=true , address=145.79.227.7:4295    , piece_id=DXIJ26ILOHWTMS75FPHW7RRVB4CHHTWPRNQ5TQEE42GGH2TJVS2A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.404928321 (386h5m50.867020804s) [noise=true , address=145.79.227.4:4185    , piece_id=UTDL5IOQ6GMNGPDMB3NQ4HCAYVODWE3JIOXBOK5H7OSKLON4FCQQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.456562682 (386h5m50.918655175s) [noise=true , address=145.79.227.11:4730   , piece_id=HBZCZVD5H27SWWTMVDWWNHOJZCVQC2YI6DX4DY2A3GDOQ54PMD2A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.515032722 (386h5m50.977125205s) [noise=true , address=77.90.31.21:4877     , piece_id=3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.926564111 (386h5m51.388656595s) [noise=true , address=145.79.227.12:4767   , piece_id=EHEIO5WX5PQKX5ZDHPZ2XMAZTCTZAAII4L2Q4DJAI3GG2DX3XUXQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.373844666 (386h5m51.835937149s) [noise=true , address=145.79.227.13:4804   , piece_id=FUN5LPTLV2JQNLJB4JGNFWZIAVQTGEBJZULLVEP73PSHFSM3NZAA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.736384436 (386h5m52.198476909s) [noise=true , address=145.79.227.17:4970   , piece_id=2F5TXHEN3LIB2XN4DTSQN6W75BSTZYK3EL5JDKOMWI7VL27PTARA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.736427608 (386h5m52.198520091s) [seg_pos={0 0}, upload=339720]: Segment reached optimal threshold of 13 pieces.
Oct  9 15:37:06.736566292 (386h5m52.198658775s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736576751 (386h5m52.198669234s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736597040 (386h5m52.198689543s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736607961 (386h5m52.198700444s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736799205 (386h5m52.198891699s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736808032 (386h5m52.198900505s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736843279 (386h5m52.198935762s) [seg_pos={0 0}, upload=339720]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct  9 15:37:06.736970692 (386h5m52.199063185s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct  9 15:37:06.736978837 (386h5m52.19907132s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct  9 15:37:07.042768755 (386h5m52.504861238s) [upload=339720]: Done uploading segments...
Oct  9 15:37:07.042792771 (386h5m52.504885254s) [upload=339720]: Upload finished. err: <nil>
Duration: 7.379509542s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration: 
14.967934898s
FAIL (2025-10-09 16:17:18 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, Piece ID: NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q) context deadline exceeded; piecestore: (Node ID: 12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, Piece ID: 3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ) context deadline exceeded
======LOGS======
Oct  9 15:37:02.242123523 (386h5m47.704215996s) [upload=339720]: Starting upload
Oct  9 15:37:02.242222231 (386h5m47.704314714s) [upload=339720]: Done starting upload
Oct  9 15:37:02.242341397 (386h5m47.70443388s) [upload=339720]: Uploading segments...
Oct  9 15:37:02.242462188 (386h5m47.704554671s) [upload=339720]: Got next segment. Inline: false
Oct  9 15:37:02.242528735 (386h5m47.704621218s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct  9 15:37:02.242536409 (386h5m47.704628892s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct  9 15:37:02.504197156 (386h5m47.966289629s) [seg_pos={0 0}, upload=339720]: Begin upload segment...
Oct  9 15:37:02.504256378 (386h5m47.966348861s) [seg_pos={0 0}, upload=339720]: Done begin upload segment.
Oct  9 15:37:02.504284772 (386h5m47.966377255s) [noise=true , address=145.79.227.13:4804   , piece_id=FUN5LPTLV2JQNLJB4JGNFWZIAVQTGEBJZULLVEP73PSHFSM3NZAA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.506016159 (386h5m47.968108642s) [noise=true , address=145.79.227.4:4185    , piece_id=UTDL5IOQ6GMNGPDMB3NQ4HCAYVODWE3JIOXBOK5H7OSKLON4FCQQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.506805693 (386h5m47.968898176s) [noise=true , address=145.79.227.12:4767   , piece_id=EHEIO5WX5PQKX5ZDHPZ2XMAZTCTZAAII4L2Q4DJAI3GG2DX3XUXQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.507381258 (386h5m47.969473751s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.508983771 (386h5m47.971076254s) [noise=true , address=77.90.31.17:4770     , piece_id=TCKYBCAFTDTNTLJCQRVEFCCHKT3DLNYILNR7MVOWFI4YHYBKPR6A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.509265788 (386h5m47.971358281s) [noise=true , address=77.90.31.21:4877     , piece_id=3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.510802103 (386h5m47.972894586s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.510991884 (386h5m47.973084377s) [noise=true , address=145.79.227.11:4730   , piece_id=HBZCZVD5H27SWWTMVDWWNHOJZCVQC2YI6DX4DY2A3GDOQ54PMD2A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.512377853 (386h5m47.974470336s) [noise=true , address=45.91.116.10:4083    , piece_id=WWFIBCZ4S3SYN3NOUWPO276LIQJ7BM7X42G6Z2UY2O3EJDP5GGRA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.512884819 (386h5m47.974977312s) [noise=true , address=145.79.227.17:4970   , piece_id=2F5TXHEN3LIB2XN4DTSQN6W75BSTZYK3EL5JDKOMWI7VL27PTARA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.513772208 (386h5m47.975864691s) [noise=true , address=77.90.31.19:4842     , piece_id=5GRKUSGWRVZZNJSQ7AVDAFRB2YRIOF3PQRCEMNENLLZMKAPIRT7Q, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.514679907 (386h5m47.97677239s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.515172375 (386h5m47.977264858s) [noise=true , address=145.79.227.7:4295    , piece_id=DXIJ26ILOHWTMS75FPHW7RRVB4CHHTWPRNQ5TQEE42GGH2TJVS2A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.516618288 (386h5m47.978710771s) [noise=true , address=77.90.31.21:4878     , piece_id=NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.516681799 (386h5m47.978774282s) [noise=true , address=77.90.31.18:4807     , piece_id=3MVQ72K2DFLN2SZHDDGB5EK6WSKBIEOQAYKQKQQQLNQRIMZEEZOQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.519789937 (386h5m47.98188243s) [noise=true , address=45.91.116.5:4299     , piece_id=EOURFB5N5DEUK6PRMWDZI7TCLXDK2DCY36DIR4ETE5FI67KCJ37A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:04.342892789 (386h5m49.804985272s) [upload=339720]: Next returned nil segment
Oct  9 15:37:04.342934217 (386h5m49.8050267s) [upload=339720]: Waiting for error group managing segments...
Oct  9 15:37:04.771607028 (386h5m50.233699511s) [noise=true , address=45.91.116.10:4083    , piece_id=WWFIBCZ4S3SYN3NOUWPO276LIQJ7BM7X42G6Z2UY2O3EJDP5GGRA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.808771606 (386h5m50.270864089s) [noise=true , address=77.90.31.18:4807     , piece_id=3MVQ72K2DFLN2SZHDDGB5EK6WSKBIEOQAYKQKQQQLNQRIMZEEZOQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.911015099 (386h5m50.373107582s) [noise=true , address=77.90.31.19:4842     , piece_id=5GRKUSGWRVZZNJSQ7AVDAFRB2YRIOF3PQRCEMNENLLZMKAPIRT7Q, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.937504590 (386h5m50.399597073s) [noise=true , address=45.91.116.5:4299     , piece_id=EOURFB5N5DEUK6PRMWDZI7TCLXDK2DCY36DIR4ETE5FI67KCJ37A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.014747387 (386h5m50.47683987s) [noise=true , address=77.90.31.21:4878     , piece_id=NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.181525045 (386h5m50.643617528s) [noise=true , address=77.90.31.17:4770     , piece_id=TCKYBCAFTDTNTLJCQRVEFCCHKT3DLNYILNR7MVOWFI4YHYBKPR6A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.385017486 (386h5m50.847109969s) [noise=true , address=145.79.227.7:4295    , piece_id=DXIJ26ILOHWTMS75FPHW7RRVB4CHHTWPRNQ5TQEE42GGH2TJVS2A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.404928321 (386h5m50.867020804s) [noise=true , address=145.79.227.4:4185    , piece_id=UTDL5IOQ6GMNGPDMB3NQ4HCAYVODWE3JIOXBOK5H7OSKLON4FCQQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.456562682 (386h5m50.918655175s) [noise=true , address=145.79.227.11:4730   , piece_id=HBZCZVD5H27SWWTMVDWWNHOJZCVQC2YI6DX4DY2A3GDOQ54PMD2A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.515032722 (386h5m50.977125205s) [noise=true , address=77.90.31.21:4877     , piece_id=3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.926564111 (386h5m51.388656595s) [noise=true , address=145.79.227.12:4767   , piece_id=EHEIO5WX5PQKX5ZDHPZ2XMAZTCTZAAII4L2Q4DJAI3GG2DX3XUXQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.373844666 (386h5m51.835937149s) [noise=true , address=145.79.227.13:4804   , piece_id=FUN5LPTLV2JQNLJB4JGNFWZIAVQTGEBJZULLVEP73PSHFSM3NZAA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.736384436 (386h5m52.198476909s) [noise=true , address=145.79.227.17:4970   , piece_id=2F5TXHEN3LIB2XN4DTSQN6W75BSTZYK3EL5JDKOMWI7VL27PTARA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.736427608 (386h5m52.198520091s) [seg_pos={0 0}, upload=339720]: Segment reached optimal threshold of 13 pieces.
Oct  9 15:37:06.736566292 (386h5m52.198658775s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736576751 (386h5m52.198669234s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736597040 (386h5m52.198689543s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736607961 (386h5m52.198700444s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736799205 (386h5m52.198891699s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736808032 (386h5m52.198900505s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736843279 (386h5m52.198935762s) [seg_pos={0 0}, upload=339720]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct  9 15:37:06.736970692 (386h5m52.199063185s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct  9 15:37:06.736978837 (386h5m52.19907132s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct  9 15:37:07.042768755 (386h5m52.504861238s) [upload=339720]: Done uploading segments...
Oct  9 15:37:07.042792771 (386h5m52.504885254s) [upload=339720]: Upload finished. err: <nil>
Duration: 14.967964825s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...X........................................................]
duration: 
6.986035399s
FAIL (2025-10-09 16:16:40 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, Piece ID: NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q) context deadline exceeded; piecestore: (Node ID: 12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, Piece ID: 3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ) context deadline exceeded
======LOGS======
Oct  9 15:37:02.242123523 (386h5m47.704215996s) [upload=339720]: Starting upload
Oct  9 15:37:02.242222231 (386h5m47.704314714s) [upload=339720]: Done starting upload
Oct  9 15:37:02.242341397 (386h5m47.70443388s) [upload=339720]: Uploading segments...
Oct  9 15:37:02.242462188 (386h5m47.704554671s) [upload=339720]: Got next segment. Inline: false
Oct  9 15:37:02.242528735 (386h5m47.704621218s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct  9 15:37:02.242536409 (386h5m47.704628892s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct  9 15:37:02.504197156 (386h5m47.966289629s) [seg_pos={0 0}, upload=339720]: Begin upload segment...
Oct  9 15:37:02.504256378 (386h5m47.966348861s) [seg_pos={0 0}, upload=339720]: Done begin upload segment.
Oct  9 15:37:02.504284772 (386h5m47.966377255s) [noise=true , address=145.79.227.13:4804   , piece_id=FUN5LPTLV2JQNLJB4JGNFWZIAVQTGEBJZULLVEP73PSHFSM3NZAA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.506016159 (386h5m47.968108642s) [noise=true , address=145.79.227.4:4185    , piece_id=UTDL5IOQ6GMNGPDMB3NQ4HCAYVODWE3JIOXBOK5H7OSKLON4FCQQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.506805693 (386h5m47.968898176s) [noise=true , address=145.79.227.12:4767   , piece_id=EHEIO5WX5PQKX5ZDHPZ2XMAZTCTZAAII4L2Q4DJAI3GG2DX3XUXQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.507381258 (386h5m47.969473751s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.508983771 (386h5m47.971076254s) [noise=true , address=77.90.31.17:4770     , piece_id=TCKYBCAFTDTNTLJCQRVEFCCHKT3DLNYILNR7MVOWFI4YHYBKPR6A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.509265788 (386h5m47.971358281s) [noise=true , address=77.90.31.21:4877     , piece_id=3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.510802103 (386h5m47.972894586s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.510991884 (386h5m47.973084377s) [noise=true , address=145.79.227.11:4730   , piece_id=HBZCZVD5H27SWWTMVDWWNHOJZCVQC2YI6DX4DY2A3GDOQ54PMD2A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.512377853 (386h5m47.974470336s) [noise=true , address=45.91.116.10:4083    , piece_id=WWFIBCZ4S3SYN3NOUWPO276LIQJ7BM7X42G6Z2UY2O3EJDP5GGRA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.512884819 (386h5m47.974977312s) [noise=true , address=145.79.227.17:4970   , piece_id=2F5TXHEN3LIB2XN4DTSQN6W75BSTZYK3EL5JDKOMWI7VL27PTARA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.513772208 (386h5m47.975864691s) [noise=true , address=77.90.31.19:4842     , piece_id=5GRKUSGWRVZZNJSQ7AVDAFRB2YRIOF3PQRCEMNENLLZMKAPIRT7Q, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.514679907 (386h5m47.97677239s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.515172375 (386h5m47.977264858s) [noise=true , address=145.79.227.7:4295    , piece_id=DXIJ26ILOHWTMS75FPHW7RRVB4CHHTWPRNQ5TQEE42GGH2TJVS2A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.516618288 (386h5m47.978710771s) [noise=true , address=77.90.31.21:4878     , piece_id=NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.516681799 (386h5m47.978774282s) [noise=true , address=77.90.31.18:4807     , piece_id=3MVQ72K2DFLN2SZHDDGB5EK6WSKBIEOQAYKQKQQQLNQRIMZEEZOQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.519789937 (386h5m47.98188243s) [noise=true , address=45.91.116.5:4299     , piece_id=EOURFB5N5DEUK6PRMWDZI7TCLXDK2DCY36DIR4ETE5FI67KCJ37A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:04.342892789 (386h5m49.804985272s) [upload=339720]: Next returned nil segment
Oct  9 15:37:04.342934217 (386h5m49.8050267s) [upload=339720]: Waiting for error group managing segments...
Oct  9 15:37:04.771607028 (386h5m50.233699511s) [noise=true , address=45.91.116.10:4083    , piece_id=WWFIBCZ4S3SYN3NOUWPO276LIQJ7BM7X42G6Z2UY2O3EJDP5GGRA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.808771606 (386h5m50.270864089s) [noise=true , address=77.90.31.18:4807     , piece_id=3MVQ72K2DFLN2SZHDDGB5EK6WSKBIEOQAYKQKQQQLNQRIMZEEZOQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.911015099 (386h5m50.373107582s) [noise=true , address=77.90.31.19:4842     , piece_id=5GRKUSGWRVZZNJSQ7AVDAFRB2YRIOF3PQRCEMNENLLZMKAPIRT7Q, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.937504590 (386h5m50.399597073s) [noise=true , address=45.91.116.5:4299     , piece_id=EOURFB5N5DEUK6PRMWDZI7TCLXDK2DCY36DIR4ETE5FI67KCJ37A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.014747387 (386h5m50.47683987s) [noise=true , address=77.90.31.21:4878     , piece_id=NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.181525045 (386h5m50.643617528s) [noise=true , address=77.90.31.17:4770     , piece_id=TCKYBCAFTDTNTLJCQRVEFCCHKT3DLNYILNR7MVOWFI4YHYBKPR6A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.385017486 (386h5m50.847109969s) [noise=true , address=145.79.227.7:4295    , piece_id=DXIJ26ILOHWTMS75FPHW7RRVB4CHHTWPRNQ5TQEE42GGH2TJVS2A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.404928321 (386h5m50.867020804s) [noise=true , address=145.79.227.4:4185    , piece_id=UTDL5IOQ6GMNGPDMB3NQ4HCAYVODWE3JIOXBOK5H7OSKLON4FCQQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.456562682 (386h5m50.918655175s) [noise=true , address=145.79.227.11:4730   , piece_id=HBZCZVD5H27SWWTMVDWWNHOJZCVQC2YI6DX4DY2A3GDOQ54PMD2A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.515032722 (386h5m50.977125205s) [noise=true , address=77.90.31.21:4877     , piece_id=3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.926564111 (386h5m51.388656595s) [noise=true , address=145.79.227.12:4767   , piece_id=EHEIO5WX5PQKX5ZDHPZ2XMAZTCTZAAII4L2Q4DJAI3GG2DX3XUXQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.373844666 (386h5m51.835937149s) [noise=true , address=145.79.227.13:4804   , piece_id=FUN5LPTLV2JQNLJB4JGNFWZIAVQTGEBJZULLVEP73PSHFSM3NZAA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.736384436 (386h5m52.198476909s) [noise=true , address=145.79.227.17:4970   , piece_id=2F5TXHEN3LIB2XN4DTSQN6W75BSTZYK3EL5JDKOMWI7VL27PTARA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.736427608 (386h5m52.198520091s) [seg_pos={0 0}, upload=339720]: Segment reached optimal threshold of 13 pieces.
Oct  9 15:37:06.736566292 (386h5m52.198658775s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736576751 (386h5m52.198669234s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736597040 (386h5m52.198689543s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736607961 (386h5m52.198700444s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736799205 (386h5m52.198891699s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736808032 (386h5m52.198900505s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736843279 (386h5m52.198935762s) [seg_pos={0 0}, upload=339720]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct  9 15:37:06.736970692 (386h5m52.199063185s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct  9 15:37:06.736978837 (386h5m52.19907132s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct  9 15:37:07.042768755 (386h5m52.504861238s) [upload=339720]: Done uploading segments...
Oct  9 15:37:07.042792771 (386h5m52.504885254s) [upload=339720]: Upload finished. err: <nil>
Duration: 6.986275838s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration: 
13.479624127s
FAIL (2025-10-09 16:15:42 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, Piece ID: NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q) context deadline exceeded; piecestore: (Node ID: 12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, Piece ID: 3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ) context deadline exceeded
======LOGS======
Oct  9 15:37:02.242123523 (386h5m47.704215996s) [upload=339720]: Starting upload
Oct  9 15:37:02.242222231 (386h5m47.704314714s) [upload=339720]: Done starting upload
Oct  9 15:37:02.242341397 (386h5m47.70443388s) [upload=339720]: Uploading segments...
Oct  9 15:37:02.242462188 (386h5m47.704554671s) [upload=339720]: Got next segment. Inline: false
Oct  9 15:37:02.242528735 (386h5m47.704621218s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct  9 15:37:02.242536409 (386h5m47.704628892s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct  9 15:37:02.504197156 (386h5m47.966289629s) [seg_pos={0 0}, upload=339720]: Begin upload segment...
Oct  9 15:37:02.504256378 (386h5m47.966348861s) [seg_pos={0 0}, upload=339720]: Done begin upload segment.
Oct  9 15:37:02.504284772 (386h5m47.966377255s) [noise=true , address=145.79.227.13:4804   , piece_id=FUN5LPTLV2JQNLJB4JGNFWZIAVQTGEBJZULLVEP73PSHFSM3NZAA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.506016159 (386h5m47.968108642s) [noise=true , address=145.79.227.4:4185    , piece_id=UTDL5IOQ6GMNGPDMB3NQ4HCAYVODWE3JIOXBOK5H7OSKLON4FCQQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.506805693 (386h5m47.968898176s) [noise=true , address=145.79.227.12:4767   , piece_id=EHEIO5WX5PQKX5ZDHPZ2XMAZTCTZAAII4L2Q4DJAI3GG2DX3XUXQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.507381258 (386h5m47.969473751s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.508983771 (386h5m47.971076254s) [noise=true , address=77.90.31.17:4770     , piece_id=TCKYBCAFTDTNTLJCQRVEFCCHKT3DLNYILNR7MVOWFI4YHYBKPR6A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.509265788 (386h5m47.971358281s) [noise=true , address=77.90.31.21:4877     , piece_id=3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.510802103 (386h5m47.972894586s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.510991884 (386h5m47.973084377s) [noise=true , address=145.79.227.11:4730   , piece_id=HBZCZVD5H27SWWTMVDWWNHOJZCVQC2YI6DX4DY2A3GDOQ54PMD2A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.512377853 (386h5m47.974470336s) [noise=true , address=45.91.116.10:4083    , piece_id=WWFIBCZ4S3SYN3NOUWPO276LIQJ7BM7X42G6Z2UY2O3EJDP5GGRA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.512884819 (386h5m47.974977312s) [noise=true , address=145.79.227.17:4970   , piece_id=2F5TXHEN3LIB2XN4DTSQN6W75BSTZYK3EL5JDKOMWI7VL27PTARA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.513772208 (386h5m47.975864691s) [noise=true , address=77.90.31.19:4842     , piece_id=5GRKUSGWRVZZNJSQ7AVDAFRB2YRIOF3PQRCEMNENLLZMKAPIRT7Q, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.514679907 (386h5m47.97677239s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.515172375 (386h5m47.977264858s) [noise=true , address=145.79.227.7:4295    , piece_id=DXIJ26ILOHWTMS75FPHW7RRVB4CHHTWPRNQ5TQEE42GGH2TJVS2A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.516618288 (386h5m47.978710771s) [noise=true , address=77.90.31.21:4878     , piece_id=NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.516681799 (386h5m47.978774282s) [noise=true , address=77.90.31.18:4807     , piece_id=3MVQ72K2DFLN2SZHDDGB5EK6WSKBIEOQAYKQKQQQLNQRIMZEEZOQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.519789937 (386h5m47.98188243s) [noise=true , address=45.91.116.5:4299     , piece_id=EOURFB5N5DEUK6PRMWDZI7TCLXDK2DCY36DIR4ETE5FI67KCJ37A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:04.342892789 (386h5m49.804985272s) [upload=339720]: Next returned nil segment
Oct  9 15:37:04.342934217 (386h5m49.8050267s) [upload=339720]: Waiting for error group managing segments...
Oct  9 15:37:04.771607028 (386h5m50.233699511s) [noise=true , address=45.91.116.10:4083    , piece_id=WWFIBCZ4S3SYN3NOUWPO276LIQJ7BM7X42G6Z2UY2O3EJDP5GGRA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.808771606 (386h5m50.270864089s) [noise=true , address=77.90.31.18:4807     , piece_id=3MVQ72K2DFLN2SZHDDGB5EK6WSKBIEOQAYKQKQQQLNQRIMZEEZOQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.911015099 (386h5m50.373107582s) [noise=true , address=77.90.31.19:4842     , piece_id=5GRKUSGWRVZZNJSQ7AVDAFRB2YRIOF3PQRCEMNENLLZMKAPIRT7Q, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.937504590 (386h5m50.399597073s) [noise=true , address=45.91.116.5:4299     , piece_id=EOURFB5N5DEUK6PRMWDZI7TCLXDK2DCY36DIR4ETE5FI67KCJ37A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.014747387 (386h5m50.47683987s) [noise=true , address=77.90.31.21:4878     , piece_id=NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.181525045 (386h5m50.643617528s) [noise=true , address=77.90.31.17:4770     , piece_id=TCKYBCAFTDTNTLJCQRVEFCCHKT3DLNYILNR7MVOWFI4YHYBKPR6A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.385017486 (386h5m50.847109969s) [noise=true , address=145.79.227.7:4295    , piece_id=DXIJ26ILOHWTMS75FPHW7RRVB4CHHTWPRNQ5TQEE42GGH2TJVS2A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.404928321 (386h5m50.867020804s) [noise=true , address=145.79.227.4:4185    , piece_id=UTDL5IOQ6GMNGPDMB3NQ4HCAYVODWE3JIOXBOK5H7OSKLON4FCQQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.456562682 (386h5m50.918655175s) [noise=true , address=145.79.227.11:4730   , piece_id=HBZCZVD5H27SWWTMVDWWNHOJZCVQC2YI6DX4DY2A3GDOQ54PMD2A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.515032722 (386h5m50.977125205s) [noise=true , address=77.90.31.21:4877     , piece_id=3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.926564111 (386h5m51.388656595s) [noise=true , address=145.79.227.12:4767   , piece_id=EHEIO5WX5PQKX5ZDHPZ2XMAZTCTZAAII4L2Q4DJAI3GG2DX3XUXQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.373844666 (386h5m51.835937149s) [noise=true , address=145.79.227.13:4804   , piece_id=FUN5LPTLV2JQNLJB4JGNFWZIAVQTGEBJZULLVEP73PSHFSM3NZAA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.736384436 (386h5m52.198476909s) [noise=true , address=145.79.227.17:4970   , piece_id=2F5TXHEN3LIB2XN4DTSQN6W75BSTZYK3EL5JDKOMWI7VL27PTARA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.736427608 (386h5m52.198520091s) [seg_pos={0 0}, upload=339720]: Segment reached optimal threshold of 13 pieces.
Oct  9 15:37:06.736566292 (386h5m52.198658775s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736576751 (386h5m52.198669234s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736597040 (386h5m52.198689543s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736607961 (386h5m52.198700444s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736799205 (386h5m52.198891699s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736808032 (386h5m52.198900505s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736843279 (386h5m52.198935762s) [seg_pos={0 0}, upload=339720]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct  9 15:37:06.736970692 (386h5m52.199063185s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct  9 15:37:06.736978837 (386h5m52.19907132s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct  9 15:37:07.042768755 (386h5m52.504861238s) [upload=339720]: Done uploading segments...
Oct  9 15:37:07.042792771 (386h5m52.504885254s) [upload=339720]: Upload finished. err: <nil>
Duration: 13.479657702s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration: 
7.134355036s
FAIL (2025-10-09 16:15:13 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, Piece ID: NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q) context deadline exceeded; piecestore: (Node ID: 12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, Piece ID: 3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ) context deadline exceeded
======LOGS======
Oct  9 15:37:02.242123523 (386h5m47.704215996s) [upload=339720]: Starting upload
Oct  9 15:37:02.242222231 (386h5m47.704314714s) [upload=339720]: Done starting upload
Oct  9 15:37:02.242341397 (386h5m47.70443388s) [upload=339720]: Uploading segments...
Oct  9 15:37:02.242462188 (386h5m47.704554671s) [upload=339720]: Got next segment. Inline: false
Oct  9 15:37:02.242528735 (386h5m47.704621218s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct  9 15:37:02.242536409 (386h5m47.704628892s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct  9 15:37:02.504197156 (386h5m47.966289629s) [seg_pos={0 0}, upload=339720]: Begin upload segment...
Oct  9 15:37:02.504256378 (386h5m47.966348861s) [seg_pos={0 0}, upload=339720]: Done begin upload segment.
Oct  9 15:37:02.504284772 (386h5m47.966377255s) [noise=true , address=145.79.227.13:4804   , piece_id=FUN5LPTLV2JQNLJB4JGNFWZIAVQTGEBJZULLVEP73PSHFSM3NZAA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.506016159 (386h5m47.968108642s) [noise=true , address=145.79.227.4:4185    , piece_id=UTDL5IOQ6GMNGPDMB3NQ4HCAYVODWE3JIOXBOK5H7OSKLON4FCQQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.506805693 (386h5m47.968898176s) [noise=true , address=145.79.227.12:4767   , piece_id=EHEIO5WX5PQKX5ZDHPZ2XMAZTCTZAAII4L2Q4DJAI3GG2DX3XUXQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.507381258 (386h5m47.969473751s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.508983771 (386h5m47.971076254s) [noise=true , address=77.90.31.17:4770     , piece_id=TCKYBCAFTDTNTLJCQRVEFCCHKT3DLNYILNR7MVOWFI4YHYBKPR6A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.509265788 (386h5m47.971358281s) [noise=true , address=77.90.31.21:4877     , piece_id=3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.510802103 (386h5m47.972894586s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.510991884 (386h5m47.973084377s) [noise=true , address=145.79.227.11:4730   , piece_id=HBZCZVD5H27SWWTMVDWWNHOJZCVQC2YI6DX4DY2A3GDOQ54PMD2A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.512377853 (386h5m47.974470336s) [noise=true , address=45.91.116.10:4083    , piece_id=WWFIBCZ4S3SYN3NOUWPO276LIQJ7BM7X42G6Z2UY2O3EJDP5GGRA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.512884819 (386h5m47.974977312s) [noise=true , address=145.79.227.17:4970   , piece_id=2F5TXHEN3LIB2XN4DTSQN6W75BSTZYK3EL5JDKOMWI7VL27PTARA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.513772208 (386h5m47.975864691s) [noise=true , address=77.90.31.19:4842     , piece_id=5GRKUSGWRVZZNJSQ7AVDAFRB2YRIOF3PQRCEMNENLLZMKAPIRT7Q, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.514679907 (386h5m47.97677239s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.515172375 (386h5m47.977264858s) [noise=true , address=145.79.227.7:4295    , piece_id=DXIJ26ILOHWTMS75FPHW7RRVB4CHHTWPRNQ5TQEE42GGH2TJVS2A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.516618288 (386h5m47.978710771s) [noise=true , address=77.90.31.21:4878     , piece_id=NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.516681799 (386h5m47.978774282s) [noise=true , address=77.90.31.18:4807     , piece_id=3MVQ72K2DFLN2SZHDDGB5EK6WSKBIEOQAYKQKQQQLNQRIMZEEZOQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.519789937 (386h5m47.98188243s) [noise=true , address=45.91.116.5:4299     , piece_id=EOURFB5N5DEUK6PRMWDZI7TCLXDK2DCY36DIR4ETE5FI67KCJ37A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:04.342892789 (386h5m49.804985272s) [upload=339720]: Next returned nil segment
Oct  9 15:37:04.342934217 (386h5m49.8050267s) [upload=339720]: Waiting for error group managing segments...
Oct  9 15:37:04.771607028 (386h5m50.233699511s) [noise=true , address=45.91.116.10:4083    , piece_id=WWFIBCZ4S3SYN3NOUWPO276LIQJ7BM7X42G6Z2UY2O3EJDP5GGRA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.808771606 (386h5m50.270864089s) [noise=true , address=77.90.31.18:4807     , piece_id=3MVQ72K2DFLN2SZHDDGB5EK6WSKBIEOQAYKQKQQQLNQRIMZEEZOQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.911015099 (386h5m50.373107582s) [noise=true , address=77.90.31.19:4842     , piece_id=5GRKUSGWRVZZNJSQ7AVDAFRB2YRIOF3PQRCEMNENLLZMKAPIRT7Q, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.937504590 (386h5m50.399597073s) [noise=true , address=45.91.116.5:4299     , piece_id=EOURFB5N5DEUK6PRMWDZI7TCLXDK2DCY36DIR4ETE5FI67KCJ37A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.014747387 (386h5m50.47683987s) [noise=true , address=77.90.31.21:4878     , piece_id=NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.181525045 (386h5m50.643617528s) [noise=true , address=77.90.31.17:4770     , piece_id=TCKYBCAFTDTNTLJCQRVEFCCHKT3DLNYILNR7MVOWFI4YHYBKPR6A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.385017486 (386h5m50.847109969s) [noise=true , address=145.79.227.7:4295    , piece_id=DXIJ26ILOHWTMS75FPHW7RRVB4CHHTWPRNQ5TQEE42GGH2TJVS2A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.404928321 (386h5m50.867020804s) [noise=true , address=145.79.227.4:4185    , piece_id=UTDL5IOQ6GMNGPDMB3NQ4HCAYVODWE3JIOXBOK5H7OSKLON4FCQQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.456562682 (386h5m50.918655175s) [noise=true , address=145.79.227.11:4730   , piece_id=HBZCZVD5H27SWWTMVDWWNHOJZCVQC2YI6DX4DY2A3GDOQ54PMD2A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.515032722 (386h5m50.977125205s) [noise=true , address=77.90.31.21:4877     , piece_id=3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.926564111 (386h5m51.388656595s) [noise=true , address=145.79.227.12:4767   , piece_id=EHEIO5WX5PQKX5ZDHPZ2XMAZTCTZAAII4L2Q4DJAI3GG2DX3XUXQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.373844666 (386h5m51.835937149s) [noise=true , address=145.79.227.13:4804   , piece_id=FUN5LPTLV2JQNLJB4JGNFWZIAVQTGEBJZULLVEP73PSHFSM3NZAA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.736384436 (386h5m52.198476909s) [noise=true , address=145.79.227.17:4970   , piece_id=2F5TXHEN3LIB2XN4DTSQN6W75BSTZYK3EL5JDKOMWI7VL27PTARA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.736427608 (386h5m52.198520091s) [seg_pos={0 0}, upload=339720]: Segment reached optimal threshold of 13 pieces.
Oct  9 15:37:06.736566292 (386h5m52.198658775s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736576751 (386h5m52.198669234s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736597040 (386h5m52.198689543s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736607961 (386h5m52.198700444s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736799205 (386h5m52.198891699s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736808032 (386h5m52.198900505s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736843279 (386h5m52.198935762s) [seg_pos={0 0}, upload=339720]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct  9 15:37:06.736970692 (386h5m52.199063185s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct  9 15:37:06.736978837 (386h5m52.19907132s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct  9 15:37:07.042768755 (386h5m52.504861238s) [upload=339720]: Done uploading segments...
Oct  9 15:37:07.042792771 (386h5m52.504885254s) [upload=339720]: Upload finished. err: <nil>
Duration: 7.134439618s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration: 
7.697256392s
FAIL (2025-10-09 16:14:37 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, Piece ID: NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q) context deadline exceeded; piecestore: (Node ID: 12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, Piece ID: 3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ) context deadline exceeded
======LOGS======
Oct  9 15:37:02.242123523 (386h5m47.704215996s) [upload=339720]: Starting upload
Oct  9 15:37:02.242222231 (386h5m47.704314714s) [upload=339720]: Done starting upload
Oct  9 15:37:02.242341397 (386h5m47.70443388s) [upload=339720]: Uploading segments...
Oct  9 15:37:02.242462188 (386h5m47.704554671s) [upload=339720]: Got next segment. Inline: false
Oct  9 15:37:02.242528735 (386h5m47.704621218s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct  9 15:37:02.242536409 (386h5m47.704628892s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct  9 15:37:02.504197156 (386h5m47.966289629s) [seg_pos={0 0}, upload=339720]: Begin upload segment...
Oct  9 15:37:02.504256378 (386h5m47.966348861s) [seg_pos={0 0}, upload=339720]: Done begin upload segment.
Oct  9 15:37:02.504284772 (386h5m47.966377255s) [noise=true , address=145.79.227.13:4804   , piece_id=FUN5LPTLV2JQNLJB4JGNFWZIAVQTGEBJZULLVEP73PSHFSM3NZAA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.506016159 (386h5m47.968108642s) [noise=true , address=145.79.227.4:4185    , piece_id=UTDL5IOQ6GMNGPDMB3NQ4HCAYVODWE3JIOXBOK5H7OSKLON4FCQQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.506805693 (386h5m47.968898176s) [noise=true , address=145.79.227.12:4767   , piece_id=EHEIO5WX5PQKX5ZDHPZ2XMAZTCTZAAII4L2Q4DJAI3GG2DX3XUXQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.507381258 (386h5m47.969473751s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.508983771 (386h5m47.971076254s) [noise=true , address=77.90.31.17:4770     , piece_id=TCKYBCAFTDTNTLJCQRVEFCCHKT3DLNYILNR7MVOWFI4YHYBKPR6A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.509265788 (386h5m47.971358281s) [noise=true , address=77.90.31.21:4877     , piece_id=3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.510802103 (386h5m47.972894586s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.510991884 (386h5m47.973084377s) [noise=true , address=145.79.227.11:4730   , piece_id=HBZCZVD5H27SWWTMVDWWNHOJZCVQC2YI6DX4DY2A3GDOQ54PMD2A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.512377853 (386h5m47.974470336s) [noise=true , address=45.91.116.10:4083    , piece_id=WWFIBCZ4S3SYN3NOUWPO276LIQJ7BM7X42G6Z2UY2O3EJDP5GGRA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.512884819 (386h5m47.974977312s) [noise=true , address=145.79.227.17:4970   , piece_id=2F5TXHEN3LIB2XN4DTSQN6W75BSTZYK3EL5JDKOMWI7VL27PTARA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.513772208 (386h5m47.975864691s) [noise=true , address=77.90.31.19:4842     , piece_id=5GRKUSGWRVZZNJSQ7AVDAFRB2YRIOF3PQRCEMNENLLZMKAPIRT7Q, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.514679907 (386h5m47.97677239s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.515172375 (386h5m47.977264858s) [noise=true , address=145.79.227.7:4295    , piece_id=DXIJ26ILOHWTMS75FPHW7RRVB4CHHTWPRNQ5TQEE42GGH2TJVS2A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.516618288 (386h5m47.978710771s) [noise=true , address=77.90.31.21:4878     , piece_id=NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.516681799 (386h5m47.978774282s) [noise=true , address=77.90.31.18:4807     , piece_id=3MVQ72K2DFLN2SZHDDGB5EK6WSKBIEOQAYKQKQQQLNQRIMZEEZOQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.519789937 (386h5m47.98188243s) [noise=true , address=45.91.116.5:4299     , piece_id=EOURFB5N5DEUK6PRMWDZI7TCLXDK2DCY36DIR4ETE5FI67KCJ37A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:04.342892789 (386h5m49.804985272s) [upload=339720]: Next returned nil segment
Oct  9 15:37:04.342934217 (386h5m49.8050267s) [upload=339720]: Waiting for error group managing segments...
Oct  9 15:37:04.771607028 (386h5m50.233699511s) [noise=true , address=45.91.116.10:4083    , piece_id=WWFIBCZ4S3SYN3NOUWPO276LIQJ7BM7X42G6Z2UY2O3EJDP5GGRA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.808771606 (386h5m50.270864089s) [noise=true , address=77.90.31.18:4807     , piece_id=3MVQ72K2DFLN2SZHDDGB5EK6WSKBIEOQAYKQKQQQLNQRIMZEEZOQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.911015099 (386h5m50.373107582s) [noise=true , address=77.90.31.19:4842     , piece_id=5GRKUSGWRVZZNJSQ7AVDAFRB2YRIOF3PQRCEMNENLLZMKAPIRT7Q, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.937504590 (386h5m50.399597073s) [noise=true , address=45.91.116.5:4299     , piece_id=EOURFB5N5DEUK6PRMWDZI7TCLXDK2DCY36DIR4ETE5FI67KCJ37A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.014747387 (386h5m50.47683987s) [noise=true , address=77.90.31.21:4878     , piece_id=NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.181525045 (386h5m50.643617528s) [noise=true , address=77.90.31.17:4770     , piece_id=TCKYBCAFTDTNTLJCQRVEFCCHKT3DLNYILNR7MVOWFI4YHYBKPR6A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.385017486 (386h5m50.847109969s) [noise=true , address=145.79.227.7:4295    , piece_id=DXIJ26ILOHWTMS75FPHW7RRVB4CHHTWPRNQ5TQEE42GGH2TJVS2A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.404928321 (386h5m50.867020804s) [noise=true , address=145.79.227.4:4185    , piece_id=UTDL5IOQ6GMNGPDMB3NQ4HCAYVODWE3JIOXBOK5H7OSKLON4FCQQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.456562682 (386h5m50.918655175s) [noise=true , address=145.79.227.11:4730   , piece_id=HBZCZVD5H27SWWTMVDWWNHOJZCVQC2YI6DX4DY2A3GDOQ54PMD2A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.515032722 (386h5m50.977125205s) [noise=true , address=77.90.31.21:4877     , piece_id=3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.926564111 (386h5m51.388656595s) [noise=true , address=145.79.227.12:4767   , piece_id=EHEIO5WX5PQKX5ZDHPZ2XMAZTCTZAAII4L2Q4DJAI3GG2DX3XUXQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.373844666 (386h5m51.835937149s) [noise=true , address=145.79.227.13:4804   , piece_id=FUN5LPTLV2JQNLJB4JGNFWZIAVQTGEBJZULLVEP73PSHFSM3NZAA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.736384436 (386h5m52.198476909s) [noise=true , address=145.79.227.17:4970   , piece_id=2F5TXHEN3LIB2XN4DTSQN6W75BSTZYK3EL5JDKOMWI7VL27PTARA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.736427608 (386h5m52.198520091s) [seg_pos={0 0}, upload=339720]: Segment reached optimal threshold of 13 pieces.
Oct  9 15:37:06.736566292 (386h5m52.198658775s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736576751 (386h5m52.198669234s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736597040 (386h5m52.198689543s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736607961 (386h5m52.198700444s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736799205 (386h5m52.198891699s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736808032 (386h5m52.198900505s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736843279 (386h5m52.198935762s) [seg_pos={0 0}, upload=339720]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct  9 15:37:06.736970692 (386h5m52.199063185s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct  9 15:37:06.736978837 (386h5m52.19907132s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct  9 15:37:07.042768755 (386h5m52.504861238s) [upload=339720]: Done uploading segments...
Oct  9 15:37:07.042792771 (386h5m52.504885254s) [upload=339720]: Upload finished. err: <nil>
Duration: 7.69728691s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration: 
7.777635438s
FAIL (2025-10-09 16:14:09 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, Piece ID: NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q) context deadline exceeded; piecestore: (Node ID: 12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, Piece ID: 3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ) context deadline exceeded
======LOGS======
Oct  9 15:37:02.242123523 (386h5m47.704215996s) [upload=339720]: Starting upload
Oct  9 15:37:02.242222231 (386h5m47.704314714s) [upload=339720]: Done starting upload
Oct  9 15:37:02.242341397 (386h5m47.70443388s) [upload=339720]: Uploading segments...
Oct  9 15:37:02.242462188 (386h5m47.704554671s) [upload=339720]: Got next segment. Inline: false
Oct  9 15:37:02.242528735 (386h5m47.704621218s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct  9 15:37:02.242536409 (386h5m47.704628892s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct  9 15:37:02.504197156 (386h5m47.966289629s) [seg_pos={0 0}, upload=339720]: Begin upload segment...
Oct  9 15:37:02.504256378 (386h5m47.966348861s) [seg_pos={0 0}, upload=339720]: Done begin upload segment.
Oct  9 15:37:02.504284772 (386h5m47.966377255s) [noise=true , address=145.79.227.13:4804   , piece_id=FUN5LPTLV2JQNLJB4JGNFWZIAVQTGEBJZULLVEP73PSHFSM3NZAA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.506016159 (386h5m47.968108642s) [noise=true , address=145.79.227.4:4185    , piece_id=UTDL5IOQ6GMNGPDMB3NQ4HCAYVODWE3JIOXBOK5H7OSKLON4FCQQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.506805693 (386h5m47.968898176s) [noise=true , address=145.79.227.12:4767   , piece_id=EHEIO5WX5PQKX5ZDHPZ2XMAZTCTZAAII4L2Q4DJAI3GG2DX3XUXQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.507381258 (386h5m47.969473751s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.508983771 (386h5m47.971076254s) [noise=true , address=77.90.31.17:4770     , piece_id=TCKYBCAFTDTNTLJCQRVEFCCHKT3DLNYILNR7MVOWFI4YHYBKPR6A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.509265788 (386h5m47.971358281s) [noise=true , address=77.90.31.21:4877     , piece_id=3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.510802103 (386h5m47.972894586s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.510991884 (386h5m47.973084377s) [noise=true , address=145.79.227.11:4730   , piece_id=HBZCZVD5H27SWWTMVDWWNHOJZCVQC2YI6DX4DY2A3GDOQ54PMD2A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.512377853 (386h5m47.974470336s) [noise=true , address=45.91.116.10:4083    , piece_id=WWFIBCZ4S3SYN3NOUWPO276LIQJ7BM7X42G6Z2UY2O3EJDP5GGRA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.512884819 (386h5m47.974977312s) [noise=true , address=145.79.227.17:4970   , piece_id=2F5TXHEN3LIB2XN4DTSQN6W75BSTZYK3EL5JDKOMWI7VL27PTARA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.513772208 (386h5m47.975864691s) [noise=true , address=77.90.31.19:4842     , piece_id=5GRKUSGWRVZZNJSQ7AVDAFRB2YRIOF3PQRCEMNENLLZMKAPIRT7Q, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.514679907 (386h5m47.97677239s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.515172375 (386h5m47.977264858s) [noise=true , address=145.79.227.7:4295    , piece_id=DXIJ26ILOHWTMS75FPHW7RRVB4CHHTWPRNQ5TQEE42GGH2TJVS2A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.516618288 (386h5m47.978710771s) [noise=true , address=77.90.31.21:4878     , piece_id=NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.516681799 (386h5m47.978774282s) [noise=true , address=77.90.31.18:4807     , piece_id=3MVQ72K2DFLN2SZHDDGB5EK6WSKBIEOQAYKQKQQQLNQRIMZEEZOQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.519789937 (386h5m47.98188243s) [noise=true , address=45.91.116.5:4299     , piece_id=EOURFB5N5DEUK6PRMWDZI7TCLXDK2DCY36DIR4ETE5FI67KCJ37A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:04.342892789 (386h5m49.804985272s) [upload=339720]: Next returned nil segment
Oct  9 15:37:04.342934217 (386h5m49.8050267s) [upload=339720]: Waiting for error group managing segments...
Oct  9 15:37:04.771607028 (386h5m50.233699511s) [noise=true , address=45.91.116.10:4083    , piece_id=WWFIBCZ4S3SYN3NOUWPO276LIQJ7BM7X42G6Z2UY2O3EJDP5GGRA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.808771606 (386h5m50.270864089s) [noise=true , address=77.90.31.18:4807     , piece_id=3MVQ72K2DFLN2SZHDDGB5EK6WSKBIEOQAYKQKQQQLNQRIMZEEZOQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.911015099 (386h5m50.373107582s) [noise=true , address=77.90.31.19:4842     , piece_id=5GRKUSGWRVZZNJSQ7AVDAFRB2YRIOF3PQRCEMNENLLZMKAPIRT7Q, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.937504590 (386h5m50.399597073s) [noise=true , address=45.91.116.5:4299     , piece_id=EOURFB5N5DEUK6PRMWDZI7TCLXDK2DCY36DIR4ETE5FI67KCJ37A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.014747387 (386h5m50.47683987s) [noise=true , address=77.90.31.21:4878     , piece_id=NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.181525045 (386h5m50.643617528s) [noise=true , address=77.90.31.17:4770     , piece_id=TCKYBCAFTDTNTLJCQRVEFCCHKT3DLNYILNR7MVOWFI4YHYBKPR6A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.385017486 (386h5m50.847109969s) [noise=true , address=145.79.227.7:4295    , piece_id=DXIJ26ILOHWTMS75FPHW7RRVB4CHHTWPRNQ5TQEE42GGH2TJVS2A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.404928321 (386h5m50.867020804s) [noise=true , address=145.79.227.4:4185    , piece_id=UTDL5IOQ6GMNGPDMB3NQ4HCAYVODWE3JIOXBOK5H7OSKLON4FCQQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.456562682 (386h5m50.918655175s) [noise=true , address=145.79.227.11:4730   , piece_id=HBZCZVD5H27SWWTMVDWWNHOJZCVQC2YI6DX4DY2A3GDOQ54PMD2A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.515032722 (386h5m50.977125205s) [noise=true , address=77.90.31.21:4877     , piece_id=3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.926564111 (386h5m51.388656595s) [noise=true , address=145.79.227.12:4767   , piece_id=EHEIO5WX5PQKX5ZDHPZ2XMAZTCTZAAII4L2Q4DJAI3GG2DX3XUXQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.373844666 (386h5m51.835937149s) [noise=true , address=145.79.227.13:4804   , piece_id=FUN5LPTLV2JQNLJB4JGNFWZIAVQTGEBJZULLVEP73PSHFSM3NZAA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.736384436 (386h5m52.198476909s) [noise=true , address=145.79.227.17:4970   , piece_id=2F5TXHEN3LIB2XN4DTSQN6W75BSTZYK3EL5JDKOMWI7VL27PTARA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.736427608 (386h5m52.198520091s) [seg_pos={0 0}, upload=339720]: Segment reached optimal threshold of 13 pieces.
Oct  9 15:37:06.736566292 (386h5m52.198658775s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736576751 (386h5m52.198669234s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736597040 (386h5m52.198689543s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736607961 (386h5m52.198700444s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736799205 (386h5m52.198891699s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736808032 (386h5m52.198900505s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736843279 (386h5m52.198935762s) [seg_pos={0 0}, upload=339720]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct  9 15:37:06.736970692 (386h5m52.199063185s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct  9 15:37:06.736978837 (386h5m52.19907132s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct  9 15:37:07.042768755 (386h5m52.504861238s) [upload=339720]: Done uploading segments...
Oct  9 15:37:07.042792771 (386h5m52.504885254s) [upload=339720]: Upload finished. err: <nil>
Duration: 7.77767221s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [........X...................................................]
duration: 
7.812174105s
FAIL (2025-10-09 16:13:03 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, Piece ID: NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q) context deadline exceeded; piecestore: (Node ID: 12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, Piece ID: 3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ) context deadline exceeded
======LOGS======
Oct  9 15:37:02.242123523 (386h5m47.704215996s) [upload=339720]: Starting upload
Oct  9 15:37:02.242222231 (386h5m47.704314714s) [upload=339720]: Done starting upload
Oct  9 15:37:02.242341397 (386h5m47.70443388s) [upload=339720]: Uploading segments...
Oct  9 15:37:02.242462188 (386h5m47.704554671s) [upload=339720]: Got next segment. Inline: false
Oct  9 15:37:02.242528735 (386h5m47.704621218s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct  9 15:37:02.242536409 (386h5m47.704628892s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct  9 15:37:02.504197156 (386h5m47.966289629s) [seg_pos={0 0}, upload=339720]: Begin upload segment...
Oct  9 15:37:02.504256378 (386h5m47.966348861s) [seg_pos={0 0}, upload=339720]: Done begin upload segment.
Oct  9 15:37:02.504284772 (386h5m47.966377255s) [noise=true , address=145.79.227.13:4804   , piece_id=FUN5LPTLV2JQNLJB4JGNFWZIAVQTGEBJZULLVEP73PSHFSM3NZAA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.506016159 (386h5m47.968108642s) [noise=true , address=145.79.227.4:4185    , piece_id=UTDL5IOQ6GMNGPDMB3NQ4HCAYVODWE3JIOXBOK5H7OSKLON4FCQQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.506805693 (386h5m47.968898176s) [noise=true , address=145.79.227.12:4767   , piece_id=EHEIO5WX5PQKX5ZDHPZ2XMAZTCTZAAII4L2Q4DJAI3GG2DX3XUXQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.507381258 (386h5m47.969473751s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.508983771 (386h5m47.971076254s) [noise=true , address=77.90.31.17:4770     , piece_id=TCKYBCAFTDTNTLJCQRVEFCCHKT3DLNYILNR7MVOWFI4YHYBKPR6A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.509265788 (386h5m47.971358281s) [noise=true , address=77.90.31.21:4877     , piece_id=3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.510802103 (386h5m47.972894586s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.510991884 (386h5m47.973084377s) [noise=true , address=145.79.227.11:4730   , piece_id=HBZCZVD5H27SWWTMVDWWNHOJZCVQC2YI6DX4DY2A3GDOQ54PMD2A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.512377853 (386h5m47.974470336s) [noise=true , address=45.91.116.10:4083    , piece_id=WWFIBCZ4S3SYN3NOUWPO276LIQJ7BM7X42G6Z2UY2O3EJDP5GGRA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.512884819 (386h5m47.974977312s) [noise=true , address=145.79.227.17:4970   , piece_id=2F5TXHEN3LIB2XN4DTSQN6W75BSTZYK3EL5JDKOMWI7VL27PTARA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.513772208 (386h5m47.975864691s) [noise=true , address=77.90.31.19:4842     , piece_id=5GRKUSGWRVZZNJSQ7AVDAFRB2YRIOF3PQRCEMNENLLZMKAPIRT7Q, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.514679907 (386h5m47.97677239s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.515172375 (386h5m47.977264858s) [noise=true , address=145.79.227.7:4295    , piece_id=DXIJ26ILOHWTMS75FPHW7RRVB4CHHTWPRNQ5TQEE42GGH2TJVS2A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.516618288 (386h5m47.978710771s) [noise=true , address=77.90.31.21:4878     , piece_id=NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.516681799 (386h5m47.978774282s) [noise=true , address=77.90.31.18:4807     , piece_id=3MVQ72K2DFLN2SZHDDGB5EK6WSKBIEOQAYKQKQQQLNQRIMZEEZOQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.519789937 (386h5m47.98188243s) [noise=true , address=45.91.116.5:4299     , piece_id=EOURFB5N5DEUK6PRMWDZI7TCLXDK2DCY36DIR4ETE5FI67KCJ37A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:04.342892789 (386h5m49.804985272s) [upload=339720]: Next returned nil segment
Oct  9 15:37:04.342934217 (386h5m49.8050267s) [upload=339720]: Waiting for error group managing segments...
Oct  9 15:37:04.771607028 (386h5m50.233699511s) [noise=true , address=45.91.116.10:4083    , piece_id=WWFIBCZ4S3SYN3NOUWPO276LIQJ7BM7X42G6Z2UY2O3EJDP5GGRA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.808771606 (386h5m50.270864089s) [noise=true , address=77.90.31.18:4807     , piece_id=3MVQ72K2DFLN2SZHDDGB5EK6WSKBIEOQAYKQKQQQLNQRIMZEEZOQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.911015099 (386h5m50.373107582s) [noise=true , address=77.90.31.19:4842     , piece_id=5GRKUSGWRVZZNJSQ7AVDAFRB2YRIOF3PQRCEMNENLLZMKAPIRT7Q, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.937504590 (386h5m50.399597073s) [noise=true , address=45.91.116.5:4299     , piece_id=EOURFB5N5DEUK6PRMWDZI7TCLXDK2DCY36DIR4ETE5FI67KCJ37A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.014747387 (386h5m50.47683987s) [noise=true , address=77.90.31.21:4878     , piece_id=NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.181525045 (386h5m50.643617528s) [noise=true , address=77.90.31.17:4770     , piece_id=TCKYBCAFTDTNTLJCQRVEFCCHKT3DLNYILNR7MVOWFI4YHYBKPR6A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.385017486 (386h5m50.847109969s) [noise=true , address=145.79.227.7:4295    , piece_id=DXIJ26ILOHWTMS75FPHW7RRVB4CHHTWPRNQ5TQEE42GGH2TJVS2A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.404928321 (386h5m50.867020804s) [noise=true , address=145.79.227.4:4185    , piece_id=UTDL5IOQ6GMNGPDMB3NQ4HCAYVODWE3JIOXBOK5H7OSKLON4FCQQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.456562682 (386h5m50.918655175s) [noise=true , address=145.79.227.11:4730   , piece_id=HBZCZVD5H27SWWTMVDWWNHOJZCVQC2YI6DX4DY2A3GDOQ54PMD2A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.515032722 (386h5m50.977125205s) [noise=true , address=77.90.31.21:4877     , piece_id=3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.926564111 (386h5m51.388656595s) [noise=true , address=145.79.227.12:4767   , piece_id=EHEIO5WX5PQKX5ZDHPZ2XMAZTCTZAAII4L2Q4DJAI3GG2DX3XUXQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.373844666 (386h5m51.835937149s) [noise=true , address=145.79.227.13:4804   , piece_id=FUN5LPTLV2JQNLJB4JGNFWZIAVQTGEBJZULLVEP73PSHFSM3NZAA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.736384436 (386h5m52.198476909s) [noise=true , address=145.79.227.17:4970   , piece_id=2F5TXHEN3LIB2XN4DTSQN6W75BSTZYK3EL5JDKOMWI7VL27PTARA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.736427608 (386h5m52.198520091s) [seg_pos={0 0}, upload=339720]: Segment reached optimal threshold of 13 pieces.
Oct  9 15:37:06.736566292 (386h5m52.198658775s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736576751 (386h5m52.198669234s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736597040 (386h5m52.198689543s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736607961 (386h5m52.198700444s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736799205 (386h5m52.198891699s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736808032 (386h5m52.198900505s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736843279 (386h5m52.198935762s) [seg_pos={0 0}, upload=339720]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct  9 15:37:06.736970692 (386h5m52.199063185s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct  9 15:37:06.736978837 (386h5m52.19907132s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct  9 15:37:07.042768755 (386h5m52.504861238s) [upload=339720]: Done uploading segments...
Oct  9 15:37:07.042792771 (386h5m52.504885254s) [upload=339720]: Upload finished. err: <nil>
Duration: 7.812198443s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.........X..................................................]
duration: 
6.461405446s
FAIL (2025-10-09 16:12:00 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, Piece ID: NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q) context deadline exceeded; piecestore: (Node ID: 12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, Piece ID: 3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ) context deadline exceeded
======LOGS======
Oct  9 15:37:02.242123523 (386h5m47.704215996s) [upload=339720]: Starting upload
Oct  9 15:37:02.242222231 (386h5m47.704314714s) [upload=339720]: Done starting upload
Oct  9 15:37:02.242341397 (386h5m47.70443388s) [upload=339720]: Uploading segments...
Oct  9 15:37:02.242462188 (386h5m47.704554671s) [upload=339720]: Got next segment. Inline: false
Oct  9 15:37:02.242528735 (386h5m47.704621218s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct  9 15:37:02.242536409 (386h5m47.704628892s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct  9 15:37:02.504197156 (386h5m47.966289629s) [seg_pos={0 0}, upload=339720]: Begin upload segment...
Oct  9 15:37:02.504256378 (386h5m47.966348861s) [seg_pos={0 0}, upload=339720]: Done begin upload segment.
Oct  9 15:37:02.504284772 (386h5m47.966377255s) [noise=true , address=145.79.227.13:4804   , piece_id=FUN5LPTLV2JQNLJB4JGNFWZIAVQTGEBJZULLVEP73PSHFSM3NZAA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.506016159 (386h5m47.968108642s) [noise=true , address=145.79.227.4:4185    , piece_id=UTDL5IOQ6GMNGPDMB3NQ4HCAYVODWE3JIOXBOK5H7OSKLON4FCQQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.506805693 (386h5m47.968898176s) [noise=true , address=145.79.227.12:4767   , piece_id=EHEIO5WX5PQKX5ZDHPZ2XMAZTCTZAAII4L2Q4DJAI3GG2DX3XUXQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.507381258 (386h5m47.969473751s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.508983771 (386h5m47.971076254s) [noise=true , address=77.90.31.17:4770     , piece_id=TCKYBCAFTDTNTLJCQRVEFCCHKT3DLNYILNR7MVOWFI4YHYBKPR6A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.509265788 (386h5m47.971358281s) [noise=true , address=77.90.31.21:4877     , piece_id=3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.510802103 (386h5m47.972894586s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.510991884 (386h5m47.973084377s) [noise=true , address=145.79.227.11:4730   , piece_id=HBZCZVD5H27SWWTMVDWWNHOJZCVQC2YI6DX4DY2A3GDOQ54PMD2A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.512377853 (386h5m47.974470336s) [noise=true , address=45.91.116.10:4083    , piece_id=WWFIBCZ4S3SYN3NOUWPO276LIQJ7BM7X42G6Z2UY2O3EJDP5GGRA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.512884819 (386h5m47.974977312s) [noise=true , address=145.79.227.17:4970   , piece_id=2F5TXHEN3LIB2XN4DTSQN6W75BSTZYK3EL5JDKOMWI7VL27PTARA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.513772208 (386h5m47.975864691s) [noise=true , address=77.90.31.19:4842     , piece_id=5GRKUSGWRVZZNJSQ7AVDAFRB2YRIOF3PQRCEMNENLLZMKAPIRT7Q, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.514679907 (386h5m47.97677239s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.515172375 (386h5m47.977264858s) [noise=true , address=145.79.227.7:4295    , piece_id=DXIJ26ILOHWTMS75FPHW7RRVB4CHHTWPRNQ5TQEE42GGH2TJVS2A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.516618288 (386h5m47.978710771s) [noise=true , address=77.90.31.21:4878     , piece_id=NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.516681799 (386h5m47.978774282s) [noise=true , address=77.90.31.18:4807     , piece_id=3MVQ72K2DFLN2SZHDDGB5EK6WSKBIEOQAYKQKQQQLNQRIMZEEZOQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.519789937 (386h5m47.98188243s) [noise=true , address=45.91.116.5:4299     , piece_id=EOURFB5N5DEUK6PRMWDZI7TCLXDK2DCY36DIR4ETE5FI67KCJ37A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:04.342892789 (386h5m49.804985272s) [upload=339720]: Next returned nil segment
Oct  9 15:37:04.342934217 (386h5m49.8050267s) [upload=339720]: Waiting for error group managing segments...
Oct  9 15:37:04.771607028 (386h5m50.233699511s) [noise=true , address=45.91.116.10:4083    , piece_id=WWFIBCZ4S3SYN3NOUWPO276LIQJ7BM7X42G6Z2UY2O3EJDP5GGRA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.808771606 (386h5m50.270864089s) [noise=true , address=77.90.31.18:4807     , piece_id=3MVQ72K2DFLN2SZHDDGB5EK6WSKBIEOQAYKQKQQQLNQRIMZEEZOQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.911015099 (386h5m50.373107582s) [noise=true , address=77.90.31.19:4842     , piece_id=5GRKUSGWRVZZNJSQ7AVDAFRB2YRIOF3PQRCEMNENLLZMKAPIRT7Q, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.937504590 (386h5m50.399597073s) [noise=true , address=45.91.116.5:4299     , piece_id=EOURFB5N5DEUK6PRMWDZI7TCLXDK2DCY36DIR4ETE5FI67KCJ37A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.014747387 (386h5m50.47683987s) [noise=true , address=77.90.31.21:4878     , piece_id=NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.181525045 (386h5m50.643617528s) [noise=true , address=77.90.31.17:4770     , piece_id=TCKYBCAFTDTNTLJCQRVEFCCHKT3DLNYILNR7MVOWFI4YHYBKPR6A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.385017486 (386h5m50.847109969s) [noise=true , address=145.79.227.7:4295    , piece_id=DXIJ26ILOHWTMS75FPHW7RRVB4CHHTWPRNQ5TQEE42GGH2TJVS2A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.404928321 (386h5m50.867020804s) [noise=true , address=145.79.227.4:4185    , piece_id=UTDL5IOQ6GMNGPDMB3NQ4HCAYVODWE3JIOXBOK5H7OSKLON4FCQQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.456562682 (386h5m50.918655175s) [noise=true , address=145.79.227.11:4730   , piece_id=HBZCZVD5H27SWWTMVDWWNHOJZCVQC2YI6DX4DY2A3GDOQ54PMD2A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.515032722 (386h5m50.977125205s) [noise=true , address=77.90.31.21:4877     , piece_id=3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.926564111 (386h5m51.388656595s) [noise=true , address=145.79.227.12:4767   , piece_id=EHEIO5WX5PQKX5ZDHPZ2XMAZTCTZAAII4L2Q4DJAI3GG2DX3XUXQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.373844666 (386h5m51.835937149s) [noise=true , address=145.79.227.13:4804   , piece_id=FUN5LPTLV2JQNLJB4JGNFWZIAVQTGEBJZULLVEP73PSHFSM3NZAA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.736384436 (386h5m52.198476909s) [noise=true , address=145.79.227.17:4970   , piece_id=2F5TXHEN3LIB2XN4DTSQN6W75BSTZYK3EL5JDKOMWI7VL27PTARA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.736427608 (386h5m52.198520091s) [seg_pos={0 0}, upload=339720]: Segment reached optimal threshold of 13 pieces.
Oct  9 15:37:06.736566292 (386h5m52.198658775s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736576751 (386h5m52.198669234s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736597040 (386h5m52.198689543s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736607961 (386h5m52.198700444s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736799205 (386h5m52.198891699s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736808032 (386h5m52.198900505s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736843279 (386h5m52.198935762s) [seg_pos={0 0}, upload=339720]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct  9 15:37:06.736970692 (386h5m52.199063185s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct  9 15:37:06.736978837 (386h5m52.19907132s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct  9 15:37:07.042768755 (386h5m52.504861238s) [upload=339720]: Done uploading segments...
Oct  9 15:37:07.042792771 (386h5m52.504885254s) [upload=339720]: Upload finished. err: <nil>
Duration: 6.46143985s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..........X.................................................]
duration: 
6.346533758s
FAIL (2025-10-09 16:11:16 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, Piece ID: NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q) context deadline exceeded; piecestore: (Node ID: 12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, Piece ID: 3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ) context deadline exceeded
======LOGS======
Oct  9 15:37:02.242123523 (386h5m47.704215996s) [upload=339720]: Starting upload
Oct  9 15:37:02.242222231 (386h5m47.704314714s) [upload=339720]: Done starting upload
Oct  9 15:37:02.242341397 (386h5m47.70443388s) [upload=339720]: Uploading segments...
Oct  9 15:37:02.242462188 (386h5m47.704554671s) [upload=339720]: Got next segment. Inline: false
Oct  9 15:37:02.242528735 (386h5m47.704621218s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct  9 15:37:02.242536409 (386h5m47.704628892s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct  9 15:37:02.504197156 (386h5m47.966289629s) [seg_pos={0 0}, upload=339720]: Begin upload segment...
Oct  9 15:37:02.504256378 (386h5m47.966348861s) [seg_pos={0 0}, upload=339720]: Done begin upload segment.
Oct  9 15:37:02.504284772 (386h5m47.966377255s) [noise=true , address=145.79.227.13:4804   , piece_id=FUN5LPTLV2JQNLJB4JGNFWZIAVQTGEBJZULLVEP73PSHFSM3NZAA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.506016159 (386h5m47.968108642s) [noise=true , address=145.79.227.4:4185    , piece_id=UTDL5IOQ6GMNGPDMB3NQ4HCAYVODWE3JIOXBOK5H7OSKLON4FCQQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.506805693 (386h5m47.968898176s) [noise=true , address=145.79.227.12:4767   , piece_id=EHEIO5WX5PQKX5ZDHPZ2XMAZTCTZAAII4L2Q4DJAI3GG2DX3XUXQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.507381258 (386h5m47.969473751s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.508983771 (386h5m47.971076254s) [noise=true , address=77.90.31.17:4770     , piece_id=TCKYBCAFTDTNTLJCQRVEFCCHKT3DLNYILNR7MVOWFI4YHYBKPR6A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.509265788 (386h5m47.971358281s) [noise=true , address=77.90.31.21:4877     , piece_id=3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.510802103 (386h5m47.972894586s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.510991884 (386h5m47.973084377s) [noise=true , address=145.79.227.11:4730   , piece_id=HBZCZVD5H27SWWTMVDWWNHOJZCVQC2YI6DX4DY2A3GDOQ54PMD2A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.512377853 (386h5m47.974470336s) [noise=true , address=45.91.116.10:4083    , piece_id=WWFIBCZ4S3SYN3NOUWPO276LIQJ7BM7X42G6Z2UY2O3EJDP5GGRA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.512884819 (386h5m47.974977312s) [noise=true , address=145.79.227.17:4970   , piece_id=2F5TXHEN3LIB2XN4DTSQN6W75BSTZYK3EL5JDKOMWI7VL27PTARA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.513772208 (386h5m47.975864691s) [noise=true , address=77.90.31.19:4842     , piece_id=5GRKUSGWRVZZNJSQ7AVDAFRB2YRIOF3PQRCEMNENLLZMKAPIRT7Q, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.514679907 (386h5m47.97677239s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.515172375 (386h5m47.977264858s) [noise=true , address=145.79.227.7:4295    , piece_id=DXIJ26ILOHWTMS75FPHW7RRVB4CHHTWPRNQ5TQEE42GGH2TJVS2A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.516618288 (386h5m47.978710771s) [noise=true , address=77.90.31.21:4878     , piece_id=NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.516681799 (386h5m47.978774282s) [noise=true , address=77.90.31.18:4807     , piece_id=3MVQ72K2DFLN2SZHDDGB5EK6WSKBIEOQAYKQKQQQLNQRIMZEEZOQ, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:02.519789937 (386h5m47.98188243s) [noise=true , address=45.91.116.5:4299     , piece_id=EOURFB5N5DEUK6PRMWDZI7TCLXDK2DCY36DIR4ETE5FI67KCJ37A, seg_pos={0 0}, upload=339720]: Uploading piece...
Oct  9 15:37:04.342892789 (386h5m49.804985272s) [upload=339720]: Next returned nil segment
Oct  9 15:37:04.342934217 (386h5m49.8050267s) [upload=339720]: Waiting for error group managing segments...
Oct  9 15:37:04.771607028 (386h5m50.233699511s) [noise=true , address=45.91.116.10:4083    , piece_id=WWFIBCZ4S3SYN3NOUWPO276LIQJ7BM7X42G6Z2UY2O3EJDP5GGRA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.808771606 (386h5m50.270864089s) [noise=true , address=77.90.31.18:4807     , piece_id=3MVQ72K2DFLN2SZHDDGB5EK6WSKBIEOQAYKQKQQQLNQRIMZEEZOQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.911015099 (386h5m50.373107582s) [noise=true , address=77.90.31.19:4842     , piece_id=5GRKUSGWRVZZNJSQ7AVDAFRB2YRIOF3PQRCEMNENLLZMKAPIRT7Q, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:04.937504590 (386h5m50.399597073s) [noise=true , address=45.91.116.5:4299     , piece_id=EOURFB5N5DEUK6PRMWDZI7TCLXDK2DCY36DIR4ETE5FI67KCJ37A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.014747387 (386h5m50.47683987s) [noise=true , address=77.90.31.21:4878     , piece_id=NIOTO4IJZ6FRBGVDL6LYYI7OHWPPO4QEVWBATQ42AQZH5MPT5K4Q, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.181525045 (386h5m50.643617528s) [noise=true , address=77.90.31.17:4770     , piece_id=TCKYBCAFTDTNTLJCQRVEFCCHKT3DLNYILNR7MVOWFI4YHYBKPR6A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.385017486 (386h5m50.847109969s) [noise=true , address=145.79.227.7:4295    , piece_id=DXIJ26ILOHWTMS75FPHW7RRVB4CHHTWPRNQ5TQEE42GGH2TJVS2A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.404928321 (386h5m50.867020804s) [noise=true , address=145.79.227.4:4185    , piece_id=UTDL5IOQ6GMNGPDMB3NQ4HCAYVODWE3JIOXBOK5H7OSKLON4FCQQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.456562682 (386h5m50.918655175s) [noise=true , address=145.79.227.11:4730   , piece_id=HBZCZVD5H27SWWTMVDWWNHOJZCVQC2YI6DX4DY2A3GDOQ54PMD2A, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.515032722 (386h5m50.977125205s) [noise=true , address=77.90.31.21:4877     , piece_id=3ZK3543VGODZ3452ZZ23YLH5FARCRKGCOVVHAQSLBDTYCINKBJVQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:05.926564111 (386h5m51.388656595s) [noise=true , address=145.79.227.12:4767   , piece_id=EHEIO5WX5PQKX5ZDHPZ2XMAZTCTZAAII4L2Q4DJAI3GG2DX3XUXQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.373844666 (386h5m51.835937149s) [noise=true , address=145.79.227.13:4804   , piece_id=FUN5LPTLV2JQNLJB4JGNFWZIAVQTGEBJZULLVEP73PSHFSM3NZAA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.736384436 (386h5m52.198476909s) [noise=true , address=145.79.227.17:4970   , piece_id=2F5TXHEN3LIB2XN4DTSQN6W75BSTZYK3EL5JDKOMWI7VL27PTARA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: <nil>
Oct  9 15:37:06.736427608 (386h5m52.198520091s) [seg_pos={0 0}, upload=339720]: Segment reached optimal threshold of 13 pieces.
Oct  9 15:37:06.736566292 (386h5m52.198658775s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736576751 (386h5m52.198669234s) [noise=true , address=145.79.227.3:4151    , piece_id=MS3KJ3OCWQR5N6JWZCXIFTB4TFPLZNTNSQSWOJQP476OAKM6O7NQ, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736597040 (386h5m52.198689543s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736607961 (386h5m52.198700444s) [noise=true , address=145.79.227.6:4259    , piece_id=NGTT3BQRHDUOQ4QTTSK6GE2CI4J7AXZ5LXKBI245O3PT35KRP7NA, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736799205 (386h5m52.198891699s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Oct  9 15:37:06.736808032 (386h5m52.198900505s) [noise=true , address=145.79.227.15:4876   , piece_id=KLXHO4LI22RXA7EZFM5HWPLOPPTWFGJXBJJ4MLV4ZTSMBKZ5DPAA, seg_pos={0 0}, upload=339720]: Long tail cancellation due to optimal threshold
Oct  9 15:37:06.736843279 (386h5m52.198935762s) [seg_pos={0 0}, upload=339720]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct  9 15:37:06.736970692 (386h5m52.199063185s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct  9 15:37:06.736978837 (386h5m52.19907132s) [upload=339720]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct  9 15:37:07.042768755 (386h5m52.504861238s) [upload=339720]: Done uploading segments...
Oct  9 15:37:07.042792771 (386h5m52.504885254s) [upload=339720]: Upload finished. err: <nil>
Duration: 6.346575677s core uplink us-select-1