Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
5.670942011s
FAIL (2025-08-19 04:37:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:18:49.441032045 (250h52m43.872112176s) [upload=260936]: Starting upload Aug 19 04:18:49.441102109 (250h52m43.87218224s) [upload=260936]: Done starting upload Aug 19 04:18:49.441206920 (250h52m43.872287051s) [upload=260936]: Uploading segments... Aug 19 04:18:49.441282183 (250h52m43.872362314s) [upload=260936]: Got next segment. Inline: false Aug 19 04:18:49.441329023 (250h52m43.872409154s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:18:49.441333632 (250h52m43.872413763s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 04:18:49.656070915 (250h52m44.087151126s) [upload=260936]: Next segment err: metaclient: Too Many Requests Aug 19 04:18:49.656126561 (250h52m44.087206763s) [upload=260936]: Done uploading segments... Aug 19 04:18:49.656151800 (250h52m44.087231981s) [upload=260936]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.670961727s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X........X...................] duration:
1.854065308s
FAIL (2025-08-19 04:36:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:56.958844719 (250h55m51.38992485s) [upload=260989]: Starting upload Aug 19 04:21:56.958902229 (250h55m51.38998236s) [upload=260989]: Done starting upload Aug 19 04:21:56.958998763 (250h55m51.390078944s) [upload=260989]: Uploading segments... Aug 19 04:21:56.959063738 (250h55m51.390143869s) [upload=260989]: Got next segment. Inline: true Aug 19 04:21:56.959068307 (250h55m51.390148438s) [upload=260989]: Waiting for error group managing segments... Aug 19 04:21:56.959117832 (250h55m51.390197953s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:21:56.959121949 (250h55m51.390202081s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 04:21:56.959124484 (250h55m51.390204615s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 04:21:57.175047657 (250h55m51.606127788s) [upload=260989]: Done uploading segments... Aug 19 04:21:57.175064238 (250h55m51.606144369s) [upload=260989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.854083733s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
5.698142576s
FAIL (2025-08-19 04:36:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:18:49.441032045 (250h52m43.872112176s) [upload=260936]: Starting upload Aug 19 04:18:49.441102109 (250h52m43.87218224s) [upload=260936]: Done starting upload Aug 19 04:18:49.441206920 (250h52m43.872287051s) [upload=260936]: Uploading segments... Aug 19 04:18:49.441282183 (250h52m43.872362314s) [upload=260936]: Got next segment. Inline: false Aug 19 04:18:49.441329023 (250h52m43.872409154s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:18:49.441333632 (250h52m43.872413763s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 04:18:49.656070915 (250h52m44.087151126s) [upload=260936]: Next segment err: metaclient: Too Many Requests Aug 19 04:18:49.656126561 (250h52m44.087206763s) [upload=260936]: Done uploading segments... Aug 19 04:18:49.656151800 (250h52m44.087231981s) [upload=260936]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.698169897s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.290625177s
FAIL (2025-08-19 04:36:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.290662638s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X........X..................] duration:
1.912067159s
FAIL (2025-08-19 04:35:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:56.958844719 (250h55m51.38992485s) [upload=260989]: Starting upload Aug 19 04:21:56.958902229 (250h55m51.38998236s) [upload=260989]: Done starting upload Aug 19 04:21:56.958998763 (250h55m51.390078944s) [upload=260989]: Uploading segments... Aug 19 04:21:56.959063738 (250h55m51.390143869s) [upload=260989]: Got next segment. Inline: true Aug 19 04:21:56.959068307 (250h55m51.390148438s) [upload=260989]: Waiting for error group managing segments... Aug 19 04:21:56.959117832 (250h55m51.390197953s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:21:56.959121949 (250h55m51.390202081s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 04:21:56.959124484 (250h55m51.390204615s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 04:21:57.175047657 (250h55m51.606127788s) [upload=260989]: Done uploading segments... Aug 19 04:21:57.175064238 (250h55m51.606144369s) [upload=260989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.912116985s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
5.740026598s
FAIL (2025-08-19 04:35:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:18:49.441032045 (250h52m43.872112176s) [upload=260936]: Starting upload Aug 19 04:18:49.441102109 (250h52m43.87218224s) [upload=260936]: Done starting upload Aug 19 04:18:49.441206920 (250h52m43.872287051s) [upload=260936]: Uploading segments... Aug 19 04:18:49.441282183 (250h52m43.872362314s) [upload=260936]: Got next segment. Inline: false Aug 19 04:18:49.441329023 (250h52m43.872409154s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:18:49.441333632 (250h52m43.872413763s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 04:18:49.656070915 (250h52m44.087151126s) [upload=260936]: Next segment err: metaclient: Too Many Requests Aug 19 04:18:49.656126561 (250h52m44.087206763s) [upload=260936]: Done uploading segments... Aug 19 04:18:49.656151800 (250h52m44.087231981s) [upload=260936]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.7400538s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X........X.................] duration:
2.494574815s
FAIL (2025-08-19 04:35:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:56.958844719 (250h55m51.38992485s) [upload=260989]: Starting upload Aug 19 04:21:56.958902229 (250h55m51.38998236s) [upload=260989]: Done starting upload Aug 19 04:21:56.958998763 (250h55m51.390078944s) [upload=260989]: Uploading segments... Aug 19 04:21:56.959063738 (250h55m51.390143869s) [upload=260989]: Got next segment. Inline: true Aug 19 04:21:56.959068307 (250h55m51.390148438s) [upload=260989]: Waiting for error group managing segments... Aug 19 04:21:56.959117832 (250h55m51.390197953s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:21:56.959121949 (250h55m51.390202081s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 04:21:56.959124484 (250h55m51.390204615s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 04:21:57.175047657 (250h55m51.606127788s) [upload=260989]: Done uploading segments... Aug 19 04:21:57.175064238 (250h55m51.606144369s) [upload=260989]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.494602248s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [X..............] duration:
650.383259ms remote:
"tcp:13.203.125.58:443" response headers:
Date=Tue, 19 Aug 2025 04:25:31 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-19 04:35:03 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 650.413015ms
core
website
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.291326099s
FAIL (2025-08-19 04:35:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.291349393s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.X.............] duration:
623.467089ms remote:
"tcp:13.203.125.58:443" response headers:
Date=Tue, 19 Aug 2025 04:25:31 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-19 04:34:31 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 623.501724ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
6.076041641s
FAIL (2025-08-19 04:34:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:18:49.441032045 (250h52m43.872112176s) [upload=260936]: Starting upload Aug 19 04:18:49.441102109 (250h52m43.87218224s) [upload=260936]: Done starting upload Aug 19 04:18:49.441206920 (250h52m43.872287051s) [upload=260936]: Uploading segments... Aug 19 04:18:49.441282183 (250h52m43.872362314s) [upload=260936]: Got next segment. Inline: false Aug 19 04:18:49.441329023 (250h52m43.872409154s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:18:49.441333632 (250h52m43.872413763s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 04:18:49.656070915 (250h52m44.087151126s) [upload=260936]: Next segment err: metaclient: Too Many Requests Aug 19 04:18:49.656126561 (250h52m44.087206763s) [upload=260936]: Done uploading segments... Aug 19 04:18:49.656151800 (250h52m44.087231981s) [upload=260936]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.076117686s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
3.308307851s
FAIL (2025-08-19 04:34:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.308327638s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X........X................] duration:
3.960464214s
FAIL (2025-08-19 04:34:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:56.958844719 (250h55m51.38992485s) [upload=260989]: Starting upload Aug 19 04:21:56.958902229 (250h55m51.38998236s) [upload=260989]: Done starting upload Aug 19 04:21:56.958998763 (250h55m51.390078944s) [upload=260989]: Uploading segments... Aug 19 04:21:56.959063738 (250h55m51.390143869s) [upload=260989]: Got next segment. Inline: true Aug 19 04:21:56.959068307 (250h55m51.390148438s) [upload=260989]: Waiting for error group managing segments... Aug 19 04:21:56.959117832 (250h55m51.390197953s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:21:56.959121949 (250h55m51.390202081s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 04:21:56.959124484 (250h55m51.390204615s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 04:21:57.175047657 (250h55m51.606127788s) [upload=260989]: Done uploading segments... Aug 19 04:21:57.175064238 (250h55m51.606144369s) [upload=260989]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.96048778s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.839649155s
FAIL (2025-08-19 04:34:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.839666769s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X........X...............] duration:
2.013666671s
FAIL (2025-08-19 04:33:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:56.958844719 (250h55m51.38992485s) [upload=260989]: Starting upload Aug 19 04:21:56.958902229 (250h55m51.38998236s) [upload=260989]: Done starting upload Aug 19 04:21:56.958998763 (250h55m51.390078944s) [upload=260989]: Uploading segments... Aug 19 04:21:56.959063738 (250h55m51.390143869s) [upload=260989]: Got next segment. Inline: true Aug 19 04:21:56.959068307 (250h55m51.390148438s) [upload=260989]: Waiting for error group managing segments... Aug 19 04:21:56.959117832 (250h55m51.390197953s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:21:56.959121949 (250h55m51.390202081s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 04:21:56.959124484 (250h55m51.390204615s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 04:21:57.175047657 (250h55m51.606127788s) [upload=260989]: Done uploading segments... Aug 19 04:21:57.175064238 (250h55m51.606144369s) [upload=260989]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.013693783s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.276475593s
FAIL (2025-08-19 04:33:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.276514337s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [..X............] duration:
650.045054ms remote:
"tcp:13.203.125.58:443" response headers:
Date=Tue, 19 Aug 2025 04:25:31 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-19 04:33:38 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 650.071183ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
5.844535806s
FAIL (2025-08-19 04:33:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:18:49.441032045 (250h52m43.872112176s) [upload=260936]: Starting upload Aug 19 04:18:49.441102109 (250h52m43.87218224s) [upload=260936]: Done starting upload Aug 19 04:18:49.441206920 (250h52m43.872287051s) [upload=260936]: Uploading segments... Aug 19 04:18:49.441282183 (250h52m43.872362314s) [upload=260936]: Got next segment. Inline: false Aug 19 04:18:49.441329023 (250h52m43.872409154s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:18:49.441333632 (250h52m43.872413763s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 04:18:49.656070915 (250h52m44.087151126s) [upload=260936]: Next segment err: metaclient: Too Many Requests Aug 19 04:18:49.656126561 (250h52m44.087206763s) [upload=260936]: Done uploading segments... Aug 19 04:18:49.656151800 (250h52m44.087231981s) [upload=260936]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.844560214s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.279556257s
FAIL (2025-08-19 04:33:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.279579451s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [...X...........] duration:
609.774259ms remote:
"tcp:13.203.125.58:443" response headers:
Date=Tue, 19 Aug 2025 04:25:31 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-19 04:33:18 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 609.802693ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................X........X..............] duration:
2.001286823s
FAIL (2025-08-19 04:32:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:56.958844719 (250h55m51.38992485s) [upload=260989]: Starting upload Aug 19 04:21:56.958902229 (250h55m51.38998236s) [upload=260989]: Done starting upload Aug 19 04:21:56.958998763 (250h55m51.390078944s) [upload=260989]: Uploading segments... Aug 19 04:21:56.959063738 (250h55m51.390143869s) [upload=260989]: Got next segment. Inline: true Aug 19 04:21:56.959068307 (250h55m51.390148438s) [upload=260989]: Waiting for error group managing segments... Aug 19 04:21:56.959117832 (250h55m51.390197953s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:21:56.959121949 (250h55m51.390202081s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 04:21:56.959124484 (250h55m51.390204615s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 04:21:57.175047657 (250h55m51.606127788s) [upload=260989]: Done uploading segments... Aug 19 04:21:57.175064238 (250h55m51.606144369s) [upload=260989]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.001308355s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000808144s
FAIL (2025-08-19 04:32:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.000843502s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X........X.............] duration:
1.959068233s
FAIL (2025-08-19 04:32:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:56.958844719 (250h55m51.38992485s) [upload=260989]: Starting upload Aug 19 04:21:56.958902229 (250h55m51.38998236s) [upload=260989]: Done starting upload Aug 19 04:21:56.958998763 (250h55m51.390078944s) [upload=260989]: Uploading segments... Aug 19 04:21:56.959063738 (250h55m51.390143869s) [upload=260989]: Got next segment. Inline: true Aug 19 04:21:56.959068307 (250h55m51.390148438s) [upload=260989]: Waiting for error group managing segments... Aug 19 04:21:56.959117832 (250h55m51.390197953s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:21:56.959121949 (250h55m51.390202081s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 04:21:56.959124484 (250h55m51.390204615s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 04:21:57.175047657 (250h55m51.606127788s) [upload=260989]: Done uploading segments... Aug 19 04:21:57.175064238 (250h55m51.606144369s) [upload=260989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.959092921s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [....X..........] duration:
742.421146ms remote:
"tcp:13.203.125.58:443" response headers:
Date=Tue, 19 Aug 2025 04:25:31 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-19 04:32:22 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 742.445794ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
5.726972409s
FAIL (2025-08-19 04:32:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:18:49.441032045 (250h52m43.872112176s) [upload=260936]: Starting upload Aug 19 04:18:49.441102109 (250h52m43.87218224s) [upload=260936]: Done starting upload Aug 19 04:18:49.441206920 (250h52m43.872287051s) [upload=260936]: Uploading segments... Aug 19 04:18:49.441282183 (250h52m43.872362314s) [upload=260936]: Got next segment. Inline: false Aug 19 04:18:49.441329023 (250h52m43.872409154s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:18:49.441333632 (250h52m43.872413763s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 04:18:49.656070915 (250h52m44.087151126s) [upload=260936]: Next segment err: metaclient: Too Many Requests Aug 19 04:18:49.656126561 (250h52m44.087206763s) [upload=260936]: Done uploading segments... Aug 19 04:18:49.656151800 (250h52m44.087231981s) [upload=260936]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.726995994s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.915899836s
FAIL (2025-08-19 04:31:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:18:49.441032045 (250h52m43.872112176s) [upload=260936]: Starting upload Aug 19 04:18:49.441102109 (250h52m43.87218224s) [upload=260936]: Done starting upload Aug 19 04:18:49.441206920 (250h52m43.872287051s) [upload=260936]: Uploading segments... Aug 19 04:18:49.441282183 (250h52m43.872362314s) [upload=260936]: Got next segment. Inline: false Aug 19 04:18:49.441329023 (250h52m43.872409154s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:18:49.441333632 (250h52m43.872413763s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 04:18:49.656070915 (250h52m44.087151126s) [upload=260936]: Next segment err: metaclient: Too Many Requests Aug 19 04:18:49.656126561 (250h52m44.087206763s) [upload=260936]: Done uploading segments... Aug 19 04:18:49.656151800 (250h52m44.087231981s) [upload=260936]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.915921967s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................X........X............] duration:
1.960889827s
FAIL (2025-08-19 04:31:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:56.958844719 (250h55m51.38992485s) [upload=260989]: Starting upload Aug 19 04:21:56.958902229 (250h55m51.38998236s) [upload=260989]: Done starting upload Aug 19 04:21:56.958998763 (250h55m51.390078944s) [upload=260989]: Uploading segments... Aug 19 04:21:56.959063738 (250h55m51.390143869s) [upload=260989]: Got next segment. Inline: true Aug 19 04:21:56.959068307 (250h55m51.390148438s) [upload=260989]: Waiting for error group managing segments... Aug 19 04:21:56.959117832 (250h55m51.390197953s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:21:56.959121949 (250h55m51.390202081s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 04:21:56.959124484 (250h55m51.390204615s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 04:21:57.175047657 (250h55m51.606127788s) [upload=260989]: Done uploading segments... Aug 19 04:21:57.175064238 (250h55m51.606144369s) [upload=260989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.960915446s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.....X.........] duration:
655.751883ms remote:
"tcp:13.203.125.58:443" response headers:
Date=Tue, 19 Aug 2025 04:25:31 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-19 04:31:14 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 655.773755ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X........X...........] duration:
1.87585488s
FAIL (2025-08-19 04:30:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:56.958844719 (250h55m51.38992485s) [upload=260989]: Starting upload Aug 19 04:21:56.958902229 (250h55m51.38998236s) [upload=260989]: Done starting upload Aug 19 04:21:56.958998763 (250h55m51.390078944s) [upload=260989]: Uploading segments... Aug 19 04:21:56.959063738 (250h55m51.390143869s) [upload=260989]: Got next segment. Inline: true Aug 19 04:21:56.959068307 (250h55m51.390148438s) [upload=260989]: Waiting for error group managing segments... Aug 19 04:21:56.959117832 (250h55m51.390197953s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:21:56.959121949 (250h55m51.390202081s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 04:21:56.959124484 (250h55m51.390204615s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 04:21:57.175047657 (250h55m51.606127788s) [upload=260989]: Done uploading segments... Aug 19 04:21:57.175064238 (250h55m51.606144369s) [upload=260989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.875887733s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [......X........] duration:
869.289248ms remote:
"tcp:13.203.125.58:443" response headers:
Date=Tue, 19 Aug 2025 04:25:31 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-19 04:30:59 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 869.313343ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.63619252s
FAIL (2025-08-19 04:30:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:18:49.441032045 (250h52m43.872112176s) [upload=260936]: Starting upload Aug 19 04:18:49.441102109 (250h52m43.87218224s) [upload=260936]: Done starting upload Aug 19 04:18:49.441206920 (250h52m43.872287051s) [upload=260936]: Uploading segments... Aug 19 04:18:49.441282183 (250h52m43.872362314s) [upload=260936]: Got next segment. Inline: false Aug 19 04:18:49.441329023 (250h52m43.872409154s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:18:49.441333632 (250h52m43.872413763s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 04:18:49.656070915 (250h52m44.087151126s) [upload=260936]: Next segment err: metaclient: Too Many Requests Aug 19 04:18:49.656126561 (250h52m44.087206763s) [upload=260936]: Done uploading segments... Aug 19 04:18:49.656151800 (250h52m44.087231981s) [upload=260936]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.636225774s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.770700608s
FAIL (2025-08-19 04:30:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:18:49.441032045 (250h52m43.872112176s) [upload=260936]: Starting upload Aug 19 04:18:49.441102109 (250h52m43.87218224s) [upload=260936]: Done starting upload Aug 19 04:18:49.441206920 (250h52m43.872287051s) [upload=260936]: Uploading segments... Aug 19 04:18:49.441282183 (250h52m43.872362314s) [upload=260936]: Got next segment. Inline: false Aug 19 04:18:49.441329023 (250h52m43.872409154s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:18:49.441333632 (250h52m43.872413763s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 04:18:49.656070915 (250h52m44.087151126s) [upload=260936]: Next segment err: metaclient: Too Many Requests Aug 19 04:18:49.656126561 (250h52m44.087206763s) [upload=260936]: Done uploading segments... Aug 19 04:18:49.656151800 (250h52m44.087231981s) [upload=260936]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.770731959s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................................X........X..........] duration:
1.892235964s
FAIL (2025-08-19 04:30:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:56.958844719 (250h55m51.38992485s) [upload=260989]: Starting upload Aug 19 04:21:56.958902229 (250h55m51.38998236s) [upload=260989]: Done starting upload Aug 19 04:21:56.958998763 (250h55m51.390078944s) [upload=260989]: Uploading segments... Aug 19 04:21:56.959063738 (250h55m51.390143869s) [upload=260989]: Got next segment. Inline: true Aug 19 04:21:56.959068307 (250h55m51.390148438s) [upload=260989]: Waiting for error group managing segments... Aug 19 04:21:56.959117832 (250h55m51.390197953s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:21:56.959121949 (250h55m51.390202081s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 04:21:56.959124484 (250h55m51.390204615s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 04:21:57.175047657 (250h55m51.606127788s) [upload=260989]: Done uploading segments... Aug 19 04:21:57.175064238 (250h55m51.606144369s) [upload=260989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.892262897s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X........X.........] duration:
1.8073903s
FAIL (2025-08-19 04:29:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:56.958844719 (250h55m51.38992485s) [upload=260989]: Starting upload Aug 19 04:21:56.958902229 (250h55m51.38998236s) [upload=260989]: Done starting upload Aug 19 04:21:56.958998763 (250h55m51.390078944s) [upload=260989]: Uploading segments... Aug 19 04:21:56.959063738 (250h55m51.390143869s) [upload=260989]: Got next segment. Inline: true Aug 19 04:21:56.959068307 (250h55m51.390148438s) [upload=260989]: Waiting for error group managing segments... Aug 19 04:21:56.959117832 (250h55m51.390197953s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:21:56.959121949 (250h55m51.390202081s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 04:21:56.959124484 (250h55m51.390204615s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 04:21:57.175047657 (250h55m51.606127788s) [upload=260989]: Done uploading segments... Aug 19 04:21:57.175064238 (250h55m51.606144369s) [upload=260989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.807418663s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.......X.......] duration:
630.807142ms remote:
"tcp:13.203.125.58:443" response headers:
Date=Tue, 19 Aug 2025 04:25:31 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-19 04:29:58 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 630.832101ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [........X......] duration:
641.345287ms remote:
"tcp:13.203.125.58:443" response headers:
Date=Tue, 19 Aug 2025 04:25:31 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-19 04:29:25 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 641.375595ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
6.060411466s
FAIL (2025-08-19 04:29:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:18:49.441032045 (250h52m43.872112176s) [upload=260936]: Starting upload Aug 19 04:18:49.441102109 (250h52m43.87218224s) [upload=260936]: Done starting upload Aug 19 04:18:49.441206920 (250h52m43.872287051s) [upload=260936]: Uploading segments... Aug 19 04:18:49.441282183 (250h52m43.872362314s) [upload=260936]: Got next segment. Inline: false Aug 19 04:18:49.441329023 (250h52m43.872409154s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:18:49.441333632 (250h52m43.872413763s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 04:18:49.656070915 (250h52m44.087151126s) [upload=260936]: Next segment err: metaclient: Too Many Requests Aug 19 04:18:49.656126561 (250h52m44.087206763s) [upload=260936]: Done uploading segments... Aug 19 04:18:49.656151800 (250h52m44.087231981s) [upload=260936]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.060433127s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X........X........] duration:
1.920373733s
FAIL (2025-08-19 04:29:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:56.958844719 (250h55m51.38992485s) [upload=260989]: Starting upload Aug 19 04:21:56.958902229 (250h55m51.38998236s) [upload=260989]: Done starting upload Aug 19 04:21:56.958998763 (250h55m51.390078944s) [upload=260989]: Uploading segments... Aug 19 04:21:56.959063738 (250h55m51.390143869s) [upload=260989]: Got next segment. Inline: true Aug 19 04:21:56.959068307 (250h55m51.390148438s) [upload=260989]: Waiting for error group managing segments... Aug 19 04:21:56.959117832 (250h55m51.390197953s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:21:56.959121949 (250h55m51.390202081s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 04:21:56.959124484 (250h55m51.390204615s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 04:21:57.175047657 (250h55m51.606127788s) [upload=260989]: Done uploading segments... Aug 19 04:21:57.175064238 (250h55m51.606144369s) [upload=260989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.920409112s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
5.905426767s
FAIL (2025-08-19 04:29:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:18:49.441032045 (250h52m43.872112176s) [upload=260936]: Starting upload Aug 19 04:18:49.441102109 (250h52m43.87218224s) [upload=260936]: Done starting upload Aug 19 04:18:49.441206920 (250h52m43.872287051s) [upload=260936]: Uploading segments... Aug 19 04:18:49.441282183 (250h52m43.872362314s) [upload=260936]: Got next segment. Inline: false Aug 19 04:18:49.441329023 (250h52m43.872409154s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:18:49.441333632 (250h52m43.872413763s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 04:18:49.656070915 (250h52m44.087151126s) [upload=260936]: Next segment err: metaclient: Too Many Requests Aug 19 04:18:49.656126561 (250h52m44.087206763s) [upload=260936]: Done uploading segments... Aug 19 04:18:49.656151800 (250h52m44.087231981s) [upload=260936]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.905451864s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.........X.....] duration:
635.750038ms remote:
"tcp:13.203.125.58:443" response headers:
Date=Tue, 19 Aug 2025 04:25:31 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-19 04:28:41 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 635.812196ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X........X.......] duration:
1.81588706s
FAIL (2025-08-19 04:28:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:56.958844719 (250h55m51.38992485s) [upload=260989]: Starting upload Aug 19 04:21:56.958902229 (250h55m51.38998236s) [upload=260989]: Done starting upload Aug 19 04:21:56.958998763 (250h55m51.390078944s) [upload=260989]: Uploading segments... Aug 19 04:21:56.959063738 (250h55m51.390143869s) [upload=260989]: Got next segment. Inline: true Aug 19 04:21:56.959068307 (250h55m51.390148438s) [upload=260989]: Waiting for error group managing segments... Aug 19 04:21:56.959117832 (250h55m51.390197953s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:21:56.959121949 (250h55m51.390202081s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 04:21:56.959124484 (250h55m51.390204615s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 04:21:57.175047657 (250h55m51.606127788s) [upload=260989]: Done uploading segments... Aug 19 04:21:57.175064238 (250h55m51.606144369s) [upload=260989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.815913611s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
5.839190105s
FAIL (2025-08-19 04:27:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:18:49.441032045 (250h52m43.872112176s) [upload=260936]: Starting upload Aug 19 04:18:49.441102109 (250h52m43.87218224s) [upload=260936]: Done starting upload Aug 19 04:18:49.441206920 (250h52m43.872287051s) [upload=260936]: Uploading segments... Aug 19 04:18:49.441282183 (250h52m43.872362314s) [upload=260936]: Got next segment. Inline: false Aug 19 04:18:49.441329023 (250h52m43.872409154s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:18:49.441333632 (250h52m43.872413763s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 04:18:49.656070915 (250h52m44.087151126s) [upload=260936]: Next segment err: metaclient: Too Many Requests Aug 19 04:18:49.656126561 (250h52m44.087206763s) [upload=260936]: Done uploading segments... Aug 19 04:18:49.656151800 (250h52m44.087231981s) [upload=260936]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.839215655s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [..........X....] duration:
657.035566ms remote:
"tcp:13.203.125.58:443" response headers:
Date=Tue, 19 Aug 2025 04:25:31 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-19 04:27:40 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 657.067808ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [...........X...] duration:
617.815451ms remote:
"tcp:13.203.125.58:443" response headers:
Date=Tue, 19 Aug 2025 04:25:31 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-19 04:27:22 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 617.859396ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................................X........X......] duration:
1.832241803s
FAIL (2025-08-19 04:27:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:56.958844719 (250h55m51.38992485s) [upload=260989]: Starting upload Aug 19 04:21:56.958902229 (250h55m51.38998236s) [upload=260989]: Done starting upload Aug 19 04:21:56.958998763 (250h55m51.390078944s) [upload=260989]: Uploading segments... Aug 19 04:21:56.959063738 (250h55m51.390143869s) [upload=260989]: Got next segment. Inline: true Aug 19 04:21:56.959068307 (250h55m51.390148438s) [upload=260989]: Waiting for error group managing segments... Aug 19 04:21:56.959117832 (250h55m51.390197953s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:21:56.959121949 (250h55m51.390202081s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 04:21:56.959124484 (250h55m51.390204615s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 04:21:57.175047657 (250h55m51.606127788s) [upload=260989]: Done uploading segments... Aug 19 04:21:57.175064238 (250h55m51.606144369s) [upload=260989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.832268434s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.845570468s
FAIL (2025-08-19 04:27:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:18:49.441032045 (250h52m43.872112176s) [upload=260936]: Starting upload Aug 19 04:18:49.441102109 (250h52m43.87218224s) [upload=260936]: Done starting upload Aug 19 04:18:49.441206920 (250h52m43.872287051s) [upload=260936]: Uploading segments... Aug 19 04:18:49.441282183 (250h52m43.872362314s) [upload=260936]: Got next segment. Inline: false Aug 19 04:18:49.441329023 (250h52m43.872409154s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:18:49.441333632 (250h52m43.872413763s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 04:18:49.656070915 (250h52m44.087151126s) [upload=260936]: Next segment err: metaclient: Too Many Requests Aug 19 04:18:49.656126561 (250h52m44.087206763s) [upload=260936]: Done uploading segments... Aug 19 04:18:49.656151800 (250h52m44.087231981s) [upload=260936]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.845613s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X........X.....] duration:
1.828568185s
FAIL (2025-08-19 04:26:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:56.958844719 (250h55m51.38992485s) [upload=260989]: Starting upload Aug 19 04:21:56.958902229 (250h55m51.38998236s) [upload=260989]: Done starting upload Aug 19 04:21:56.958998763 (250h55m51.390078944s) [upload=260989]: Uploading segments... Aug 19 04:21:56.959063738 (250h55m51.390143869s) [upload=260989]: Got next segment. Inline: true Aug 19 04:21:56.959068307 (250h55m51.390148438s) [upload=260989]: Waiting for error group managing segments... Aug 19 04:21:56.959117832 (250h55m51.390197953s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:21:56.959121949 (250h55m51.390202081s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 04:21:56.959124484 (250h55m51.390204615s) [upload=260989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 04:21:57.175047657 (250h55m51.606127788s) [upload=260989]: Done uploading segments... Aug 19 04:21:57.175064238 (250h55m51.606144369s) [upload=260989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.828594694s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [............X..] duration:
622.212467ms remote:
"tcp:13.203.125.58:443" response headers:
Date=Tue, 19 Aug 2025 04:25:31 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-19 04:26:35 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 622.242083ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
5.757197039s
FAIL (2025-08-19 04:26:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:18:49.441032045 (250h52m43.872112176s) [upload=260936]: Starting upload Aug 19 04:18:49.441102109 (250h52m43.87218224s) [upload=260936]: Done starting upload Aug 19 04:18:49.441206920 (250h52m43.872287051s) [upload=260936]: Uploading segments... Aug 19 04:18:49.441282183 (250h52m43.872362314s) [upload=260936]: Got next segment. Inline: false Aug 19 04:18:49.441329023 (250h52m43.872409154s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:18:49.441333632 (250h52m43.872413763s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 04:18:49.656070915 (250h52m44.087151126s) [upload=260936]: Next segment err: metaclient: Too Many Requests Aug 19 04:18:49.656126561 (250h52m44.087206763s) [upload=260936]: Done uploading segments... Aug 19 04:18:49.656151800 (250h52m44.087231981s) [upload=260936]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.757224671s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
5.779274101s
FAIL (2025-08-19 04:26:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:18:49.441032045 (250h52m43.872112176s) [upload=260936]: Starting upload Aug 19 04:18:49.441102109 (250h52m43.87218224s) [upload=260936]: Done starting upload Aug 19 04:18:49.441206920 (250h52m43.872287051s) [upload=260936]: Uploading segments... Aug 19 04:18:49.441282183 (250h52m43.872362314s) [upload=260936]: Got next segment. Inline: false Aug 19 04:18:49.441329023 (250h52m43.872409154s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 04:18:49.441333632 (250h52m43.872413763s) [upload=260936]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 04:18:49.656070915 (250h52m44.087151126s) [upload=260936]: Next segment err: metaclient: Too Many Requests Aug 19 04:18:49.656126561 (250h52m44.087206763s) [upload=260936]: Done uploading segments... Aug 19 04:18:49.656151800 (250h52m44.087231981s) [upload=260936]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.779302295s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|