Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
717.051752ms
FAIL (2025-08-09 00:43:33 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 717.083262ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
9.299645195s
FAIL (2025-08-09 00:43:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:25:21.054812319 (6h59m15.48589246s) [upload=7311]: Starting upload Aug 9 00:25:21.054887373 (6h59m15.485967514s) [upload=7311]: Done starting upload Aug 9 00:25:21.054974740 (6h59m15.486054871s) [upload=7311]: Uploading segments... Aug 9 00:25:21.055143473 (6h59m15.486223604s) [upload=7311]: Got next segment. Inline: false Aug 9 00:25:21.055207194 (6h59m15.486287325s) [upload=7311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:25:21.055213838 (6h59m15.486293969s) [upload=7311]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:25:21.326628933 (6h59m15.757709064s) [upload=7311]: Next segment err: metaclient: Too Many Requests Aug 9 00:25:21.326662107 (6h59m15.757742238s) [upload=7311]: Done uploading segments... Aug 9 00:25:21.326682726 (6h59m15.757762907s) [upload=7311]: Upload finished. err: metaclient: Too Many Requests
Duration: 9.299687455s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.........X....X.....X.X..........................X.X.....X..] duration:
2.048948457s
FAIL (2025-08-09 00:43:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:41:49.183606846 (7h15m43.614686977s) [upload=7605]: Starting upload Aug 9 00:41:49.183643877 (7h15m43.614723998s) [upload=7605]: Done starting upload Aug 9 00:41:49.183694574 (7h15m43.614774705s) [upload=7605]: Uploading segments... Aug 9 00:41:49.183722818 (7h15m43.614802949s) [upload=7605]: Got next segment. Inline: true Aug 9 00:41:49.183726575 (7h15m43.614806696s) [upload=7605]: Waiting for error group managing segments... Aug 9 00:41:49.183755280 (7h15m43.614835411s) [upload=7605]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:41:49.183758957 (7h15m43.614839088s) [upload=7605]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:41:49.183761503 (7h15m43.614841634s) [upload=7605]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:41:49.397497653 (7h15m43.828577784s) [upload=7605]: Done uploading segments... Aug 9 00:41:49.397515988 (7h15m43.828596119s) [upload=7605]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.048977143s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
730.649629ms
FAIL (2025-08-09 00:43:05 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 730.68735ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.263095704s
FAIL (2025-08-09 00:42:59 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.263290888s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
773.335929ms
FAIL (2025-08-09 00:42:46 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 773.362419ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [..........X....X.....X.X..........................X.X.....X.] duration:
1.830747743s
FAIL (2025-08-09 00:42:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:41:49.183606846 (7h15m43.614686977s) [upload=7605]: Starting upload Aug 9 00:41:49.183643877 (7h15m43.614723998s) [upload=7605]: Done starting upload Aug 9 00:41:49.183694574 (7h15m43.614774705s) [upload=7605]: Uploading segments... Aug 9 00:41:49.183722818 (7h15m43.614802949s) [upload=7605]: Got next segment. Inline: true Aug 9 00:41:49.183726575 (7h15m43.614806696s) [upload=7605]: Waiting for error group managing segments... Aug 9 00:41:49.183755280 (7h15m43.614835411s) [upload=7605]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:41:49.183758957 (7h15m43.614839088s) [upload=7605]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:41:49.183761503 (7h15m43.614841634s) [upload=7605]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:41:49.397497653 (7h15m43.828577784s) [upload=7605]: Done uploading segments... Aug 9 00:41:49.397515988 (7h15m43.828596119s) [upload=7605]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.830775715s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.34320163s
FAIL (2025-08-09 00:42:30 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.343226428s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
729.802448ms
FAIL (2025-08-09 00:42:24 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 729.827086ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
6.310262341s
FAIL (2025-08-09 00:42:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:25:21.054812319 (6h59m15.48589246s) [upload=7311]: Starting upload Aug 9 00:25:21.054887373 (6h59m15.485967514s) [upload=7311]: Done starting upload Aug 9 00:25:21.054974740 (6h59m15.486054871s) [upload=7311]: Uploading segments... Aug 9 00:25:21.055143473 (6h59m15.486223604s) [upload=7311]: Got next segment. Inline: false Aug 9 00:25:21.055207194 (6h59m15.486287325s) [upload=7311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:25:21.055213838 (6h59m15.486293969s) [upload=7311]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:25:21.326628933 (6h59m15.757709064s) [upload=7311]: Next segment err: metaclient: Too Many Requests Aug 9 00:25:21.326662107 (6h59m15.757742238s) [upload=7311]: Done uploading segments... Aug 9 00:25:21.326682726 (6h59m15.757762907s) [upload=7311]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.310286288s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
758.510024ms
FAIL (2025-08-09 00:42:05 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 758.53859ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.211214948s
FAIL (2025-08-09 00:41:56 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.211242851s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [X..........X....X.....X.X..........................X.X.....X] duration:
861.708734ms
FAIL (2025-08-09 00:41:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:41:49.183606846 (7h15m43.614686977s) [upload=7605]: Starting upload Aug 9 00:41:49.183643877 (7h15m43.614723998s) [upload=7605]: Done starting upload Aug 9 00:41:49.183694574 (7h15m43.614774705s) [upload=7605]: Uploading segments... Aug 9 00:41:49.183722818 (7h15m43.614802949s) [upload=7605]: Got next segment. Inline: true Aug 9 00:41:49.183726575 (7h15m43.614806696s) [upload=7605]: Waiting for error group managing segments... Aug 9 00:41:49.183755280 (7h15m43.614835411s) [upload=7605]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:41:49.183758957 (7h15m43.614839088s) [upload=7605]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:41:49.183761503 (7h15m43.614841634s) [upload=7605]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:41:49.397497653 (7h15m43.828577784s) [upload=7605]: Done uploading segments... Aug 9 00:41:49.397515988 (7h15m43.828596119s) [upload=7605]: Upload finished. err: metaclient: Too Many Requests
Duration: 861.7331ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.X..........X....X.....X.X..........................X.X.....] duration:
1.937420402s
FAIL (2025-08-09 00:41:13 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 00:37:11.583727689 (7h11m6.01480782s) [upload=7521]: Starting upload Aug 9 00:37:11.583770762 (7h11m6.014850893s) [upload=7521]: Done starting upload Aug 9 00:37:11.583826358 (7h11m6.014906489s) [upload=7521]: Uploading segments... Aug 9 00:37:11.583855424 (7h11m6.014935555s) [upload=7521]: Got next segment. Inline: true Aug 9 00:37:11.583859081 (7h11m6.014939202s) [upload=7521]: Waiting for error group managing segments... Aug 9 00:37:11.583894167 (7h11m6.014974299s) [upload=7521]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:37:11.583898245 (7h11m6.014978376s) [upload=7521]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:37:11.583900660 (7h11m6.014980791s) [upload=7521]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:37:11.859837539 (7h11m6.2909177s) [upload=7521]: Done uploading segments... Aug 9 00:37:11.859857908 (7h11m6.290938039s) [upload=7521]: Upload finished. err: <nil>
Duration: 1.937454187s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X.......................................X...................] duration:
5.710828919s
FAIL (2025-08-09 00:41:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:25:21.054812319 (6h59m15.48589246s) [upload=7311]: Starting upload Aug 9 00:25:21.054887373 (6h59m15.485967514s) [upload=7311]: Done starting upload Aug 9 00:25:21.054974740 (6h59m15.486054871s) [upload=7311]: Uploading segments... Aug 9 00:25:21.055143473 (6h59m15.486223604s) [upload=7311]: Got next segment. Inline: false Aug 9 00:25:21.055207194 (6h59m15.486287325s) [upload=7311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:25:21.055213838 (6h59m15.486293969s) [upload=7311]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:25:21.326628933 (6h59m15.757709064s) [upload=7311]: Next segment err: metaclient: Too Many Requests Aug 9 00:25:21.326662107 (6h59m15.757742238s) [upload=7311]: Done uploading segments... Aug 9 00:25:21.326682726 (6h59m15.757762907s) [upload=7311]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.710856752s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
770.176918ms
FAIL (2025-08-09 00:40:58 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 770.215371ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.261581215s
FAIL (2025-08-09 00:40:43 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.261605492s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X.......................................X..................] duration:
6.524412521s
FAIL (2025-08-09 00:40:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:25:21.054812319 (6h59m15.48589246s) [upload=7311]: Starting upload Aug 9 00:25:21.054887373 (6h59m15.485967514s) [upload=7311]: Done starting upload Aug 9 00:25:21.054974740 (6h59m15.486054871s) [upload=7311]: Uploading segments... Aug 9 00:25:21.055143473 (6h59m15.486223604s) [upload=7311]: Got next segment. Inline: false Aug 9 00:25:21.055207194 (6h59m15.486287325s) [upload=7311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:25:21.055213838 (6h59m15.486293969s) [upload=7311]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:25:21.326628933 (6h59m15.757709064s) [upload=7311]: Next segment err: metaclient: Too Many Requests Aug 9 00:25:21.326662107 (6h59m15.757742238s) [upload=7311]: Done uploading segments... Aug 9 00:25:21.326682726 (6h59m15.757762907s) [upload=7311]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.524445736s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.351929076s
FAIL (2025-08-09 00:40:11 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.351953595s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
749.160215ms
FAIL (2025-08-09 00:40:11 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 749.225361ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X.......................................X.................] duration:
7.130163076s
FAIL (2025-08-09 00:40:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:25:21.054812319 (6h59m15.48589246s) [upload=7311]: Starting upload Aug 9 00:25:21.054887373 (6h59m15.485967514s) [upload=7311]: Done starting upload Aug 9 00:25:21.054974740 (6h59m15.486054871s) [upload=7311]: Uploading segments... Aug 9 00:25:21.055143473 (6h59m15.486223604s) [upload=7311]: Got next segment. Inline: false Aug 9 00:25:21.055207194 (6h59m15.486287325s) [upload=7311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:25:21.055213838 (6h59m15.486293969s) [upload=7311]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:25:21.326628933 (6h59m15.757709064s) [upload=7311]: Next segment err: metaclient: Too Many Requests Aug 9 00:25:21.326662107 (6h59m15.757742238s) [upload=7311]: Done uploading segments... Aug 9 00:25:21.326682726 (6h59m15.757762907s) [upload=7311]: Upload finished. err: metaclient: Too Many Requests
Duration: 7.130255904s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [..X..........X....X.....X.X..........................X.X....] duration:
2.189033972s
FAIL (2025-08-09 00:40:01 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 00:37:11.583727689 (7h11m6.01480782s) [upload=7521]: Starting upload Aug 9 00:37:11.583770762 (7h11m6.014850893s) [upload=7521]: Done starting upload Aug 9 00:37:11.583826358 (7h11m6.014906489s) [upload=7521]: Uploading segments... Aug 9 00:37:11.583855424 (7h11m6.014935555s) [upload=7521]: Got next segment. Inline: true Aug 9 00:37:11.583859081 (7h11m6.014939202s) [upload=7521]: Waiting for error group managing segments... Aug 9 00:37:11.583894167 (7h11m6.014974299s) [upload=7521]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:37:11.583898245 (7h11m6.014978376s) [upload=7521]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:37:11.583900660 (7h11m6.014980791s) [upload=7521]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:37:11.859837539 (7h11m6.2909177s) [upload=7521]: Done uploading segments... Aug 9 00:37:11.859857908 (7h11m6.290938039s) [upload=7521]: Upload finished. err: <nil>
Duration: 2.189061053s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
769.74481ms
FAIL (2025-08-09 00:39:55 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 769.776481ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.530330242s
FAIL (2025-08-09 00:39:31 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.530441465s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [...X..........X....X.....X.X..........................X.X...] duration:
1.878185505s
FAIL (2025-08-09 00:39:23 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 00:37:11.583727689 (7h11m6.01480782s) [upload=7521]: Starting upload Aug 9 00:37:11.583770762 (7h11m6.014850893s) [upload=7521]: Done starting upload Aug 9 00:37:11.583826358 (7h11m6.014906489s) [upload=7521]: Uploading segments... Aug 9 00:37:11.583855424 (7h11m6.014935555s) [upload=7521]: Got next segment. Inline: true Aug 9 00:37:11.583859081 (7h11m6.014939202s) [upload=7521]: Waiting for error group managing segments... Aug 9 00:37:11.583894167 (7h11m6.014974299s) [upload=7521]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:37:11.583898245 (7h11m6.014978376s) [upload=7521]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:37:11.583900660 (7h11m6.014980791s) [upload=7521]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:37:11.859837539 (7h11m6.2909177s) [upload=7521]: Done uploading segments... Aug 9 00:37:11.859857908 (7h11m6.290938039s) [upload=7521]: Upload finished. err: <nil>
Duration: 1.878218897s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.466333749s
FAIL (2025-08-09 00:39:06 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.466349959s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
754.69735ms
FAIL (2025-08-09 00:39:06 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 754.727428ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X.......................................X................] duration:
6.687201658s
FAIL (2025-08-09 00:38:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:25:21.054812319 (6h59m15.48589246s) [upload=7311]: Starting upload Aug 9 00:25:21.054887373 (6h59m15.485967514s) [upload=7311]: Done starting upload Aug 9 00:25:21.054974740 (6h59m15.486054871s) [upload=7311]: Uploading segments... Aug 9 00:25:21.055143473 (6h59m15.486223604s) [upload=7311]: Got next segment. Inline: false Aug 9 00:25:21.055207194 (6h59m15.486287325s) [upload=7311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:25:21.055213838 (6h59m15.486293969s) [upload=7311]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:25:21.326628933 (6h59m15.757709064s) [upload=7311]: Next segment err: metaclient: Too Many Requests Aug 9 00:25:21.326662107 (6h59m15.757742238s) [upload=7311]: Done uploading segments... Aug 9 00:25:21.326682726 (6h59m15.757762907s) [upload=7311]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.687229311s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.289874338s
FAIL (2025-08-09 00:38:35 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.289900497s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [....X..........X....X.....X.X..........................X.X..] duration:
1.992881553s
FAIL (2025-08-09 00:38:21 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 00:37:11.583727689 (7h11m6.01480782s) [upload=7521]: Starting upload Aug 9 00:37:11.583770762 (7h11m6.014850893s) [upload=7521]: Done starting upload Aug 9 00:37:11.583826358 (7h11m6.014906489s) [upload=7521]: Uploading segments... Aug 9 00:37:11.583855424 (7h11m6.014935555s) [upload=7521]: Got next segment. Inline: true Aug 9 00:37:11.583859081 (7h11m6.014939202s) [upload=7521]: Waiting for error group managing segments... Aug 9 00:37:11.583894167 (7h11m6.014974299s) [upload=7521]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:37:11.583898245 (7h11m6.014978376s) [upload=7521]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:37:11.583900660 (7h11m6.014980791s) [upload=7521]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:37:11.859837539 (7h11m6.2909177s) [upload=7521]: Done uploading segments... Aug 9 00:37:11.859857908 (7h11m6.290938039s) [upload=7521]: Upload finished. err: <nil>
Duration: 1.9929008s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
735.29142ms
FAIL (2025-08-09 00:38:13 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 735.31238ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X.......................................X...............] duration:
6.81675251s
FAIL (2025-08-09 00:38:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:25:21.054812319 (6h59m15.48589246s) [upload=7311]: Starting upload Aug 9 00:25:21.054887373 (6h59m15.485967514s) [upload=7311]: Done starting upload Aug 9 00:25:21.054974740 (6h59m15.486054871s) [upload=7311]: Uploading segments... Aug 9 00:25:21.055143473 (6h59m15.486223604s) [upload=7311]: Got next segment. Inline: false Aug 9 00:25:21.055207194 (6h59m15.486287325s) [upload=7311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:25:21.055213838 (6h59m15.486293969s) [upload=7311]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:25:21.326628933 (6h59m15.757709064s) [upload=7311]: Next segment err: metaclient: Too Many Requests Aug 9 00:25:21.326662107 (6h59m15.757742238s) [upload=7311]: Done uploading segments... Aug 9 00:25:21.326682726 (6h59m15.757762907s) [upload=7311]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.816782016s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.594634486s
FAIL (2025-08-09 00:37:56 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.594659514s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.....X..........X....X.....X.X..........................X.X.] duration:
2.084773349s
FAIL (2025-08-09 00:37:36 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 00:37:11.583727689 (7h11m6.01480782s) [upload=7521]: Starting upload Aug 9 00:37:11.583770762 (7h11m6.014850893s) [upload=7521]: Done starting upload Aug 9 00:37:11.583826358 (7h11m6.014906489s) [upload=7521]: Uploading segments... Aug 9 00:37:11.583855424 (7h11m6.014935555s) [upload=7521]: Got next segment. Inline: true Aug 9 00:37:11.583859081 (7h11m6.014939202s) [upload=7521]: Waiting for error group managing segments... Aug 9 00:37:11.583894167 (7h11m6.014974299s) [upload=7521]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:37:11.583898245 (7h11m6.014978376s) [upload=7521]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:37:11.583900660 (7h11m6.014980791s) [upload=7521]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:37:11.859837539 (7h11m6.2909177s) [upload=7521]: Done uploading segments... Aug 9 00:37:11.859857908 (7h11m6.290938039s) [upload=7521]: Upload finished. err: <nil>
Duration: 2.084804239s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X.......................................X..............] duration:
6.678098986s
FAIL (2025-08-09 00:37:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:25:21.054812319 (6h59m15.48589246s) [upload=7311]: Starting upload Aug 9 00:25:21.054887373 (6h59m15.485967514s) [upload=7311]: Done starting upload Aug 9 00:25:21.054974740 (6h59m15.486054871s) [upload=7311]: Uploading segments... Aug 9 00:25:21.055143473 (6h59m15.486223604s) [upload=7311]: Got next segment. Inline: false Aug 9 00:25:21.055207194 (6h59m15.486287325s) [upload=7311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:25:21.055213838 (6h59m15.486293969s) [upload=7311]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:25:21.326628933 (6h59m15.757709064s) [upload=7311]: Next segment err: metaclient: Too Many Requests Aug 9 00:25:21.326662107 (6h59m15.757742238s) [upload=7311]: Done uploading segments... Aug 9 00:25:21.326682726 (6h59m15.757762907s) [upload=7311]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.678121089s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
736.694425ms
FAIL (2025-08-09 00:37:18 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 736.719553ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [......X..........X....X.....X.X..........................X.X] duration:
1.379607577s
FAIL (2025-08-09 00:37:12 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 00:37:11.583727689 (7h11m6.01480782s) [upload=7521]: Starting upload Aug 9 00:37:11.583770762 (7h11m6.014850893s) [upload=7521]: Done starting upload Aug 9 00:37:11.583826358 (7h11m6.014906489s) [upload=7521]: Uploading segments... Aug 9 00:37:11.583855424 (7h11m6.014935555s) [upload=7521]: Got next segment. Inline: true Aug 9 00:37:11.583859081 (7h11m6.014939202s) [upload=7521]: Waiting for error group managing segments... Aug 9 00:37:11.583894167 (7h11m6.014974299s) [upload=7521]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:37:11.583898245 (7h11m6.014978376s) [upload=7521]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:37:11.583900660 (7h11m6.014980791s) [upload=7521]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:37:11.859837539 (7h11m6.2909177s) [upload=7521]: Done uploading segments... Aug 9 00:37:11.859857908 (7h11m6.290938039s) [upload=7521]: Upload finished. err: <nil>
Duration: 1.379627546s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
761.641237ms
FAIL (2025-08-09 00:36:58 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 761.666183ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.375304882s
FAIL (2025-08-09 00:36:51 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.375327486s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.......X..........X....X.....X.X..........................X.] duration:
1.893538451s
FAIL (2025-08-09 00:36:34 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 00:35:53.654297133 (7h9m48.085377255s) [upload=7499]: Starting upload
Aug 9 00:35:53.654343371 (7h9m48.085423492s) [upload=7499]: Done starting upload
Aug 9 00:35:53.654388067 (7h9m48.085468198s) [upload=7499]: Uploading segments...
Aug 9 00:35:53.654424176 (7h9m48.085504307s) [upload=7499]: Got next segment. Inline: true
Aug 9 00:35:53.654428154 (7h9m48.085508275s) [upload=7499]: Waiting for error group managing segments...
Aug 9 00:35:53.654461949 (7h9m48.08554207s) [upload=7499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 00:35:53.654466016 (7h9m48.085546148s) [upload=7499]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 00:35:53.654468531 (7h9m48.085548662s) [upload=7499]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 00:35:53.954280910 (7h9m48.385361031s) [upload=7499]: Done uploading segments...
Aug 9 00:35:53.954299737 (7h9m48.385379868s) [upload=7499]: Upload finished. err: <nil>
Duration: 1.893601652s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X.......................................X.............] duration:
8.84332428s
FAIL (2025-08-09 00:36:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:25:21.054812319 (6h59m15.48589246s) [upload=7311]: Starting upload Aug 9 00:25:21.054887373 (6h59m15.485967514s) [upload=7311]: Done starting upload Aug 9 00:25:21.054974740 (6h59m15.486054871s) [upload=7311]: Uploading segments... Aug 9 00:25:21.055143473 (6h59m15.486223604s) [upload=7311]: Got next segment. Inline: false Aug 9 00:25:21.055207194 (6h59m15.486287325s) [upload=7311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:25:21.055213838 (6h59m15.486293969s) [upload=7311]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:25:21.326628933 (6h59m15.757709064s) [upload=7311]: Next segment err: metaclient: Too Many Requests Aug 9 00:25:21.326662107 (6h59m15.757742238s) [upload=7311]: Done uploading segments... Aug 9 00:25:21.326682726 (6h59m15.757762907s) [upload=7311]: Upload finished. err: metaclient: Too Many Requests
Duration: 8.843347746s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [........X..........X....X.....X.X..........................X] duration:
1.643916749s
FAIL (2025-08-09 00:35:54 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 00:35:53.654297133 (7h9m48.085377255s) [upload=7499]: Starting upload
Aug 9 00:35:53.654343371 (7h9m48.085423492s) [upload=7499]: Done starting upload
Aug 9 00:35:53.654388067 (7h9m48.085468198s) [upload=7499]: Uploading segments...
Aug 9 00:35:53.654424176 (7h9m48.085504307s) [upload=7499]: Got next segment. Inline: true
Aug 9 00:35:53.654428154 (7h9m48.085508275s) [upload=7499]: Waiting for error group managing segments...
Aug 9 00:35:53.654461949 (7h9m48.08554207s) [upload=7499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 00:35:53.654466016 (7h9m48.085546148s) [upload=7499]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 00:35:53.654468531 (7h9m48.085548662s) [upload=7499]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 00:35:53.954280910 (7h9m48.385361031s) [upload=7499]: Done uploading segments...
Aug 9 00:35:53.954299737 (7h9m48.385379868s) [upload=7499]: Upload finished. err: <nil>
Duration: 1.643950685s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.34527175s
FAIL (2025-08-09 00:35:47 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.345287229s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
729.401891ms
FAIL (2025-08-09 00:35:44 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 729.434283ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X.......................................X............] duration:
11.249368355s
FAIL (2025-08-09 00:35:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:25:21.054812319 (6h59m15.48589246s) [upload=7311]: Starting upload Aug 9 00:25:21.054887373 (6h59m15.485967514s) [upload=7311]: Done starting upload Aug 9 00:25:21.054974740 (6h59m15.486054871s) [upload=7311]: Uploading segments... Aug 9 00:25:21.055143473 (6h59m15.486223604s) [upload=7311]: Got next segment. Inline: false Aug 9 00:25:21.055207194 (6h59m15.486287325s) [upload=7311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:25:21.055213838 (6h59m15.486293969s) [upload=7311]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:25:21.326628933 (6h59m15.757709064s) [upload=7311]: Next segment err: metaclient: Too Many Requests Aug 9 00:25:21.326662107 (6h59m15.757742238s) [upload=7311]: Done uploading segments... Aug 9 00:25:21.326682726 (6h59m15.757762907s) [upload=7311]: Upload finished. err: metaclient: Too Many Requests
Duration: 11.249395137s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.357315603s
FAIL (2025-08-09 00:35:29 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.357337044s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [X........X..........X....X.....X.X..........................] duration:
1.908265148s
FAIL (2025-08-09 00:35:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 00:15:20.946114856 (6h49m15.377194997s) [upload=7145]: Starting upload
Aug 9 00:15:20.946168780 (6h49m15.377248911s) [upload=7145]: Done starting upload
Aug 9 00:15:20.946228393 (6h49m15.377308525s) [upload=7145]: Uploading segments...
Aug 9 00:15:20.946267749 (6h49m15.37734788s) [upload=7145]: Got next segment. Inline: true
Aug 9 00:15:20.946271877 (6h49m15.377352008s) [upload=7145]: Waiting for error group managing segments...
Aug 9 00:15:20.946306713 (6h49m15.377386845s) [upload=7145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 00:15:20.946310951 (6h49m15.377391082s) [upload=7145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 00:15:20.946313546 (6h49m15.377393677s) [upload=7145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 00:15:21.403671645 (6h49m15.834751776s) [upload=7145]: Done uploading segments...
Aug 9 00:15:21.403691763 (6h49m15.834771894s) [upload=7145]: Upload finished. err: <nil>
Duration: 1.908291268s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
714.975645ms
FAIL (2025-08-09 00:35:11 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 715.001995ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X.......................................X...........] duration:
6.129649683s
FAIL (2025-08-09 00:34:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:25:21.054812319 (6h59m15.48589246s) [upload=7311]: Starting upload Aug 9 00:25:21.054887373 (6h59m15.485967514s) [upload=7311]: Done starting upload Aug 9 00:25:21.054974740 (6h59m15.486054871s) [upload=7311]: Uploading segments... Aug 9 00:25:21.055143473 (6h59m15.486223604s) [upload=7311]: Got next segment. Inline: false Aug 9 00:25:21.055207194 (6h59m15.486287325s) [upload=7311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:25:21.055213838 (6h59m15.486293969s) [upload=7311]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:25:21.326628933 (6h59m15.757709064s) [upload=7311]: Next segment err: metaclient: Too Many Requests Aug 9 00:25:21.326662107 (6h59m15.757742238s) [upload=7311]: Done uploading segments... Aug 9 00:25:21.326682726 (6h59m15.757762907s) [upload=7311]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.129677485s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.549702958s
FAIL (2025-08-09 00:34:20 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.549725393s
edge
gateway
us-select-1
|