Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 751922 reports (Page 12698 of 15039)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [...........X......................X.................X.......]
duration:
1.969447665s
FAIL (2025-08-14 09:48:16 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 09:43:43.170320191 (136h17m37.601400322s) [upload=141773]: Starting upload
Aug 14 09:43:43.170357793 (136h17m37.601437924s) [upload=141773]: Done starting upload
Aug 14 09:43:43.170399432 (136h17m37.601479563s) [upload=141773]: Uploading segments...
Aug 14 09:43:43.170433217 (136h17m37.601513349s) [upload=141773]: Got next segment. Inline: true
Aug 14 09:43:43.170436844 (136h17m37.601516975s) [upload=141773]: Waiting for error group managing segments...
Aug 14 09:43:43.170466781 (136h17m37.601546913s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:43:43.170470909 (136h17m37.60155103s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:43:43.170473654 (136h17m37.601553785s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:43:43.444637125 (136h17m37.875717256s) [upload=141773]: Done uploading segments...
Aug 14 09:43:43.444655951 (136h17m37.875736082s) [upload=141773]: Upload finished. err: <nil>
Duration: 1.969469648s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
6.433563538s
FAIL (2025-08-14 09:47:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.43360602s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [X...........X......................X.................X......]
duration:
1.972274013s
FAIL (2025-08-14 09:47:41 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 09:43:43.170320191 (136h17m37.601400322s) [upload=141773]: Starting upload
Aug 14 09:43:43.170357793 (136h17m37.601437924s) [upload=141773]: Done starting upload
Aug 14 09:43:43.170399432 (136h17m37.601479563s) [upload=141773]: Uploading segments...
Aug 14 09:43:43.170433217 (136h17m37.601513349s) [upload=141773]: Got next segment. Inline: true
Aug 14 09:43:43.170436844 (136h17m37.601516975s) [upload=141773]: Waiting for error group managing segments...
Aug 14 09:43:43.170466781 (136h17m37.601546913s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:43:43.170470909 (136h17m37.60155103s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:43:43.170473654 (136h17m37.601553785s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:43:43.444637125 (136h17m37.875717256s) [upload=141773]: Done uploading segments...
Aug 14 09:43:43.444655951 (136h17m37.875736082s) [upload=141773]: Upload finished. err: <nil>
Duration: 1.972307578s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
6.270278288s
FAIL (2025-08-14 09:47:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.270301652s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
6.335893958s
FAIL (2025-08-14 09:47:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.335917854s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [.X...........X......................X.................X.....]
duration:
1.830808234s
FAIL (2025-08-14 09:47:02 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 09:43:43.170320191 (136h17m37.601400322s) [upload=141773]: Starting upload
Aug 14 09:43:43.170357793 (136h17m37.601437924s) [upload=141773]: Done starting upload
Aug 14 09:43:43.170399432 (136h17m37.601479563s) [upload=141773]: Uploading segments...
Aug 14 09:43:43.170433217 (136h17m37.601513349s) [upload=141773]: Got next segment. Inline: true
Aug 14 09:43:43.170436844 (136h17m37.601516975s) [upload=141773]: Waiting for error group managing segments...
Aug 14 09:43:43.170466781 (136h17m37.601546913s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:43:43.170470909 (136h17m37.60155103s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:43:43.170473654 (136h17m37.601553785s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:43:43.444637125 (136h17m37.875717256s) [upload=141773]: Done uploading segments...
Aug 14 09:43:43.444655951 (136h17m37.875736082s) [upload=141773]: Upload finished. err: <nil>
Duration: 1.830832691s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [..X...........X......................X.................X....]
duration:
1.858371584s
FAIL (2025-08-14 09:46:12 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 09:43:43.170320191 (136h17m37.601400322s) [upload=141773]: Starting upload
Aug 14 09:43:43.170357793 (136h17m37.601437924s) [upload=141773]: Done starting upload
Aug 14 09:43:43.170399432 (136h17m37.601479563s) [upload=141773]: Uploading segments...
Aug 14 09:43:43.170433217 (136h17m37.601513349s) [upload=141773]: Got next segment. Inline: true
Aug 14 09:43:43.170436844 (136h17m37.601516975s) [upload=141773]: Waiting for error group managing segments...
Aug 14 09:43:43.170466781 (136h17m37.601546913s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:43:43.170470909 (136h17m37.60155103s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:43:43.170473654 (136h17m37.601553785s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:43:43.444637125 (136h17m37.875717256s) [upload=141773]: Done uploading segments...
Aug 14 09:43:43.444655951 (136h17m37.875736082s) [upload=141773]: Upload finished. err: <nil>
Duration: 1.858401831s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................]
duration:
5.987626303s
FAIL (2025-08-14 09:46:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.987647966s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................]
duration:
6.331038844s
FAIL (2025-08-14 09:45:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.331064854s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
5 out of 60 is failed (threshold=3) [X..X...........X......................X.................X...]
duration:
1.845979141s
FAIL (2025-08-14 09:45:20 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 09:43:43.170320191 (136h17m37.601400322s) [upload=141773]: Starting upload
Aug 14 09:43:43.170357793 (136h17m37.601437924s) [upload=141773]: Done starting upload
Aug 14 09:43:43.170399432 (136h17m37.601479563s) [upload=141773]: Uploading segments...
Aug 14 09:43:43.170433217 (136h17m37.601513349s) [upload=141773]: Got next segment. Inline: true
Aug 14 09:43:43.170436844 (136h17m37.601516975s) [upload=141773]: Waiting for error group managing segments...
Aug 14 09:43:43.170466781 (136h17m37.601546913s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:43:43.170470909 (136h17m37.60155103s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:43:43.170473654 (136h17m37.601553785s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:43:43.444637125 (136h17m37.875717256s) [upload=141773]: Done uploading segments...
Aug 14 09:43:43.444655951 (136h17m37.875736082s) [upload=141773]: Upload finished. err: <nil>
Duration: 1.846011743s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
5 out of 60 is failed (threshold=3) [.X..X...........X......................X.................X..]
duration:
1.97618691s
FAIL (2025-08-14 09:44:51 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 09:43:43.170320191 (136h17m37.601400322s) [upload=141773]: Starting upload
Aug 14 09:43:43.170357793 (136h17m37.601437924s) [upload=141773]: Done starting upload
Aug 14 09:43:43.170399432 (136h17m37.601479563s) [upload=141773]: Uploading segments...
Aug 14 09:43:43.170433217 (136h17m37.601513349s) [upload=141773]: Got next segment. Inline: true
Aug 14 09:43:43.170436844 (136h17m37.601516975s) [upload=141773]: Waiting for error group managing segments...
Aug 14 09:43:43.170466781 (136h17m37.601546913s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:43:43.170470909 (136h17m37.60155103s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:43:43.170473654 (136h17m37.601553785s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:43:43.444637125 (136h17m37.875717256s) [upload=141773]: Done uploading segments...
Aug 14 09:43:43.444655951 (136h17m37.875736082s) [upload=141773]: Upload finished. err: <nil>
Duration: 1.976229482s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................]
duration:
6.108529218s
FAIL (2025-08-14 09:44:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.108552863s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
5 out of 60 is failed (threshold=3) [..X..X...........X......................X.................X.]
duration:
1.961708038s
FAIL (2025-08-14 09:44:11 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 09:43:43.170320191 (136h17m37.601400322s) [upload=141773]: Starting upload
Aug 14 09:43:43.170357793 (136h17m37.601437924s) [upload=141773]: Done starting upload
Aug 14 09:43:43.170399432 (136h17m37.601479563s) [upload=141773]: Uploading segments...
Aug 14 09:43:43.170433217 (136h17m37.601513349s) [upload=141773]: Got next segment. Inline: true
Aug 14 09:43:43.170436844 (136h17m37.601516975s) [upload=141773]: Waiting for error group managing segments...
Aug 14 09:43:43.170466781 (136h17m37.601546913s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:43:43.170470909 (136h17m37.60155103s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:43:43.170473654 (136h17m37.601553785s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:43:43.444637125 (136h17m37.875717256s) [upload=141773]: Done uploading segments...
Aug 14 09:43:43.444655951 (136h17m37.875736082s) [upload=141773]: Upload finished. err: <nil>
Duration: 1.961734558s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................]
duration:
6.294481799s
FAIL (2025-08-14 09:43:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.294502868s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
5 out of 60 is failed (threshold=3) [...X..X...........X......................X.................X]
duration:
1.578135494s
FAIL (2025-08-14 09:43:44 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 09:43:43.170320191 (136h17m37.601400322s) [upload=141773]: Starting upload
Aug 14 09:43:43.170357793 (136h17m37.601437924s) [upload=141773]: Done starting upload
Aug 14 09:43:43.170399432 (136h17m37.601479563s) [upload=141773]: Uploading segments...
Aug 14 09:43:43.170433217 (136h17m37.601513349s) [upload=141773]: Got next segment. Inline: true
Aug 14 09:43:43.170436844 (136h17m37.601516975s) [upload=141773]: Waiting for error group managing segments...
Aug 14 09:43:43.170466781 (136h17m37.601546913s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:43:43.170470909 (136h17m37.60155103s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:43:43.170473654 (136h17m37.601553785s) [upload=141773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:43:43.444637125 (136h17m37.875717256s) [upload=141773]: Done uploading segments...
Aug 14 09:43:43.444655951 (136h17m37.875736082s) [upload=141773]: Upload finished. err: <nil>
Duration: 1.578153458s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................]
duration:
6.129553786s
FAIL (2025-08-14 09:43:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.129575148s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [....X..X...........X......................X.................]
duration:
1.853543682s
FAIL (2025-08-14 09:42:51 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 14 09:30:42.997267637 (136h4m37.428347768s) [upload=141549]: Starting upload
Aug 14 09:30:42.997314857 (136h4m37.428394988s) [upload=141549]: Done starting upload
Aug 14 09:30:42.997364092 (136h4m37.428444213s) [upload=141549]: Uploading segments...
Aug 14 09:30:42.997397325 (136h4m37.428477456s) [upload=141549]: Got next segment. Inline: true
Aug 14 09:30:42.997400671 (136h4m37.428480803s) [upload=141549]: Waiting for error group managing segments...
Aug 14 09:30:42.997434657 (136h4m37.428514788s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:30:42.997438464 (136h4m37.428518585s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:30:42.997442211 (136h4m37.428522343s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:30:43.211762977 (136h4m37.642843108s) [upload=141549]: Done uploading segments...
Aug 14 09:30:43.211783526 (136h4m37.642863677s) [upload=141549]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.853563641s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................]
duration:
6.130036542s
FAIL (2025-08-14 09:41:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.130058985s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [.....X..X...........X......................X................]
duration:
1.976497715s
FAIL (2025-08-14 09:41:47 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 14 09:30:42.997267637 (136h4m37.428347768s) [upload=141549]: Starting upload
Aug 14 09:30:42.997314857 (136h4m37.428394988s) [upload=141549]: Done starting upload
Aug 14 09:30:42.997364092 (136h4m37.428444213s) [upload=141549]: Uploading segments...
Aug 14 09:30:42.997397325 (136h4m37.428477456s) [upload=141549]: Got next segment. Inline: true
Aug 14 09:30:42.997400671 (136h4m37.428480803s) [upload=141549]: Waiting for error group managing segments...
Aug 14 09:30:42.997434657 (136h4m37.428514788s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:30:42.997438464 (136h4m37.428518585s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:30:42.997442211 (136h4m37.428522343s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:30:43.211762977 (136h4m37.642843108s) [upload=141549]: Done uploading segments...
Aug 14 09:30:43.211783526 (136h4m37.642863677s) [upload=141549]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.976521149s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [......X..X...........X......................X...............]
duration:
2.978482009s
FAIL (2025-08-14 09:41:28 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 14 09:30:42.997267637 (136h4m37.428347768s) [upload=141549]: Starting upload
Aug 14 09:30:42.997314857 (136h4m37.428394988s) [upload=141549]: Done starting upload
Aug 14 09:30:42.997364092 (136h4m37.428444213s) [upload=141549]: Uploading segments...
Aug 14 09:30:42.997397325 (136h4m37.428477456s) [upload=141549]: Got next segment. Inline: true
Aug 14 09:30:42.997400671 (136h4m37.428480803s) [upload=141549]: Waiting for error group managing segments...
Aug 14 09:30:42.997434657 (136h4m37.428514788s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:30:42.997438464 (136h4m37.428518585s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:30:42.997442211 (136h4m37.428522343s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:30:43.211762977 (136h4m37.642843108s) [upload=141549]: Done uploading segments...
Aug 14 09:30:43.211783526 (136h4m37.642863677s) [upload=141549]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.978517526s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................]
duration:
6.301126887s
FAIL (2025-08-14 09:41:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.30114446s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [.......X..X...........X......................X..............]
duration:
1.839902793s
FAIL (2025-08-14 09:40:58 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 14 09:30:42.997267637 (136h4m37.428347768s) [upload=141549]: Starting upload
Aug 14 09:30:42.997314857 (136h4m37.428394988s) [upload=141549]: Done starting upload
Aug 14 09:30:42.997364092 (136h4m37.428444213s) [upload=141549]: Uploading segments...
Aug 14 09:30:42.997397325 (136h4m37.428477456s) [upload=141549]: Got next segment. Inline: true
Aug 14 09:30:42.997400671 (136h4m37.428480803s) [upload=141549]: Waiting for error group managing segments...
Aug 14 09:30:42.997434657 (136h4m37.428514788s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:30:42.997438464 (136h4m37.428518585s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:30:42.997442211 (136h4m37.428522343s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:30:43.211762977 (136h4m37.642843108s) [upload=141549]: Done uploading segments...
Aug 14 09:30:43.211783526 (136h4m37.642863677s) [upload=141549]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.839928723s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................]
duration:
5.934688116s
FAIL (2025-08-14 09:40:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.934711622s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [........X..X...........X......................X.............]
duration:
1.83341002s
FAIL (2025-08-14 09:40:38 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 14 09:30:42.997267637 (136h4m37.428347768s) [upload=141549]: Starting upload
Aug 14 09:30:42.997314857 (136h4m37.428394988s) [upload=141549]: Done starting upload
Aug 14 09:30:42.997364092 (136h4m37.428444213s) [upload=141549]: Uploading segments...
Aug 14 09:30:42.997397325 (136h4m37.428477456s) [upload=141549]: Got next segment. Inline: true
Aug 14 09:30:42.997400671 (136h4m37.428480803s) [upload=141549]: Waiting for error group managing segments...
Aug 14 09:30:42.997434657 (136h4m37.428514788s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:30:42.997438464 (136h4m37.428518585s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:30:42.997442211 (136h4m37.428522343s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:30:43.211762977 (136h4m37.642843108s) [upload=141549]: Done uploading segments...
Aug 14 09:30:43.211783526 (136h4m37.642863677s) [upload=141549]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.833447893s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................]
duration:
5.943651806s
FAIL (2025-08-14 09:40:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.943672846s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [.........X..X...........X......................X............]
duration:
1.825173106s
FAIL (2025-08-14 09:40:09 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 14 09:30:42.997267637 (136h4m37.428347768s) [upload=141549]: Starting upload
Aug 14 09:30:42.997314857 (136h4m37.428394988s) [upload=141549]: Done starting upload
Aug 14 09:30:42.997364092 (136h4m37.428444213s) [upload=141549]: Uploading segments...
Aug 14 09:30:42.997397325 (136h4m37.428477456s) [upload=141549]: Got next segment. Inline: true
Aug 14 09:30:42.997400671 (136h4m37.428480803s) [upload=141549]: Waiting for error group managing segments...
Aug 14 09:30:42.997434657 (136h4m37.428514788s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:30:42.997438464 (136h4m37.428518585s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:30:42.997442211 (136h4m37.428522343s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:30:43.211762977 (136h4m37.642843108s) [upload=141549]: Done uploading segments...
Aug 14 09:30:43.211783526 (136h4m37.642863677s) [upload=141549]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.825207169s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration:
6.166055648s
FAIL (2025-08-14 09:39:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.166078552s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [..........X..X...........X......................X...........]
duration:
1.808147063s
FAIL (2025-08-14 09:39:09 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 14 09:30:42.997267637 (136h4m37.428347768s) [upload=141549]: Starting upload
Aug 14 09:30:42.997314857 (136h4m37.428394988s) [upload=141549]: Done starting upload
Aug 14 09:30:42.997364092 (136h4m37.428444213s) [upload=141549]: Uploading segments...
Aug 14 09:30:42.997397325 (136h4m37.428477456s) [upload=141549]: Got next segment. Inline: true
Aug 14 09:30:42.997400671 (136h4m37.428480803s) [upload=141549]: Waiting for error group managing segments...
Aug 14 09:30:42.997434657 (136h4m37.428514788s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:30:42.997438464 (136h4m37.428518585s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:30:42.997442211 (136h4m37.428522343s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:30:43.211762977 (136h4m37.642843108s) [upload=141549]: Done uploading segments...
Aug 14 09:30:43.211783526 (136h4m37.642863677s) [upload=141549]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.808176539s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration:
6.161741262s
FAIL (2025-08-14 09:38:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.161773674s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [...........X..X...........X......................X..........]
duration:
1.827966356s
FAIL (2025-08-14 09:38:00 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 14 09:30:42.997267637 (136h4m37.428347768s) [upload=141549]: Starting upload
Aug 14 09:30:42.997314857 (136h4m37.428394988s) [upload=141549]: Done starting upload
Aug 14 09:30:42.997364092 (136h4m37.428444213s) [upload=141549]: Uploading segments...
Aug 14 09:30:42.997397325 (136h4m37.428477456s) [upload=141549]: Got next segment. Inline: true
Aug 14 09:30:42.997400671 (136h4m37.428480803s) [upload=141549]: Waiting for error group managing segments...
Aug 14 09:30:42.997434657 (136h4m37.428514788s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:30:42.997438464 (136h4m37.428518585s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:30:42.997442211 (136h4m37.428522343s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:30:43.211762977 (136h4m37.642843108s) [upload=141549]: Done uploading segments...
Aug 14 09:30:43.211783526 (136h4m37.642863677s) [upload=141549]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.827986526s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................]
duration:
6.087829813s
FAIL (2025-08-14 09:38:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.087883457s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [............X..X...........X......................X.........]
duration:
1.824498952s
FAIL (2025-08-14 09:37:22 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 14 09:30:42.997267637 (136h4m37.428347768s) [upload=141549]: Starting upload
Aug 14 09:30:42.997314857 (136h4m37.428394988s) [upload=141549]: Done starting upload
Aug 14 09:30:42.997364092 (136h4m37.428444213s) [upload=141549]: Uploading segments...
Aug 14 09:30:42.997397325 (136h4m37.428477456s) [upload=141549]: Got next segment. Inline: true
Aug 14 09:30:42.997400671 (136h4m37.428480803s) [upload=141549]: Waiting for error group managing segments...
Aug 14 09:30:42.997434657 (136h4m37.428514788s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:30:42.997438464 (136h4m37.428518585s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:30:42.997442211 (136h4m37.428522343s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:30:43.211762977 (136h4m37.642843108s) [upload=141549]: Done uploading segments...
Aug 14 09:30:43.211783526 (136h4m37.642863677s) [upload=141549]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.824531074s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration:
6.228246845s
FAIL (2025-08-14 09:37:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.228267035s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [.............X..X...........X......................X........]
duration:
1.934074481s
FAIL (2025-08-14 09:36:46 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 14 09:30:42.997267637 (136h4m37.428347768s) [upload=141549]: Starting upload
Aug 14 09:30:42.997314857 (136h4m37.428394988s) [upload=141549]: Done starting upload
Aug 14 09:30:42.997364092 (136h4m37.428444213s) [upload=141549]: Uploading segments...
Aug 14 09:30:42.997397325 (136h4m37.428477456s) [upload=141549]: Got next segment. Inline: true
Aug 14 09:30:42.997400671 (136h4m37.428480803s) [upload=141549]: Waiting for error group managing segments...
Aug 14 09:30:42.997434657 (136h4m37.428514788s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:30:42.997438464 (136h4m37.428518585s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:30:42.997442211 (136h4m37.428522343s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:30:43.211762977 (136h4m37.642843108s) [upload=141549]: Done uploading segments...
Aug 14 09:30:43.211783526 (136h4m37.642863677s) [upload=141549]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.934099769s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration:
5.913425469s
FAIL (2025-08-14 09:36:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.913438134s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................]
duration:
6.423520241s
FAIL (2025-08-14 09:36:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.423542094s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................]
duration:
5.919143349s
FAIL (2025-08-14 09:35:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.91915914s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [..............X..X...........X......................X.......]
duration:
1.865613721s
FAIL (2025-08-14 09:35:35 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 14 09:30:42.997267637 (136h4m37.428347768s) [upload=141549]: Starting upload
Aug 14 09:30:42.997314857 (136h4m37.428394988s) [upload=141549]: Done starting upload
Aug 14 09:30:42.997364092 (136h4m37.428444213s) [upload=141549]: Uploading segments...
Aug 14 09:30:42.997397325 (136h4m37.428477456s) [upload=141549]: Got next segment. Inline: true
Aug 14 09:30:42.997400671 (136h4m37.428480803s) [upload=141549]: Waiting for error group managing segments...
Aug 14 09:30:42.997434657 (136h4m37.428514788s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:30:42.997438464 (136h4m37.428518585s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:30:42.997442211 (136h4m37.428522343s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:30:43.211762977 (136h4m37.642843108s) [upload=141549]: Done uploading segments...
Aug 14 09:30:43.211783526 (136h4m37.642863677s) [upload=141549]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.865648729s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................]
duration:
6.127371893s
FAIL (2025-08-14 09:35:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.127395978s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [...............X..X...........X......................X......]
duration:
1.815597861s
FAIL (2025-08-14 09:35:08 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 14 09:30:42.997267637 (136h4m37.428347768s) [upload=141549]: Starting upload
Aug 14 09:30:42.997314857 (136h4m37.428394988s) [upload=141549]: Done starting upload
Aug 14 09:30:42.997364092 (136h4m37.428444213s) [upload=141549]: Uploading segments...
Aug 14 09:30:42.997397325 (136h4m37.428477456s) [upload=141549]: Got next segment. Inline: true
Aug 14 09:30:42.997400671 (136h4m37.428480803s) [upload=141549]: Waiting for error group managing segments...
Aug 14 09:30:42.997434657 (136h4m37.428514788s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:30:42.997438464 (136h4m37.428518585s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:30:42.997442211 (136h4m37.428522343s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:30:43.211762977 (136h4m37.642843108s) [upload=141549]: Done uploading segments...
Aug 14 09:30:43.211783526 (136h4m37.642863677s) [upload=141549]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.815658468s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................]
duration:
6.578943275s
FAIL (2025-08-14 09:35:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.578965557s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [................X..X...........X......................X.....]
duration:
1.851809063s
FAIL (2025-08-14 09:34:05 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 14 09:30:42.997267637 (136h4m37.428347768s) [upload=141549]: Starting upload
Aug 14 09:30:42.997314857 (136h4m37.428394988s) [upload=141549]: Done starting upload
Aug 14 09:30:42.997364092 (136h4m37.428444213s) [upload=141549]: Uploading segments...
Aug 14 09:30:42.997397325 (136h4m37.428477456s) [upload=141549]: Got next segment. Inline: true
Aug 14 09:30:42.997400671 (136h4m37.428480803s) [upload=141549]: Waiting for error group managing segments...
Aug 14 09:30:42.997434657 (136h4m37.428514788s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:30:42.997438464 (136h4m37.428518585s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:30:42.997442211 (136h4m37.428522343s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:30:43.211762977 (136h4m37.642843108s) [upload=141549]: Done uploading segments...
Aug 14 09:30:43.211783526 (136h4m37.642863677s) [upload=141549]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.851833881s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................]
duration:
6.134143099s
FAIL (2025-08-14 09:33:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.134166914s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................]
duration:
6.623991292s
FAIL (2025-08-14 09:33:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.624012252s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [.................X..X...........X......................X....]
duration:
1.917631609s
FAIL (2025-08-14 09:32:52 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 14 09:30:42.997267637 (136h4m37.428347768s) [upload=141549]: Starting upload
Aug 14 09:30:42.997314857 (136h4m37.428394988s) [upload=141549]: Done starting upload
Aug 14 09:30:42.997364092 (136h4m37.428444213s) [upload=141549]: Uploading segments...
Aug 14 09:30:42.997397325 (136h4m37.428477456s) [upload=141549]: Got next segment. Inline: true
Aug 14 09:30:42.997400671 (136h4m37.428480803s) [upload=141549]: Waiting for error group managing segments...
Aug 14 09:30:42.997434657 (136h4m37.428514788s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:30:42.997438464 (136h4m37.428518585s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:30:42.997442211 (136h4m37.428522343s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:30:43.211762977 (136h4m37.642843108s) [upload=141549]: Done uploading segments...
Aug 14 09:30:43.211783526 (136h4m37.642863677s) [upload=141549]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.91766367s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................]
duration:
6.121766744s
FAIL (2025-08-14 09:32:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.121787404s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [..................X..X...........X......................X...]
duration:
1.888841804s
FAIL (2025-08-14 09:32:17 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 14 09:30:42.997267637 (136h4m37.428347768s) [upload=141549]: Starting upload
Aug 14 09:30:42.997314857 (136h4m37.428394988s) [upload=141549]: Done starting upload
Aug 14 09:30:42.997364092 (136h4m37.428444213s) [upload=141549]: Uploading segments...
Aug 14 09:30:42.997397325 (136h4m37.428477456s) [upload=141549]: Got next segment. Inline: true
Aug 14 09:30:42.997400671 (136h4m37.428480803s) [upload=141549]: Waiting for error group managing segments...
Aug 14 09:30:42.997434657 (136h4m37.428514788s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:30:42.997438464 (136h4m37.428518585s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:30:42.997442211 (136h4m37.428522343s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:30:43.211762977 (136h4m37.642843108s) [upload=141549]: Done uploading segments...
Aug 14 09:30:43.211783526 (136h4m37.642863677s) [upload=141549]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.888872273s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration:
6.125028718s
FAIL (2025-08-14 09:32:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.125052693s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [...................X..X...........X......................X..]
duration:
1.818530221s
FAIL (2025-08-14 09:31:27 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 14 09:30:42.997267637 (136h4m37.428347768s) [upload=141549]: Starting upload
Aug 14 09:30:42.997314857 (136h4m37.428394988s) [upload=141549]: Done starting upload
Aug 14 09:30:42.997364092 (136h4m37.428444213s) [upload=141549]: Uploading segments...
Aug 14 09:30:42.997397325 (136h4m37.428477456s) [upload=141549]: Got next segment. Inline: true
Aug 14 09:30:42.997400671 (136h4m37.428480803s) [upload=141549]: Waiting for error group managing segments...
Aug 14 09:30:42.997434657 (136h4m37.428514788s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 09:30:42.997438464 (136h4m37.428518585s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 09:30:42.997442211 (136h4m37.428522343s) [upload=141549]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 09:30:43.211762977 (136h4m37.642843108s) [upload=141549]: Done uploading segments...
Aug 14 09:30:43.211783526 (136h4m37.642863677s) [upload=141549]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.818555499s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration:
5.886558867s
FAIL (2025-08-14 09:31:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.886637698s edge gateway us-select-1