Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X.X..................................................] duration:
6.258213022s
FAIL (2025-08-13 14:52:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.258234273s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X.....................X.......X.............................] duration:
6.683713429s
FAIL (2025-08-13 14:52:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:31:01.866494186 (117h4m56.297574318s) [upload=121799]: Starting upload Aug 13 14:31:01.866533341 (117h4m56.297613472s) [upload=121799]: Done starting upload Aug 13 14:31:01.866740558 (117h4m56.297820699s) [upload=121799]: Uploading segments... Aug 13 14:31:01.867428624 (117h4m56.298508765s) [upload=121799]: Got next segment. Inline: false Aug 13 14:31:01.867473409 (117h4m56.29855354s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:31:01.867478218 (117h4m56.298558349s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 14:31:02.174794903 (117h4m56.605875034s) [upload=121799]: Next segment err: metaclient: Too Many Requests Aug 13 14:31:02.174815282 (117h4m56.605895413s) [upload=121799]: Done uploading segments... Aug 13 14:31:02.174842604 (117h4m56.605922735s) [upload=121799]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.683744618s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X.............X.....X.X.........................X..........] duration:
2.002518421s
FAIL (2025-08-13 14:52:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:45:47.692702050 (117h19m42.123782181s) [upload=122061]: Starting upload Aug 13 14:45:47.692776562 (117h19m42.123856713s) [upload=122061]: Done starting upload Aug 13 14:45:47.692843671 (117h19m42.123923802s) [upload=122061]: Uploading segments... Aug 13 14:45:47.692894458 (117h19m42.123974589s) [upload=122061]: Got next segment. Inline: true Aug 13 14:45:47.692900299 (117h19m42.12398043s) [upload=122061]: Waiting for error group managing segments... Aug 13 14:45:47.692944353 (117h19m42.124024484s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:45:47.692950145 (117h19m42.124030296s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 14:45:47.692953772 (117h19m42.124033913s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 14:45:47.939296760 (117h19m42.370376881s) [upload=122061]: Done uploading segments... Aug 13 14:45:47.939315467 (117h19m42.370395598s) [upload=122061]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.002543579s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [X.......X.X.................................................] duration:
6.500474844s
FAIL (2025-08-13 14:52:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.500510984s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X.......X.X................................................] duration:
6.131268001s
FAIL (2025-08-13 14:51:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.131285555s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..X.............X.....X.X.........................X.........] duration:
2.006459294s
FAIL (2025-08-13 14:51:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:45:47.692702050 (117h19m42.123782181s) [upload=122061]: Starting upload Aug 13 14:45:47.692776562 (117h19m42.123856713s) [upload=122061]: Done starting upload Aug 13 14:45:47.692843671 (117h19m42.123923802s) [upload=122061]: Uploading segments... Aug 13 14:45:47.692894458 (117h19m42.123974589s) [upload=122061]: Got next segment. Inline: true Aug 13 14:45:47.692900299 (117h19m42.12398043s) [upload=122061]: Waiting for error group managing segments... Aug 13 14:45:47.692944353 (117h19m42.124024484s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:45:47.692950145 (117h19m42.124030296s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 14:45:47.692953772 (117h19m42.124033913s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 14:45:47.939296760 (117h19m42.370376881s) [upload=122061]: Done uploading segments... Aug 13 14:45:47.939315467 (117h19m42.370395598s) [upload=122061]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.006495292s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X.....................X.......X............................] duration:
6.423246846s
FAIL (2025-08-13 14:51:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:31:01.866494186 (117h4m56.297574318s) [upload=121799]: Starting upload Aug 13 14:31:01.866533341 (117h4m56.297613472s) [upload=121799]: Done starting upload Aug 13 14:31:01.866740558 (117h4m56.297820699s) [upload=121799]: Uploading segments... Aug 13 14:31:01.867428624 (117h4m56.298508765s) [upload=121799]: Got next segment. Inline: false Aug 13 14:31:01.867473409 (117h4m56.29855354s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:31:01.867478218 (117h4m56.298558349s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 14:31:02.174794903 (117h4m56.605875034s) [upload=121799]: Next segment err: metaclient: Too Many Requests Aug 13 14:31:02.174815282 (117h4m56.605895413s) [upload=121799]: Done uploading segments... Aug 13 14:31:02.174842604 (117h4m56.605922735s) [upload=121799]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.423272484s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X.......X.X...............................................] duration:
6.193167495s
FAIL (2025-08-13 14:50:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.193183717s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X.....................X.......X...........................] duration:
6.115848649s
FAIL (2025-08-13 14:50:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:31:01.866494186 (117h4m56.297574318s) [upload=121799]: Starting upload Aug 13 14:31:01.866533341 (117h4m56.297613472s) [upload=121799]: Done starting upload Aug 13 14:31:01.866740558 (117h4m56.297820699s) [upload=121799]: Uploading segments... Aug 13 14:31:01.867428624 (117h4m56.298508765s) [upload=121799]: Got next segment. Inline: false Aug 13 14:31:01.867473409 (117h4m56.29855354s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:31:01.867478218 (117h4m56.298558349s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 14:31:02.174794903 (117h4m56.605875034s) [upload=121799]: Next segment err: metaclient: Too Many Requests Aug 13 14:31:02.174815282 (117h4m56.605895413s) [upload=121799]: Done uploading segments... Aug 13 14:31:02.174842604 (117h4m56.605922735s) [upload=121799]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.115876592s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [X..X.............X.....X.X.........................X........] duration:
1.962917602s
FAIL (2025-08-13 14:50:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:45:47.692702050 (117h19m42.123782181s) [upload=122061]: Starting upload Aug 13 14:45:47.692776562 (117h19m42.123856713s) [upload=122061]: Done starting upload Aug 13 14:45:47.692843671 (117h19m42.123923802s) [upload=122061]: Uploading segments... Aug 13 14:45:47.692894458 (117h19m42.123974589s) [upload=122061]: Got next segment. Inline: true Aug 13 14:45:47.692900299 (117h19m42.12398043s) [upload=122061]: Waiting for error group managing segments... Aug 13 14:45:47.692944353 (117h19m42.124024484s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:45:47.692950145 (117h19m42.124030296s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 14:45:47.692953772 (117h19m42.124033913s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 14:45:47.939296760 (117h19m42.370376881s) [upload=122061]: Done uploading segments... Aug 13 14:45:47.939315467 (117h19m42.370395598s) [upload=122061]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.962945716s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X.......X.X..............................................] duration:
6.278462623s
FAIL (2025-08-13 14:50:37 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.278484064s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.X..X.............X.....X.X.........................X.......] duration:
1.976669574s
FAIL (2025-08-13 14:50:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:45:47.692702050 (117h19m42.123782181s) [upload=122061]: Starting upload Aug 13 14:45:47.692776562 (117h19m42.123856713s) [upload=122061]: Done starting upload Aug 13 14:45:47.692843671 (117h19m42.123923802s) [upload=122061]: Uploading segments... Aug 13 14:45:47.692894458 (117h19m42.123974589s) [upload=122061]: Got next segment. Inline: true Aug 13 14:45:47.692900299 (117h19m42.12398043s) [upload=122061]: Waiting for error group managing segments... Aug 13 14:45:47.692944353 (117h19m42.124024484s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:45:47.692950145 (117h19m42.124030296s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 14:45:47.692953772 (117h19m42.124033913s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 14:45:47.939296760 (117h19m42.370376881s) [upload=122061]: Done uploading segments... Aug 13 14:45:47.939315467 (117h19m42.370395598s) [upload=122061]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.976699612s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X.......X.X.............................................] duration:
6.207888573s
FAIL (2025-08-13 14:49:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.207906127s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X.....................X.......X..........................] duration:
6.626016115s
FAIL (2025-08-13 14:49:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:31:01.866494186 (117h4m56.297574318s) [upload=121799]: Starting upload Aug 13 14:31:01.866533341 (117h4m56.297613472s) [upload=121799]: Done starting upload Aug 13 14:31:01.866740558 (117h4m56.297820699s) [upload=121799]: Uploading segments... Aug 13 14:31:01.867428624 (117h4m56.298508765s) [upload=121799]: Got next segment. Inline: false Aug 13 14:31:01.867473409 (117h4m56.29855354s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:31:01.867478218 (117h4m56.298558349s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 14:31:02.174794903 (117h4m56.605875034s) [upload=121799]: Next segment err: metaclient: Too Many Requests Aug 13 14:31:02.174815282 (117h4m56.605895413s) [upload=121799]: Done uploading segments... Aug 13 14:31:02.174842604 (117h4m56.605922735s) [upload=121799]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.626047065s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X.......X.X............................................] duration:
6.246088822s
FAIL (2025-08-13 14:49:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.246112107s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..X..X.............X.....X.X.........................X......] duration:
1.995177927s
FAIL (2025-08-13 14:49:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:45:47.692702050 (117h19m42.123782181s) [upload=122061]: Starting upload Aug 13 14:45:47.692776562 (117h19m42.123856713s) [upload=122061]: Done starting upload Aug 13 14:45:47.692843671 (117h19m42.123923802s) [upload=122061]: Uploading segments... Aug 13 14:45:47.692894458 (117h19m42.123974589s) [upload=122061]: Got next segment. Inline: true Aug 13 14:45:47.692900299 (117h19m42.12398043s) [upload=122061]: Waiting for error group managing segments... Aug 13 14:45:47.692944353 (117h19m42.124024484s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:45:47.692950145 (117h19m42.124030296s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 14:45:47.692953772 (117h19m42.124033913s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 14:45:47.939296760 (117h19m42.370376881s) [upload=122061]: Done uploading segments... Aug 13 14:45:47.939315467 (117h19m42.370395598s) [upload=122061]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.99520608s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X.....................X.......X.........................] duration:
6.896500734s
FAIL (2025-08-13 14:48:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:31:01.866494186 (117h4m56.297574318s) [upload=121799]: Starting upload Aug 13 14:31:01.866533341 (117h4m56.297613472s) [upload=121799]: Done starting upload Aug 13 14:31:01.866740558 (117h4m56.297820699s) [upload=121799]: Uploading segments... Aug 13 14:31:01.867428624 (117h4m56.298508765s) [upload=121799]: Got next segment. Inline: false Aug 13 14:31:01.867473409 (117h4m56.29855354s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:31:01.867478218 (117h4m56.298558349s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 14:31:02.174794903 (117h4m56.605875034s) [upload=121799]: Next segment err: metaclient: Too Many Requests Aug 13 14:31:02.174815282 (117h4m56.605895413s) [upload=121799]: Done uploading segments... Aug 13 14:31:02.174842604 (117h4m56.605922735s) [upload=121799]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.896523397s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...X..X.............X.....X.X.........................X.....] duration:
2.219736135s
FAIL (2025-08-13 14:48:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:45:47.692702050 (117h19m42.123782181s) [upload=122061]: Starting upload Aug 13 14:45:47.692776562 (117h19m42.123856713s) [upload=122061]: Done starting upload Aug 13 14:45:47.692843671 (117h19m42.123923802s) [upload=122061]: Uploading segments... Aug 13 14:45:47.692894458 (117h19m42.123974589s) [upload=122061]: Got next segment. Inline: true Aug 13 14:45:47.692900299 (117h19m42.12398043s) [upload=122061]: Waiting for error group managing segments... Aug 13 14:45:47.692944353 (117h19m42.124024484s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:45:47.692950145 (117h19m42.124030296s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 14:45:47.692953772 (117h19m42.124033913s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 14:45:47.939296760 (117h19m42.370376881s) [upload=122061]: Done uploading segments... Aug 13 14:45:47.939315467 (117h19m42.370395598s) [upload=122061]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.219762684s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X.....................X.......X........................] duration:
6.336009053s
FAIL (2025-08-13 14:48:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:31:01.866494186 (117h4m56.297574318s) [upload=121799]: Starting upload Aug 13 14:31:01.866533341 (117h4m56.297613472s) [upload=121799]: Done starting upload Aug 13 14:31:01.866740558 (117h4m56.297820699s) [upload=121799]: Uploading segments... Aug 13 14:31:01.867428624 (117h4m56.298508765s) [upload=121799]: Got next segment. Inline: false Aug 13 14:31:01.867473409 (117h4m56.29855354s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:31:01.867478218 (117h4m56.298558349s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 14:31:02.174794903 (117h4m56.605875034s) [upload=121799]: Next segment err: metaclient: Too Many Requests Aug 13 14:31:02.174815282 (117h4m56.605895413s) [upload=121799]: Done uploading segments... Aug 13 14:31:02.174842604 (117h4m56.605922735s) [upload=121799]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.336037797s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X.......X.X...........................................] duration:
6.503809893s
FAIL (2025-08-13 14:48:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.503874014s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X.....................X.......X.......................] duration:
7.450094021s
FAIL (2025-08-13 14:48:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:31:01.866494186 (117h4m56.297574318s) [upload=121799]: Starting upload Aug 13 14:31:01.866533341 (117h4m56.297613472s) [upload=121799]: Done starting upload Aug 13 14:31:01.866740558 (117h4m56.297820699s) [upload=121799]: Uploading segments... Aug 13 14:31:01.867428624 (117h4m56.298508765s) [upload=121799]: Got next segment. Inline: false Aug 13 14:31:01.867473409 (117h4m56.29855354s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:31:01.867478218 (117h4m56.298558349s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 14:31:02.174794903 (117h4m56.605875034s) [upload=121799]: Next segment err: metaclient: Too Many Requests Aug 13 14:31:02.174815282 (117h4m56.605895413s) [upload=121799]: Done uploading segments... Aug 13 14:31:02.174842604 (117h4m56.605922735s) [upload=121799]: Upload finished. err: metaclient: Too Many Requests
Duration: 7.4501983s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [....X..X.............X.....X.X.........................X....] duration:
1.940935673s
FAIL (2025-08-13 14:48:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:45:47.692702050 (117h19m42.123782181s) [upload=122061]: Starting upload Aug 13 14:45:47.692776562 (117h19m42.123856713s) [upload=122061]: Done starting upload Aug 13 14:45:47.692843671 (117h19m42.123923802s) [upload=122061]: Uploading segments... Aug 13 14:45:47.692894458 (117h19m42.123974589s) [upload=122061]: Got next segment. Inline: true Aug 13 14:45:47.692900299 (117h19m42.12398043s) [upload=122061]: Waiting for error group managing segments... Aug 13 14:45:47.692944353 (117h19m42.124024484s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:45:47.692950145 (117h19m42.124030296s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 14:45:47.692953772 (117h19m42.124033913s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 14:45:47.939296760 (117h19m42.370376881s) [upload=122061]: Done uploading segments... Aug 13 14:45:47.939315467 (117h19m42.370395598s) [upload=122061]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.940968556s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X.......X.X..........................................] duration:
8.408446687s
FAIL (2025-08-13 14:47:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 8.408468449s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.....X..X.............X.....X.X.........................X...] duration:
1.934594789s
FAIL (2025-08-13 14:47:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:45:47.692702050 (117h19m42.123782181s) [upload=122061]: Starting upload Aug 13 14:45:47.692776562 (117h19m42.123856713s) [upload=122061]: Done starting upload Aug 13 14:45:47.692843671 (117h19m42.123923802s) [upload=122061]: Uploading segments... Aug 13 14:45:47.692894458 (117h19m42.123974589s) [upload=122061]: Got next segment. Inline: true Aug 13 14:45:47.692900299 (117h19m42.12398043s) [upload=122061]: Waiting for error group managing segments... Aug 13 14:45:47.692944353 (117h19m42.124024484s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:45:47.692950145 (117h19m42.124030296s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 14:45:47.692953772 (117h19m42.124033913s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 14:45:47.939296760 (117h19m42.370376881s) [upload=122061]: Done uploading segments... Aug 13 14:45:47.939315467 (117h19m42.370395598s) [upload=122061]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.93462084s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X.......X.X.........................................] duration:
9.150854939s
FAIL (2025-08-13 14:47:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 9.150900376s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [......X..X.............X.....X.X.........................X..] duration:
1.906057027s
FAIL (2025-08-13 14:47:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:45:47.692702050 (117h19m42.123782181s) [upload=122061]: Starting upload Aug 13 14:45:47.692776562 (117h19m42.123856713s) [upload=122061]: Done starting upload Aug 13 14:45:47.692843671 (117h19m42.123923802s) [upload=122061]: Uploading segments... Aug 13 14:45:47.692894458 (117h19m42.123974589s) [upload=122061]: Got next segment. Inline: true Aug 13 14:45:47.692900299 (117h19m42.12398043s) [upload=122061]: Waiting for error group managing segments... Aug 13 14:45:47.692944353 (117h19m42.124024484s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:45:47.692950145 (117h19m42.124030296s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 14:45:47.692953772 (117h19m42.124033913s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 14:45:47.939296760 (117h19m42.370376881s) [upload=122061]: Done uploading segments... Aug 13 14:45:47.939315467 (117h19m42.370395598s) [upload=122061]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.906083127s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X......X.....................X.......X......................] duration:
6.192107937s
FAIL (2025-08-13 14:46:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:31:01.866494186 (117h4m56.297574318s) [upload=121799]: Starting upload Aug 13 14:31:01.866533341 (117h4m56.297613472s) [upload=121799]: Done starting upload Aug 13 14:31:01.866740558 (117h4m56.297820699s) [upload=121799]: Uploading segments... Aug 13 14:31:01.867428624 (117h4m56.298508765s) [upload=121799]: Got next segment. Inline: false Aug 13 14:31:01.867473409 (117h4m56.29855354s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:31:01.867478218 (117h4m56.298558349s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 14:31:02.174794903 (117h4m56.605875034s) [upload=121799]: Next segment err: metaclient: Too Many Requests Aug 13 14:31:02.174815282 (117h4m56.605895413s) [upload=121799]: Done uploading segments... Aug 13 14:31:02.174842604 (117h4m56.605922735s) [upload=121799]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.192136631s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X......X.....................X.......X.....................] duration:
6.077654612s
FAIL (2025-08-13 14:46:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:31:01.866494186 (117h4m56.297574318s) [upload=121799]: Starting upload Aug 13 14:31:01.866533341 (117h4m56.297613472s) [upload=121799]: Done starting upload Aug 13 14:31:01.866740558 (117h4m56.297820699s) [upload=121799]: Uploading segments... Aug 13 14:31:01.867428624 (117h4m56.298508765s) [upload=121799]: Got next segment. Inline: false Aug 13 14:31:01.867473409 (117h4m56.29855354s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:31:01.867478218 (117h4m56.298558349s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 14:31:02.174794903 (117h4m56.605875034s) [upload=121799]: Next segment err: metaclient: Too Many Requests Aug 13 14:31:02.174815282 (117h4m56.605895413s) [upload=121799]: Done uploading segments... Aug 13 14:31:02.174842604 (117h4m56.605922735s) [upload=121799]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.077683928s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.......X..X.............X.....X.X.........................X.] duration:
1.931764869s
FAIL (2025-08-13 14:46:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:45:47.692702050 (117h19m42.123782181s) [upload=122061]: Starting upload Aug 13 14:45:47.692776562 (117h19m42.123856713s) [upload=122061]: Done starting upload Aug 13 14:45:47.692843671 (117h19m42.123923802s) [upload=122061]: Uploading segments... Aug 13 14:45:47.692894458 (117h19m42.123974589s) [upload=122061]: Got next segment. Inline: true Aug 13 14:45:47.692900299 (117h19m42.12398043s) [upload=122061]: Waiting for error group managing segments... Aug 13 14:45:47.692944353 (117h19m42.124024484s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:45:47.692950145 (117h19m42.124030296s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 14:45:47.692953772 (117h19m42.124033913s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 14:45:47.939296760 (117h19m42.370376881s) [upload=122061]: Done uploading segments... Aug 13 14:45:47.939315467 (117h19m42.370395598s) [upload=122061]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.931801579s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X.......X.X........................................] duration:
6.327094806s
FAIL (2025-08-13 14:46:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.327116227s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [........X..X.............X.....X.X.........................X] duration:
976.433686ms
FAIL (2025-08-13 14:45:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:45:47.692702050 (117h19m42.123782181s) [upload=122061]: Starting upload Aug 13 14:45:47.692776562 (117h19m42.123856713s) [upload=122061]: Done starting upload Aug 13 14:45:47.692843671 (117h19m42.123923802s) [upload=122061]: Uploading segments... Aug 13 14:45:47.692894458 (117h19m42.123974589s) [upload=122061]: Got next segment. Inline: true Aug 13 14:45:47.692900299 (117h19m42.12398043s) [upload=122061]: Waiting for error group managing segments... Aug 13 14:45:47.692944353 (117h19m42.124024484s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:45:47.692950145 (117h19m42.124030296s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 14:45:47.692953772 (117h19m42.124033913s) [upload=122061]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 14:45:47.939296760 (117h19m42.370376881s) [upload=122061]: Done uploading segments... Aug 13 14:45:47.939315467 (117h19m42.370395598s) [upload=122061]: Upload finished. err: metaclient: Too Many Requests
Duration: 976.460066ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.........X..X.............X.....X.X.........................] duration:
2.048247537s
FAIL (2025-08-13 14:45:33 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 14:25:57.508778246 (116h59m51.939858377s) [upload=121717]: Starting upload Aug 13 14:25:57.508850885 (116h59m51.939931016s) [upload=121717]: Done starting upload Aug 13 14:25:57.508940917 (116h59m51.940021058s) [upload=121717]: Uploading segments... Aug 13 14:25:57.509065897 (116h59m51.940146038s) [upload=121717]: Got next segment. Inline: true Aug 13 14:25:57.509071818 (116h59m51.940151959s) [upload=121717]: Waiting for error group managing segments... Aug 13 14:25:57.509160628 (116h59m51.940240769s) [upload=121717]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:25:57.509169355 (116h59m51.940249496s) [upload=121717]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 14:25:57.509174675 (116h59m51.940254806s) [upload=121717]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 14:25:58.324969756 (116h59m52.756049887s) [upload=121717]: Done uploading segments... Aug 13 14:25:58.324989163 (116h59m52.756069294s) [upload=121717]: Upload finished. err: <nil>
Duration: 2.048273797s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X......X.....................X.......X....................] duration:
6.139558454s
FAIL (2025-08-13 14:45:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:31:01.866494186 (117h4m56.297574318s) [upload=121799]: Starting upload Aug 13 14:31:01.866533341 (117h4m56.297613472s) [upload=121799]: Done starting upload Aug 13 14:31:01.866740558 (117h4m56.297820699s) [upload=121799]: Uploading segments... Aug 13 14:31:01.867428624 (117h4m56.298508765s) [upload=121799]: Got next segment. Inline: false Aug 13 14:31:01.867473409 (117h4m56.29855354s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:31:01.867478218 (117h4m56.298558349s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 14:31:02.174794903 (117h4m56.605875034s) [upload=121799]: Next segment err: metaclient: Too Many Requests Aug 13 14:31:02.174815282 (117h4m56.605895413s) [upload=121799]: Done uploading segments... Aug 13 14:31:02.174842604 (117h4m56.605922735s) [upload=121799]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.139585555s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X.......X.X.......................................] duration:
6.225442439s
FAIL (2025-08-13 14:44:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.225466856s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..........X..X.............X.....X.X........................] duration:
2.027966894s
FAIL (2025-08-13 14:44:48 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 14:25:57.508778246 (116h59m51.939858377s) [upload=121717]: Starting upload Aug 13 14:25:57.508850885 (116h59m51.939931016s) [upload=121717]: Done starting upload Aug 13 14:25:57.508940917 (116h59m51.940021058s) [upload=121717]: Uploading segments... Aug 13 14:25:57.509065897 (116h59m51.940146038s) [upload=121717]: Got next segment. Inline: true Aug 13 14:25:57.509071818 (116h59m51.940151959s) [upload=121717]: Waiting for error group managing segments... Aug 13 14:25:57.509160628 (116h59m51.940240769s) [upload=121717]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:25:57.509169355 (116h59m51.940249496s) [upload=121717]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 14:25:57.509174675 (116h59m51.940254806s) [upload=121717]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 14:25:58.324969756 (116h59m52.756049887s) [upload=121717]: Done uploading segments... Aug 13 14:25:58.324989163 (116h59m52.756069294s) [upload=121717]: Upload finished. err: <nil>
Duration: 2.027990408s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X.......X.X......................................] duration:
17.265329066s
FAIL (2025-08-13 14:44:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 17.265346721s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X......X.....................X.......X...................] duration:
6.748769264s
FAIL (2025-08-13 14:44:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:31:01.866494186 (117h4m56.297574318s) [upload=121799]: Starting upload Aug 13 14:31:01.866533341 (117h4m56.297613472s) [upload=121799]: Done starting upload Aug 13 14:31:01.866740558 (117h4m56.297820699s) [upload=121799]: Uploading segments... Aug 13 14:31:01.867428624 (117h4m56.298508765s) [upload=121799]: Got next segment. Inline: false Aug 13 14:31:01.867473409 (117h4m56.29855354s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:31:01.867478218 (117h4m56.298558349s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 14:31:02.174794903 (117h4m56.605875034s) [upload=121799]: Next segment err: metaclient: Too Many Requests Aug 13 14:31:02.174815282 (117h4m56.605895413s) [upload=121799]: Done uploading segments... Aug 13 14:31:02.174842604 (117h4m56.605922735s) [upload=121799]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.748795294s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...........X..X.............X.....X.X.......................] duration:
1.967229602s
FAIL (2025-08-13 14:44:19 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 14:25:57.508778246 (116h59m51.939858377s) [upload=121717]: Starting upload Aug 13 14:25:57.508850885 (116h59m51.939931016s) [upload=121717]: Done starting upload Aug 13 14:25:57.508940917 (116h59m51.940021058s) [upload=121717]: Uploading segments... Aug 13 14:25:57.509065897 (116h59m51.940146038s) [upload=121717]: Got next segment. Inline: true Aug 13 14:25:57.509071818 (116h59m51.940151959s) [upload=121717]: Waiting for error group managing segments... Aug 13 14:25:57.509160628 (116h59m51.940240769s) [upload=121717]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:25:57.509169355 (116h59m51.940249496s) [upload=121717]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 14:25:57.509174675 (116h59m51.940254806s) [upload=121717]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 14:25:58.324969756 (116h59m52.756049887s) [upload=121717]: Done uploading segments... Aug 13 14:25:58.324989163 (116h59m52.756069294s) [upload=121717]: Upload finished. err: <nil>
Duration: 1.967262906s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X......X.....................X.......X..................] duration:
7.372402565s
FAIL (2025-08-13 14:43:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:31:01.866494186 (117h4m56.297574318s) [upload=121799]: Starting upload Aug 13 14:31:01.866533341 (117h4m56.297613472s) [upload=121799]: Done starting upload Aug 13 14:31:01.866740558 (117h4m56.297820699s) [upload=121799]: Uploading segments... Aug 13 14:31:01.867428624 (117h4m56.298508765s) [upload=121799]: Got next segment. Inline: false Aug 13 14:31:01.867473409 (117h4m56.29855354s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:31:01.867478218 (117h4m56.298558349s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 14:31:02.174794903 (117h4m56.605875034s) [upload=121799]: Next segment err: metaclient: Too Many Requests Aug 13 14:31:02.174815282 (117h4m56.605895413s) [upload=121799]: Done uploading segments... Aug 13 14:31:02.174842604 (117h4m56.605922735s) [upload=121799]: Upload finished. err: metaclient: Too Many Requests
Duration: 7.372425237s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [............X..X.............X.....X.X......................] duration:
1.97199976s
FAIL (2025-08-13 14:43:44 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 14:25:57.508778246 (116h59m51.939858377s) [upload=121717]: Starting upload Aug 13 14:25:57.508850885 (116h59m51.939931016s) [upload=121717]: Done starting upload Aug 13 14:25:57.508940917 (116h59m51.940021058s) [upload=121717]: Uploading segments... Aug 13 14:25:57.509065897 (116h59m51.940146038s) [upload=121717]: Got next segment. Inline: true Aug 13 14:25:57.509071818 (116h59m51.940151959s) [upload=121717]: Waiting for error group managing segments... Aug 13 14:25:57.509160628 (116h59m51.940240769s) [upload=121717]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:25:57.509169355 (116h59m51.940249496s) [upload=121717]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 14:25:57.509174675 (116h59m51.940254806s) [upload=121717]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 14:25:58.324969756 (116h59m52.756049887s) [upload=121717]: Done uploading segments... Aug 13 14:25:58.324989163 (116h59m52.756069294s) [upload=121717]: Upload finished. err: <nil>
Duration: 1.972030769s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.............X..X.............X.....X.X.....................] duration:
2.103817772s
FAIL (2025-08-13 14:43:12 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 14:25:57.508778246 (116h59m51.939858377s) [upload=121717]: Starting upload Aug 13 14:25:57.508850885 (116h59m51.939931016s) [upload=121717]: Done starting upload Aug 13 14:25:57.508940917 (116h59m51.940021058s) [upload=121717]: Uploading segments... Aug 13 14:25:57.509065897 (116h59m51.940146038s) [upload=121717]: Got next segment. Inline: true Aug 13 14:25:57.509071818 (116h59m51.940151959s) [upload=121717]: Waiting for error group managing segments... Aug 13 14:25:57.509160628 (116h59m51.940240769s) [upload=121717]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:25:57.509169355 (116h59m51.940249496s) [upload=121717]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 14:25:57.509174675 (116h59m51.940254806s) [upload=121717]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 14:25:58.324969756 (116h59m52.756049887s) [upload=121717]: Done uploading segments... Aug 13 14:25:58.324989163 (116h59m52.756069294s) [upload=121717]: Upload finished. err: <nil>
Duration: 2.103854733s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X.......X.X.....................................] duration:
6.198117094s
FAIL (2025-08-13 14:43:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.198140729s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X......X.....................X.......X.................] duration:
6.232332803s
FAIL (2025-08-13 14:42:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:31:01.866494186 (117h4m56.297574318s) [upload=121799]: Starting upload Aug 13 14:31:01.866533341 (117h4m56.297613472s) [upload=121799]: Done starting upload Aug 13 14:31:01.866740558 (117h4m56.297820699s) [upload=121799]: Uploading segments... Aug 13 14:31:01.867428624 (117h4m56.298508765s) [upload=121799]: Got next segment. Inline: false Aug 13 14:31:01.867473409 (117h4m56.29855354s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:31:01.867478218 (117h4m56.298558349s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 14:31:02.174794903 (117h4m56.605875034s) [upload=121799]: Next segment err: metaclient: Too Many Requests Aug 13 14:31:02.174815282 (117h4m56.605895413s) [upload=121799]: Done uploading segments... Aug 13 14:31:02.174842604 (117h4m56.605922735s) [upload=121799]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.232356978s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X.......X.X....................................] duration:
6.741466961s
FAIL (2025-08-13 14:42:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.741488982s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..............X..X.............X.....X.X....................] duration:
1.977868096s
FAIL (2025-08-13 14:42:31 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 14:25:57.508778246 (116h59m51.939858377s) [upload=121717]: Starting upload Aug 13 14:25:57.508850885 (116h59m51.939931016s) [upload=121717]: Done starting upload Aug 13 14:25:57.508940917 (116h59m51.940021058s) [upload=121717]: Uploading segments... Aug 13 14:25:57.509065897 (116h59m51.940146038s) [upload=121717]: Got next segment. Inline: true Aug 13 14:25:57.509071818 (116h59m51.940151959s) [upload=121717]: Waiting for error group managing segments... Aug 13 14:25:57.509160628 (116h59m51.940240769s) [upload=121717]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:25:57.509169355 (116h59m51.940249496s) [upload=121717]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 14:25:57.509174675 (116h59m51.940254806s) [upload=121717]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 14:25:58.324969756 (116h59m52.756049887s) [upload=121717]: Done uploading segments... Aug 13 14:25:58.324989163 (116h59m52.756069294s) [upload=121717]: Upload finished. err: <nil>
Duration: 1.9779016s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X.......X.X...................................] duration:
6.298067798s
FAIL (2025-08-13 14:42:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.298092296s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X.....X......X.....................X.......X................] duration:
6.268088955s
FAIL (2025-08-13 14:42:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:31:01.866494186 (117h4m56.297574318s) [upload=121799]: Starting upload Aug 13 14:31:01.866533341 (117h4m56.297613472s) [upload=121799]: Done starting upload Aug 13 14:31:01.866740558 (117h4m56.297820699s) [upload=121799]: Uploading segments... Aug 13 14:31:01.867428624 (117h4m56.298508765s) [upload=121799]: Got next segment. Inline: false Aug 13 14:31:01.867473409 (117h4m56.29855354s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:31:01.867478218 (117h4m56.298558349s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 14:31:02.174794903 (117h4m56.605875034s) [upload=121799]: Next segment err: metaclient: Too Many Requests Aug 13 14:31:02.174815282 (117h4m56.605895413s) [upload=121799]: Done uploading segments... Aug 13 14:31:02.174842604 (117h4m56.605922735s) [upload=121799]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.268114734s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...............X..X.............X.....X.X...................] duration:
2.001895279s
FAIL (2025-08-13 14:41:46 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 14:25:57.508778246 (116h59m51.939858377s) [upload=121717]: Starting upload Aug 13 14:25:57.508850885 (116h59m51.939931016s) [upload=121717]: Done starting upload Aug 13 14:25:57.508940917 (116h59m51.940021058s) [upload=121717]: Uploading segments... Aug 13 14:25:57.509065897 (116h59m51.940146038s) [upload=121717]: Got next segment. Inline: true Aug 13 14:25:57.509071818 (116h59m51.940151959s) [upload=121717]: Waiting for error group managing segments... Aug 13 14:25:57.509160628 (116h59m51.940240769s) [upload=121717]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:25:57.509169355 (116h59m51.940249496s) [upload=121717]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 14:25:57.509174675 (116h59m51.940254806s) [upload=121717]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 14:25:58.324969756 (116h59m52.756049887s) [upload=121717]: Done uploading segments... Aug 13 14:25:58.324989163 (116h59m52.756069294s) [upload=121717]: Upload finished. err: <nil>
Duration: 2.001921959s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X.....X......X.....................X.......X...............] duration:
8.134923615s
FAIL (2025-08-13 14:41:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 14:31:01.866494186 (117h4m56.297574318s) [upload=121799]: Starting upload Aug 13 14:31:01.866533341 (117h4m56.297613472s) [upload=121799]: Done starting upload Aug 13 14:31:01.866740558 (117h4m56.297820699s) [upload=121799]: Uploading segments... Aug 13 14:31:01.867428624 (117h4m56.298508765s) [upload=121799]: Got next segment. Inline: false Aug 13 14:31:01.867473409 (117h4m56.29855354s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 14:31:01.867478218 (117h4m56.298558349s) [upload=121799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 14:31:02.174794903 (117h4m56.605875034s) [upload=121799]: Next segment err: metaclient: Too Many Requests Aug 13 14:31:02.174815282 (117h4m56.605895413s) [upload=121799]: Done uploading segments... Aug 13 14:31:02.174842604 (117h4m56.605922735s) [upload=121799]: Upload finished. err: metaclient: Too Many Requests
Duration: 8.134969274s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X.......X.X..................................] duration:
6.453553554s
FAIL (2025-08-13 14:41:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.453575897s
edge
gateway
us-select-1
|