Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X...............X.......................] duration:
1.839838035s
FAIL (2025-08-22 18:30:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil>
Duration: 1.839906487s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
6.036089649s
FAIL (2025-08-22 18:29:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.036105439s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [....X............X..........X...X.X.................X.......] duration:
5.905958695s
FAIL (2025-08-22 18:29:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:25:30.698854970 (336h59m25.129935101s) [upload=350593]: Starting upload Aug 22 18:25:30.698911879 (336h59m25.12999201s) [upload=350593]: Done starting upload Aug 22 18:25:30.699035856 (336h59m25.130115988s) [upload=350593]: Uploading segments... Aug 22 18:25:30.699125217 (336h59m25.130205348s) [upload=350593]: Got next segment. Inline: false Aug 22 18:25:30.699179180 (336h59m25.130259322s) [upload=350593]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:25:30.699184611 (336h59m25.130264752s) [upload=350593]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 18:25:30.967627323 (336h59m25.398707474s) [upload=350593]: Next segment err: metaclient: Too Many Requests Aug 22 18:25:30.967661118 (336h59m25.398741259s) [upload=350593]: Done uploading segments... Aug 22 18:25:30.967680164 (336h59m25.398760315s) [upload=350593]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.905986628s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.821091739s
FAIL (2025-08-22 18:29:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.821115273s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.....X............X..........X...X.X.................X......] duration:
5.994989888s
FAIL (2025-08-22 18:29:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:25:30.698854970 (336h59m25.129935101s) [upload=350593]: Starting upload Aug 22 18:25:30.698911879 (336h59m25.12999201s) [upload=350593]: Done starting upload Aug 22 18:25:30.699035856 (336h59m25.130115988s) [upload=350593]: Uploading segments... Aug 22 18:25:30.699125217 (336h59m25.130205348s) [upload=350593]: Got next segment. Inline: false Aug 22 18:25:30.699179180 (336h59m25.130259322s) [upload=350593]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:25:30.699184611 (336h59m25.130264752s) [upload=350593]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 18:25:30.967627323 (336h59m25.398707474s) [upload=350593]: Next segment err: metaclient: Too Many Requests Aug 22 18:25:30.967661118 (336h59m25.398741259s) [upload=350593]: Done uploading segments... Aug 22 18:25:30.967680164 (336h59m25.398760315s) [upload=350593]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.995014535s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X...............X......................] duration:
2.133907692s
FAIL (2025-08-22 18:28:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil>
Duration: 2.13395398s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [......X............X..........X...X.X.................X.....] duration:
5.844352216s
FAIL (2025-08-22 18:28:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:25:30.698854970 (336h59m25.129935101s) [upload=350593]: Starting upload Aug 22 18:25:30.698911879 (336h59m25.12999201s) [upload=350593]: Done starting upload Aug 22 18:25:30.699035856 (336h59m25.130115988s) [upload=350593]: Uploading segments... Aug 22 18:25:30.699125217 (336h59m25.130205348s) [upload=350593]: Got next segment. Inline: false Aug 22 18:25:30.699179180 (336h59m25.130259322s) [upload=350593]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:25:30.699184611 (336h59m25.130264752s) [upload=350593]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 18:25:30.967627323 (336h59m25.398707474s) [upload=350593]: Next segment err: metaclient: Too Many Requests Aug 22 18:25:30.967661118 (336h59m25.398741259s) [upload=350593]: Done uploading segments... Aug 22 18:25:30.967680164 (336h59m25.398760315s) [upload=350593]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.84437502s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
6.062145825s
FAIL (2025-08-22 18:28:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.062396746s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X...............X.....................] duration:
2.074348373s
FAIL (2025-08-22 18:28:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil>
Duration: 2.074375685s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
5.956642564s
FAIL (2025-08-22 18:27:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.956659507s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.......X............X..........X...X.X.................X....] duration:
5.921668634s
FAIL (2025-08-22 18:27:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:25:30.698854970 (336h59m25.129935101s) [upload=350593]: Starting upload Aug 22 18:25:30.698911879 (336h59m25.12999201s) [upload=350593]: Done starting upload Aug 22 18:25:30.699035856 (336h59m25.130115988s) [upload=350593]: Uploading segments... Aug 22 18:25:30.699125217 (336h59m25.130205348s) [upload=350593]: Got next segment. Inline: false Aug 22 18:25:30.699179180 (336h59m25.130259322s) [upload=350593]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:25:30.699184611 (336h59m25.130264752s) [upload=350593]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 18:25:30.967627323 (336h59m25.398707474s) [upload=350593]: Next segment err: metaclient: Too Many Requests Aug 22 18:25:30.967661118 (336h59m25.398741259s) [upload=350593]: Done uploading segments... Aug 22 18:25:30.967680164 (336h59m25.398760315s) [upload=350593]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.921694614s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X...............X....................] duration:
2.089870903s
FAIL (2025-08-22 18:27:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil>
Duration: 2.089897684s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [........X............X..........X...X.X.................X...] duration:
5.641011289s
FAIL (2025-08-22 18:27:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:25:30.698854970 (336h59m25.129935101s) [upload=350593]: Starting upload Aug 22 18:25:30.698911879 (336h59m25.12999201s) [upload=350593]: Done starting upload Aug 22 18:25:30.699035856 (336h59m25.130115988s) [upload=350593]: Uploading segments... Aug 22 18:25:30.699125217 (336h59m25.130205348s) [upload=350593]: Got next segment. Inline: false Aug 22 18:25:30.699179180 (336h59m25.130259322s) [upload=350593]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:25:30.699184611 (336h59m25.130264752s) [upload=350593]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 18:25:30.967627323 (336h59m25.398707474s) [upload=350593]: Next segment err: metaclient: Too Many Requests Aug 22 18:25:30.967661118 (336h59m25.398741259s) [upload=350593]: Done uploading segments... Aug 22 18:25:30.967680164 (336h59m25.398760315s) [upload=350593]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.641038081s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.........X............X..........X...X.X.................X..] duration:
5.831869071s
FAIL (2025-08-22 18:27:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:25:30.698854970 (336h59m25.129935101s) [upload=350593]: Starting upload Aug 22 18:25:30.698911879 (336h59m25.12999201s) [upload=350593]: Done starting upload Aug 22 18:25:30.699035856 (336h59m25.130115988s) [upload=350593]: Uploading segments... Aug 22 18:25:30.699125217 (336h59m25.130205348s) [upload=350593]: Got next segment. Inline: false Aug 22 18:25:30.699179180 (336h59m25.130259322s) [upload=350593]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:25:30.699184611 (336h59m25.130264752s) [upload=350593]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 18:25:30.967627323 (336h59m25.398707474s) [upload=350593]: Next segment err: metaclient: Too Many Requests Aug 22 18:25:30.967661118 (336h59m25.398741259s) [upload=350593]: Done uploading segments... Aug 22 18:25:30.967680164 (336h59m25.398760315s) [upload=350593]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.831897254s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
6.626650553s
FAIL (2025-08-22 18:26:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.626673037s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..........X............X..........X...X.X.................X.] duration:
5.701224724s
FAIL (2025-08-22 18:26:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:25:30.698854970 (336h59m25.129935101s) [upload=350593]: Starting upload Aug 22 18:25:30.698911879 (336h59m25.12999201s) [upload=350593]: Done starting upload Aug 22 18:25:30.699035856 (336h59m25.130115988s) [upload=350593]: Uploading segments... Aug 22 18:25:30.699125217 (336h59m25.130205348s) [upload=350593]: Got next segment. Inline: false Aug 22 18:25:30.699179180 (336h59m25.130259322s) [upload=350593]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:25:30.699184611 (336h59m25.130264752s) [upload=350593]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 18:25:30.967627323 (336h59m25.398707474s) [upload=350593]: Next segment err: metaclient: Too Many Requests Aug 22 18:25:30.967661118 (336h59m25.398741259s) [upload=350593]: Done uploading segments... Aug 22 18:25:30.967680164 (336h59m25.398760315s) [upload=350593]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.701261014s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X.......................X...............X...................] duration:
2.079385979s
FAIL (2025-08-22 18:26:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil>
Duration: 2.07940669s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
6.142171486s
FAIL (2025-08-22 18:25:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.142249705s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...........X............X..........X...X.X.................X] duration:
927.272183ms
FAIL (2025-08-22 18:25:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:25:30.698854970 (336h59m25.129935101s) [upload=350593]: Starting upload Aug 22 18:25:30.698911879 (336h59m25.12999201s) [upload=350593]: Done starting upload Aug 22 18:25:30.699035856 (336h59m25.130115988s) [upload=350593]: Uploading segments... Aug 22 18:25:30.699125217 (336h59m25.130205348s) [upload=350593]: Got next segment. Inline: false Aug 22 18:25:30.699179180 (336h59m25.130259322s) [upload=350593]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:25:30.699184611 (336h59m25.130264752s) [upload=350593]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 18:25:30.967627323 (336h59m25.398707474s) [upload=350593]: Next segment err: metaclient: Too Many Requests Aug 22 18:25:30.967661118 (336h59m25.398741259s) [upload=350593]: Done uploading segments... Aug 22 18:25:30.967680164 (336h59m25.398760315s) [upload=350593]: Upload finished. err: metaclient: Too Many Requests
Duration: 927.290108ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X.......................X...............X..................] duration:
2.176001807s
FAIL (2025-08-22 18:25:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil>
Duration: 2.176037443s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [............X............X..........X...X.X.................] duration:
5.660249261s
FAIL (2025-08-22 18:25:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:11:53.967411803 (336h45m48.398491934s) [upload=350360]: Starting upload Aug 22 18:11:53.967476777 (336h45m48.398556898s) [upload=350360]: Done starting upload Aug 22 18:11:53.967595966 (336h45m48.398676097s) [upload=350360]: Uploading segments... Aug 22 18:11:53.967692540 (336h45m48.398772671s) [upload=350360]: Got next segment. Inline: false Aug 22 18:11:53.967736525 (336h45m48.398816656s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:11:53.967743548 (336h45m48.398823679s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 18:11:54.183340924 (336h45m48.614421055s) [upload=350360]: Next segment err: metaclient: Too Many Requests Aug 22 18:11:54.183370010 (336h45m48.614450141s) [upload=350360]: Done uploading segments... Aug 22 18:11:54.183406580 (336h45m48.614486711s) [upload=350360]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.660273699s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X.......................X...............X.................] duration:
2.069451516s
FAIL (2025-08-22 18:24:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil>
Duration: 2.069478799s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.............X............X..........X...X.X................] duration:
6.084093376s
FAIL (2025-08-22 18:24:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:11:53.967411803 (336h45m48.398491934s) [upload=350360]: Starting upload Aug 22 18:11:53.967476777 (336h45m48.398556898s) [upload=350360]: Done starting upload Aug 22 18:11:53.967595966 (336h45m48.398676097s) [upload=350360]: Uploading segments... Aug 22 18:11:53.967692540 (336h45m48.398772671s) [upload=350360]: Got next segment. Inline: false Aug 22 18:11:53.967736525 (336h45m48.398816656s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:11:53.967743548 (336h45m48.398823679s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 18:11:54.183340924 (336h45m48.614421055s) [upload=350360]: Next segment err: metaclient: Too Many Requests Aug 22 18:11:54.183370010 (336h45m48.614450141s) [upload=350360]: Done uploading segments... Aug 22 18:11:54.183406580 (336h45m48.614486711s) [upload=350360]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.084125188s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
6.150824132s
FAIL (2025-08-22 18:24:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.150853527s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..............X............X..........X...X.X...............] duration:
5.620876196s
FAIL (2025-08-22 18:24:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:11:53.967411803 (336h45m48.398491934s) [upload=350360]: Starting upload Aug 22 18:11:53.967476777 (336h45m48.398556898s) [upload=350360]: Done starting upload Aug 22 18:11:53.967595966 (336h45m48.398676097s) [upload=350360]: Uploading segments... Aug 22 18:11:53.967692540 (336h45m48.398772671s) [upload=350360]: Got next segment. Inline: false Aug 22 18:11:53.967736525 (336h45m48.398816656s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:11:53.967743548 (336h45m48.398823679s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 18:11:54.183340924 (336h45m48.614421055s) [upload=350360]: Next segment err: metaclient: Too Many Requests Aug 22 18:11:54.183370010 (336h45m48.614450141s) [upload=350360]: Done uploading segments... Aug 22 18:11:54.183406580 (336h45m48.614486711s) [upload=350360]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.620905792s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X.......................X...............X................] duration:
2.095939717s
FAIL (2025-08-22 18:24:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil>
Duration: 2.095974955s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...............X............X..........X...X.X..............] duration:
5.814530863s
FAIL (2025-08-22 18:24:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:11:53.967411803 (336h45m48.398491934s) [upload=350360]: Starting upload Aug 22 18:11:53.967476777 (336h45m48.398556898s) [upload=350360]: Done starting upload Aug 22 18:11:53.967595966 (336h45m48.398676097s) [upload=350360]: Uploading segments... Aug 22 18:11:53.967692540 (336h45m48.398772671s) [upload=350360]: Got next segment. Inline: false Aug 22 18:11:53.967736525 (336h45m48.398816656s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:11:53.967743548 (336h45m48.398823679s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 18:11:54.183340924 (336h45m48.614421055s) [upload=350360]: Next segment err: metaclient: Too Many Requests Aug 22 18:11:54.183370010 (336h45m48.614450141s) [upload=350360]: Done uploading segments... Aug 22 18:11:54.183406580 (336h45m48.614486711s) [upload=350360]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.814556171s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
6.3151226s
FAIL (2025-08-22 18:23:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.315141567s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [................X............X..........X...X.X.............] duration:
6.044309683s
FAIL (2025-08-22 18:23:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:11:53.967411803 (336h45m48.398491934s) [upload=350360]: Starting upload Aug 22 18:11:53.967476777 (336h45m48.398556898s) [upload=350360]: Done starting upload Aug 22 18:11:53.967595966 (336h45m48.398676097s) [upload=350360]: Uploading segments... Aug 22 18:11:53.967692540 (336h45m48.398772671s) [upload=350360]: Got next segment. Inline: false Aug 22 18:11:53.967736525 (336h45m48.398816656s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:11:53.967743548 (336h45m48.398823679s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 18:11:54.183340924 (336h45m48.614421055s) [upload=350360]: Next segment err: metaclient: Too Many Requests Aug 22 18:11:54.183370010 (336h45m48.614450141s) [upload=350360]: Done uploading segments... Aug 22 18:11:54.183406580 (336h45m48.614486711s) [upload=350360]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.044338037s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
6.309389018s
FAIL (2025-08-22 18:23:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.309407996s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X.......................X...............X...............] duration:
1.903956666s
FAIL (2025-08-22 18:23:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil>
Duration: 1.903983607s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.................X............X..........X...X.X............] duration:
6.050875086s
FAIL (2025-08-22 18:22:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:11:53.967411803 (336h45m48.398491934s) [upload=350360]: Starting upload Aug 22 18:11:53.967476777 (336h45m48.398556898s) [upload=350360]: Done starting upload Aug 22 18:11:53.967595966 (336h45m48.398676097s) [upload=350360]: Uploading segments... Aug 22 18:11:53.967692540 (336h45m48.398772671s) [upload=350360]: Got next segment. Inline: false Aug 22 18:11:53.967736525 (336h45m48.398816656s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:11:53.967743548 (336h45m48.398823679s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 18:11:54.183340924 (336h45m48.614421055s) [upload=350360]: Next segment err: metaclient: Too Many Requests Aug 22 18:11:54.183370010 (336h45m48.614450141s) [upload=350360]: Done uploading segments... Aug 22 18:11:54.183406580 (336h45m48.614486711s) [upload=350360]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.050896717s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..................X............X..........X...X.X...........] duration:
5.640540178s
FAIL (2025-08-22 18:22:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:11:53.967411803 (336h45m48.398491934s) [upload=350360]: Starting upload Aug 22 18:11:53.967476777 (336h45m48.398556898s) [upload=350360]: Done starting upload Aug 22 18:11:53.967595966 (336h45m48.398676097s) [upload=350360]: Uploading segments... Aug 22 18:11:53.967692540 (336h45m48.398772671s) [upload=350360]: Got next segment. Inline: false Aug 22 18:11:53.967736525 (336h45m48.398816656s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:11:53.967743548 (336h45m48.398823679s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 18:11:54.183340924 (336h45m48.614421055s) [upload=350360]: Next segment err: metaclient: Too Many Requests Aug 22 18:11:54.183370010 (336h45m48.614450141s) [upload=350360]: Done uploading segments... Aug 22 18:11:54.183406580 (336h45m48.614486711s) [upload=350360]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.640566278s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X.......................X...............X..............] duration:
1.867173776s
FAIL (2025-08-22 18:22:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil>
Duration: 1.867203253s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
5.855401586s
FAIL (2025-08-22 18:21:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.855436183s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...................X............X..........X...X.X..........] duration:
5.804907801s
FAIL (2025-08-22 18:21:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:11:53.967411803 (336h45m48.398491934s) [upload=350360]: Starting upload Aug 22 18:11:53.967476777 (336h45m48.398556898s) [upload=350360]: Done starting upload Aug 22 18:11:53.967595966 (336h45m48.398676097s) [upload=350360]: Uploading segments... Aug 22 18:11:53.967692540 (336h45m48.398772671s) [upload=350360]: Got next segment. Inline: false Aug 22 18:11:53.967736525 (336h45m48.398816656s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:11:53.967743548 (336h45m48.398823679s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 18:11:54.183340924 (336h45m48.614421055s) [upload=350360]: Next segment err: metaclient: Too Many Requests Aug 22 18:11:54.183370010 (336h45m48.614450141s) [upload=350360]: Done uploading segments... Aug 22 18:11:54.183406580 (336h45m48.614486711s) [upload=350360]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.80493314s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X.......................X...............X.............] duration:
1.940591726s
FAIL (2025-08-22 18:21:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil>
Duration: 1.94063603s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
5.859297451s
FAIL (2025-08-22 18:21:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.859320674s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X.......................X...............X............] duration:
1.952063376s
FAIL (2025-08-22 18:20:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil>
Duration: 1.952089224s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [....................X............X..........X...X.X.........] duration:
6.000427551s
FAIL (2025-08-22 18:20:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:11:53.967411803 (336h45m48.398491934s) [upload=350360]: Starting upload Aug 22 18:11:53.967476777 (336h45m48.398556898s) [upload=350360]: Done starting upload Aug 22 18:11:53.967595966 (336h45m48.398676097s) [upload=350360]: Uploading segments... Aug 22 18:11:53.967692540 (336h45m48.398772671s) [upload=350360]: Got next segment. Inline: false Aug 22 18:11:53.967736525 (336h45m48.398816656s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:11:53.967743548 (336h45m48.398823679s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 18:11:54.183340924 (336h45m48.614421055s) [upload=350360]: Next segment err: metaclient: Too Many Requests Aug 22 18:11:54.183370010 (336h45m48.614450141s) [upload=350360]: Done uploading segments... Aug 22 18:11:54.183406580 (336h45m48.614486711s) [upload=350360]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.000458049s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
6.244329792s
FAIL (2025-08-22 18:20:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.244352156s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....................X............X..........X...X.X........] duration:
5.866817931s
FAIL (2025-08-22 18:19:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:11:53.967411803 (336h45m48.398491934s) [upload=350360]: Starting upload Aug 22 18:11:53.967476777 (336h45m48.398556898s) [upload=350360]: Done starting upload Aug 22 18:11:53.967595966 (336h45m48.398676097s) [upload=350360]: Uploading segments... Aug 22 18:11:53.967692540 (336h45m48.398772671s) [upload=350360]: Got next segment. Inline: false Aug 22 18:11:53.967736525 (336h45m48.398816656s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:11:53.967743548 (336h45m48.398823679s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 18:11:54.183340924 (336h45m48.614421055s) [upload=350360]: Next segment err: metaclient: Too Many Requests Aug 22 18:11:54.183370010 (336h45m48.614450141s) [upload=350360]: Done uploading segments... Aug 22 18:11:54.183406580 (336h45m48.614486711s) [upload=350360]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.866842187s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
5.982802677s
FAIL (2025-08-22 18:19:37 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.982820229s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X.......................X...............X...........] duration:
1.859205881s
FAIL (2025-08-22 18:19:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil>
Duration: 1.859228985s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [......................X............X..........X...X.X.......] duration:
6.154832831s
FAIL (2025-08-22 18:18:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:11:53.967411803 (336h45m48.398491934s) [upload=350360]: Starting upload Aug 22 18:11:53.967476777 (336h45m48.398556898s) [upload=350360]: Done starting upload Aug 22 18:11:53.967595966 (336h45m48.398676097s) [upload=350360]: Uploading segments... Aug 22 18:11:53.967692540 (336h45m48.398772671s) [upload=350360]: Got next segment. Inline: false Aug 22 18:11:53.967736525 (336h45m48.398816656s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:11:53.967743548 (336h45m48.398823679s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 18:11:54.183340924 (336h45m48.614421055s) [upload=350360]: Next segment err: metaclient: Too Many Requests Aug 22 18:11:54.183370010 (336h45m48.614450141s) [upload=350360]: Done uploading segments... Aug 22 18:11:54.183406580 (336h45m48.614486711s) [upload=350360]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.154856135s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
5.914482792s
FAIL (2025-08-22 18:18:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.914507249s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X.......................X...............X..........] duration:
2.040512354s
FAIL (2025-08-22 18:18:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil>
Duration: 2.040532051s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.......................X............X..........X...X.X......] duration:
5.807220055s
FAIL (2025-08-22 18:17:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:11:53.967411803 (336h45m48.398491934s) [upload=350360]: Starting upload Aug 22 18:11:53.967476777 (336h45m48.398556898s) [upload=350360]: Done starting upload Aug 22 18:11:53.967595966 (336h45m48.398676097s) [upload=350360]: Uploading segments... Aug 22 18:11:53.967692540 (336h45m48.398772671s) [upload=350360]: Got next segment. Inline: false Aug 22 18:11:53.967736525 (336h45m48.398816656s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:11:53.967743548 (336h45m48.398823679s) [upload=350360]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 18:11:54.183340924 (336h45m48.614421055s) [upload=350360]: Next segment err: metaclient: Too Many Requests Aug 22 18:11:54.183370010 (336h45m48.614450141s) [upload=350360]: Done uploading segments... Aug 22 18:11:54.183406580 (336h45m48.614486711s) [upload=350360]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.807243961s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
6.237562156s
FAIL (2025-08-22 18:17:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.237592203s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X.......................X...............X.........] duration:
1.924330462s
FAIL (2025-08-22 18:17:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil>
Duration: 1.924355499s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|