Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.........................X...X........XX.............X.X....] duration:
1.989233125s
FAIL (2025-08-21 23:29:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 38c9239c7be0f9590decfcd9e04ddfdedfb12e7aaf4b98990689ac8e70b4311b != before d7ffaa78fd733d6399224c0a9ee137c7b14864622c769eb900e829f3322931a6 ======LOGS====== Aug 21 23:26:17.897968945 (318h0m12.329049066s) [upload=330846]: Starting upload Aug 21 23:26:17.898004473 (318h0m12.329084604s) [upload=330846]: Done starting upload Aug 21 23:26:17.898048928 (318h0m12.329129059s) [upload=330846]: Uploading segments... Aug 21 23:26:17.898083935 (318h0m12.329164066s) [upload=330846]: Got next segment. Inline: true Aug 21 23:26:17.898087011 (318h0m12.329167142s) [upload=330846]: Waiting for error group managing segments... Aug 21 23:26:17.898116949 (318h0m12.32919708s) [upload=330846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:26:17.898120946 (318h0m12.329201077s) [upload=330846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:26:17.898123691 (318h0m12.329203823s) [upload=330846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:26:18.194503530 (318h0m12.625583661s) [upload=330846]: Done uploading segments... Aug 21 23:26:18.194525361 (318h0m12.625605492s) [upload=330846]: Upload finished. err: <nil>
Duration: 1.989253475s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [................XX..........................................] duration:
6.195258399s
FAIL (2025-08-21 23:29:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.195280261s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [........XX.X..............X...........X.....................] duration:
6.171007993s
FAIL (2025-08-21 23:28:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.171033971s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..........................X...X........XX.............X.X...] duration:
1.892948012s
FAIL (2025-08-21 23:28:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 38c9239c7be0f9590decfcd9e04ddfdedfb12e7aaf4b98990689ac8e70b4311b != before d7ffaa78fd733d6399224c0a9ee137c7b14864622c769eb900e829f3322931a6 ======LOGS====== Aug 21 23:26:17.897968945 (318h0m12.329049066s) [upload=330846]: Starting upload Aug 21 23:26:17.898004473 (318h0m12.329084604s) [upload=330846]: Done starting upload Aug 21 23:26:17.898048928 (318h0m12.329129059s) [upload=330846]: Uploading segments... Aug 21 23:26:17.898083935 (318h0m12.329164066s) [upload=330846]: Got next segment. Inline: true Aug 21 23:26:17.898087011 (318h0m12.329167142s) [upload=330846]: Waiting for error group managing segments... Aug 21 23:26:17.898116949 (318h0m12.32919708s) [upload=330846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:26:17.898120946 (318h0m12.329201077s) [upload=330846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:26:17.898123691 (318h0m12.329203823s) [upload=330846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:26:18.194503530 (318h0m12.625583661s) [upload=330846]: Done uploading segments... Aug 21 23:26:18.194525361 (318h0m12.625605492s) [upload=330846]: Upload finished. err: <nil>
Duration: 1.89297212s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................XX.........................................] duration:
6.13639048s
FAIL (2025-08-21 23:28:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.136409437s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...........................X...X........XX.............X.X..] duration:
2.071436533s
FAIL (2025-08-21 23:28:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 38c9239c7be0f9590decfcd9e04ddfdedfb12e7aaf4b98990689ac8e70b4311b != before d7ffaa78fd733d6399224c0a9ee137c7b14864622c769eb900e829f3322931a6 ======LOGS====== Aug 21 23:26:17.897968945 (318h0m12.329049066s) [upload=330846]: Starting upload Aug 21 23:26:17.898004473 (318h0m12.329084604s) [upload=330846]: Done starting upload Aug 21 23:26:17.898048928 (318h0m12.329129059s) [upload=330846]: Uploading segments... Aug 21 23:26:17.898083935 (318h0m12.329164066s) [upload=330846]: Got next segment. Inline: true Aug 21 23:26:17.898087011 (318h0m12.329167142s) [upload=330846]: Waiting for error group managing segments... Aug 21 23:26:17.898116949 (318h0m12.32919708s) [upload=330846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:26:17.898120946 (318h0m12.329201077s) [upload=330846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:26:17.898123691 (318h0m12.329203823s) [upload=330846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:26:18.194503530 (318h0m12.625583661s) [upload=330846]: Done uploading segments... Aug 21 23:26:18.194525361 (318h0m12.625605492s) [upload=330846]: Upload finished. err: <nil>
Duration: 2.071464947s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.........XX.X..............X...........X....................] duration:
6.254803886s
FAIL (2025-08-21 23:27:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.254835327s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................XX........................................] duration:
5.989277662s
FAIL (2025-08-21 23:27:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.989300156s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [............................X...X........XX.............X.X.] duration:
2.197025492s
FAIL (2025-08-21 23:27:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 38c9239c7be0f9590decfcd9e04ddfdedfb12e7aaf4b98990689ac8e70b4311b != before d7ffaa78fd733d6399224c0a9ee137c7b14864622c769eb900e829f3322931a6 ======LOGS====== Aug 21 23:26:17.897968945 (318h0m12.329049066s) [upload=330846]: Starting upload Aug 21 23:26:17.898004473 (318h0m12.329084604s) [upload=330846]: Done starting upload Aug 21 23:26:17.898048928 (318h0m12.329129059s) [upload=330846]: Uploading segments... Aug 21 23:26:17.898083935 (318h0m12.329164066s) [upload=330846]: Got next segment. Inline: true Aug 21 23:26:17.898087011 (318h0m12.329167142s) [upload=330846]: Waiting for error group managing segments... Aug 21 23:26:17.898116949 (318h0m12.32919708s) [upload=330846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:26:17.898120946 (318h0m12.329201077s) [upload=330846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:26:17.898123691 (318h0m12.329203823s) [upload=330846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:26:18.194503530 (318h0m12.625583661s) [upload=330846]: Done uploading segments... Aug 21 23:26:18.194525361 (318h0m12.625605492s) [upload=330846]: Upload finished. err: <nil>
Duration: 2.197048647s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..........XX.X..............X...........X...................] duration:
9.258589906s
FAIL (2025-08-21 23:27:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 9.258612349s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................XX.......................................] duration:
5.413438597s
FAIL (2025-08-21 23:26:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.413466943s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...........XX.X..............X...........X..................] duration:
6.439438352s
FAIL (2025-08-21 23:26:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.439461987s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.............................X...X........XX.............X.X] duration:
1.641298424s
FAIL (2025-08-21 23:26:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 38c9239c7be0f9590decfcd9e04ddfdedfb12e7aaf4b98990689ac8e70b4311b != before d7ffaa78fd733d6399224c0a9ee137c7b14864622c769eb900e829f3322931a6 ======LOGS====== Aug 21 23:26:17.897968945 (318h0m12.329049066s) [upload=330846]: Starting upload Aug 21 23:26:17.898004473 (318h0m12.329084604s) [upload=330846]: Done starting upload Aug 21 23:26:17.898048928 (318h0m12.329129059s) [upload=330846]: Uploading segments... Aug 21 23:26:17.898083935 (318h0m12.329164066s) [upload=330846]: Got next segment. Inline: true Aug 21 23:26:17.898087011 (318h0m12.329167142s) [upload=330846]: Waiting for error group managing segments... Aug 21 23:26:17.898116949 (318h0m12.32919708s) [upload=330846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:26:17.898120946 (318h0m12.329201077s) [upload=330846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:26:17.898123691 (318h0m12.329203823s) [upload=330846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:26:18.194503530 (318h0m12.625583661s) [upload=330846]: Done uploading segments... Aug 21 23:26:18.194525361 (318h0m12.625605492s) [upload=330846]: Upload finished. err: <nil>
Duration: 1.641331285s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................XX......................................] duration:
6.298527216s
FAIL (2025-08-21 23:26:03 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.298552195s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..............................X...X........XX.............X.] duration:
2.015190712s
FAIL (2025-08-21 23:25:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e7ad3a79c66cc0642ae190eff25612c3a28ead74fe050ff3601e33ae7649ac28 != before 84b425d37267d7e06cbc58a40f3a1d23f1af23ff28441a602d4f02d65b2a49a7 ======LOGS====== Aug 21 23:25:00.162806482 (317h58m54.593886613s) [upload=330820]: Starting upload Aug 21 23:25:00.162879863 (317h58m54.593959994s) [upload=330820]: Done starting upload Aug 21 23:25:00.162939907 (317h58m54.594020039s) [upload=330820]: Uploading segments... Aug 21 23:25:00.162987158 (317h58m54.594067319s) [upload=330820]: Got next segment. Inline: true Aug 21 23:25:00.162993460 (317h58m54.594073591s) [upload=330820]: Waiting for error group managing segments... Aug 21 23:25:00.163037715 (317h58m54.594117846s) [upload=330820]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:25:00.163044728 (317h58m54.594124889s) [upload=330820]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:25:00.163049788 (317h58m54.594129949s) [upload=330820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:25:00.513929764 (317h58m54.945009895s) [upload=330820]: Done uploading segments... Aug 21 23:25:00.513952377 (317h58m54.945032538s) [upload=330820]: Upload finished. err: <nil>
Duration: 2.015224616s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [............XX.X..............X...........X.................] duration:
6.657335381s
FAIL (2025-08-21 23:25:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.657359328s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...............................X...X........XX.............X] duration:
1.69962899s
FAIL (2025-08-21 23:25:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e7ad3a79c66cc0642ae190eff25612c3a28ead74fe050ff3601e33ae7649ac28 != before 84b425d37267d7e06cbc58a40f3a1d23f1af23ff28441a602d4f02d65b2a49a7 ======LOGS====== Aug 21 23:25:00.162806482 (317h58m54.593886613s) [upload=330820]: Starting upload Aug 21 23:25:00.162879863 (317h58m54.593959994s) [upload=330820]: Done starting upload Aug 21 23:25:00.162939907 (317h58m54.594020039s) [upload=330820]: Uploading segments... Aug 21 23:25:00.162987158 (317h58m54.594067319s) [upload=330820]: Got next segment. Inline: true Aug 21 23:25:00.162993460 (317h58m54.594073591s) [upload=330820]: Waiting for error group managing segments... Aug 21 23:25:00.163037715 (317h58m54.594117846s) [upload=330820]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:25:00.163044728 (317h58m54.594124889s) [upload=330820]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:25:00.163049788 (317h58m54.594129949s) [upload=330820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:25:00.513929764 (317h58m54.945009895s) [upload=330820]: Done uploading segments... Aug 21 23:25:00.513952377 (317h58m54.945032538s) [upload=330820]: Upload finished. err: <nil>
Duration: 1.69966079s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................XX.....................................] duration:
6.171758427s
FAIL (2025-08-21 23:24:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.171772754s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.............XX.X..............X...........X................] duration:
6.121607459s
FAIL (2025-08-21 23:24:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.121633238s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................XX....................................] duration:
6.217294331s
FAIL (2025-08-21 23:24:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.217331041s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..............XX.X..............X...........X...............] duration:
5.775799161s
FAIL (2025-08-21 23:24:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.775823748s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................XX...................................] duration:
5.7867973s
FAIL (2025-08-21 23:24:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.786820192s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................XX..................................] duration:
6.042354496s
FAIL (2025-08-21 23:23:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.042370419s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................................X...X........XX.............] duration:
2.279709747s
FAIL (2025-08-21 23:23:51 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 23:15:31.385933556 (317h49m25.817013687s) [upload=330657]: Starting upload
Aug 21 23:15:31.385974795 (317h49m25.817054926s) [upload=330657]: Done starting upload
Aug 21 23:15:31.386029720 (317h49m25.817109851s) [upload=330657]: Uploading segments...
Aug 21 23:15:31.386080717 (317h49m25.817160858s) [upload=330657]: Got next segment. Inline: true
Aug 21 23:15:31.386086278 (317h49m25.817166399s) [upload=330657]: Waiting for error group managing segments...
Aug 21 23:15:31.386140312 (317h49m25.817220473s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 23:15:31.386147325 (317h49m25.817227466s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 23:15:31.386151864 (317h49m25.817231995s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 23:15:32.310207456 (317h49m26.741287587s) [upload=330657]: Done uploading segments...
Aug 21 23:15:32.310225530 (317h49m26.741305651s) [upload=330657]: Upload finished. err: <nil>
Duration: 2.279735417s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................XX.................................] duration:
5.981216607s
FAIL (2025-08-21 23:23:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.981241466s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...............XX.X..............X...........X..............] duration:
5.967878158s
FAIL (2025-08-21 23:23:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.967903868s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.................................X...X........XX............] duration:
1.873015254s
FAIL (2025-08-21 23:22:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 23:15:31.385933556 (317h49m25.817013687s) [upload=330657]: Starting upload
Aug 21 23:15:31.385974795 (317h49m25.817054926s) [upload=330657]: Done starting upload
Aug 21 23:15:31.386029720 (317h49m25.817109851s) [upload=330657]: Uploading segments...
Aug 21 23:15:31.386080717 (317h49m25.817160858s) [upload=330657]: Got next segment. Inline: true
Aug 21 23:15:31.386086278 (317h49m25.817166399s) [upload=330657]: Waiting for error group managing segments...
Aug 21 23:15:31.386140312 (317h49m25.817220473s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 23:15:31.386147325 (317h49m25.817227466s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 23:15:31.386151864 (317h49m25.817231995s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 23:15:32.310207456 (317h49m26.741287587s) [upload=330657]: Done uploading segments...
Aug 21 23:15:32.310225530 (317h49m26.741305651s) [upload=330657]: Upload finished. err: <nil>
Duration: 1.873037106s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..................................X...X........XX...........] duration:
2.386803139s
FAIL (2025-08-21 23:22:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 23:15:31.385933556 (317h49m25.817013687s) [upload=330657]: Starting upload
Aug 21 23:15:31.385974795 (317h49m25.817054926s) [upload=330657]: Done starting upload
Aug 21 23:15:31.386029720 (317h49m25.817109851s) [upload=330657]: Uploading segments...
Aug 21 23:15:31.386080717 (317h49m25.817160858s) [upload=330657]: Got next segment. Inline: true
Aug 21 23:15:31.386086278 (317h49m25.817166399s) [upload=330657]: Waiting for error group managing segments...
Aug 21 23:15:31.386140312 (317h49m25.817220473s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 23:15:31.386147325 (317h49m25.817227466s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 23:15:31.386151864 (317h49m25.817231995s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 23:15:32.310207456 (317h49m26.741287587s) [upload=330657]: Done uploading segments...
Aug 21 23:15:32.310225530 (317h49m26.741305651s) [upload=330657]: Upload finished. err: <nil>
Duration: 2.386826624s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................XX................................] duration:
6.142734031s
FAIL (2025-08-21 23:22:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.142757878s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [................XX.X..............X...........X.............] duration:
6.31182152s
FAIL (2025-08-21 23:22:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.311844916s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................XX...............................] duration:
5.787441842s
FAIL (2025-08-21 23:21:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.787463162s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...................................X...X........XX..........] duration:
1.984682738s
FAIL (2025-08-21 23:21:27 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 23:15:31.385933556 (317h49m25.817013687s) [upload=330657]: Starting upload
Aug 21 23:15:31.385974795 (317h49m25.817054926s) [upload=330657]: Done starting upload
Aug 21 23:15:31.386029720 (317h49m25.817109851s) [upload=330657]: Uploading segments...
Aug 21 23:15:31.386080717 (317h49m25.817160858s) [upload=330657]: Got next segment. Inline: true
Aug 21 23:15:31.386086278 (317h49m25.817166399s) [upload=330657]: Waiting for error group managing segments...
Aug 21 23:15:31.386140312 (317h49m25.817220473s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 23:15:31.386147325 (317h49m25.817227466s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 23:15:31.386151864 (317h49m25.817231995s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 23:15:32.310207456 (317h49m26.741287587s) [upload=330657]: Done uploading segments...
Aug 21 23:15:32.310225530 (317h49m26.741305651s) [upload=330657]: Upload finished. err: <nil>
Duration: 1.984706863s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................XX..............................] duration:
6.009325269s
FAIL (2025-08-21 23:21:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.009342581s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....................................X...X........XX.........] duration:
3.315193145s
FAIL (2025-08-21 23:20:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 23:15:31.385933556 (317h49m25.817013687s) [upload=330657]: Starting upload
Aug 21 23:15:31.385974795 (317h49m25.817054926s) [upload=330657]: Done starting upload
Aug 21 23:15:31.386029720 (317h49m25.817109851s) [upload=330657]: Uploading segments...
Aug 21 23:15:31.386080717 (317h49m25.817160858s) [upload=330657]: Got next segment. Inline: true
Aug 21 23:15:31.386086278 (317h49m25.817166399s) [upload=330657]: Waiting for error group managing segments...
Aug 21 23:15:31.386140312 (317h49m25.817220473s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 23:15:31.386147325 (317h49m25.817227466s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 23:15:31.386151864 (317h49m25.817231995s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 23:15:32.310207456 (317h49m26.741287587s) [upload=330657]: Done uploading segments...
Aug 21 23:15:32.310225530 (317h49m26.741305651s) [upload=330657]: Upload finished. err: <nil>
Duration: 3.315219283s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.................XX.X..............X...........X............] duration:
6.29346012s
FAIL (2025-08-21 23:20:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.293474438s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....................................X...X........XX........] duration:
2.134148925s
FAIL (2025-08-21 23:20:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 23:15:31.385933556 (317h49m25.817013687s) [upload=330657]: Starting upload
Aug 21 23:15:31.385974795 (317h49m25.817054926s) [upload=330657]: Done starting upload
Aug 21 23:15:31.386029720 (317h49m25.817109851s) [upload=330657]: Uploading segments...
Aug 21 23:15:31.386080717 (317h49m25.817160858s) [upload=330657]: Got next segment. Inline: true
Aug 21 23:15:31.386086278 (317h49m25.817166399s) [upload=330657]: Waiting for error group managing segments...
Aug 21 23:15:31.386140312 (317h49m25.817220473s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 23:15:31.386147325 (317h49m25.817227466s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 23:15:31.386151864 (317h49m25.817231995s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 23:15:32.310207456 (317h49m26.741287587s) [upload=330657]: Done uploading segments...
Aug 21 23:15:32.310225530 (317h49m26.741305651s) [upload=330657]: Upload finished. err: <nil>
Duration: 2.134169323s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................XX.............................] duration:
6.22884762s
FAIL (2025-08-21 23:20:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.2288683s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..................XX.X..............X...........X...........] duration:
6.044924825s
FAIL (2025-08-21 23:19:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.044942157s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......................................X...X........XX.......] duration:
1.93071095s
FAIL (2025-08-21 23:19:54 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 23:15:31.385933556 (317h49m25.817013687s) [upload=330657]: Starting upload
Aug 21 23:15:31.385974795 (317h49m25.817054926s) [upload=330657]: Done starting upload
Aug 21 23:15:31.386029720 (317h49m25.817109851s) [upload=330657]: Uploading segments...
Aug 21 23:15:31.386080717 (317h49m25.817160858s) [upload=330657]: Got next segment. Inline: true
Aug 21 23:15:31.386086278 (317h49m25.817166399s) [upload=330657]: Waiting for error group managing segments...
Aug 21 23:15:31.386140312 (317h49m25.817220473s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 23:15:31.386147325 (317h49m25.817227466s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 23:15:31.386151864 (317h49m25.817231995s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 23:15:32.310207456 (317h49m26.741287587s) [upload=330657]: Done uploading segments...
Aug 21 23:15:32.310225530 (317h49m26.741305651s) [upload=330657]: Upload finished. err: <nil>
Duration: 1.930740175s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................XX............................] duration:
5.936729697s
FAIL (2025-08-21 23:19:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.936754054s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......................................X...X........XX......] duration:
1.871459098s
FAIL (2025-08-21 23:19:32 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 23:15:31.385933556 (317h49m25.817013687s) [upload=330657]: Starting upload
Aug 21 23:15:31.385974795 (317h49m25.817054926s) [upload=330657]: Done starting upload
Aug 21 23:15:31.386029720 (317h49m25.817109851s) [upload=330657]: Uploading segments...
Aug 21 23:15:31.386080717 (317h49m25.817160858s) [upload=330657]: Got next segment. Inline: true
Aug 21 23:15:31.386086278 (317h49m25.817166399s) [upload=330657]: Waiting for error group managing segments...
Aug 21 23:15:31.386140312 (317h49m25.817220473s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 23:15:31.386147325 (317h49m25.817227466s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 23:15:31.386151864 (317h49m25.817231995s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 23:15:32.310207456 (317h49m26.741287587s) [upload=330657]: Done uploading segments...
Aug 21 23:15:32.310225530 (317h49m26.741305651s) [upload=330657]: Upload finished. err: <nil>
Duration: 1.871490779s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...................XX.X..............X...........X..........] duration:
6.143085304s
FAIL (2025-08-21 23:19:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.143111054s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................XX...........................] duration:
6.109818532s
FAIL (2025-08-21 23:19:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.109868978s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........................................X...X........XX.....] duration:
1.991323625s
FAIL (2025-08-21 23:19:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 23:15:31.385933556 (317h49m25.817013687s) [upload=330657]: Starting upload
Aug 21 23:15:31.385974795 (317h49m25.817054926s) [upload=330657]: Done starting upload
Aug 21 23:15:31.386029720 (317h49m25.817109851s) [upload=330657]: Uploading segments...
Aug 21 23:15:31.386080717 (317h49m25.817160858s) [upload=330657]: Got next segment. Inline: true
Aug 21 23:15:31.386086278 (317h49m25.817166399s) [upload=330657]: Waiting for error group managing segments...
Aug 21 23:15:31.386140312 (317h49m25.817220473s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 23:15:31.386147325 (317h49m25.817227466s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 23:15:31.386151864 (317h49m25.817231995s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 23:15:32.310207456 (317h49m26.741287587s) [upload=330657]: Done uploading segments...
Aug 21 23:15:32.310225530 (317h49m26.741305651s) [upload=330657]: Upload finished. err: <nil>
Duration: 1.991369753s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................XX..........................] duration:
6.211740497s
FAIL (2025-08-21 23:18:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.211789171s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........................................X...X........XX....] duration:
1.892554902s
FAIL (2025-08-21 23:18:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 23:15:31.385933556 (317h49m25.817013687s) [upload=330657]: Starting upload
Aug 21 23:15:31.385974795 (317h49m25.817054926s) [upload=330657]: Done starting upload
Aug 21 23:15:31.386029720 (317h49m25.817109851s) [upload=330657]: Uploading segments...
Aug 21 23:15:31.386080717 (317h49m25.817160858s) [upload=330657]: Got next segment. Inline: true
Aug 21 23:15:31.386086278 (317h49m25.817166399s) [upload=330657]: Waiting for error group managing segments...
Aug 21 23:15:31.386140312 (317h49m25.817220473s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 23:15:31.386147325 (317h49m25.817227466s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 23:15:31.386151864 (317h49m25.817231995s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 23:15:32.310207456 (317h49m26.741287587s) [upload=330657]: Done uploading segments...
Aug 21 23:15:32.310225530 (317h49m26.741305651s) [upload=330657]: Upload finished. err: <nil>
Duration: 1.892589048s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [....................XX.X..............X...........X.........] duration:
6.123934545s
FAIL (2025-08-21 23:18:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.123964141s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........................................X...X........XX...] duration:
2.132984613s
FAIL (2025-08-21 23:17:44 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 23:15:31.385933556 (317h49m25.817013687s) [upload=330657]: Starting upload
Aug 21 23:15:31.385974795 (317h49m25.817054926s) [upload=330657]: Done starting upload
Aug 21 23:15:31.386029720 (317h49m25.817109851s) [upload=330657]: Uploading segments...
Aug 21 23:15:31.386080717 (317h49m25.817160858s) [upload=330657]: Got next segment. Inline: true
Aug 21 23:15:31.386086278 (317h49m25.817166399s) [upload=330657]: Waiting for error group managing segments...
Aug 21 23:15:31.386140312 (317h49m25.817220473s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 23:15:31.386147325 (317h49m25.817227466s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 23:15:31.386151864 (317h49m25.817231995s) [upload=330657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 23:15:32.310207456 (317h49m26.741287587s) [upload=330657]: Done uploading segments...
Aug 21 23:15:32.310225530 (317h49m26.741305651s) [upload=330657]: Upload finished. err: <nil>
Duration: 2.133017216s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................XX.........................] duration:
6.072121031s
FAIL (2025-08-21 23:17:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.07214154s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....................XX.X..............X...........X........] duration:
5.918740574s
FAIL (2025-08-21 23:17:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.918765731s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|