Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 762640 reports (Page 12489 of 15253)
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration:
6.680567554s
FAIL (2025-08-19 11:33:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.680581682s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [...................X...................X..................X.]
duration:
2.026013267s
FAIL (2025-08-19 11:33:46 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:1024 (size:1024)
======LOGS======
Aug 19 11:32:45.191708118 (258h6m39.622788239s) [upload=268393]: Starting upload
Aug 19 11:32:45.191756440 (258h6m39.622836571s) [upload=268393]: Done starting upload
Aug 19 11:32:45.191820172 (258h6m39.622900293s) [upload=268393]: Uploading segments...
Aug 19 11:32:45.191863595 (258h6m39.622943726s) [upload=268393]: Got next segment. Inline: true
Aug 19 11:32:45.191867612 (258h6m39.622947743s) [upload=268393]: Waiting for error group managing segments...
Aug 19 11:32:45.191903131 (258h6m39.622983262s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:32:45.191907148 (258h6m39.622987279s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 11:32:45.191910104 (258h6m39.622990235s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:32:45.587982248 (258h6m40.019062379s) [upload=268393]: Done uploading segments...
Aug 19 11:32:45.588001634 (258h6m40.019081766s) [upload=268393]: Upload finished. err: <nil>
Duration: 2.026056591s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [................................X..X........................]
duration:
6.008455078s
FAIL (2025-08-19 11:33:42 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 11:13:02.350167148 (257h46m56.781247279s) [upload=268051]: Starting upload
Aug 19 11:13:02.350220850 (257h46m56.781300981s) [upload=268051]: Done starting upload
Aug 19 11:13:02.350300823 (257h46m56.781380964s) [upload=268051]: Uploading segments...
Aug 19 11:13:02.350427946 (257h46m56.781508087s) [upload=268051]: Got next segment. Inline: false
Aug 19 11:13:02.350462212 (257h46m56.781542343s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:13:02.350467132 (257h46m56.781547263s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:13:02.564249157 (257h46m56.995329288s) [upload=268051]: Next segment err: metaclient: Too Many Requests
Aug 19 11:13:02.564267602 (257h46m56.995347733s) [upload=268051]: Done uploading segments...
Aug 19 11:13:02.564303270 (257h46m56.995383401s) [upload=268051]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.008484624s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration:
6.703014943s
FAIL (2025-08-19 11:33:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.703036065s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [....................X...................X..................X]
duration:
1.727150738s
FAIL (2025-08-19 11:32:46 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:1024 (size:1024)
======LOGS======
Aug 19 11:32:45.191708118 (258h6m39.622788239s) [upload=268393]: Starting upload
Aug 19 11:32:45.191756440 (258h6m39.622836571s) [upload=268393]: Done starting upload
Aug 19 11:32:45.191820172 (258h6m39.622900293s) [upload=268393]: Uploading segments...
Aug 19 11:32:45.191863595 (258h6m39.622943726s) [upload=268393]: Got next segment. Inline: true
Aug 19 11:32:45.191867612 (258h6m39.622947743s) [upload=268393]: Waiting for error group managing segments...
Aug 19 11:32:45.191903131 (258h6m39.622983262s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:32:45.191907148 (258h6m39.622987279s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 11:32:45.191910104 (258h6m39.622990235s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:32:45.587982248 (258h6m40.019062379s) [upload=268393]: Done uploading segments...
Aug 19 11:32:45.588001634 (258h6m40.019081766s) [upload=268393]: Upload finished. err: <nil>
Duration: 1.727180985s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.................................X..X.......................]
duration:
6.146403153s
FAIL (2025-08-19 11:32:43 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 11:13:02.350167148 (257h46m56.781247279s) [upload=268051]: Starting upload
Aug 19 11:13:02.350220850 (257h46m56.781300981s) [upload=268051]: Done starting upload
Aug 19 11:13:02.350300823 (257h46m56.781380964s) [upload=268051]: Uploading segments...
Aug 19 11:13:02.350427946 (257h46m56.781508087s) [upload=268051]: Got next segment. Inline: false
Aug 19 11:13:02.350462212 (257h46m56.781542343s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:13:02.350467132 (257h46m56.781547263s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:13:02.564249157 (257h46m56.995329288s) [upload=268051]: Next segment err: metaclient: Too Many Requests
Aug 19 11:13:02.564267602 (257h46m56.995347733s) [upload=268051]: Done uploading segments...
Aug 19 11:13:02.564303270 (257h46m56.995383401s) [upload=268051]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.146440926s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................]
duration:
6.528135886s
FAIL (2025-08-19 11:32:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.528161256s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.....................X...................X..................]
duration:
2.172220955s
FAIL (2025-08-19 11:32:21 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 67b943f5649a2129dea514a0c5af761c2bbc1f24e33a4d7d5f2d767153f6bb32 != before 236da9d35508cbae7c8ee51e69768fac7af042114cf311586bfa69054cfaf7f1
======LOGS======
Aug 19 11:18:27.109409096 (257h52m21.540489228s) [upload=268147]: Starting upload
Aug 19 11:18:27.109479290 (257h52m21.540559421s) [upload=268147]: Done starting upload
Aug 19 11:18:27.109526902 (257h52m21.540607023s) [upload=268147]: Uploading segments...
Aug 19 11:18:27.109606564 (257h52m21.540686695s) [upload=268147]: Got next segment. Inline: true
Aug 19 11:18:27.109611193 (257h52m21.540691324s) [upload=268147]: Waiting for error group managing segments...
Aug 19 11:18:27.109651370 (257h52m21.540731501s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:18:27.109658113 (257h52m21.540738244s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 11:18:27.109662752 (257h52m21.540742883s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:18:27.397220851 (257h52m21.828300982s) [upload=268147]: Done uploading segments...
Aug 19 11:18:27.397246480 (257h52m21.828326611s) [upload=268147]: Upload finished. err: <nil>
Duration: 2.172251473s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..................................X..X......................]
duration:
5.790087208s
FAIL (2025-08-19 11:32:18 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 11:13:02.350167148 (257h46m56.781247279s) [upload=268051]: Starting upload
Aug 19 11:13:02.350220850 (257h46m56.781300981s) [upload=268051]: Done starting upload
Aug 19 11:13:02.350300823 (257h46m56.781380964s) [upload=268051]: Uploading segments...
Aug 19 11:13:02.350427946 (257h46m56.781508087s) [upload=268051]: Got next segment. Inline: false
Aug 19 11:13:02.350462212 (257h46m56.781542343s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:13:02.350467132 (257h46m56.781547263s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:13:02.564249157 (257h46m56.995329288s) [upload=268051]: Next segment err: metaclient: Too Many Requests
Aug 19 11:13:02.564267602 (257h46m56.995347733s) [upload=268051]: Done uploading segments...
Aug 19 11:13:02.564303270 (257h46m56.995383401s) [upload=268051]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.790109411s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [......................X...................X.................]
duration:
2.084830458s
FAIL (2025-08-19 11:31:46 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 67b943f5649a2129dea514a0c5af761c2bbc1f24e33a4d7d5f2d767153f6bb32 != before 236da9d35508cbae7c8ee51e69768fac7af042114cf311586bfa69054cfaf7f1
======LOGS======
Aug 19 11:18:27.109409096 (257h52m21.540489228s) [upload=268147]: Starting upload
Aug 19 11:18:27.109479290 (257h52m21.540559421s) [upload=268147]: Done starting upload
Aug 19 11:18:27.109526902 (257h52m21.540607023s) [upload=268147]: Uploading segments...
Aug 19 11:18:27.109606564 (257h52m21.540686695s) [upload=268147]: Got next segment. Inline: true
Aug 19 11:18:27.109611193 (257h52m21.540691324s) [upload=268147]: Waiting for error group managing segments...
Aug 19 11:18:27.109651370 (257h52m21.540731501s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:18:27.109658113 (257h52m21.540738244s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 11:18:27.109662752 (257h52m21.540742883s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:18:27.397220851 (257h52m21.828300982s) [upload=268147]: Done uploading segments...
Aug 19 11:18:27.397246480 (257h52m21.828326611s) [upload=268147]: Upload finished. err: <nil>
Duration: 2.084862419s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration:
6.688215415s
FAIL (2025-08-19 11:31:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.688257796s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration:
6.822050159s
FAIL (2025-08-19 11:31:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.822076619s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [...................................X..X.....................]
duration:
5.949673064s
FAIL (2025-08-19 11:31:05 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 11:13:02.350167148 (257h46m56.781247279s) [upload=268051]: Starting upload
Aug 19 11:13:02.350220850 (257h46m56.781300981s) [upload=268051]: Done starting upload
Aug 19 11:13:02.350300823 (257h46m56.781380964s) [upload=268051]: Uploading segments...
Aug 19 11:13:02.350427946 (257h46m56.781508087s) [upload=268051]: Got next segment. Inline: false
Aug 19 11:13:02.350462212 (257h46m56.781542343s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:13:02.350467132 (257h46m56.781547263s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:13:02.564249157 (257h46m56.995329288s) [upload=268051]: Next segment err: metaclient: Too Many Requests
Aug 19 11:13:02.564267602 (257h46m56.995347733s) [upload=268051]: Done uploading segments...
Aug 19 11:13:02.564303270 (257h46m56.995383401s) [upload=268051]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.949705514s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.......................X...................X................]
duration:
2.069701783s
FAIL (2025-08-19 11:30:51 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 67b943f5649a2129dea514a0c5af761c2bbc1f24e33a4d7d5f2d767153f6bb32 != before 236da9d35508cbae7c8ee51e69768fac7af042114cf311586bfa69054cfaf7f1
======LOGS======
Aug 19 11:18:27.109409096 (257h52m21.540489228s) [upload=268147]: Starting upload
Aug 19 11:18:27.109479290 (257h52m21.540559421s) [upload=268147]: Done starting upload
Aug 19 11:18:27.109526902 (257h52m21.540607023s) [upload=268147]: Uploading segments...
Aug 19 11:18:27.109606564 (257h52m21.540686695s) [upload=268147]: Got next segment. Inline: true
Aug 19 11:18:27.109611193 (257h52m21.540691324s) [upload=268147]: Waiting for error group managing segments...
Aug 19 11:18:27.109651370 (257h52m21.540731501s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:18:27.109658113 (257h52m21.540738244s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 11:18:27.109662752 (257h52m21.540742883s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:18:27.397220851 (257h52m21.828300982s) [upload=268147]: Done uploading segments...
Aug 19 11:18:27.397246480 (257h52m21.828326611s) [upload=268147]: Upload finished. err: <nil>
Duration: 2.069734556s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [....................................X..X....................]
duration:
6.046012042s
FAIL (2025-08-19 11:30:30 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 11:13:02.350167148 (257h46m56.781247279s) [upload=268051]: Starting upload
Aug 19 11:13:02.350220850 (257h46m56.781300981s) [upload=268051]: Done starting upload
Aug 19 11:13:02.350300823 (257h46m56.781380964s) [upload=268051]: Uploading segments...
Aug 19 11:13:02.350427946 (257h46m56.781508087s) [upload=268051]: Got next segment. Inline: false
Aug 19 11:13:02.350462212 (257h46m56.781542343s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:13:02.350467132 (257h46m56.781547263s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:13:02.564249157 (257h46m56.995329288s) [upload=268051]: Next segment err: metaclient: Too Many Requests
Aug 19 11:13:02.564267602 (257h46m56.995347733s) [upload=268051]: Done uploading segments...
Aug 19 11:13:02.564303270 (257h46m56.995383401s) [upload=268051]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.046036399s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................]
duration:
6.377650096s
FAIL (2025-08-19 11:30:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.377670705s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [........................X...................X...............]
duration:
2.180229099s
FAIL (2025-08-19 11:30:11 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 67b943f5649a2129dea514a0c5af761c2bbc1f24e33a4d7d5f2d767153f6bb32 != before 236da9d35508cbae7c8ee51e69768fac7af042114cf311586bfa69054cfaf7f1
======LOGS======
Aug 19 11:18:27.109409096 (257h52m21.540489228s) [upload=268147]: Starting upload
Aug 19 11:18:27.109479290 (257h52m21.540559421s) [upload=268147]: Done starting upload
Aug 19 11:18:27.109526902 (257h52m21.540607023s) [upload=268147]: Uploading segments...
Aug 19 11:18:27.109606564 (257h52m21.540686695s) [upload=268147]: Got next segment. Inline: true
Aug 19 11:18:27.109611193 (257h52m21.540691324s) [upload=268147]: Waiting for error group managing segments...
Aug 19 11:18:27.109651370 (257h52m21.540731501s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:18:27.109658113 (257h52m21.540738244s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 11:18:27.109662752 (257h52m21.540742883s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:18:27.397220851 (257h52m21.828300982s) [upload=268147]: Done uploading segments...
Aug 19 11:18:27.397246480 (257h52m21.828326611s) [upload=268147]: Upload finished. err: <nil>
Duration: 2.180252884s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................]
duration:
6.762414801s
FAIL (2025-08-19 11:30:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.762440712s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.....................................X..X...................]
duration:
5.748564979s
FAIL (2025-08-19 11:29:45 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 11:13:02.350167148 (257h46m56.781247279s) [upload=268051]: Starting upload
Aug 19 11:13:02.350220850 (257h46m56.781300981s) [upload=268051]: Done starting upload
Aug 19 11:13:02.350300823 (257h46m56.781380964s) [upload=268051]: Uploading segments...
Aug 19 11:13:02.350427946 (257h46m56.781508087s) [upload=268051]: Got next segment. Inline: false
Aug 19 11:13:02.350462212 (257h46m56.781542343s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:13:02.350467132 (257h46m56.781547263s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:13:02.564249157 (257h46m56.995329288s) [upload=268051]: Next segment err: metaclient: Too Many Requests
Aug 19 11:13:02.564267602 (257h46m56.995347733s) [upload=268051]: Done uploading segments...
Aug 19 11:13:02.564303270 (257h46m56.995383401s) [upload=268051]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.748591439s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [X........................X...................X..............]
duration:
2.121289882s
FAIL (2025-08-19 11:28:57 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 67b943f5649a2129dea514a0c5af761c2bbc1f24e33a4d7d5f2d767153f6bb32 != before 236da9d35508cbae7c8ee51e69768fac7af042114cf311586bfa69054cfaf7f1
======LOGS======
Aug 19 11:18:27.109409096 (257h52m21.540489228s) [upload=268147]: Starting upload
Aug 19 11:18:27.109479290 (257h52m21.540559421s) [upload=268147]: Done starting upload
Aug 19 11:18:27.109526902 (257h52m21.540607023s) [upload=268147]: Uploading segments...
Aug 19 11:18:27.109606564 (257h52m21.540686695s) [upload=268147]: Got next segment. Inline: true
Aug 19 11:18:27.109611193 (257h52m21.540691324s) [upload=268147]: Waiting for error group managing segments...
Aug 19 11:18:27.109651370 (257h52m21.540731501s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:18:27.109658113 (257h52m21.540738244s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 11:18:27.109662752 (257h52m21.540742883s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:18:27.397220851 (257h52m21.828300982s) [upload=268147]: Done uploading segments...
Aug 19 11:18:27.397246480 (257h52m21.828326611s) [upload=268147]: Upload finished. err: <nil>
Duration: 2.121329527s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................]
duration:
6.461566903s
FAIL (2025-08-19 11:28:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.461586521s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................]
duration:
6.83222529s
FAIL (2025-08-19 11:28:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.832245459s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [......................................X..X..................]
duration:
5.978142009s
FAIL (2025-08-19 11:28:32 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 11:13:02.350167148 (257h46m56.781247279s) [upload=268051]: Starting upload
Aug 19 11:13:02.350220850 (257h46m56.781300981s) [upload=268051]: Done starting upload
Aug 19 11:13:02.350300823 (257h46m56.781380964s) [upload=268051]: Uploading segments...
Aug 19 11:13:02.350427946 (257h46m56.781508087s) [upload=268051]: Got next segment. Inline: false
Aug 19 11:13:02.350462212 (257h46m56.781542343s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:13:02.350467132 (257h46m56.781547263s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:13:02.564249157 (257h46m56.995329288s) [upload=268051]: Next segment err: metaclient: Too Many Requests
Aug 19 11:13:02.564267602 (257h46m56.995347733s) [upload=268051]: Done uploading segments...
Aug 19 11:13:02.564303270 (257h46m56.995383401s) [upload=268051]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.978171083s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
3 out of 60 is failed (threshold=3) [X......................................X..X.................]
duration:
6.027285437s
FAIL (2025-08-19 11:28:09 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 11:13:02.350167148 (257h46m56.781247279s) [upload=268051]: Starting upload
Aug 19 11:13:02.350220850 (257h46m56.781300981s) [upload=268051]: Done starting upload
Aug 19 11:13:02.350300823 (257h46m56.781380964s) [upload=268051]: Uploading segments...
Aug 19 11:13:02.350427946 (257h46m56.781508087s) [upload=268051]: Got next segment. Inline: false
Aug 19 11:13:02.350462212 (257h46m56.781542343s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:13:02.350467132 (257h46m56.781547263s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:13:02.564249157 (257h46m56.995329288s) [upload=268051]: Next segment err: metaclient: Too Many Requests
Aug 19 11:13:02.564267602 (257h46m56.995347733s) [upload=268051]: Done uploading segments...
Aug 19 11:13:02.564303270 (257h46m56.995383401s) [upload=268051]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.027310695s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [.X........................X...................X.............]
duration:
1.833272393s
FAIL (2025-08-19 11:28:08 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 67b943f5649a2129dea514a0c5af761c2bbc1f24e33a4d7d5f2d767153f6bb32 != before 236da9d35508cbae7c8ee51e69768fac7af042114cf311586bfa69054cfaf7f1
======LOGS======
Aug 19 11:18:27.109409096 (257h52m21.540489228s) [upload=268147]: Starting upload
Aug 19 11:18:27.109479290 (257h52m21.540559421s) [upload=268147]: Done starting upload
Aug 19 11:18:27.109526902 (257h52m21.540607023s) [upload=268147]: Uploading segments...
Aug 19 11:18:27.109606564 (257h52m21.540686695s) [upload=268147]: Got next segment. Inline: true
Aug 19 11:18:27.109611193 (257h52m21.540691324s) [upload=268147]: Waiting for error group managing segments...
Aug 19 11:18:27.109651370 (257h52m21.540731501s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:18:27.109658113 (257h52m21.540738244s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 11:18:27.109662752 (257h52m21.540742883s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:18:27.397220851 (257h52m21.828300982s) [upload=268147]: Done uploading segments...
Aug 19 11:18:27.397246480 (257h52m21.828326611s) [upload=268147]: Upload finished. err: <nil>
Duration: 1.833362105s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................]
duration:
6.32657169s
FAIL (2025-08-19 11:27:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.326596246s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
3 out of 60 is failed (threshold=3) [.X......................................X..X................]
duration:
5.93620294s
FAIL (2025-08-19 11:27:15 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 11:13:02.350167148 (257h46m56.781247279s) [upload=268051]: Starting upload
Aug 19 11:13:02.350220850 (257h46m56.781300981s) [upload=268051]: Done starting upload
Aug 19 11:13:02.350300823 (257h46m56.781380964s) [upload=268051]: Uploading segments...
Aug 19 11:13:02.350427946 (257h46m56.781508087s) [upload=268051]: Got next segment. Inline: false
Aug 19 11:13:02.350462212 (257h46m56.781542343s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:13:02.350467132 (257h46m56.781547263s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:13:02.564249157 (257h46m56.995329288s) [upload=268051]: Next segment err: metaclient: Too Many Requests
Aug 19 11:13:02.564267602 (257h46m56.995347733s) [upload=268051]: Done uploading segments...
Aug 19 11:13:02.564303270 (257h46m56.995383401s) [upload=268051]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.936233246s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................]
duration:
6.865936171s
FAIL (2025-08-19 11:27:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.865959366s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [..X........................X...................X............]
duration:
2.046366381s
FAIL (2025-08-19 11:26:56 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 67b943f5649a2129dea514a0c5af761c2bbc1f24e33a4d7d5f2d767153f6bb32 != before 236da9d35508cbae7c8ee51e69768fac7af042114cf311586bfa69054cfaf7f1
======LOGS======
Aug 19 11:18:27.109409096 (257h52m21.540489228s) [upload=268147]: Starting upload
Aug 19 11:18:27.109479290 (257h52m21.540559421s) [upload=268147]: Done starting upload
Aug 19 11:18:27.109526902 (257h52m21.540607023s) [upload=268147]: Uploading segments...
Aug 19 11:18:27.109606564 (257h52m21.540686695s) [upload=268147]: Got next segment. Inline: true
Aug 19 11:18:27.109611193 (257h52m21.540691324s) [upload=268147]: Waiting for error group managing segments...
Aug 19 11:18:27.109651370 (257h52m21.540731501s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:18:27.109658113 (257h52m21.540738244s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 11:18:27.109662752 (257h52m21.540742883s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:18:27.397220851 (257h52m21.828300982s) [upload=268147]: Done uploading segments...
Aug 19 11:18:27.397246480 (257h52m21.828326611s) [upload=268147]: Upload finished. err: <nil>
Duration: 2.046389906s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................]
duration:
6.082911725s
FAIL (2025-08-19 11:26:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.082937515s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [...X........................X...................X...........]
duration:
1.850006272s
FAIL (2025-08-19 11:26:20 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 67b943f5649a2129dea514a0c5af761c2bbc1f24e33a4d7d5f2d767153f6bb32 != before 236da9d35508cbae7c8ee51e69768fac7af042114cf311586bfa69054cfaf7f1
======LOGS======
Aug 19 11:18:27.109409096 (257h52m21.540489228s) [upload=268147]: Starting upload
Aug 19 11:18:27.109479290 (257h52m21.540559421s) [upload=268147]: Done starting upload
Aug 19 11:18:27.109526902 (257h52m21.540607023s) [upload=268147]: Uploading segments...
Aug 19 11:18:27.109606564 (257h52m21.540686695s) [upload=268147]: Got next segment. Inline: true
Aug 19 11:18:27.109611193 (257h52m21.540691324s) [upload=268147]: Waiting for error group managing segments...
Aug 19 11:18:27.109651370 (257h52m21.540731501s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:18:27.109658113 (257h52m21.540738244s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 11:18:27.109662752 (257h52m21.540742883s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:18:27.397220851 (257h52m21.828300982s) [upload=268147]: Done uploading segments...
Aug 19 11:18:27.397246480 (257h52m21.828326611s) [upload=268147]: Upload finished. err: <nil>
Duration: 1.850027432s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
3 out of 60 is failed (threshold=3) [..X......................................X..X...............]
duration:
6.036771689s
FAIL (2025-08-19 11:26:17 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 11:13:02.350167148 (257h46m56.781247279s) [upload=268051]: Starting upload
Aug 19 11:13:02.350220850 (257h46m56.781300981s) [upload=268051]: Done starting upload
Aug 19 11:13:02.350300823 (257h46m56.781380964s) [upload=268051]: Uploading segments...
Aug 19 11:13:02.350427946 (257h46m56.781508087s) [upload=268051]: Got next segment. Inline: false
Aug 19 11:13:02.350462212 (257h46m56.781542343s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:13:02.350467132 (257h46m56.781547263s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:13:02.564249157 (257h46m56.995329288s) [upload=268051]: Next segment err: metaclient: Too Many Requests
Aug 19 11:13:02.564267602 (257h46m56.995347733s) [upload=268051]: Done uploading segments...
Aug 19 11:13:02.564303270 (257h46m56.995383401s) [upload=268051]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.036796597s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration:
6.567826062s
FAIL (2025-08-19 11:25:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.567844577s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [....X........................X...................X..........]
duration:
1.979991549s
FAIL (2025-08-19 11:25:22 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 67b943f5649a2129dea514a0c5af761c2bbc1f24e33a4d7d5f2d767153f6bb32 != before 236da9d35508cbae7c8ee51e69768fac7af042114cf311586bfa69054cfaf7f1
======LOGS======
Aug 19 11:18:27.109409096 (257h52m21.540489228s) [upload=268147]: Starting upload
Aug 19 11:18:27.109479290 (257h52m21.540559421s) [upload=268147]: Done starting upload
Aug 19 11:18:27.109526902 (257h52m21.540607023s) [upload=268147]: Uploading segments...
Aug 19 11:18:27.109606564 (257h52m21.540686695s) [upload=268147]: Got next segment. Inline: true
Aug 19 11:18:27.109611193 (257h52m21.540691324s) [upload=268147]: Waiting for error group managing segments...
Aug 19 11:18:27.109651370 (257h52m21.540731501s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:18:27.109658113 (257h52m21.540738244s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 11:18:27.109662752 (257h52m21.540742883s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:18:27.397220851 (257h52m21.828300982s) [upload=268147]: Done uploading segments...
Aug 19 11:18:27.397246480 (257h52m21.828326611s) [upload=268147]: Upload finished. err: <nil>
Duration: 1.980027397s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
3 out of 60 is failed (threshold=3) [...X......................................X..X..............]
duration:
5.709246498s
FAIL (2025-08-19 11:25:15 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 11:13:02.350167148 (257h46m56.781247279s) [upload=268051]: Starting upload
Aug 19 11:13:02.350220850 (257h46m56.781300981s) [upload=268051]: Done starting upload
Aug 19 11:13:02.350300823 (257h46m56.781380964s) [upload=268051]: Uploading segments...
Aug 19 11:13:02.350427946 (257h46m56.781508087s) [upload=268051]: Got next segment. Inline: false
Aug 19 11:13:02.350462212 (257h46m56.781542343s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:13:02.350467132 (257h46m56.781547263s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:13:02.564249157 (257h46m56.995329288s) [upload=268051]: Next segment err: metaclient: Too Many Requests
Aug 19 11:13:02.564267602 (257h46m56.995347733s) [upload=268051]: Done uploading segments...
Aug 19 11:13:02.564303270 (257h46m56.995383401s) [upload=268051]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.70927795s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration:
6.3162458s
FAIL (2025-08-19 11:24:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.316262031s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [.....X........................X...................X.........]
duration:
1.924254828s
FAIL (2025-08-19 11:24:43 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 67b943f5649a2129dea514a0c5af761c2bbc1f24e33a4d7d5f2d767153f6bb32 != before 236da9d35508cbae7c8ee51e69768fac7af042114cf311586bfa69054cfaf7f1
======LOGS======
Aug 19 11:18:27.109409096 (257h52m21.540489228s) [upload=268147]: Starting upload
Aug 19 11:18:27.109479290 (257h52m21.540559421s) [upload=268147]: Done starting upload
Aug 19 11:18:27.109526902 (257h52m21.540607023s) [upload=268147]: Uploading segments...
Aug 19 11:18:27.109606564 (257h52m21.540686695s) [upload=268147]: Got next segment. Inline: true
Aug 19 11:18:27.109611193 (257h52m21.540691324s) [upload=268147]: Waiting for error group managing segments...
Aug 19 11:18:27.109651370 (257h52m21.540731501s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:18:27.109658113 (257h52m21.540738244s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 11:18:27.109662752 (257h52m21.540742883s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:18:27.397220851 (257h52m21.828300982s) [upload=268147]: Done uploading segments...
Aug 19 11:18:27.397246480 (257h52m21.828326611s) [upload=268147]: Upload finished. err: <nil>
Duration: 1.924280018s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................]
duration:
6.766764684s
FAIL (2025-08-19 11:24:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.766786115s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [......X........................X...................X........]
duration:
1.841105922s
FAIL (2025-08-19 11:24:28 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 67b943f5649a2129dea514a0c5af761c2bbc1f24e33a4d7d5f2d767153f6bb32 != before 236da9d35508cbae7c8ee51e69768fac7af042114cf311586bfa69054cfaf7f1
======LOGS======
Aug 19 11:18:27.109409096 (257h52m21.540489228s) [upload=268147]: Starting upload
Aug 19 11:18:27.109479290 (257h52m21.540559421s) [upload=268147]: Done starting upload
Aug 19 11:18:27.109526902 (257h52m21.540607023s) [upload=268147]: Uploading segments...
Aug 19 11:18:27.109606564 (257h52m21.540686695s) [upload=268147]: Got next segment. Inline: true
Aug 19 11:18:27.109611193 (257h52m21.540691324s) [upload=268147]: Waiting for error group managing segments...
Aug 19 11:18:27.109651370 (257h52m21.540731501s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:18:27.109658113 (257h52m21.540738244s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 11:18:27.109662752 (257h52m21.540742883s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:18:27.397220851 (257h52m21.828300982s) [upload=268147]: Done uploading segments...
Aug 19 11:18:27.397246480 (257h52m21.828326611s) [upload=268147]: Upload finished. err: <nil>
Duration: 1.841129548s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
3 out of 60 is failed (threshold=3) [....X......................................X..X.............]
duration:
6.010137408s
FAIL (2025-08-19 11:24:10 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 11:13:02.350167148 (257h46m56.781247279s) [upload=268051]: Starting upload
Aug 19 11:13:02.350220850 (257h46m56.781300981s) [upload=268051]: Done starting upload
Aug 19 11:13:02.350300823 (257h46m56.781380964s) [upload=268051]: Uploading segments...
Aug 19 11:13:02.350427946 (257h46m56.781508087s) [upload=268051]: Got next segment. Inline: false
Aug 19 11:13:02.350462212 (257h46m56.781542343s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:13:02.350467132 (257h46m56.781547263s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:13:02.564249157 (257h46m56.995329288s) [upload=268051]: Next segment err: metaclient: Too Many Requests
Aug 19 11:13:02.564267602 (257h46m56.995347733s) [upload=268051]: Done uploading segments...
Aug 19 11:13:02.564303270 (257h46m56.995383401s) [upload=268051]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.010161044s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................]
duration:
6.596791413s
FAIL (2025-08-19 11:23:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.596833655s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [.......X........................X...................X.......]
duration:
1.836174075s
FAIL (2025-08-19 11:23:43 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 67b943f5649a2129dea514a0c5af761c2bbc1f24e33a4d7d5f2d767153f6bb32 != before 236da9d35508cbae7c8ee51e69768fac7af042114cf311586bfa69054cfaf7f1
======LOGS======
Aug 19 11:18:27.109409096 (257h52m21.540489228s) [upload=268147]: Starting upload
Aug 19 11:18:27.109479290 (257h52m21.540559421s) [upload=268147]: Done starting upload
Aug 19 11:18:27.109526902 (257h52m21.540607023s) [upload=268147]: Uploading segments...
Aug 19 11:18:27.109606564 (257h52m21.540686695s) [upload=268147]: Got next segment. Inline: true
Aug 19 11:18:27.109611193 (257h52m21.540691324s) [upload=268147]: Waiting for error group managing segments...
Aug 19 11:18:27.109651370 (257h52m21.540731501s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:18:27.109658113 (257h52m21.540738244s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 11:18:27.109662752 (257h52m21.540742883s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:18:27.397220851 (257h52m21.828300982s) [upload=268147]: Done uploading segments...
Aug 19 11:18:27.397246480 (257h52m21.828326611s) [upload=268147]: Upload finished. err: <nil>
Duration: 1.836202398s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [X.......X........................X...................X......]
duration:
1.818048993s
FAIL (2025-08-19 11:23:19 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 67b943f5649a2129dea514a0c5af761c2bbc1f24e33a4d7d5f2d767153f6bb32 != before 236da9d35508cbae7c8ee51e69768fac7af042114cf311586bfa69054cfaf7f1
======LOGS======
Aug 19 11:18:27.109409096 (257h52m21.540489228s) [upload=268147]: Starting upload
Aug 19 11:18:27.109479290 (257h52m21.540559421s) [upload=268147]: Done starting upload
Aug 19 11:18:27.109526902 (257h52m21.540607023s) [upload=268147]: Uploading segments...
Aug 19 11:18:27.109606564 (257h52m21.540686695s) [upload=268147]: Got next segment. Inline: true
Aug 19 11:18:27.109611193 (257h52m21.540691324s) [upload=268147]: Waiting for error group managing segments...
Aug 19 11:18:27.109651370 (257h52m21.540731501s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:18:27.109658113 (257h52m21.540738244s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 11:18:27.109662752 (257h52m21.540742883s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:18:27.397220851 (257h52m21.828300982s) [upload=268147]: Done uploading segments...
Aug 19 11:18:27.397246480 (257h52m21.828326611s) [upload=268147]: Upload finished. err: <nil>
Duration: 1.818074643s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
3 out of 60 is failed (threshold=3) [.....X......................................X..X............]
duration:
5.931287206s
FAIL (2025-08-19 11:23:01 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 11:13:02.350167148 (257h46m56.781247279s) [upload=268051]: Starting upload
Aug 19 11:13:02.350220850 (257h46m56.781300981s) [upload=268051]: Done starting upload
Aug 19 11:13:02.350300823 (257h46m56.781380964s) [upload=268051]: Uploading segments...
Aug 19 11:13:02.350427946 (257h46m56.781508087s) [upload=268051]: Got next segment. Inline: false
Aug 19 11:13:02.350462212 (257h46m56.781542343s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:13:02.350467132 (257h46m56.781547263s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:13:02.564249157 (257h46m56.995329288s) [upload=268051]: Next segment err: metaclient: Too Many Requests
Aug 19 11:13:02.564267602 (257h46m56.995347733s) [upload=268051]: Done uploading segments...
Aug 19 11:13:02.564303270 (257h46m56.995383401s) [upload=268051]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.931317464s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [.X.......X........................X...................X.....]
duration:
2.035380923s
FAIL (2025-08-19 11:22:47 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 67b943f5649a2129dea514a0c5af761c2bbc1f24e33a4d7d5f2d767153f6bb32 != before 236da9d35508cbae7c8ee51e69768fac7af042114cf311586bfa69054cfaf7f1
======LOGS======
Aug 19 11:18:27.109409096 (257h52m21.540489228s) [upload=268147]: Starting upload
Aug 19 11:18:27.109479290 (257h52m21.540559421s) [upload=268147]: Done starting upload
Aug 19 11:18:27.109526902 (257h52m21.540607023s) [upload=268147]: Uploading segments...
Aug 19 11:18:27.109606564 (257h52m21.540686695s) [upload=268147]: Got next segment. Inline: true
Aug 19 11:18:27.109611193 (257h52m21.540691324s) [upload=268147]: Waiting for error group managing segments...
Aug 19 11:18:27.109651370 (257h52m21.540731501s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:18:27.109658113 (257h52m21.540738244s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 11:18:27.109662752 (257h52m21.540742883s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:18:27.397220851 (257h52m21.828300982s) [upload=268147]: Done uploading segments...
Aug 19 11:18:27.397246480 (257h52m21.828326611s) [upload=268147]: Upload finished. err: <nil>
Duration: 2.035413035s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................]
duration:
6.384480587s
FAIL (2025-08-19 11:22:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.384502529s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
3 out of 60 is failed (threshold=3) [......X......................................X..X...........]
duration:
5.888912173s
FAIL (2025-08-19 11:22:11 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 11:13:02.350167148 (257h46m56.781247279s) [upload=268051]: Starting upload
Aug 19 11:13:02.350220850 (257h46m56.781300981s) [upload=268051]: Done starting upload
Aug 19 11:13:02.350300823 (257h46m56.781380964s) [upload=268051]: Uploading segments...
Aug 19 11:13:02.350427946 (257h46m56.781508087s) [upload=268051]: Got next segment. Inline: false
Aug 19 11:13:02.350462212 (257h46m56.781542343s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:13:02.350467132 (257h46m56.781547263s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:13:02.564249157 (257h46m56.995329288s) [upload=268051]: Next segment err: metaclient: Too Many Requests
Aug 19 11:13:02.564267602 (257h46m56.995347733s) [upload=268051]: Done uploading segments...
Aug 19 11:13:02.564303270 (257h46m56.995383401s) [upload=268051]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.888939387s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [..X.......X........................X...................X....]
duration:
1.95900253s
FAIL (2025-08-19 11:22:02 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 67b943f5649a2129dea514a0c5af761c2bbc1f24e33a4d7d5f2d767153f6bb32 != before 236da9d35508cbae7c8ee51e69768fac7af042114cf311586bfa69054cfaf7f1
======LOGS======
Aug 19 11:18:27.109409096 (257h52m21.540489228s) [upload=268147]: Starting upload
Aug 19 11:18:27.109479290 (257h52m21.540559421s) [upload=268147]: Done starting upload
Aug 19 11:18:27.109526902 (257h52m21.540607023s) [upload=268147]: Uploading segments...
Aug 19 11:18:27.109606564 (257h52m21.540686695s) [upload=268147]: Got next segment. Inline: true
Aug 19 11:18:27.109611193 (257h52m21.540691324s) [upload=268147]: Waiting for error group managing segments...
Aug 19 11:18:27.109651370 (257h52m21.540731501s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:18:27.109658113 (257h52m21.540738244s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 11:18:27.109662752 (257h52m21.540742883s) [upload=268147]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:18:27.397220851 (257h52m21.828300982s) [upload=268147]: Done uploading segments...
Aug 19 11:18:27.397246480 (257h52m21.828326611s) [upload=268147]: Upload finished. err: <nil>
Duration: 1.95902937s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
3 out of 60 is failed (threshold=3) [.......X......................................X..X..........]
duration:
5.924237618s
FAIL (2025-08-19 11:21:43 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 11:13:02.350167148 (257h46m56.781247279s) [upload=268051]: Starting upload
Aug 19 11:13:02.350220850 (257h46m56.781300981s) [upload=268051]: Done starting upload
Aug 19 11:13:02.350300823 (257h46m56.781380964s) [upload=268051]: Uploading segments...
Aug 19 11:13:02.350427946 (257h46m56.781508087s) [upload=268051]: Got next segment. Inline: false
Aug 19 11:13:02.350462212 (257h46m56.781542343s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:13:02.350467132 (257h46m56.781547263s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:13:02.564249157 (257h46m56.995329288s) [upload=268051]: Next segment err: metaclient: Too Many Requests
Aug 19 11:13:02.564267602 (257h46m56.995347733s) [upload=268051]: Done uploading segments...
Aug 19 11:13:02.564303270 (257h46m56.995383401s) [upload=268051]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.924256194s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................]
duration:
6.408354528s
FAIL (2025-08-19 11:21:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.408375958s core uplink us-select-1 us1-placement-20