Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............X...........X...X...........X................] duration:
1.82775462s
FAIL (2025-08-24 12:22:03 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 24 12:09:31.043599391 (378h43m25.474679522s) [upload=393986]: Starting upload
Aug 24 12:09:31.043636922 (378h43m25.474717053s) [upload=393986]: Done starting upload
Aug 24 12:09:31.043683572 (378h43m25.474763703s) [upload=393986]: Uploading segments...
Aug 24 12:09:31.043715343 (378h43m25.474795474s) [upload=393986]: Got next segment. Inline: true
Aug 24 12:09:31.043718719 (378h43m25.47479885s) [upload=393986]: Waiting for error group managing segments...
Aug 24 12:09:31.043750660 (378h43m25.474830791s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 12:09:31.043754688 (378h43m25.474834819s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 24 12:09:31.043757093 (378h43m25.474837224s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 12:09:31.311367440 (378h43m25.742447571s) [upload=393986]: Done uploading segments...
Aug 24 12:09:31.311385405 (378h43m25.742465536s) [upload=393986]: Upload finished. err: <nil>
Duration: 1.827782004s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X................X.........X...........................] duration:
5.840666691s
FAIL (2025-08-24 12:21:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.840685728s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................X...........X...X...........X...............] duration:
1.850173567s
FAIL (2025-08-24 12:21:34 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 24 12:09:31.043599391 (378h43m25.474679522s) [upload=393986]: Starting upload
Aug 24 12:09:31.043636922 (378h43m25.474717053s) [upload=393986]: Done starting upload
Aug 24 12:09:31.043683572 (378h43m25.474763703s) [upload=393986]: Uploading segments...
Aug 24 12:09:31.043715343 (378h43m25.474795474s) [upload=393986]: Got next segment. Inline: true
Aug 24 12:09:31.043718719 (378h43m25.47479885s) [upload=393986]: Waiting for error group managing segments...
Aug 24 12:09:31.043750660 (378h43m25.474830791s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 12:09:31.043754688 (378h43m25.474834819s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 24 12:09:31.043757093 (378h43m25.474837224s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 12:09:31.311367440 (378h43m25.742447571s) [upload=393986]: Done uploading segments...
Aug 24 12:09:31.311385405 (378h43m25.742465536s) [upload=393986]: Upload finished. err: <nil>
Duration: 1.850203625s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.................X...........X...X...........X..............] duration:
2.060123048s
FAIL (2025-08-24 12:20:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 24 12:09:31.043599391 (378h43m25.474679522s) [upload=393986]: Starting upload
Aug 24 12:09:31.043636922 (378h43m25.474717053s) [upload=393986]: Done starting upload
Aug 24 12:09:31.043683572 (378h43m25.474763703s) [upload=393986]: Uploading segments...
Aug 24 12:09:31.043715343 (378h43m25.474795474s) [upload=393986]: Got next segment. Inline: true
Aug 24 12:09:31.043718719 (378h43m25.47479885s) [upload=393986]: Waiting for error group managing segments...
Aug 24 12:09:31.043750660 (378h43m25.474830791s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 12:09:31.043754688 (378h43m25.474834819s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 24 12:09:31.043757093 (378h43m25.474837224s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 12:09:31.311367440 (378h43m25.742447571s) [upload=393986]: Done uploading segments...
Aug 24 12:09:31.311385405 (378h43m25.742465536s) [upload=393986]: Upload finished. err: <nil>
Duration: 2.060199183s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X................X.........X..........................] duration:
5.83034923s
FAIL (2025-08-24 12:20:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.830375629s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X................X.........X.........................] duration:
5.659649291s
FAIL (2025-08-24 12:19:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.659674048s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..................X...........X...X...........X.............] duration:
2.080871177s
FAIL (2025-08-24 12:19:41 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 24 12:09:31.043599391 (378h43m25.474679522s) [upload=393986]: Starting upload
Aug 24 12:09:31.043636922 (378h43m25.474717053s) [upload=393986]: Done starting upload
Aug 24 12:09:31.043683572 (378h43m25.474763703s) [upload=393986]: Uploading segments...
Aug 24 12:09:31.043715343 (378h43m25.474795474s) [upload=393986]: Got next segment. Inline: true
Aug 24 12:09:31.043718719 (378h43m25.47479885s) [upload=393986]: Waiting for error group managing segments...
Aug 24 12:09:31.043750660 (378h43m25.474830791s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 12:09:31.043754688 (378h43m25.474834819s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 24 12:09:31.043757093 (378h43m25.474837224s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 12:09:31.311367440 (378h43m25.742447571s) [upload=393986]: Done uploading segments...
Aug 24 12:09:31.311385405 (378h43m25.742465536s) [upload=393986]: Upload finished. err: <nil>
Duration: 2.080896916s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X................X.........X........................] duration:
5.799116216s
FAIL (2025-08-24 12:19:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.799142305s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...................X...........X...X...........X............] duration:
1.815615886s
FAIL (2025-08-24 12:18:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 24 12:09:31.043599391 (378h43m25.474679522s) [upload=393986]: Starting upload
Aug 24 12:09:31.043636922 (378h43m25.474717053s) [upload=393986]: Done starting upload
Aug 24 12:09:31.043683572 (378h43m25.474763703s) [upload=393986]: Uploading segments...
Aug 24 12:09:31.043715343 (378h43m25.474795474s) [upload=393986]: Got next segment. Inline: true
Aug 24 12:09:31.043718719 (378h43m25.47479885s) [upload=393986]: Waiting for error group managing segments...
Aug 24 12:09:31.043750660 (378h43m25.474830791s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 12:09:31.043754688 (378h43m25.474834819s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 24 12:09:31.043757093 (378h43m25.474837224s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 12:09:31.311367440 (378h43m25.742447571s) [upload=393986]: Done uploading segments...
Aug 24 12:09:31.311385405 (378h43m25.742465536s) [upload=393986]: Upload finished. err: <nil>
Duration: 1.81563965s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....................X...........X...X...........X...........] duration:
1.829083234s
FAIL (2025-08-24 12:18:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 24 12:09:31.043599391 (378h43m25.474679522s) [upload=393986]: Starting upload
Aug 24 12:09:31.043636922 (378h43m25.474717053s) [upload=393986]: Done starting upload
Aug 24 12:09:31.043683572 (378h43m25.474763703s) [upload=393986]: Uploading segments...
Aug 24 12:09:31.043715343 (378h43m25.474795474s) [upload=393986]: Got next segment. Inline: true
Aug 24 12:09:31.043718719 (378h43m25.47479885s) [upload=393986]: Waiting for error group managing segments...
Aug 24 12:09:31.043750660 (378h43m25.474830791s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 12:09:31.043754688 (378h43m25.474834819s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 24 12:09:31.043757093 (378h43m25.474837224s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 12:09:31.311367440 (378h43m25.742447571s) [upload=393986]: Done uploading segments...
Aug 24 12:09:31.311385405 (378h43m25.742465536s) [upload=393986]: Upload finished. err: <nil>
Duration: 1.829109274s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X................X.........X.......................] duration:
5.891816252s
FAIL (2025-08-24 12:18:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.891852853s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....................X...........X...X...........X..........] duration:
1.823134681s
FAIL (2025-08-24 12:17:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 24 12:09:31.043599391 (378h43m25.474679522s) [upload=393986]: Starting upload
Aug 24 12:09:31.043636922 (378h43m25.474717053s) [upload=393986]: Done starting upload
Aug 24 12:09:31.043683572 (378h43m25.474763703s) [upload=393986]: Uploading segments...
Aug 24 12:09:31.043715343 (378h43m25.474795474s) [upload=393986]: Got next segment. Inline: true
Aug 24 12:09:31.043718719 (378h43m25.47479885s) [upload=393986]: Waiting for error group managing segments...
Aug 24 12:09:31.043750660 (378h43m25.474830791s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 12:09:31.043754688 (378h43m25.474834819s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 24 12:09:31.043757093 (378h43m25.474837224s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 12:09:31.311367440 (378h43m25.742447571s) [upload=393986]: Done uploading segments...
Aug 24 12:09:31.311385405 (378h43m25.742465536s) [upload=393986]: Upload finished. err: <nil>
Duration: 1.823162403s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X................X.........X......................] duration:
5.842451406s
FAIL (2025-08-24 12:17:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.842502224s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X..........X................X.........X.....................] duration:
5.507195735s
FAIL (2025-08-24 12:17:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.507227396s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......................X...........X...X...........X.........] duration:
1.860105871s
FAIL (2025-08-24 12:16:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 24 12:09:31.043599391 (378h43m25.474679522s) [upload=393986]: Starting upload
Aug 24 12:09:31.043636922 (378h43m25.474717053s) [upload=393986]: Done starting upload
Aug 24 12:09:31.043683572 (378h43m25.474763703s) [upload=393986]: Uploading segments...
Aug 24 12:09:31.043715343 (378h43m25.474795474s) [upload=393986]: Got next segment. Inline: true
Aug 24 12:09:31.043718719 (378h43m25.47479885s) [upload=393986]: Waiting for error group managing segments...
Aug 24 12:09:31.043750660 (378h43m25.474830791s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 12:09:31.043754688 (378h43m25.474834819s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 24 12:09:31.043757093 (378h43m25.474837224s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 12:09:31.311367440 (378h43m25.742447571s) [upload=393986]: Done uploading segments...
Aug 24 12:09:31.311385405 (378h43m25.742465536s) [upload=393986]: Upload finished. err: <nil>
Duration: 1.860134546s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......................X...........X...X...........X........] duration:
1.843540197s
FAIL (2025-08-24 12:16:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 24 12:09:31.043599391 (378h43m25.474679522s) [upload=393986]: Starting upload
Aug 24 12:09:31.043636922 (378h43m25.474717053s) [upload=393986]: Done starting upload
Aug 24 12:09:31.043683572 (378h43m25.474763703s) [upload=393986]: Uploading segments...
Aug 24 12:09:31.043715343 (378h43m25.474795474s) [upload=393986]: Got next segment. Inline: true
Aug 24 12:09:31.043718719 (378h43m25.47479885s) [upload=393986]: Waiting for error group managing segments...
Aug 24 12:09:31.043750660 (378h43m25.474830791s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 12:09:31.043754688 (378h43m25.474834819s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 24 12:09:31.043757093 (378h43m25.474837224s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 12:09:31.311367440 (378h43m25.742447571s) [upload=393986]: Done uploading segments...
Aug 24 12:09:31.311385405 (378h43m25.742465536s) [upload=393986]: Upload finished. err: <nil>
Duration: 1.843564814s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X..........X................X.........X....................] duration:
5.90056962s
FAIL (2025-08-24 12:16:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.900602754s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........................X...........X...X...........X.......] duration:
1.903821227s
FAIL (2025-08-24 12:16:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 24 12:09:31.043599391 (378h43m25.474679522s) [upload=393986]: Starting upload
Aug 24 12:09:31.043636922 (378h43m25.474717053s) [upload=393986]: Done starting upload
Aug 24 12:09:31.043683572 (378h43m25.474763703s) [upload=393986]: Uploading segments...
Aug 24 12:09:31.043715343 (378h43m25.474795474s) [upload=393986]: Got next segment. Inline: true
Aug 24 12:09:31.043718719 (378h43m25.47479885s) [upload=393986]: Waiting for error group managing segments...
Aug 24 12:09:31.043750660 (378h43m25.474830791s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 12:09:31.043754688 (378h43m25.474834819s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 24 12:09:31.043757093 (378h43m25.474837224s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 12:09:31.311367440 (378h43m25.742447571s) [upload=393986]: Done uploading segments...
Aug 24 12:09:31.311385405 (378h43m25.742465536s) [upload=393986]: Upload finished. err: <nil>
Duration: 1.903846035s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X..........X................X.........X...................] duration:
5.774456835s
FAIL (2025-08-24 12:15:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.774524154s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........................X...........X...X...........X......] duration:
1.823202911s
FAIL (2025-08-24 12:15:00 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 24 12:09:31.043599391 (378h43m25.474679522s) [upload=393986]: Starting upload
Aug 24 12:09:31.043636922 (378h43m25.474717053s) [upload=393986]: Done starting upload
Aug 24 12:09:31.043683572 (378h43m25.474763703s) [upload=393986]: Uploading segments...
Aug 24 12:09:31.043715343 (378h43m25.474795474s) [upload=393986]: Got next segment. Inline: true
Aug 24 12:09:31.043718719 (378h43m25.47479885s) [upload=393986]: Waiting for error group managing segments...
Aug 24 12:09:31.043750660 (378h43m25.474830791s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 12:09:31.043754688 (378h43m25.474834819s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 24 12:09:31.043757093 (378h43m25.474837224s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 12:09:31.311367440 (378h43m25.742447571s) [upload=393986]: Done uploading segments...
Aug 24 12:09:31.311385405 (378h43m25.742465536s) [upload=393986]: Upload finished. err: <nil>
Duration: 1.823227719s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X..........X................X.........X..................] duration:
6.009447749s
FAIL (2025-08-24 12:14:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.009473067s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X.........................X...........X...X...........X.....] duration:
2.005517063s
FAIL (2025-08-24 12:14:37 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 24 12:09:31.043599391 (378h43m25.474679522s) [upload=393986]: Starting upload
Aug 24 12:09:31.043636922 (378h43m25.474717053s) [upload=393986]: Done starting upload
Aug 24 12:09:31.043683572 (378h43m25.474763703s) [upload=393986]: Uploading segments...
Aug 24 12:09:31.043715343 (378h43m25.474795474s) [upload=393986]: Got next segment. Inline: true
Aug 24 12:09:31.043718719 (378h43m25.47479885s) [upload=393986]: Waiting for error group managing segments...
Aug 24 12:09:31.043750660 (378h43m25.474830791s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 12:09:31.043754688 (378h43m25.474834819s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 24 12:09:31.043757093 (378h43m25.474837224s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 12:09:31.311367440 (378h43m25.742447571s) [upload=393986]: Done uploading segments...
Aug 24 12:09:31.311385405 (378h43m25.742465536s) [upload=393986]: Upload finished. err: <nil>
Duration: 2.005560045s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X..........X................X.........X.................] duration:
6.06939401s
FAIL (2025-08-24 12:14:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.069424358s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X....X..........X................X.........X................] duration:
5.710714538s
FAIL (2025-08-24 12:13:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.710742482s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X.........................X...........X...X...........X....] duration:
1.875365689s
FAIL (2025-08-24 12:13:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 24 12:09:31.043599391 (378h43m25.474679522s) [upload=393986]: Starting upload
Aug 24 12:09:31.043636922 (378h43m25.474717053s) [upload=393986]: Done starting upload
Aug 24 12:09:31.043683572 (378h43m25.474763703s) [upload=393986]: Uploading segments...
Aug 24 12:09:31.043715343 (378h43m25.474795474s) [upload=393986]: Got next segment. Inline: true
Aug 24 12:09:31.043718719 (378h43m25.47479885s) [upload=393986]: Waiting for error group managing segments...
Aug 24 12:09:31.043750660 (378h43m25.474830791s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 12:09:31.043754688 (378h43m25.474834819s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 24 12:09:31.043757093 (378h43m25.474837224s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 12:09:31.311367440 (378h43m25.742447571s) [upload=393986]: Done uploading segments...
Aug 24 12:09:31.311385405 (378h43m25.742465536s) [upload=393986]: Upload finished. err: <nil>
Duration: 1.875401608s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X....X..........X................X.........X...............] duration:
5.72495676s
FAIL (2025-08-24 12:13:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.724998732s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..X.........................X...........X...X...........X...] duration:
2.012757257s
FAIL (2025-08-24 12:12:16 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 24 12:09:31.043599391 (378h43m25.474679522s) [upload=393986]: Starting upload
Aug 24 12:09:31.043636922 (378h43m25.474717053s) [upload=393986]: Done starting upload
Aug 24 12:09:31.043683572 (378h43m25.474763703s) [upload=393986]: Uploading segments...
Aug 24 12:09:31.043715343 (378h43m25.474795474s) [upload=393986]: Got next segment. Inline: true
Aug 24 12:09:31.043718719 (378h43m25.47479885s) [upload=393986]: Waiting for error group managing segments...
Aug 24 12:09:31.043750660 (378h43m25.474830791s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 12:09:31.043754688 (378h43m25.474834819s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 24 12:09:31.043757093 (378h43m25.474837224s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 12:09:31.311367440 (378h43m25.742447571s) [upload=393986]: Done uploading segments...
Aug 24 12:09:31.311385405 (378h43m25.742465536s) [upload=393986]: Upload finished. err: <nil>
Duration: 2.012792293s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X....X..........X................X.........X..............] duration:
5.790320719s
FAIL (2025-08-24 12:12:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.7903688s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...X.........................X...........X...X...........X..] duration:
2.074060223s
FAIL (2025-08-24 12:11:53 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 24 12:09:31.043599391 (378h43m25.474679522s) [upload=393986]: Starting upload
Aug 24 12:09:31.043636922 (378h43m25.474717053s) [upload=393986]: Done starting upload
Aug 24 12:09:31.043683572 (378h43m25.474763703s) [upload=393986]: Uploading segments...
Aug 24 12:09:31.043715343 (378h43m25.474795474s) [upload=393986]: Got next segment. Inline: true
Aug 24 12:09:31.043718719 (378h43m25.47479885s) [upload=393986]: Waiting for error group managing segments...
Aug 24 12:09:31.043750660 (378h43m25.474830791s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 12:09:31.043754688 (378h43m25.474834819s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 24 12:09:31.043757093 (378h43m25.474837224s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 12:09:31.311367440 (378h43m25.742447571s) [upload=393986]: Done uploading segments...
Aug 24 12:09:31.311385405 (378h43m25.742465536s) [upload=393986]: Upload finished. err: <nil>
Duration: 2.074088788s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...X....X..........X................X.........X.............] duration:
5.821803579s
FAIL (2025-08-24 12:11:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.821826853s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [....X.........................X...........X...X...........X.] duration:
1.99293584s
FAIL (2025-08-24 12:10:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 24 12:09:31.043599391 (378h43m25.474679522s) [upload=393986]: Starting upload
Aug 24 12:09:31.043636922 (378h43m25.474717053s) [upload=393986]: Done starting upload
Aug 24 12:09:31.043683572 (378h43m25.474763703s) [upload=393986]: Uploading segments...
Aug 24 12:09:31.043715343 (378h43m25.474795474s) [upload=393986]: Got next segment. Inline: true
Aug 24 12:09:31.043718719 (378h43m25.47479885s) [upload=393986]: Waiting for error group managing segments...
Aug 24 12:09:31.043750660 (378h43m25.474830791s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 12:09:31.043754688 (378h43m25.474834819s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 24 12:09:31.043757093 (378h43m25.474837224s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 12:09:31.311367440 (378h43m25.742447571s) [upload=393986]: Done uploading segments...
Aug 24 12:09:31.311385405 (378h43m25.742465536s) [upload=393986]: Upload finished. err: <nil>
Duration: 1.992966178s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [....X....X..........X................X.........X............] duration:
5.670036156s
FAIL (2025-08-24 12:10:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.670064029s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.....X.........................X...........X...X...........X] duration:
1.576175187s
FAIL (2025-08-24 12:09:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 24 12:09:31.043599391 (378h43m25.474679522s) [upload=393986]: Starting upload
Aug 24 12:09:31.043636922 (378h43m25.474717053s) [upload=393986]: Done starting upload
Aug 24 12:09:31.043683572 (378h43m25.474763703s) [upload=393986]: Uploading segments...
Aug 24 12:09:31.043715343 (378h43m25.474795474s) [upload=393986]: Got next segment. Inline: true
Aug 24 12:09:31.043718719 (378h43m25.47479885s) [upload=393986]: Waiting for error group managing segments...
Aug 24 12:09:31.043750660 (378h43m25.474830791s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 12:09:31.043754688 (378h43m25.474834819s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 24 12:09:31.043757093 (378h43m25.474837224s) [upload=393986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 12:09:31.311367440 (378h43m25.742447571s) [upload=393986]: Done uploading segments...
Aug 24 12:09:31.311385405 (378h43m25.742465536s) [upload=393986]: Upload finished. err: <nil>
Duration: 1.576203991s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....X....X..........X................X.........X...........] duration:
5.752580854s
FAIL (2025-08-24 12:09:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.752612024s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [......X....X..........X................X.........X..........] duration:
5.504441415s
FAIL (2025-08-24 12:08:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.504467735s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X.........................X...........X...X...........] duration:
1.848380037s
FAIL (2025-08-24 12:08:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after f72ec7f7467ce4d6c85981c178f416c0000a91f1a2131ab26a9994d9b5cd3609 != before 263a1735d1757921a55c9c06b53c55b85ea3502f059dc001c3f2ed4e0c484c75 ======LOGS====== Aug 24 11:59:06.719252293 (378h33m1.150332454s) [upload=393803]: Starting upload Aug 24 11:59:06.719341253 (378h33m1.150421384s) [upload=393803]: Done starting upload Aug 24 11:59:06.719438269 (378h33m1.15051839s) [upload=393803]: Uploading segments... Aug 24 11:59:06.719518833 (378h33m1.150598964s) [upload=393803]: Got next segment. Inline: true Aug 24 11:59:06.719523873 (378h33m1.150604004s) [upload=393803]: Waiting for error group managing segments... Aug 24 11:59:06.719581112 (378h33m1.150661233s) [upload=393803]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 11:59:06.719585981 (378h33m1.150666102s) [upload=393803]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 11:59:06.719589067 (378h33m1.150669198s) [upload=393803]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 11:59:07.030852892 (378h33m1.461933023s) [upload=393803]: Done uploading segments... Aug 24 11:59:07.030871698 (378h33m1.461951829s) [upload=393803]: Upload finished. err: <nil>
Duration: 1.84839761s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X.........................X...........X...X..........] duration:
2.01494301s
FAIL (2025-08-24 12:07:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after f72ec7f7467ce4d6c85981c178f416c0000a91f1a2131ab26a9994d9b5cd3609 != before 263a1735d1757921a55c9c06b53c55b85ea3502f059dc001c3f2ed4e0c484c75 ======LOGS====== Aug 24 11:59:06.719252293 (378h33m1.150332454s) [upload=393803]: Starting upload Aug 24 11:59:06.719341253 (378h33m1.150421384s) [upload=393803]: Done starting upload Aug 24 11:59:06.719438269 (378h33m1.15051839s) [upload=393803]: Uploading segments... Aug 24 11:59:06.719518833 (378h33m1.150598964s) [upload=393803]: Got next segment. Inline: true Aug 24 11:59:06.719523873 (378h33m1.150604004s) [upload=393803]: Waiting for error group managing segments... Aug 24 11:59:06.719581112 (378h33m1.150661233s) [upload=393803]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 11:59:06.719585981 (378h33m1.150666102s) [upload=393803]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 11:59:06.719589067 (378h33m1.150669198s) [upload=393803]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 11:59:07.030852892 (378h33m1.461933023s) [upload=393803]: Done uploading segments... Aug 24 11:59:07.030871698 (378h33m1.461951829s) [upload=393803]: Upload finished. err: <nil>
Duration: 2.014961184s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.......X....X..........X................X.........X.........] duration:
5.615112965s
FAIL (2025-08-24 12:07:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.615135198s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [........X....X..........X................X.........X........] duration:
5.643020254s
FAIL (2025-08-24 12:07:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.643048147s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.........X....X..........X................X.........X.......] duration:
5.641917323s
FAIL (2025-08-24 12:06:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.641942149s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X.........................X...........X...X.........] duration:
1.905471758s
FAIL (2025-08-24 12:06:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after f72ec7f7467ce4d6c85981c178f416c0000a91f1a2131ab26a9994d9b5cd3609 != before 263a1735d1757921a55c9c06b53c55b85ea3502f059dc001c3f2ed4e0c484c75 ======LOGS====== Aug 24 11:59:06.719252293 (378h33m1.150332454s) [upload=393803]: Starting upload Aug 24 11:59:06.719341253 (378h33m1.150421384s) [upload=393803]: Done starting upload Aug 24 11:59:06.719438269 (378h33m1.15051839s) [upload=393803]: Uploading segments... Aug 24 11:59:06.719518833 (378h33m1.150598964s) [upload=393803]: Got next segment. Inline: true Aug 24 11:59:06.719523873 (378h33m1.150604004s) [upload=393803]: Waiting for error group managing segments... Aug 24 11:59:06.719581112 (378h33m1.150661233s) [upload=393803]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 11:59:06.719585981 (378h33m1.150666102s) [upload=393803]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 11:59:06.719589067 (378h33m1.150669198s) [upload=393803]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 11:59:07.030852892 (378h33m1.461933023s) [upload=393803]: Done uploading segments... Aug 24 11:59:07.030871698 (378h33m1.461951829s) [upload=393803]: Upload finished. err: <nil>
Duration: 1.905497416s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..........X....X..........X................X.........X......] duration:
5.52800619s
FAIL (2025-08-24 12:05:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.52803267s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X.........................X...........X...X........] duration:
1.919568728s
FAIL (2025-08-24 12:05:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after f72ec7f7467ce4d6c85981c178f416c0000a91f1a2131ab26a9994d9b5cd3609 != before 263a1735d1757921a55c9c06b53c55b85ea3502f059dc001c3f2ed4e0c484c75 ======LOGS====== Aug 24 11:59:06.719252293 (378h33m1.150332454s) [upload=393803]: Starting upload Aug 24 11:59:06.719341253 (378h33m1.150421384s) [upload=393803]: Done starting upload Aug 24 11:59:06.719438269 (378h33m1.15051839s) [upload=393803]: Uploading segments... Aug 24 11:59:06.719518833 (378h33m1.150598964s) [upload=393803]: Got next segment. Inline: true Aug 24 11:59:06.719523873 (378h33m1.150604004s) [upload=393803]: Waiting for error group managing segments... Aug 24 11:59:06.719581112 (378h33m1.150661233s) [upload=393803]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 11:59:06.719585981 (378h33m1.150666102s) [upload=393803]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 11:59:06.719589067 (378h33m1.150669198s) [upload=393803]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 11:59:07.030852892 (378h33m1.461933023s) [upload=393803]: Done uploading segments... Aug 24 11:59:07.030871698 (378h33m1.461951829s) [upload=393803]: Upload finished. err: <nil>
Duration: 1.919589548s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...........X....X..........X................X.........X.....] duration:
6.171448688s
FAIL (2025-08-24 12:05:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.171472392s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X.........................X...........X...X.......] duration:
1.842704876s
FAIL (2025-08-24 12:04:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after f72ec7f7467ce4d6c85981c178f416c0000a91f1a2131ab26a9994d9b5cd3609 != before 263a1735d1757921a55c9c06b53c55b85ea3502f059dc001c3f2ed4e0c484c75 ======LOGS====== Aug 24 11:59:06.719252293 (378h33m1.150332454s) [upload=393803]: Starting upload Aug 24 11:59:06.719341253 (378h33m1.150421384s) [upload=393803]: Done starting upload Aug 24 11:59:06.719438269 (378h33m1.15051839s) [upload=393803]: Uploading segments... Aug 24 11:59:06.719518833 (378h33m1.150598964s) [upload=393803]: Got next segment. Inline: true Aug 24 11:59:06.719523873 (378h33m1.150604004s) [upload=393803]: Waiting for error group managing segments... Aug 24 11:59:06.719581112 (378h33m1.150661233s) [upload=393803]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 11:59:06.719585981 (378h33m1.150666102s) [upload=393803]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 11:59:06.719589067 (378h33m1.150669198s) [upload=393803]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 11:59:07.030852892 (378h33m1.461933023s) [upload=393803]: Done uploading segments... Aug 24 11:59:07.030871698 (378h33m1.461951829s) [upload=393803]: Upload finished. err: <nil>
Duration: 1.842721177s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [............X....X..........X................X.........X....] duration:
5.55080303s
FAIL (2025-08-24 12:04:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.550837455s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X.........................X...........X...X......] duration:
1.843968664s
FAIL (2025-08-24 12:03:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after f72ec7f7467ce4d6c85981c178f416c0000a91f1a2131ab26a9994d9b5cd3609 != before 263a1735d1757921a55c9c06b53c55b85ea3502f059dc001c3f2ed4e0c484c75 ======LOGS====== Aug 24 11:59:06.719252293 (378h33m1.150332454s) [upload=393803]: Starting upload Aug 24 11:59:06.719341253 (378h33m1.150421384s) [upload=393803]: Done starting upload Aug 24 11:59:06.719438269 (378h33m1.15051839s) [upload=393803]: Uploading segments... Aug 24 11:59:06.719518833 (378h33m1.150598964s) [upload=393803]: Got next segment. Inline: true Aug 24 11:59:06.719523873 (378h33m1.150604004s) [upload=393803]: Waiting for error group managing segments... Aug 24 11:59:06.719581112 (378h33m1.150661233s) [upload=393803]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 11:59:06.719585981 (378h33m1.150666102s) [upload=393803]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 11:59:06.719589067 (378h33m1.150669198s) [upload=393803]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 11:59:07.030852892 (378h33m1.461933023s) [upload=393803]: Done uploading segments... Aug 24 11:59:07.030871698 (378h33m1.461951829s) [upload=393803]: Upload finished. err: <nil>
Duration: 1.843995626s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.............X....X..........X................X.........X...] duration:
5.501525903s
FAIL (2025-08-24 12:03:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.501554919s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..............X....X..........X................X.........X..] duration:
6.634458345s
FAIL (2025-08-24 12:02:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 12:00:36.773248697 (378h34m31.204328818s) [upload=393828]: Starting upload Aug 24 12:00:36.773299364 (378h34m31.204379495s) [upload=393828]: Done starting upload Aug 24 12:00:36.773425746 (378h34m31.204505877s) [upload=393828]: Uploading segments... Aug 24 12:00:36.773516299 (378h34m31.20459644s) [upload=393828]: Got next segment. Inline: false Aug 24 12:00:36.773547228 (378h34m31.204627359s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 12:00:36.773552358 (378h34m31.204632489s) [upload=393828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 24 12:00:36.990127765 (378h34m31.421207896s) [upload=393828]: Next segment err: metaclient: Too Many Requests Aug 24 12:00:36.990148806 (378h34m31.421228937s) [upload=393828]: Done uploading segments... Aug 24 12:00:36.990162793 (378h34m31.421242924s) [upload=393828]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.634486578s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X.........................X...........X...X.....] duration:
1.823224312s
FAIL (2025-08-24 12:02:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after f72ec7f7467ce4d6c85981c178f416c0000a91f1a2131ab26a9994d9b5cd3609 != before 263a1735d1757921a55c9c06b53c55b85ea3502f059dc001c3f2ed4e0c484c75 ======LOGS====== Aug 24 11:59:06.719252293 (378h33m1.150332454s) [upload=393803]: Starting upload Aug 24 11:59:06.719341253 (378h33m1.150421384s) [upload=393803]: Done starting upload Aug 24 11:59:06.719438269 (378h33m1.15051839s) [upload=393803]: Uploading segments... Aug 24 11:59:06.719518833 (378h33m1.150598964s) [upload=393803]: Got next segment. Inline: true Aug 24 11:59:06.719523873 (378h33m1.150604004s) [upload=393803]: Waiting for error group managing segments... Aug 24 11:59:06.719581112 (378h33m1.150661233s) [upload=393803]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 11:59:06.719585981 (378h33m1.150666102s) [upload=393803]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 11:59:06.719589067 (378h33m1.150669198s) [upload=393803]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 11:59:07.030852892 (378h33m1.461933023s) [upload=393803]: Done uploading segments... Aug 24 11:59:07.030871698 (378h33m1.461951829s) [upload=393803]: Upload finished. err: <nil>
Duration: 1.823247777s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|