Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X........................X.......................] duration:
1.840165236s
FAIL (2025-08-25 02:57:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.840195465s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X........................X...........X............X.....] duration:
5.744316141s
FAIL (2025-08-25 02:57:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:52:56.761699831 (393h26m51.192779962s) [upload=409269]: Starting upload Aug 25 02:52:56.761824720 (393h26m51.192904851s) [upload=409269]: Done starting upload Aug 25 02:52:56.761909803 (393h26m51.192989934s) [upload=409269]: Uploading segments... Aug 25 02:52:56.762051394 (393h26m51.193131525s) [upload=409269]: Got next segment. Inline: false Aug 25 02:52:56.762075931 (393h26m51.193156062s) [upload=409269]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:52:56.762079848 (393h26m51.193159979s) [upload=409269]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 02:52:56.975224918 (393h26m51.406305049s) [upload=409269]: Next segment err: metaclient: Too Many Requests Aug 25 02:52:56.975245908 (393h26m51.406326029s) [upload=409269]: Done uploading segments... Aug 25 02:52:56.975259143 (393h26m51.406339274s) [upload=409269]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.744344535s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X........................X......................] duration:
1.825732007s
FAIL (2025-08-25 02:56:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.825758658s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X........................X.....................] duration:
1.803555916s
FAIL (2025-08-25 02:55:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.803592857s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X........................X...........X............X....] duration:
5.567619071s
FAIL (2025-08-25 02:55:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:52:56.761699831 (393h26m51.192779962s) [upload=409269]: Starting upload Aug 25 02:52:56.761824720 (393h26m51.192904851s) [upload=409269]: Done starting upload Aug 25 02:52:56.761909803 (393h26m51.192989934s) [upload=409269]: Uploading segments... Aug 25 02:52:56.762051394 (393h26m51.193131525s) [upload=409269]: Got next segment. Inline: false Aug 25 02:52:56.762075931 (393h26m51.193156062s) [upload=409269]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:52:56.762079848 (393h26m51.193159979s) [upload=409269]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 02:52:56.975224918 (393h26m51.406305049s) [upload=409269]: Next segment err: metaclient: Too Many Requests Aug 25 02:52:56.975245908 (393h26m51.406326029s) [upload=409269]: Done uploading segments... Aug 25 02:52:56.975259143 (393h26m51.406339274s) [upload=409269]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.567646483s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X........................X....................] duration:
1.834509421s
FAIL (2025-08-25 02:55:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.834564697s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X........................X...................] duration:
1.908608583s
FAIL (2025-08-25 02:55:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.908642158s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X........................X...........X............X...] duration:
5.707019117s
FAIL (2025-08-25 02:54:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:52:56.761699831 (393h26m51.192779962s) [upload=409269]: Starting upload Aug 25 02:52:56.761824720 (393h26m51.192904851s) [upload=409269]: Done starting upload Aug 25 02:52:56.761909803 (393h26m51.192989934s) [upload=409269]: Uploading segments... Aug 25 02:52:56.762051394 (393h26m51.193131525s) [upload=409269]: Got next segment. Inline: false Aug 25 02:52:56.762075931 (393h26m51.193156062s) [upload=409269]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:52:56.762079848 (393h26m51.193159979s) [upload=409269]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 02:52:56.975224918 (393h26m51.406305049s) [upload=409269]: Next segment err: metaclient: Too Many Requests Aug 25 02:52:56.975245908 (393h26m51.406326029s) [upload=409269]: Done uploading segments... Aug 25 02:52:56.975259143 (393h26m51.406339274s) [upload=409269]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.707043212s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X........................X...........X............X..] duration:
5.629415748s
FAIL (2025-08-25 02:54:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:52:56.761699831 (393h26m51.192779962s) [upload=409269]: Starting upload Aug 25 02:52:56.761824720 (393h26m51.192904851s) [upload=409269]: Done starting upload Aug 25 02:52:56.761909803 (393h26m51.192989934s) [upload=409269]: Uploading segments... Aug 25 02:52:56.762051394 (393h26m51.193131525s) [upload=409269]: Got next segment. Inline: false Aug 25 02:52:56.762075931 (393h26m51.193156062s) [upload=409269]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:52:56.762079848 (393h26m51.193159979s) [upload=409269]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 02:52:56.975224918 (393h26m51.406305049s) [upload=409269]: Next segment err: metaclient: Too Many Requests Aug 25 02:52:56.975245908 (393h26m51.406326029s) [upload=409269]: Done uploading segments... Aug 25 02:52:56.975259143 (393h26m51.406339274s) [upload=409269]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.629441057s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X........................X..................] duration:
1.888566784s
FAIL (2025-08-25 02:54:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.888597322s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X........................X...........X............X.] duration:
5.562006521s
FAIL (2025-08-25 02:53:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:52:56.761699831 (393h26m51.192779962s) [upload=409269]: Starting upload Aug 25 02:52:56.761824720 (393h26m51.192904851s) [upload=409269]: Done starting upload Aug 25 02:52:56.761909803 (393h26m51.192989934s) [upload=409269]: Uploading segments... Aug 25 02:52:56.762051394 (393h26m51.193131525s) [upload=409269]: Got next segment. Inline: false Aug 25 02:52:56.762075931 (393h26m51.193156062s) [upload=409269]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:52:56.762079848 (393h26m51.193159979s) [upload=409269]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 02:52:56.975224918 (393h26m51.406305049s) [upload=409269]: Next segment err: metaclient: Too Many Requests Aug 25 02:52:56.975245908 (393h26m51.406326029s) [upload=409269]: Done uploading segments... Aug 25 02:52:56.975259143 (393h26m51.406339274s) [upload=409269]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.56203169s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X........................X.................] duration:
1.804538406s
FAIL (2025-08-25 02:52:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.804577081s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........X........................X...........X............X] duration:
875.400402ms
FAIL (2025-08-25 02:52:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:52:56.761699831 (393h26m51.192779962s) [upload=409269]: Starting upload Aug 25 02:52:56.761824720 (393h26m51.192904851s) [upload=409269]: Done starting upload Aug 25 02:52:56.761909803 (393h26m51.192989934s) [upload=409269]: Uploading segments... Aug 25 02:52:56.762051394 (393h26m51.193131525s) [upload=409269]: Got next segment. Inline: false Aug 25 02:52:56.762075931 (393h26m51.193156062s) [upload=409269]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:52:56.762079848 (393h26m51.193159979s) [upload=409269]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 02:52:56.975224918 (393h26m51.406305049s) [upload=409269]: Next segment err: metaclient: Too Many Requests Aug 25 02:52:56.975245908 (393h26m51.406326029s) [upload=409269]: Done uploading segments... Aug 25 02:52:56.975259143 (393h26m51.406339274s) [upload=409269]: Upload finished. err: metaclient: Too Many Requests
Duration: 875.423136ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X.........X........................X...........X............] duration:
5.543472579s
FAIL (2025-08-25 02:51:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:42:39.143352299 (393h16m33.57443242s) [upload=409096]: Starting upload Aug 25 02:42:39.143400972 (393h16m33.574481103s) [upload=409096]: Done starting upload Aug 25 02:42:39.143506002 (393h16m33.574586133s) [upload=409096]: Uploading segments... Aug 25 02:42:39.143676980 (393h16m33.574757111s) [upload=409096]: Got next segment. Inline: false Aug 25 02:42:39.143727606 (393h16m33.574807727s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:42:39.143732406 (393h16m33.574812537s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 02:42:39.368947370 (393h16m33.800027511s) [upload=409096]: Next segment err: metaclient: Too Many Requests Aug 25 02:42:39.369001043 (393h16m33.800081194s) [upload=409096]: Done uploading segments... Aug 25 02:42:39.369019157 (393h16m33.800099298s) [upload=409096]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.543496566s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X........................X................] duration:
1.831581971s
FAIL (2025-08-25 02:51:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.83162253s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X.........X........................X...........X...........] duration:
5.653796336s
FAIL (2025-08-25 02:50:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:42:39.143352299 (393h16m33.57443242s) [upload=409096]: Starting upload Aug 25 02:42:39.143400972 (393h16m33.574481103s) [upload=409096]: Done starting upload Aug 25 02:42:39.143506002 (393h16m33.574586133s) [upload=409096]: Uploading segments... Aug 25 02:42:39.143676980 (393h16m33.574757111s) [upload=409096]: Got next segment. Inline: false Aug 25 02:42:39.143727606 (393h16m33.574807727s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:42:39.143732406 (393h16m33.574812537s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 02:42:39.368947370 (393h16m33.800027511s) [upload=409096]: Next segment err: metaclient: Too Many Requests Aug 25 02:42:39.369001043 (393h16m33.800081194s) [upload=409096]: Done uploading segments... Aug 25 02:42:39.369019157 (393h16m33.800099298s) [upload=409096]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.653840059s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X........................X...............] duration:
1.832975719s
FAIL (2025-08-25 02:50:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.832998863s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X........................X..............] duration:
1.942971774s
FAIL (2025-08-25 02:50:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.943002642s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X........................X.............] duration:
1.832500292s
FAIL (2025-08-25 02:49:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.832706967s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X.........X........................X...........X..........] duration:
5.506314558s
FAIL (2025-08-25 02:49:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:42:39.143352299 (393h16m33.57443242s) [upload=409096]: Starting upload Aug 25 02:42:39.143400972 (393h16m33.574481103s) [upload=409096]: Done starting upload Aug 25 02:42:39.143506002 (393h16m33.574586133s) [upload=409096]: Uploading segments... Aug 25 02:42:39.143676980 (393h16m33.574757111s) [upload=409096]: Got next segment. Inline: false Aug 25 02:42:39.143727606 (393h16m33.574807727s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:42:39.143732406 (393h16m33.574812537s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 02:42:39.368947370 (393h16m33.800027511s) [upload=409096]: Next segment err: metaclient: Too Many Requests Aug 25 02:42:39.369001043 (393h16m33.800081194s) [upload=409096]: Done uploading segments... Aug 25 02:42:39.369019157 (393h16m33.800099298s) [upload=409096]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.50634137s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X.........X........................X...........X.........] duration:
5.721849662s
FAIL (2025-08-25 02:48:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:42:39.143352299 (393h16m33.57443242s) [upload=409096]: Starting upload Aug 25 02:42:39.143400972 (393h16m33.574481103s) [upload=409096]: Done starting upload Aug 25 02:42:39.143506002 (393h16m33.574586133s) [upload=409096]: Uploading segments... Aug 25 02:42:39.143676980 (393h16m33.574757111s) [upload=409096]: Got next segment. Inline: false Aug 25 02:42:39.143727606 (393h16m33.574807727s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:42:39.143732406 (393h16m33.574812537s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 02:42:39.368947370 (393h16m33.800027511s) [upload=409096]: Next segment err: metaclient: Too Many Requests Aug 25 02:42:39.369001043 (393h16m33.800081194s) [upload=409096]: Done uploading segments... Aug 25 02:42:39.369019157 (393h16m33.800099298s) [upload=409096]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.721875471s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X........................X............] duration:
1.906420935s
FAIL (2025-08-25 02:48:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.906453147s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X........................X...........] duration:
1.828000899s
FAIL (2025-08-25 02:48:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.828026608s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X.........X........................X...........X........] duration:
5.734901365s
FAIL (2025-08-25 02:48:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:42:39.143352299 (393h16m33.57443242s) [upload=409096]: Starting upload Aug 25 02:42:39.143400972 (393h16m33.574481103s) [upload=409096]: Done starting upload Aug 25 02:42:39.143506002 (393h16m33.574586133s) [upload=409096]: Uploading segments... Aug 25 02:42:39.143676980 (393h16m33.574757111s) [upload=409096]: Got next segment. Inline: false Aug 25 02:42:39.143727606 (393h16m33.574807727s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:42:39.143732406 (393h16m33.574812537s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 02:42:39.368947370 (393h16m33.800027511s) [upload=409096]: Next segment err: metaclient: Too Many Requests Aug 25 02:42:39.369001043 (393h16m33.800081194s) [upload=409096]: Done uploading segments... Aug 25 02:42:39.369019157 (393h16m33.800099298s) [upload=409096]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.734921553s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X........................X..........] duration:
1.94172116s
FAIL (2025-08-25 02:47:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.941746358s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X........................X.........] duration:
2.01371889s
FAIL (2025-08-25 02:47:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.013755841s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X.........X........................X...........X.......] duration:
5.804226109s
FAIL (2025-08-25 02:47:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:42:39.143352299 (393h16m33.57443242s) [upload=409096]: Starting upload Aug 25 02:42:39.143400972 (393h16m33.574481103s) [upload=409096]: Done starting upload Aug 25 02:42:39.143506002 (393h16m33.574586133s) [upload=409096]: Uploading segments... Aug 25 02:42:39.143676980 (393h16m33.574757111s) [upload=409096]: Got next segment. Inline: false Aug 25 02:42:39.143727606 (393h16m33.574807727s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:42:39.143732406 (393h16m33.574812537s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 02:42:39.368947370 (393h16m33.800027511s) [upload=409096]: Next segment err: metaclient: Too Many Requests Aug 25 02:42:39.369001043 (393h16m33.800081194s) [upload=409096]: Done uploading segments... Aug 25 02:42:39.369019157 (393h16m33.800099298s) [upload=409096]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.804253923s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X.........X........................X...........X......] duration:
5.742797617s
FAIL (2025-08-25 02:46:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:42:39.143352299 (393h16m33.57443242s) [upload=409096]: Starting upload Aug 25 02:42:39.143400972 (393h16m33.574481103s) [upload=409096]: Done starting upload Aug 25 02:42:39.143506002 (393h16m33.574586133s) [upload=409096]: Uploading segments... Aug 25 02:42:39.143676980 (393h16m33.574757111s) [upload=409096]: Got next segment. Inline: false Aug 25 02:42:39.143727606 (393h16m33.574807727s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:42:39.143732406 (393h16m33.574812537s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 02:42:39.368947370 (393h16m33.800027511s) [upload=409096]: Next segment err: metaclient: Too Many Requests Aug 25 02:42:39.369001043 (393h16m33.800081194s) [upload=409096]: Done uploading segments... Aug 25 02:42:39.369019157 (393h16m33.800099298s) [upload=409096]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.742823417s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X........................X........] duration:
1.980622183s
FAIL (2025-08-25 02:46:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.980647362s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X.........X........................X...........X.....] duration:
5.905516319s
FAIL (2025-08-25 02:45:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:42:39.143352299 (393h16m33.57443242s) [upload=409096]: Starting upload Aug 25 02:42:39.143400972 (393h16m33.574481103s) [upload=409096]: Done starting upload Aug 25 02:42:39.143506002 (393h16m33.574586133s) [upload=409096]: Uploading segments... Aug 25 02:42:39.143676980 (393h16m33.574757111s) [upload=409096]: Got next segment. Inline: false Aug 25 02:42:39.143727606 (393h16m33.574807727s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:42:39.143732406 (393h16m33.574812537s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 02:42:39.368947370 (393h16m33.800027511s) [upload=409096]: Next segment err: metaclient: Too Many Requests Aug 25 02:42:39.369001043 (393h16m33.800081194s) [upload=409096]: Done uploading segments... Aug 25 02:42:39.369019157 (393h16m33.800099298s) [upload=409096]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.90554225s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X........................X.......] duration:
1.850470251s
FAIL (2025-08-25 02:45:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.850497443s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X.......X.........X........................X...........X....] duration:
5.854367198s
FAIL (2025-08-25 02:45:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:42:39.143352299 (393h16m33.57443242s) [upload=409096]: Starting upload Aug 25 02:42:39.143400972 (393h16m33.574481103s) [upload=409096]: Done starting upload Aug 25 02:42:39.143506002 (393h16m33.574586133s) [upload=409096]: Uploading segments... Aug 25 02:42:39.143676980 (393h16m33.574757111s) [upload=409096]: Got next segment. Inline: false Aug 25 02:42:39.143727606 (393h16m33.574807727s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:42:39.143732406 (393h16m33.574812537s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 02:42:39.368947370 (393h16m33.800027511s) [upload=409096]: Next segment err: metaclient: Too Many Requests Aug 25 02:42:39.369001043 (393h16m33.800081194s) [upload=409096]: Done uploading segments... Aug 25 02:42:39.369019157 (393h16m33.800099298s) [upload=409096]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.85438967s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X.......X.........X........................X...........X...] duration:
5.618507134s
FAIL (2025-08-25 02:45:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:42:39.143352299 (393h16m33.57443242s) [upload=409096]: Starting upload Aug 25 02:42:39.143400972 (393h16m33.574481103s) [upload=409096]: Done starting upload Aug 25 02:42:39.143506002 (393h16m33.574586133s) [upload=409096]: Uploading segments... Aug 25 02:42:39.143676980 (393h16m33.574757111s) [upload=409096]: Got next segment. Inline: false Aug 25 02:42:39.143727606 (393h16m33.574807727s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:42:39.143732406 (393h16m33.574812537s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 02:42:39.368947370 (393h16m33.800027511s) [upload=409096]: Next segment err: metaclient: Too Many Requests Aug 25 02:42:39.369001043 (393h16m33.800081194s) [upload=409096]: Done uploading segments... Aug 25 02:42:39.369019157 (393h16m33.800099298s) [upload=409096]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.61853603s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X........................X......] duration:
1.843906012s
FAIL (2025-08-25 02:44:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.843938495s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X.......X.........X........................X...........X..] duration:
5.504835547s
FAIL (2025-08-25 02:44:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:42:39.143352299 (393h16m33.57443242s) [upload=409096]: Starting upload Aug 25 02:42:39.143400972 (393h16m33.574481103s) [upload=409096]: Done starting upload Aug 25 02:42:39.143506002 (393h16m33.574586133s) [upload=409096]: Uploading segments... Aug 25 02:42:39.143676980 (393h16m33.574757111s) [upload=409096]: Got next segment. Inline: false Aug 25 02:42:39.143727606 (393h16m33.574807727s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:42:39.143732406 (393h16m33.574812537s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 02:42:39.368947370 (393h16m33.800027511s) [upload=409096]: Next segment err: metaclient: Too Many Requests Aug 25 02:42:39.369001043 (393h16m33.800081194s) [upload=409096]: Done uploading segments... Aug 25 02:42:39.369019157 (393h16m33.800099298s) [upload=409096]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.504861207s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X........................X.....] duration:
1.844711745s
FAIL (2025-08-25 02:44:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.844738024s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...X.......X.........X........................X...........X.] duration:
5.620778589s
FAIL (2025-08-25 02:43:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:42:39.143352299 (393h16m33.57443242s) [upload=409096]: Starting upload Aug 25 02:42:39.143400972 (393h16m33.574481103s) [upload=409096]: Done starting upload Aug 25 02:42:39.143506002 (393h16m33.574586133s) [upload=409096]: Uploading segments... Aug 25 02:42:39.143676980 (393h16m33.574757111s) [upload=409096]: Got next segment. Inline: false Aug 25 02:42:39.143727606 (393h16m33.574807727s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:42:39.143732406 (393h16m33.574812537s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 02:42:39.368947370 (393h16m33.800027511s) [upload=409096]: Next segment err: metaclient: Too Many Requests Aug 25 02:42:39.369001043 (393h16m33.800081194s) [upload=409096]: Done uploading segments... Aug 25 02:42:39.369019157 (393h16m33.800099298s) [upload=409096]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.620804338s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X........................X....] duration:
1.831245076s
FAIL (2025-08-25 02:43:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.831272278s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [....X.......X.........X........................X...........X] duration:
925.469617ms
FAIL (2025-08-25 02:42:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:42:39.143352299 (393h16m33.57443242s) [upload=409096]: Starting upload Aug 25 02:42:39.143400972 (393h16m33.574481103s) [upload=409096]: Done starting upload Aug 25 02:42:39.143506002 (393h16m33.574586133s) [upload=409096]: Uploading segments... Aug 25 02:42:39.143676980 (393h16m33.574757111s) [upload=409096]: Got next segment. Inline: false Aug 25 02:42:39.143727606 (393h16m33.574807727s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:42:39.143732406 (393h16m33.574812537s) [upload=409096]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 02:42:39.368947370 (393h16m33.800027511s) [upload=409096]: Next segment err: metaclient: Too Many Requests Aug 25 02:42:39.369001043 (393h16m33.800081194s) [upload=409096]: Done uploading segments... Aug 25 02:42:39.369019157 (393h16m33.800099298s) [upload=409096]: Upload finished. err: metaclient: Too Many Requests
Duration: 925.493454ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X........................X...] duration:
1.842069349s
FAIL (2025-08-25 02:42:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.842100249s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X........................X..] duration:
1.818994415s
FAIL (2025-08-25 02:41:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.819015093s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X........................X.] duration:
1.883289022s
FAIL (2025-08-25 02:41:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.883311895s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X.......X.........X........................X...........] duration:
5.520518741s
FAIL (2025-08-25 02:41:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 02:34:25.828860590 (393h8m20.259940721s) [upload=408956]: Starting upload
Aug 25 02:34:25.828907169 (393h8m20.2599873s) [upload=408956]: Done starting upload
Aug 25 02:34:25.829016829 (393h8m20.26009696s) [upload=408956]: Uploading segments...
Aug 25 02:34:25.829141478 (393h8m20.260221609s) [upload=408956]: Got next segment. Inline: false
Aug 25 02:34:25.829171375 (393h8m20.260251496s) [upload=408956]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 02:34:25.829175723 (393h8m20.260255854s) [upload=408956]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 02:34:26.347631608 (393h8m20.778711769s) [seg_pos={0 0}, upload=408956]: Begin upload segment...
Aug 25 02:34:26.347696893 (393h8m20.778777044s) [seg_pos={0 0}, upload=408956]: Done begin upload segment.
Aug 25 02:34:26.347732291 (393h8m20.778812452s) [noise=true , address=104.36.82.43:4854 , piece_id=4OQVLCKBSUIWQBCAZTYXQGZBHXVUFUJX7RIJGEFACH2OM5BTVFSA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.347767007 (393h8m20.778847138s) [noise=true , address=104.36.82.11:4124 , piece_id=IRJ7O3DGKVAX2PDEDWS3VPA7USXL3PUJRHTBNJ4UTFJH4H6ZY64Q, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.348211979 (393h8m20.7792921s) [noise=true , address=104.36.82.20:4456 , piece_id=D5V4RNZLADZUYPZKZEWNCEGEZLW3IQQIXAKMIATIKFSDIVHPRCHQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.348236124 (393h8m20.779316245s) [noise=true , address=79.127.205.233:4624 , piece_id=33X5SNWJF2TZQXJTG64SLUQWXH3DN2UFNVWBRHAXZRH6QTKYLF6A, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.348750038 (393h8m20.779830169s) [noise=true , address=104.36.82.49:4981 , piece_id=XGICVF4662MOR6VEK2ADZEWYNJMSDLX4QAYJF36V2Y6NA5HMLGTA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.348916506 (393h8m20.779996638s) [noise=true , address=77.90.31.21:4906 , piece_id=QFQ7BN5AN2PL2EGUYR6VEIT3KEFKJAKF2AAZYB244KWSFQEM6KRQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349089739 (393h8m20.78016987s) [noise=true , address=104.36.82.5:4845 , piece_id=ATNNHWTQBTLRHBIMBEEPTOQVZB7FQJNFQB2K6ZLPL6QS6BI3QVQQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349126258 (393h8m20.780206389s) [noise=true , address=104.36.82.2:4763 , piece_id=ANLMBDL2PYRJONXZS3OTG5QBURJWPKK7CUHNHVKENJ4U6C7E36VQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349452843 (393h8m20.780532974s) [noise=true , address=104.36.82.23:4461 , piece_id=SQE6J5A2ISWIVUGVOY6EPRCZN5U4UTBQA3A3YGVW2HYMQVGXIYZQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349459957 (393h8m20.780540088s) [noise=true , address=79.127.220.97:4378 , piece_id=YYKDMK7KRKCPEKPYBPMBWLM3KDVWPWVSPDYXR5YA7WBNRHTNCNWA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349641965 (393h8m20.780722096s) [noise=true , address=45.91.116.11:4146 , piece_id=JSRRGQXBTX7DPR64QO337EWQY5N2ICFGOQHL4TAKVUDU5EPBVUKQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349716348 (393h8m20.780796479s) [noise=true , address=104.36.82.41:4793 , piece_id=YZXE3NO4ZYQ5M5YGIRFXPYCM7REVVISSKRLH27ZBJYTHHWQ2UW4Q, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349894809 (393h8m20.78097494s) [noise=true , address=79.127.219.48:4108 , piece_id=KVYGLDZAAOTVNLPRSEJEXKZSRCNOSUAKW7X4GJGB5JLBEX3GJJ3A, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349983037 (393h8m20.781063168s) [noise=true , address=79.127.205.234:4587 , piece_id=ALROUTBEYI3W3DHB33UXFLY6KLJP5TV354KMVTKDLKYNNNJBJGRA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.350127414 (393h8m20.781207545s) [noise=true , address=104.36.82.15:4268 , piece_id=WQISR5A7DFOS7L6XYLJAQEF76QJDD75FOIW4CRYCEJX2IPR2J7IQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.350265098 (393h8m20.781345219s) [noise=true , address=77.90.31.11:4577 , piece_id=U5KJME6LDQKJA7CJWSZIO7IEIHQS65JTS5GX5IXYYZUGVSW2XNYQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.350359718 (393h8m20.781439849s) [noise=true , address=79.127.205.246:4268 , piece_id=CFU74PAGS4WIORJGN7GYH3DELTCYPYZDTELADQLNUOCPMUHUMYRA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.350593406 (393h8m20.781673527s) [noise=true , address=79.127.201.215:4349 , piece_id=GGJZI5PARR44JSSBGNKJGTJMPJJKYJ2RRI77RGO7AE5ZH7A4HJKQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:27.463621721 (393h8m21.894701842s) [upload=408956]: Next returned nil segment
Aug 25 02:34:27.463637983 (393h8m21.894718114s) [upload=408956]: Waiting for error group managing segments...
Aug 25 02:34:27.745117536 (393h8m22.176197688s) [noise=true , address=79.127.205.234:4587 , piece_id=ALROUTBEYI3W3DHB33UXFLY6KLJP5TV354KMVTKDLKYNNNJBJGRA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:27.810934997 (393h8m22.242015128s) [noise=true , address=79.127.205.246:4268 , piece_id=CFU74PAGS4WIORJGN7GYH3DELTCYPYZDTELADQLNUOCPMUHUMYRA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:27.811268275 (393h8m22.242348406s) [noise=true , address=79.127.205.233:4624 , piece_id=33X5SNWJF2TZQXJTG64SLUQWXH3DN2UFNVWBRHAXZRH6QTKYLF6A, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.189025154 (393h8m22.620105285s) [noise=true , address=79.127.220.97:4378 , piece_id=YYKDMK7KRKCPEKPYBPMBWLM3KDVWPWVSPDYXR5YA7WBNRHTNCNWA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.248947635 (393h8m22.680027766s) [noise=true , address=45.91.116.11:4146 , piece_id=JSRRGQXBTX7DPR64QO337EWQY5N2ICFGOQHL4TAKVUDU5EPBVUKQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.259090503 (393h8m22.690170634s) [noise=true , address=104.36.82.20:4456 , piece_id=D5V4RNZLADZUYPZKZEWNCEGEZLW3IQQIXAKMIATIKFSDIVHPRCHQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.260482165 (393h8m22.691562296s) [noise=true , address=104.36.82.43:4854 , piece_id=4OQVLCKBSUIWQBCAZTYXQGZBHXVUFUJX7RIJGEFACH2OM5BTVFSA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.272367408 (393h8m22.703447539s) [noise=true , address=104.36.82.2:4763 , piece_id=ANLMBDL2PYRJONXZS3OTG5QBURJWPKK7CUHNHVKENJ4U6C7E36VQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.277535367 (393h8m22.708615498s) [noise=true , address=104.36.82.11:4124 , piece_id=IRJ7O3DGKVAX2PDEDWS3VPA7USXL3PUJRHTBNJ4UTFJH4H6ZY64Q, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.285842933 (393h8m22.716923064s) [noise=true , address=79.127.201.215:4349 , piece_id=GGJZI5PARR44JSSBGNKJGTJMPJJKYJ2RRI77RGO7AE5ZH7A4HJKQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.304641704 (393h8m22.735721835s) [noise=true , address=104.36.82.23:4461 , piece_id=SQE6J5A2ISWIVUGVOY6EPRCZN5U4UTBQA3A3YGVW2HYMQVGXIYZQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.322586250 (393h8m22.753666381s) [noise=true , address=79.127.219.48:4108 , piece_id=KVYGLDZAAOTVNLPRSEJEXKZSRCNOSUAKW7X4GJGB5JLBEX3GJJ3A, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.331220763 (393h8m22.762300894s) [noise=true , address=104.36.82.49:4981 , piece_id=XGICVF4662MOR6VEK2ADZEWYNJMSDLX4QAYJF36V2Y6NA5HMLGTA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.358659366 (393h8m22.789739497s) [noise=true , address=104.36.82.15:4268 , piece_id=WQISR5A7DFOS7L6XYLJAQEF76QJDD75FOIW4CRYCEJX2IPR2J7IQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.358701456 (393h8m22.789781587s) [seg_pos={0 0}, upload=408956]: Segment reached optimal threshold of 14 pieces.
Aug 25 02:34:28.358989578 (393h8m22.790069709s) [noise=true , address=77.90.31.21:4906 , piece_id=QFQ7BN5AN2PL2EGUYR6VEIT3KEFKJAKF2AAZYB244KWSFQEM6KRQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HG7FfbxD7WJZxWS5CXYFuJgj8n5L7tMr1ZfrcyF6Lih2S67R9): protocol: expected piece hash; context canceled; EOF
Aug 25 02:34:28.359105880 (393h8m22.790186011s) [noise=true , address=104.36.82.5:4845 , piece_id=ATNNHWTQBTLRHBIMBEEPTOQVZB7FQJNFQB2K6ZLPL6QS6BI3QVQQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nChJBXktwFs6z7cSK2Wh6N3jkAZwTZ7zhEUt393Nnx4eB6ube): protocol: write tcp 188.166.225.170:42884->104.36.82.5:4845: use of closed network connection; write tcp 188.166.225.170:42884->104.36.82.5:4845: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42884->104.36.82.5:4845: use of closed network connection
Aug 25 02:34:28.359138102 (393h8m22.790218223s) [noise=true , address=104.36.82.41:4793 , piece_id=YZXE3NO4ZYQ5M5YGIRFXPYCM7REVVISSKRLH27ZBJYTHHWQ2UW4Q, seg_pos={0 0}, upload=408956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1asDxxBjiU6yNbZ5c6uBmSWQ4QbVs5J3ErLbpKBSwqaptpNhpn): protocol: expected piece hash; context canceled; EOF
Aug 25 02:34:28.359194279 (393h8m22.79027441s) [noise=true , address=77.90.31.11:4577 , piece_id=U5KJME6LDQKJA7CJWSZIO7IEIHQS65JTS5GX5IXYYZUGVSW2XNYQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rKdimacehmW1Tp5Zp4DJFxafLhcEeNh61cfw8Bfefr9pRG2ei): protocol: write tcp 188.166.225.170:38650->77.90.31.11:4577: use of closed network connection; write tcp 188.166.225.170:38650->77.90.31.11:4577: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38650->77.90.31.11:4577: use of closed network connection
Aug 25 02:34:28.359211953 (393h8m22.790292084s) [seg_pos={0 0}, upload=408956]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 02:34:28.359290744 (393h8m22.790370875s) [upload=408956]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 02:34:28.359294391 (393h8m22.790374522s) [upload=408956]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 02:34:28.707475437 (393h8m23.138555558s) [upload=408956]: Done uploading segments...
Aug 25 02:34:28.707492770 (393h8m23.138572901s) [upload=408956]: Upload finished. err: <nil>
Duration: 5.520545542s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X.......X.........X........................X..........] duration:
5.764692351s
FAIL (2025-08-25 02:41:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 02:34:25.828860590 (393h8m20.259940721s) [upload=408956]: Starting upload
Aug 25 02:34:25.828907169 (393h8m20.2599873s) [upload=408956]: Done starting upload
Aug 25 02:34:25.829016829 (393h8m20.26009696s) [upload=408956]: Uploading segments...
Aug 25 02:34:25.829141478 (393h8m20.260221609s) [upload=408956]: Got next segment. Inline: false
Aug 25 02:34:25.829171375 (393h8m20.260251496s) [upload=408956]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 02:34:25.829175723 (393h8m20.260255854s) [upload=408956]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 02:34:26.347631608 (393h8m20.778711769s) [seg_pos={0 0}, upload=408956]: Begin upload segment...
Aug 25 02:34:26.347696893 (393h8m20.778777044s) [seg_pos={0 0}, upload=408956]: Done begin upload segment.
Aug 25 02:34:26.347732291 (393h8m20.778812452s) [noise=true , address=104.36.82.43:4854 , piece_id=4OQVLCKBSUIWQBCAZTYXQGZBHXVUFUJX7RIJGEFACH2OM5BTVFSA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.347767007 (393h8m20.778847138s) [noise=true , address=104.36.82.11:4124 , piece_id=IRJ7O3DGKVAX2PDEDWS3VPA7USXL3PUJRHTBNJ4UTFJH4H6ZY64Q, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.348211979 (393h8m20.7792921s) [noise=true , address=104.36.82.20:4456 , piece_id=D5V4RNZLADZUYPZKZEWNCEGEZLW3IQQIXAKMIATIKFSDIVHPRCHQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.348236124 (393h8m20.779316245s) [noise=true , address=79.127.205.233:4624 , piece_id=33X5SNWJF2TZQXJTG64SLUQWXH3DN2UFNVWBRHAXZRH6QTKYLF6A, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.348750038 (393h8m20.779830169s) [noise=true , address=104.36.82.49:4981 , piece_id=XGICVF4662MOR6VEK2ADZEWYNJMSDLX4QAYJF36V2Y6NA5HMLGTA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.348916506 (393h8m20.779996638s) [noise=true , address=77.90.31.21:4906 , piece_id=QFQ7BN5AN2PL2EGUYR6VEIT3KEFKJAKF2AAZYB244KWSFQEM6KRQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349089739 (393h8m20.78016987s) [noise=true , address=104.36.82.5:4845 , piece_id=ATNNHWTQBTLRHBIMBEEPTOQVZB7FQJNFQB2K6ZLPL6QS6BI3QVQQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349126258 (393h8m20.780206389s) [noise=true , address=104.36.82.2:4763 , piece_id=ANLMBDL2PYRJONXZS3OTG5QBURJWPKK7CUHNHVKENJ4U6C7E36VQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349452843 (393h8m20.780532974s) [noise=true , address=104.36.82.23:4461 , piece_id=SQE6J5A2ISWIVUGVOY6EPRCZN5U4UTBQA3A3YGVW2HYMQVGXIYZQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349459957 (393h8m20.780540088s) [noise=true , address=79.127.220.97:4378 , piece_id=YYKDMK7KRKCPEKPYBPMBWLM3KDVWPWVSPDYXR5YA7WBNRHTNCNWA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349641965 (393h8m20.780722096s) [noise=true , address=45.91.116.11:4146 , piece_id=JSRRGQXBTX7DPR64QO337EWQY5N2ICFGOQHL4TAKVUDU5EPBVUKQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349716348 (393h8m20.780796479s) [noise=true , address=104.36.82.41:4793 , piece_id=YZXE3NO4ZYQ5M5YGIRFXPYCM7REVVISSKRLH27ZBJYTHHWQ2UW4Q, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349894809 (393h8m20.78097494s) [noise=true , address=79.127.219.48:4108 , piece_id=KVYGLDZAAOTVNLPRSEJEXKZSRCNOSUAKW7X4GJGB5JLBEX3GJJ3A, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349983037 (393h8m20.781063168s) [noise=true , address=79.127.205.234:4587 , piece_id=ALROUTBEYI3W3DHB33UXFLY6KLJP5TV354KMVTKDLKYNNNJBJGRA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.350127414 (393h8m20.781207545s) [noise=true , address=104.36.82.15:4268 , piece_id=WQISR5A7DFOS7L6XYLJAQEF76QJDD75FOIW4CRYCEJX2IPR2J7IQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.350265098 (393h8m20.781345219s) [noise=true , address=77.90.31.11:4577 , piece_id=U5KJME6LDQKJA7CJWSZIO7IEIHQS65JTS5GX5IXYYZUGVSW2XNYQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.350359718 (393h8m20.781439849s) [noise=true , address=79.127.205.246:4268 , piece_id=CFU74PAGS4WIORJGN7GYH3DELTCYPYZDTELADQLNUOCPMUHUMYRA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.350593406 (393h8m20.781673527s) [noise=true , address=79.127.201.215:4349 , piece_id=GGJZI5PARR44JSSBGNKJGTJMPJJKYJ2RRI77RGO7AE5ZH7A4HJKQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:27.463621721 (393h8m21.894701842s) [upload=408956]: Next returned nil segment
Aug 25 02:34:27.463637983 (393h8m21.894718114s) [upload=408956]: Waiting for error group managing segments...
Aug 25 02:34:27.745117536 (393h8m22.176197688s) [noise=true , address=79.127.205.234:4587 , piece_id=ALROUTBEYI3W3DHB33UXFLY6KLJP5TV354KMVTKDLKYNNNJBJGRA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:27.810934997 (393h8m22.242015128s) [noise=true , address=79.127.205.246:4268 , piece_id=CFU74PAGS4WIORJGN7GYH3DELTCYPYZDTELADQLNUOCPMUHUMYRA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:27.811268275 (393h8m22.242348406s) [noise=true , address=79.127.205.233:4624 , piece_id=33X5SNWJF2TZQXJTG64SLUQWXH3DN2UFNVWBRHAXZRH6QTKYLF6A, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.189025154 (393h8m22.620105285s) [noise=true , address=79.127.220.97:4378 , piece_id=YYKDMK7KRKCPEKPYBPMBWLM3KDVWPWVSPDYXR5YA7WBNRHTNCNWA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.248947635 (393h8m22.680027766s) [noise=true , address=45.91.116.11:4146 , piece_id=JSRRGQXBTX7DPR64QO337EWQY5N2ICFGOQHL4TAKVUDU5EPBVUKQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.259090503 (393h8m22.690170634s) [noise=true , address=104.36.82.20:4456 , piece_id=D5V4RNZLADZUYPZKZEWNCEGEZLW3IQQIXAKMIATIKFSDIVHPRCHQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.260482165 (393h8m22.691562296s) [noise=true , address=104.36.82.43:4854 , piece_id=4OQVLCKBSUIWQBCAZTYXQGZBHXVUFUJX7RIJGEFACH2OM5BTVFSA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.272367408 (393h8m22.703447539s) [noise=true , address=104.36.82.2:4763 , piece_id=ANLMBDL2PYRJONXZS3OTG5QBURJWPKK7CUHNHVKENJ4U6C7E36VQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.277535367 (393h8m22.708615498s) [noise=true , address=104.36.82.11:4124 , piece_id=IRJ7O3DGKVAX2PDEDWS3VPA7USXL3PUJRHTBNJ4UTFJH4H6ZY64Q, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.285842933 (393h8m22.716923064s) [noise=true , address=79.127.201.215:4349 , piece_id=GGJZI5PARR44JSSBGNKJGTJMPJJKYJ2RRI77RGO7AE5ZH7A4HJKQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.304641704 (393h8m22.735721835s) [noise=true , address=104.36.82.23:4461 , piece_id=SQE6J5A2ISWIVUGVOY6EPRCZN5U4UTBQA3A3YGVW2HYMQVGXIYZQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.322586250 (393h8m22.753666381s) [noise=true , address=79.127.219.48:4108 , piece_id=KVYGLDZAAOTVNLPRSEJEXKZSRCNOSUAKW7X4GJGB5JLBEX3GJJ3A, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.331220763 (393h8m22.762300894s) [noise=true , address=104.36.82.49:4981 , piece_id=XGICVF4662MOR6VEK2ADZEWYNJMSDLX4QAYJF36V2Y6NA5HMLGTA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.358659366 (393h8m22.789739497s) [noise=true , address=104.36.82.15:4268 , piece_id=WQISR5A7DFOS7L6XYLJAQEF76QJDD75FOIW4CRYCEJX2IPR2J7IQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.358701456 (393h8m22.789781587s) [seg_pos={0 0}, upload=408956]: Segment reached optimal threshold of 14 pieces.
Aug 25 02:34:28.358989578 (393h8m22.790069709s) [noise=true , address=77.90.31.21:4906 , piece_id=QFQ7BN5AN2PL2EGUYR6VEIT3KEFKJAKF2AAZYB244KWSFQEM6KRQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HG7FfbxD7WJZxWS5CXYFuJgj8n5L7tMr1ZfrcyF6Lih2S67R9): protocol: expected piece hash; context canceled; EOF
Aug 25 02:34:28.359105880 (393h8m22.790186011s) [noise=true , address=104.36.82.5:4845 , piece_id=ATNNHWTQBTLRHBIMBEEPTOQVZB7FQJNFQB2K6ZLPL6QS6BI3QVQQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nChJBXktwFs6z7cSK2Wh6N3jkAZwTZ7zhEUt393Nnx4eB6ube): protocol: write tcp 188.166.225.170:42884->104.36.82.5:4845: use of closed network connection; write tcp 188.166.225.170:42884->104.36.82.5:4845: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42884->104.36.82.5:4845: use of closed network connection
Aug 25 02:34:28.359138102 (393h8m22.790218223s) [noise=true , address=104.36.82.41:4793 , piece_id=YZXE3NO4ZYQ5M5YGIRFXPYCM7REVVISSKRLH27ZBJYTHHWQ2UW4Q, seg_pos={0 0}, upload=408956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1asDxxBjiU6yNbZ5c6uBmSWQ4QbVs5J3ErLbpKBSwqaptpNhpn): protocol: expected piece hash; context canceled; EOF
Aug 25 02:34:28.359194279 (393h8m22.79027441s) [noise=true , address=77.90.31.11:4577 , piece_id=U5KJME6LDQKJA7CJWSZIO7IEIHQS65JTS5GX5IXYYZUGVSW2XNYQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rKdimacehmW1Tp5Zp4DJFxafLhcEeNh61cfw8Bfefr9pRG2ei): protocol: write tcp 188.166.225.170:38650->77.90.31.11:4577: use of closed network connection; write tcp 188.166.225.170:38650->77.90.31.11:4577: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38650->77.90.31.11:4577: use of closed network connection
Aug 25 02:34:28.359211953 (393h8m22.790292084s) [seg_pos={0 0}, upload=408956]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 02:34:28.359290744 (393h8m22.790370875s) [upload=408956]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 02:34:28.359294391 (393h8m22.790374522s) [upload=408956]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 02:34:28.707475437 (393h8m23.138555558s) [upload=408956]: Done uploading segments...
Aug 25 02:34:28.707492770 (393h8m23.138572901s) [upload=408956]: Upload finished. err: <nil>
Duration: 5.764721568s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X........................X] duration:
857.50108ms
FAIL (2025-08-25 02:40:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 02:40:39.114963838 (393h14m33.546043969s) [upload=409065]: Starting upload Aug 25 02:40:39.115008714 (393h14m33.546088845s) [upload=409065]: Done starting upload Aug 25 02:40:39.115066234 (393h14m33.546146365s) [upload=409065]: Uploading segments... Aug 25 02:40:39.115134465 (393h14m33.546214596s) [upload=409065]: Got next segment. Inline: true Aug 25 02:40:39.115140427 (393h14m33.546220558s) [upload=409065]: Waiting for error group managing segments... Aug 25 02:40:39.115174081 (393h14m33.546254212s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 02:40:39.115180312 (393h14m33.546260443s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 02:40:39.115183148 (393h14m33.546263279s) [upload=409065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 02:40:39.327999117 (393h14m33.759079238s) [upload=409065]: Done uploading segments... Aug 25 02:40:39.328017602 (393h14m33.759097733s) [upload=409065]: Upload finished. err: metaclient: Too Many Requests
Duration: 857.557258ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X.......X.........X........................X.........] duration:
5.746920815s
FAIL (2025-08-25 02:40:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 02:34:25.828860590 (393h8m20.259940721s) [upload=408956]: Starting upload
Aug 25 02:34:25.828907169 (393h8m20.2599873s) [upload=408956]: Done starting upload
Aug 25 02:34:25.829016829 (393h8m20.26009696s) [upload=408956]: Uploading segments...
Aug 25 02:34:25.829141478 (393h8m20.260221609s) [upload=408956]: Got next segment. Inline: false
Aug 25 02:34:25.829171375 (393h8m20.260251496s) [upload=408956]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 02:34:25.829175723 (393h8m20.260255854s) [upload=408956]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 02:34:26.347631608 (393h8m20.778711769s) [seg_pos={0 0}, upload=408956]: Begin upload segment...
Aug 25 02:34:26.347696893 (393h8m20.778777044s) [seg_pos={0 0}, upload=408956]: Done begin upload segment.
Aug 25 02:34:26.347732291 (393h8m20.778812452s) [noise=true , address=104.36.82.43:4854 , piece_id=4OQVLCKBSUIWQBCAZTYXQGZBHXVUFUJX7RIJGEFACH2OM5BTVFSA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.347767007 (393h8m20.778847138s) [noise=true , address=104.36.82.11:4124 , piece_id=IRJ7O3DGKVAX2PDEDWS3VPA7USXL3PUJRHTBNJ4UTFJH4H6ZY64Q, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.348211979 (393h8m20.7792921s) [noise=true , address=104.36.82.20:4456 , piece_id=D5V4RNZLADZUYPZKZEWNCEGEZLW3IQQIXAKMIATIKFSDIVHPRCHQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.348236124 (393h8m20.779316245s) [noise=true , address=79.127.205.233:4624 , piece_id=33X5SNWJF2TZQXJTG64SLUQWXH3DN2UFNVWBRHAXZRH6QTKYLF6A, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.348750038 (393h8m20.779830169s) [noise=true , address=104.36.82.49:4981 , piece_id=XGICVF4662MOR6VEK2ADZEWYNJMSDLX4QAYJF36V2Y6NA5HMLGTA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.348916506 (393h8m20.779996638s) [noise=true , address=77.90.31.21:4906 , piece_id=QFQ7BN5AN2PL2EGUYR6VEIT3KEFKJAKF2AAZYB244KWSFQEM6KRQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349089739 (393h8m20.78016987s) [noise=true , address=104.36.82.5:4845 , piece_id=ATNNHWTQBTLRHBIMBEEPTOQVZB7FQJNFQB2K6ZLPL6QS6BI3QVQQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349126258 (393h8m20.780206389s) [noise=true , address=104.36.82.2:4763 , piece_id=ANLMBDL2PYRJONXZS3OTG5QBURJWPKK7CUHNHVKENJ4U6C7E36VQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349452843 (393h8m20.780532974s) [noise=true , address=104.36.82.23:4461 , piece_id=SQE6J5A2ISWIVUGVOY6EPRCZN5U4UTBQA3A3YGVW2HYMQVGXIYZQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349459957 (393h8m20.780540088s) [noise=true , address=79.127.220.97:4378 , piece_id=YYKDMK7KRKCPEKPYBPMBWLM3KDVWPWVSPDYXR5YA7WBNRHTNCNWA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349641965 (393h8m20.780722096s) [noise=true , address=45.91.116.11:4146 , piece_id=JSRRGQXBTX7DPR64QO337EWQY5N2ICFGOQHL4TAKVUDU5EPBVUKQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349716348 (393h8m20.780796479s) [noise=true , address=104.36.82.41:4793 , piece_id=YZXE3NO4ZYQ5M5YGIRFXPYCM7REVVISSKRLH27ZBJYTHHWQ2UW4Q, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349894809 (393h8m20.78097494s) [noise=true , address=79.127.219.48:4108 , piece_id=KVYGLDZAAOTVNLPRSEJEXKZSRCNOSUAKW7X4GJGB5JLBEX3GJJ3A, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349983037 (393h8m20.781063168s) [noise=true , address=79.127.205.234:4587 , piece_id=ALROUTBEYI3W3DHB33UXFLY6KLJP5TV354KMVTKDLKYNNNJBJGRA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.350127414 (393h8m20.781207545s) [noise=true , address=104.36.82.15:4268 , piece_id=WQISR5A7DFOS7L6XYLJAQEF76QJDD75FOIW4CRYCEJX2IPR2J7IQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.350265098 (393h8m20.781345219s) [noise=true , address=77.90.31.11:4577 , piece_id=U5KJME6LDQKJA7CJWSZIO7IEIHQS65JTS5GX5IXYYZUGVSW2XNYQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.350359718 (393h8m20.781439849s) [noise=true , address=79.127.205.246:4268 , piece_id=CFU74PAGS4WIORJGN7GYH3DELTCYPYZDTELADQLNUOCPMUHUMYRA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.350593406 (393h8m20.781673527s) [noise=true , address=79.127.201.215:4349 , piece_id=GGJZI5PARR44JSSBGNKJGTJMPJJKYJ2RRI77RGO7AE5ZH7A4HJKQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:27.463621721 (393h8m21.894701842s) [upload=408956]: Next returned nil segment
Aug 25 02:34:27.463637983 (393h8m21.894718114s) [upload=408956]: Waiting for error group managing segments...
Aug 25 02:34:27.745117536 (393h8m22.176197688s) [noise=true , address=79.127.205.234:4587 , piece_id=ALROUTBEYI3W3DHB33UXFLY6KLJP5TV354KMVTKDLKYNNNJBJGRA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:27.810934997 (393h8m22.242015128s) [noise=true , address=79.127.205.246:4268 , piece_id=CFU74PAGS4WIORJGN7GYH3DELTCYPYZDTELADQLNUOCPMUHUMYRA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:27.811268275 (393h8m22.242348406s) [noise=true , address=79.127.205.233:4624 , piece_id=33X5SNWJF2TZQXJTG64SLUQWXH3DN2UFNVWBRHAXZRH6QTKYLF6A, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.189025154 (393h8m22.620105285s) [noise=true , address=79.127.220.97:4378 , piece_id=YYKDMK7KRKCPEKPYBPMBWLM3KDVWPWVSPDYXR5YA7WBNRHTNCNWA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.248947635 (393h8m22.680027766s) [noise=true , address=45.91.116.11:4146 , piece_id=JSRRGQXBTX7DPR64QO337EWQY5N2ICFGOQHL4TAKVUDU5EPBVUKQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.259090503 (393h8m22.690170634s) [noise=true , address=104.36.82.20:4456 , piece_id=D5V4RNZLADZUYPZKZEWNCEGEZLW3IQQIXAKMIATIKFSDIVHPRCHQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.260482165 (393h8m22.691562296s) [noise=true , address=104.36.82.43:4854 , piece_id=4OQVLCKBSUIWQBCAZTYXQGZBHXVUFUJX7RIJGEFACH2OM5BTVFSA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.272367408 (393h8m22.703447539s) [noise=true , address=104.36.82.2:4763 , piece_id=ANLMBDL2PYRJONXZS3OTG5QBURJWPKK7CUHNHVKENJ4U6C7E36VQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.277535367 (393h8m22.708615498s) [noise=true , address=104.36.82.11:4124 , piece_id=IRJ7O3DGKVAX2PDEDWS3VPA7USXL3PUJRHTBNJ4UTFJH4H6ZY64Q, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.285842933 (393h8m22.716923064s) [noise=true , address=79.127.201.215:4349 , piece_id=GGJZI5PARR44JSSBGNKJGTJMPJJKYJ2RRI77RGO7AE5ZH7A4HJKQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.304641704 (393h8m22.735721835s) [noise=true , address=104.36.82.23:4461 , piece_id=SQE6J5A2ISWIVUGVOY6EPRCZN5U4UTBQA3A3YGVW2HYMQVGXIYZQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.322586250 (393h8m22.753666381s) [noise=true , address=79.127.219.48:4108 , piece_id=KVYGLDZAAOTVNLPRSEJEXKZSRCNOSUAKW7X4GJGB5JLBEX3GJJ3A, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.331220763 (393h8m22.762300894s) [noise=true , address=104.36.82.49:4981 , piece_id=XGICVF4662MOR6VEK2ADZEWYNJMSDLX4QAYJF36V2Y6NA5HMLGTA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.358659366 (393h8m22.789739497s) [noise=true , address=104.36.82.15:4268 , piece_id=WQISR5A7DFOS7L6XYLJAQEF76QJDD75FOIW4CRYCEJX2IPR2J7IQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.358701456 (393h8m22.789781587s) [seg_pos={0 0}, upload=408956]: Segment reached optimal threshold of 14 pieces.
Aug 25 02:34:28.358989578 (393h8m22.790069709s) [noise=true , address=77.90.31.21:4906 , piece_id=QFQ7BN5AN2PL2EGUYR6VEIT3KEFKJAKF2AAZYB244KWSFQEM6KRQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HG7FfbxD7WJZxWS5CXYFuJgj8n5L7tMr1ZfrcyF6Lih2S67R9): protocol: expected piece hash; context canceled; EOF
Aug 25 02:34:28.359105880 (393h8m22.790186011s) [noise=true , address=104.36.82.5:4845 , piece_id=ATNNHWTQBTLRHBIMBEEPTOQVZB7FQJNFQB2K6ZLPL6QS6BI3QVQQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nChJBXktwFs6z7cSK2Wh6N3jkAZwTZ7zhEUt393Nnx4eB6ube): protocol: write tcp 188.166.225.170:42884->104.36.82.5:4845: use of closed network connection; write tcp 188.166.225.170:42884->104.36.82.5:4845: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42884->104.36.82.5:4845: use of closed network connection
Aug 25 02:34:28.359138102 (393h8m22.790218223s) [noise=true , address=104.36.82.41:4793 , piece_id=YZXE3NO4ZYQ5M5YGIRFXPYCM7REVVISSKRLH27ZBJYTHHWQ2UW4Q, seg_pos={0 0}, upload=408956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1asDxxBjiU6yNbZ5c6uBmSWQ4QbVs5J3ErLbpKBSwqaptpNhpn): protocol: expected piece hash; context canceled; EOF
Aug 25 02:34:28.359194279 (393h8m22.79027441s) [noise=true , address=77.90.31.11:4577 , piece_id=U5KJME6LDQKJA7CJWSZIO7IEIHQS65JTS5GX5IXYYZUGVSW2XNYQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rKdimacehmW1Tp5Zp4DJFxafLhcEeNh61cfw8Bfefr9pRG2ei): protocol: write tcp 188.166.225.170:38650->77.90.31.11:4577: use of closed network connection; write tcp 188.166.225.170:38650->77.90.31.11:4577: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38650->77.90.31.11:4577: use of closed network connection
Aug 25 02:34:28.359211953 (393h8m22.790292084s) [seg_pos={0 0}, upload=408956]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 02:34:28.359290744 (393h8m22.790370875s) [upload=408956]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 02:34:28.359294391 (393h8m22.790374522s) [upload=408956]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 02:34:28.707475437 (393h8m23.138555558s) [upload=408956]: Done uploading segments...
Aug 25 02:34:28.707492770 (393h8m23.138572901s) [upload=408956]: Upload finished. err: <nil>
Duration: 5.746953687s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
1.862629381s
FAIL (2025-08-25 02:40:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 25 02:23:28.286113573 (392h57m22.717193704s) [upload=408759]: Starting upload
Aug 25 02:23:28.286153190 (392h57m22.717233321s) [upload=408759]: Done starting upload
Aug 25 02:23:28.286197124 (392h57m22.717277245s) [upload=408759]: Uploading segments...
Aug 25 02:23:28.286246387 (392h57m22.717326519s) [upload=408759]: Got next segment. Inline: true
Aug 25 02:23:28.286250235 (392h57m22.717330366s) [upload=408759]: Waiting for error group managing segments...
Aug 25 02:23:28.286284671 (392h57m22.717364792s) [upload=408759]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 02:23:28.286289090 (392h57m22.717369211s) [upload=408759]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 25 02:23:28.286291865 (392h57m22.717371996s) [upload=408759]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 02:23:29.116626085 (392h57m23.547706216s) [upload=408759]: Done uploading segments...
Aug 25 02:23:29.116645432 (392h57m23.547725563s) [upload=408759]: Upload finished. err: <nil>
Duration: 1.862689424s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X.......X.........X........................X........] duration:
5.734390312s
FAIL (2025-08-25 02:39:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 02:34:25.828860590 (393h8m20.259940721s) [upload=408956]: Starting upload
Aug 25 02:34:25.828907169 (393h8m20.2599873s) [upload=408956]: Done starting upload
Aug 25 02:34:25.829016829 (393h8m20.26009696s) [upload=408956]: Uploading segments...
Aug 25 02:34:25.829141478 (393h8m20.260221609s) [upload=408956]: Got next segment. Inline: false
Aug 25 02:34:25.829171375 (393h8m20.260251496s) [upload=408956]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 02:34:25.829175723 (393h8m20.260255854s) [upload=408956]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 02:34:26.347631608 (393h8m20.778711769s) [seg_pos={0 0}, upload=408956]: Begin upload segment...
Aug 25 02:34:26.347696893 (393h8m20.778777044s) [seg_pos={0 0}, upload=408956]: Done begin upload segment.
Aug 25 02:34:26.347732291 (393h8m20.778812452s) [noise=true , address=104.36.82.43:4854 , piece_id=4OQVLCKBSUIWQBCAZTYXQGZBHXVUFUJX7RIJGEFACH2OM5BTVFSA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.347767007 (393h8m20.778847138s) [noise=true , address=104.36.82.11:4124 , piece_id=IRJ7O3DGKVAX2PDEDWS3VPA7USXL3PUJRHTBNJ4UTFJH4H6ZY64Q, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.348211979 (393h8m20.7792921s) [noise=true , address=104.36.82.20:4456 , piece_id=D5V4RNZLADZUYPZKZEWNCEGEZLW3IQQIXAKMIATIKFSDIVHPRCHQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.348236124 (393h8m20.779316245s) [noise=true , address=79.127.205.233:4624 , piece_id=33X5SNWJF2TZQXJTG64SLUQWXH3DN2UFNVWBRHAXZRH6QTKYLF6A, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.348750038 (393h8m20.779830169s) [noise=true , address=104.36.82.49:4981 , piece_id=XGICVF4662MOR6VEK2ADZEWYNJMSDLX4QAYJF36V2Y6NA5HMLGTA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.348916506 (393h8m20.779996638s) [noise=true , address=77.90.31.21:4906 , piece_id=QFQ7BN5AN2PL2EGUYR6VEIT3KEFKJAKF2AAZYB244KWSFQEM6KRQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349089739 (393h8m20.78016987s) [noise=true , address=104.36.82.5:4845 , piece_id=ATNNHWTQBTLRHBIMBEEPTOQVZB7FQJNFQB2K6ZLPL6QS6BI3QVQQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349126258 (393h8m20.780206389s) [noise=true , address=104.36.82.2:4763 , piece_id=ANLMBDL2PYRJONXZS3OTG5QBURJWPKK7CUHNHVKENJ4U6C7E36VQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349452843 (393h8m20.780532974s) [noise=true , address=104.36.82.23:4461 , piece_id=SQE6J5A2ISWIVUGVOY6EPRCZN5U4UTBQA3A3YGVW2HYMQVGXIYZQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349459957 (393h8m20.780540088s) [noise=true , address=79.127.220.97:4378 , piece_id=YYKDMK7KRKCPEKPYBPMBWLM3KDVWPWVSPDYXR5YA7WBNRHTNCNWA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349641965 (393h8m20.780722096s) [noise=true , address=45.91.116.11:4146 , piece_id=JSRRGQXBTX7DPR64QO337EWQY5N2ICFGOQHL4TAKVUDU5EPBVUKQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349716348 (393h8m20.780796479s) [noise=true , address=104.36.82.41:4793 , piece_id=YZXE3NO4ZYQ5M5YGIRFXPYCM7REVVISSKRLH27ZBJYTHHWQ2UW4Q, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349894809 (393h8m20.78097494s) [noise=true , address=79.127.219.48:4108 , piece_id=KVYGLDZAAOTVNLPRSEJEXKZSRCNOSUAKW7X4GJGB5JLBEX3GJJ3A, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349983037 (393h8m20.781063168s) [noise=true , address=79.127.205.234:4587 , piece_id=ALROUTBEYI3W3DHB33UXFLY6KLJP5TV354KMVTKDLKYNNNJBJGRA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.350127414 (393h8m20.781207545s) [noise=true , address=104.36.82.15:4268 , piece_id=WQISR5A7DFOS7L6XYLJAQEF76QJDD75FOIW4CRYCEJX2IPR2J7IQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.350265098 (393h8m20.781345219s) [noise=true , address=77.90.31.11:4577 , piece_id=U5KJME6LDQKJA7CJWSZIO7IEIHQS65JTS5GX5IXYYZUGVSW2XNYQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.350359718 (393h8m20.781439849s) [noise=true , address=79.127.205.246:4268 , piece_id=CFU74PAGS4WIORJGN7GYH3DELTCYPYZDTELADQLNUOCPMUHUMYRA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.350593406 (393h8m20.781673527s) [noise=true , address=79.127.201.215:4349 , piece_id=GGJZI5PARR44JSSBGNKJGTJMPJJKYJ2RRI77RGO7AE5ZH7A4HJKQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:27.463621721 (393h8m21.894701842s) [upload=408956]: Next returned nil segment
Aug 25 02:34:27.463637983 (393h8m21.894718114s) [upload=408956]: Waiting for error group managing segments...
Aug 25 02:34:27.745117536 (393h8m22.176197688s) [noise=true , address=79.127.205.234:4587 , piece_id=ALROUTBEYI3W3DHB33UXFLY6KLJP5TV354KMVTKDLKYNNNJBJGRA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:27.810934997 (393h8m22.242015128s) [noise=true , address=79.127.205.246:4268 , piece_id=CFU74PAGS4WIORJGN7GYH3DELTCYPYZDTELADQLNUOCPMUHUMYRA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:27.811268275 (393h8m22.242348406s) [noise=true , address=79.127.205.233:4624 , piece_id=33X5SNWJF2TZQXJTG64SLUQWXH3DN2UFNVWBRHAXZRH6QTKYLF6A, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.189025154 (393h8m22.620105285s) [noise=true , address=79.127.220.97:4378 , piece_id=YYKDMK7KRKCPEKPYBPMBWLM3KDVWPWVSPDYXR5YA7WBNRHTNCNWA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.248947635 (393h8m22.680027766s) [noise=true , address=45.91.116.11:4146 , piece_id=JSRRGQXBTX7DPR64QO337EWQY5N2ICFGOQHL4TAKVUDU5EPBVUKQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.259090503 (393h8m22.690170634s) [noise=true , address=104.36.82.20:4456 , piece_id=D5V4RNZLADZUYPZKZEWNCEGEZLW3IQQIXAKMIATIKFSDIVHPRCHQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.260482165 (393h8m22.691562296s) [noise=true , address=104.36.82.43:4854 , piece_id=4OQVLCKBSUIWQBCAZTYXQGZBHXVUFUJX7RIJGEFACH2OM5BTVFSA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.272367408 (393h8m22.703447539s) [noise=true , address=104.36.82.2:4763 , piece_id=ANLMBDL2PYRJONXZS3OTG5QBURJWPKK7CUHNHVKENJ4U6C7E36VQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.277535367 (393h8m22.708615498s) [noise=true , address=104.36.82.11:4124 , piece_id=IRJ7O3DGKVAX2PDEDWS3VPA7USXL3PUJRHTBNJ4UTFJH4H6ZY64Q, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.285842933 (393h8m22.716923064s) [noise=true , address=79.127.201.215:4349 , piece_id=GGJZI5PARR44JSSBGNKJGTJMPJJKYJ2RRI77RGO7AE5ZH7A4HJKQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.304641704 (393h8m22.735721835s) [noise=true , address=104.36.82.23:4461 , piece_id=SQE6J5A2ISWIVUGVOY6EPRCZN5U4UTBQA3A3YGVW2HYMQVGXIYZQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.322586250 (393h8m22.753666381s) [noise=true , address=79.127.219.48:4108 , piece_id=KVYGLDZAAOTVNLPRSEJEXKZSRCNOSUAKW7X4GJGB5JLBEX3GJJ3A, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.331220763 (393h8m22.762300894s) [noise=true , address=104.36.82.49:4981 , piece_id=XGICVF4662MOR6VEK2ADZEWYNJMSDLX4QAYJF36V2Y6NA5HMLGTA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.358659366 (393h8m22.789739497s) [noise=true , address=104.36.82.15:4268 , piece_id=WQISR5A7DFOS7L6XYLJAQEF76QJDD75FOIW4CRYCEJX2IPR2J7IQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.358701456 (393h8m22.789781587s) [seg_pos={0 0}, upload=408956]: Segment reached optimal threshold of 14 pieces.
Aug 25 02:34:28.358989578 (393h8m22.790069709s) [noise=true , address=77.90.31.21:4906 , piece_id=QFQ7BN5AN2PL2EGUYR6VEIT3KEFKJAKF2AAZYB244KWSFQEM6KRQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HG7FfbxD7WJZxWS5CXYFuJgj8n5L7tMr1ZfrcyF6Lih2S67R9): protocol: expected piece hash; context canceled; EOF
Aug 25 02:34:28.359105880 (393h8m22.790186011s) [noise=true , address=104.36.82.5:4845 , piece_id=ATNNHWTQBTLRHBIMBEEPTOQVZB7FQJNFQB2K6ZLPL6QS6BI3QVQQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nChJBXktwFs6z7cSK2Wh6N3jkAZwTZ7zhEUt393Nnx4eB6ube): protocol: write tcp 188.166.225.170:42884->104.36.82.5:4845: use of closed network connection; write tcp 188.166.225.170:42884->104.36.82.5:4845: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42884->104.36.82.5:4845: use of closed network connection
Aug 25 02:34:28.359138102 (393h8m22.790218223s) [noise=true , address=104.36.82.41:4793 , piece_id=YZXE3NO4ZYQ5M5YGIRFXPYCM7REVVISSKRLH27ZBJYTHHWQ2UW4Q, seg_pos={0 0}, upload=408956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1asDxxBjiU6yNbZ5c6uBmSWQ4QbVs5J3ErLbpKBSwqaptpNhpn): protocol: expected piece hash; context canceled; EOF
Aug 25 02:34:28.359194279 (393h8m22.79027441s) [noise=true , address=77.90.31.11:4577 , piece_id=U5KJME6LDQKJA7CJWSZIO7IEIHQS65JTS5GX5IXYYZUGVSW2XNYQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rKdimacehmW1Tp5Zp4DJFxafLhcEeNh61cfw8Bfefr9pRG2ei): protocol: write tcp 188.166.225.170:38650->77.90.31.11:4577: use of closed network connection; write tcp 188.166.225.170:38650->77.90.31.11:4577: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38650->77.90.31.11:4577: use of closed network connection
Aug 25 02:34:28.359211953 (393h8m22.790292084s) [seg_pos={0 0}, upload=408956]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 02:34:28.359290744 (393h8m22.790370875s) [upload=408956]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 02:34:28.359294391 (393h8m22.790374522s) [upload=408956]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 02:34:28.707475437 (393h8m23.138555558s) [upload=408956]: Done uploading segments...
Aug 25 02:34:28.707492770 (393h8m23.138572901s) [upload=408956]: Upload finished. err: <nil>
Duration: 5.734416783s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
1.981619684s
FAIL (2025-08-25 02:39:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 25 02:23:28.286113573 (392h57m22.717193704s) [upload=408759]: Starting upload
Aug 25 02:23:28.286153190 (392h57m22.717233321s) [upload=408759]: Done starting upload
Aug 25 02:23:28.286197124 (392h57m22.717277245s) [upload=408759]: Uploading segments...
Aug 25 02:23:28.286246387 (392h57m22.717326519s) [upload=408759]: Got next segment. Inline: true
Aug 25 02:23:28.286250235 (392h57m22.717330366s) [upload=408759]: Waiting for error group managing segments...
Aug 25 02:23:28.286284671 (392h57m22.717364792s) [upload=408759]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 02:23:28.286289090 (392h57m22.717369211s) [upload=408759]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 25 02:23:28.286291865 (392h57m22.717371996s) [upload=408759]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 02:23:29.116626085 (392h57m23.547706216s) [upload=408759]: Done uploading segments...
Aug 25 02:23:29.116645432 (392h57m23.547725563s) [upload=408759]: Upload finished. err: <nil>
Duration: 1.98163831s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........X.......X.........X........................X.......] duration:
5.451485166s
FAIL (2025-08-25 02:38:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 02:34:25.828860590 (393h8m20.259940721s) [upload=408956]: Starting upload
Aug 25 02:34:25.828907169 (393h8m20.2599873s) [upload=408956]: Done starting upload
Aug 25 02:34:25.829016829 (393h8m20.26009696s) [upload=408956]: Uploading segments...
Aug 25 02:34:25.829141478 (393h8m20.260221609s) [upload=408956]: Got next segment. Inline: false
Aug 25 02:34:25.829171375 (393h8m20.260251496s) [upload=408956]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 02:34:25.829175723 (393h8m20.260255854s) [upload=408956]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 02:34:26.347631608 (393h8m20.778711769s) [seg_pos={0 0}, upload=408956]: Begin upload segment...
Aug 25 02:34:26.347696893 (393h8m20.778777044s) [seg_pos={0 0}, upload=408956]: Done begin upload segment.
Aug 25 02:34:26.347732291 (393h8m20.778812452s) [noise=true , address=104.36.82.43:4854 , piece_id=4OQVLCKBSUIWQBCAZTYXQGZBHXVUFUJX7RIJGEFACH2OM5BTVFSA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.347767007 (393h8m20.778847138s) [noise=true , address=104.36.82.11:4124 , piece_id=IRJ7O3DGKVAX2PDEDWS3VPA7USXL3PUJRHTBNJ4UTFJH4H6ZY64Q, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.348211979 (393h8m20.7792921s) [noise=true , address=104.36.82.20:4456 , piece_id=D5V4RNZLADZUYPZKZEWNCEGEZLW3IQQIXAKMIATIKFSDIVHPRCHQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.348236124 (393h8m20.779316245s) [noise=true , address=79.127.205.233:4624 , piece_id=33X5SNWJF2TZQXJTG64SLUQWXH3DN2UFNVWBRHAXZRH6QTKYLF6A, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.348750038 (393h8m20.779830169s) [noise=true , address=104.36.82.49:4981 , piece_id=XGICVF4662MOR6VEK2ADZEWYNJMSDLX4QAYJF36V2Y6NA5HMLGTA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.348916506 (393h8m20.779996638s) [noise=true , address=77.90.31.21:4906 , piece_id=QFQ7BN5AN2PL2EGUYR6VEIT3KEFKJAKF2AAZYB244KWSFQEM6KRQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349089739 (393h8m20.78016987s) [noise=true , address=104.36.82.5:4845 , piece_id=ATNNHWTQBTLRHBIMBEEPTOQVZB7FQJNFQB2K6ZLPL6QS6BI3QVQQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349126258 (393h8m20.780206389s) [noise=true , address=104.36.82.2:4763 , piece_id=ANLMBDL2PYRJONXZS3OTG5QBURJWPKK7CUHNHVKENJ4U6C7E36VQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349452843 (393h8m20.780532974s) [noise=true , address=104.36.82.23:4461 , piece_id=SQE6J5A2ISWIVUGVOY6EPRCZN5U4UTBQA3A3YGVW2HYMQVGXIYZQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349459957 (393h8m20.780540088s) [noise=true , address=79.127.220.97:4378 , piece_id=YYKDMK7KRKCPEKPYBPMBWLM3KDVWPWVSPDYXR5YA7WBNRHTNCNWA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349641965 (393h8m20.780722096s) [noise=true , address=45.91.116.11:4146 , piece_id=JSRRGQXBTX7DPR64QO337EWQY5N2ICFGOQHL4TAKVUDU5EPBVUKQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349716348 (393h8m20.780796479s) [noise=true , address=104.36.82.41:4793 , piece_id=YZXE3NO4ZYQ5M5YGIRFXPYCM7REVVISSKRLH27ZBJYTHHWQ2UW4Q, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349894809 (393h8m20.78097494s) [noise=true , address=79.127.219.48:4108 , piece_id=KVYGLDZAAOTVNLPRSEJEXKZSRCNOSUAKW7X4GJGB5JLBEX3GJJ3A, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.349983037 (393h8m20.781063168s) [noise=true , address=79.127.205.234:4587 , piece_id=ALROUTBEYI3W3DHB33UXFLY6KLJP5TV354KMVTKDLKYNNNJBJGRA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.350127414 (393h8m20.781207545s) [noise=true , address=104.36.82.15:4268 , piece_id=WQISR5A7DFOS7L6XYLJAQEF76QJDD75FOIW4CRYCEJX2IPR2J7IQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.350265098 (393h8m20.781345219s) [noise=true , address=77.90.31.11:4577 , piece_id=U5KJME6LDQKJA7CJWSZIO7IEIHQS65JTS5GX5IXYYZUGVSW2XNYQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.350359718 (393h8m20.781439849s) [noise=true , address=79.127.205.246:4268 , piece_id=CFU74PAGS4WIORJGN7GYH3DELTCYPYZDTELADQLNUOCPMUHUMYRA, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:26.350593406 (393h8m20.781673527s) [noise=true , address=79.127.201.215:4349 , piece_id=GGJZI5PARR44JSSBGNKJGTJMPJJKYJ2RRI77RGO7AE5ZH7A4HJKQ, seg_pos={0 0}, upload=408956]: Uploading piece...
Aug 25 02:34:27.463621721 (393h8m21.894701842s) [upload=408956]: Next returned nil segment
Aug 25 02:34:27.463637983 (393h8m21.894718114s) [upload=408956]: Waiting for error group managing segments...
Aug 25 02:34:27.745117536 (393h8m22.176197688s) [noise=true , address=79.127.205.234:4587 , piece_id=ALROUTBEYI3W3DHB33UXFLY6KLJP5TV354KMVTKDLKYNNNJBJGRA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:27.810934997 (393h8m22.242015128s) [noise=true , address=79.127.205.246:4268 , piece_id=CFU74PAGS4WIORJGN7GYH3DELTCYPYZDTELADQLNUOCPMUHUMYRA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:27.811268275 (393h8m22.242348406s) [noise=true , address=79.127.205.233:4624 , piece_id=33X5SNWJF2TZQXJTG64SLUQWXH3DN2UFNVWBRHAXZRH6QTKYLF6A, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.189025154 (393h8m22.620105285s) [noise=true , address=79.127.220.97:4378 , piece_id=YYKDMK7KRKCPEKPYBPMBWLM3KDVWPWVSPDYXR5YA7WBNRHTNCNWA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.248947635 (393h8m22.680027766s) [noise=true , address=45.91.116.11:4146 , piece_id=JSRRGQXBTX7DPR64QO337EWQY5N2ICFGOQHL4TAKVUDU5EPBVUKQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.259090503 (393h8m22.690170634s) [noise=true , address=104.36.82.20:4456 , piece_id=D5V4RNZLADZUYPZKZEWNCEGEZLW3IQQIXAKMIATIKFSDIVHPRCHQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.260482165 (393h8m22.691562296s) [noise=true , address=104.36.82.43:4854 , piece_id=4OQVLCKBSUIWQBCAZTYXQGZBHXVUFUJX7RIJGEFACH2OM5BTVFSA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.272367408 (393h8m22.703447539s) [noise=true , address=104.36.82.2:4763 , piece_id=ANLMBDL2PYRJONXZS3OTG5QBURJWPKK7CUHNHVKENJ4U6C7E36VQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.277535367 (393h8m22.708615498s) [noise=true , address=104.36.82.11:4124 , piece_id=IRJ7O3DGKVAX2PDEDWS3VPA7USXL3PUJRHTBNJ4UTFJH4H6ZY64Q, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.285842933 (393h8m22.716923064s) [noise=true , address=79.127.201.215:4349 , piece_id=GGJZI5PARR44JSSBGNKJGTJMPJJKYJ2RRI77RGO7AE5ZH7A4HJKQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.304641704 (393h8m22.735721835s) [noise=true , address=104.36.82.23:4461 , piece_id=SQE6J5A2ISWIVUGVOY6EPRCZN5U4UTBQA3A3YGVW2HYMQVGXIYZQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.322586250 (393h8m22.753666381s) [noise=true , address=79.127.219.48:4108 , piece_id=KVYGLDZAAOTVNLPRSEJEXKZSRCNOSUAKW7X4GJGB5JLBEX3GJJ3A, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.331220763 (393h8m22.762300894s) [noise=true , address=104.36.82.49:4981 , piece_id=XGICVF4662MOR6VEK2ADZEWYNJMSDLX4QAYJF36V2Y6NA5HMLGTA, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.358659366 (393h8m22.789739497s) [noise=true , address=104.36.82.15:4268 , piece_id=WQISR5A7DFOS7L6XYLJAQEF76QJDD75FOIW4CRYCEJX2IPR2J7IQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: <nil>
Aug 25 02:34:28.358701456 (393h8m22.789781587s) [seg_pos={0 0}, upload=408956]: Segment reached optimal threshold of 14 pieces.
Aug 25 02:34:28.358989578 (393h8m22.790069709s) [noise=true , address=77.90.31.21:4906 , piece_id=QFQ7BN5AN2PL2EGUYR6VEIT3KEFKJAKF2AAZYB244KWSFQEM6KRQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HG7FfbxD7WJZxWS5CXYFuJgj8n5L7tMr1ZfrcyF6Lih2S67R9): protocol: expected piece hash; context canceled; EOF
Aug 25 02:34:28.359105880 (393h8m22.790186011s) [noise=true , address=104.36.82.5:4845 , piece_id=ATNNHWTQBTLRHBIMBEEPTOQVZB7FQJNFQB2K6ZLPL6QS6BI3QVQQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nChJBXktwFs6z7cSK2Wh6N3jkAZwTZ7zhEUt393Nnx4eB6ube): protocol: write tcp 188.166.225.170:42884->104.36.82.5:4845: use of closed network connection; write tcp 188.166.225.170:42884->104.36.82.5:4845: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42884->104.36.82.5:4845: use of closed network connection
Aug 25 02:34:28.359138102 (393h8m22.790218223s) [noise=true , address=104.36.82.41:4793 , piece_id=YZXE3NO4ZYQ5M5YGIRFXPYCM7REVVISSKRLH27ZBJYTHHWQ2UW4Q, seg_pos={0 0}, upload=408956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1asDxxBjiU6yNbZ5c6uBmSWQ4QbVs5J3ErLbpKBSwqaptpNhpn): protocol: expected piece hash; context canceled; EOF
Aug 25 02:34:28.359194279 (393h8m22.79027441s) [noise=true , address=77.90.31.11:4577 , piece_id=U5KJME6LDQKJA7CJWSZIO7IEIHQS65JTS5GX5IXYYZUGVSW2XNYQ, seg_pos={0 0}, upload=408956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rKdimacehmW1Tp5Zp4DJFxafLhcEeNh61cfw8Bfefr9pRG2ei): protocol: write tcp 188.166.225.170:38650->77.90.31.11:4577: use of closed network connection; write tcp 188.166.225.170:38650->77.90.31.11:4577: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38650->77.90.31.11:4577: use of closed network connection
Aug 25 02:34:28.359211953 (393h8m22.790292084s) [seg_pos={0 0}, upload=408956]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 02:34:28.359290744 (393h8m22.790370875s) [upload=408956]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 02:34:28.359294391 (393h8m22.790374522s) [upload=408956]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 02:34:28.707475437 (393h8m23.138555558s) [upload=408956]: Done uploading segments...
Aug 25 02:34:28.707492770 (393h8m23.138572901s) [upload=408956]: Upload finished. err: <nil>
Duration: 5.45150279s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|