Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...............................XX.......X............X......] duration:
5.746854419s
FAIL (2025-08-20 09:23:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:17:49.498326932 (279h51m43.929407103s) [upload=290943]: Starting upload Aug 20 09:17:49.498462862 (279h51m43.929543023s) [upload=290943]: Done starting upload Aug 20 09:17:49.498603711 (279h51m43.929683893s) [upload=290943]: Uploading segments... Aug 20 09:17:49.498936438 (279h51m43.930016619s) [upload=290943]: Got next segment. Inline: false Aug 20 09:17:49.498991704 (279h51m43.930071895s) [upload=290943]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:17:49.499000341 (279h51m43.930080522s) [upload=290943]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 09:17:49.712743519 (279h51m44.14382365s) [upload=290943]: Next segment err: metaclient: Too Many Requests Aug 20 09:17:49.712802652 (279h51m44.143882773s) [upload=290943]: Done uploading segments... Aug 20 09:17:49.712817550 (279h51m44.143897681s) [upload=290943]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.746884856s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X..............X.....X...X.......................] duration:
1.819314676s
FAIL (2025-08-20 09:22:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.819346637s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [................................XX.......X............X.....] duration:
5.873131314s
FAIL (2025-08-20 09:22:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:17:49.498326932 (279h51m43.929407103s) [upload=290943]: Starting upload Aug 20 09:17:49.498462862 (279h51m43.929543023s) [upload=290943]: Done starting upload Aug 20 09:17:49.498603711 (279h51m43.929683893s) [upload=290943]: Uploading segments... Aug 20 09:17:49.498936438 (279h51m43.930016619s) [upload=290943]: Got next segment. Inline: false Aug 20 09:17:49.498991704 (279h51m43.930071895s) [upload=290943]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:17:49.499000341 (279h51m43.930080522s) [upload=290943]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 09:17:49.712743519 (279h51m44.14382365s) [upload=290943]: Next segment err: metaclient: Too Many Requests Aug 20 09:17:49.712802652 (279h51m44.143882773s) [upload=290943]: Done uploading segments... Aug 20 09:17:49.712817550 (279h51m44.143897681s) [upload=290943]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.873157764s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X..............X.....X...X......................] duration:
1.911074414s
FAIL (2025-08-20 09:21:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.911095325s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.................................XX.......X............X....] duration:
5.80040927s
FAIL (2025-08-20 09:21:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:17:49.498326932 (279h51m43.929407103s) [upload=290943]: Starting upload Aug 20 09:17:49.498462862 (279h51m43.929543023s) [upload=290943]: Done starting upload Aug 20 09:17:49.498603711 (279h51m43.929683893s) [upload=290943]: Uploading segments... Aug 20 09:17:49.498936438 (279h51m43.930016619s) [upload=290943]: Got next segment. Inline: false Aug 20 09:17:49.498991704 (279h51m43.930071895s) [upload=290943]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:17:49.499000341 (279h51m43.930080522s) [upload=290943]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 09:17:49.712743519 (279h51m44.14382365s) [upload=290943]: Next segment err: metaclient: Too Many Requests Aug 20 09:17:49.712802652 (279h51m44.143882773s) [upload=290943]: Done uploading segments... Aug 20 09:17:49.712817550 (279h51m44.143897681s) [upload=290943]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.800443295s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............X..............X.....X...X.....................] duration:
1.814683202s
FAIL (2025-08-20 09:20:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.814711807s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X..............X.....X...X....................] duration:
1.818470089s
FAIL (2025-08-20 09:20:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.818497172s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..................................XX.......X............X...] duration:
5.541619127s
FAIL (2025-08-20 09:20:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:17:49.498326932 (279h51m43.929407103s) [upload=290943]: Starting upload Aug 20 09:17:49.498462862 (279h51m43.929543023s) [upload=290943]: Done starting upload Aug 20 09:17:49.498603711 (279h51m43.929683893s) [upload=290943]: Uploading segments... Aug 20 09:17:49.498936438 (279h51m43.930016619s) [upload=290943]: Got next segment. Inline: false Aug 20 09:17:49.498991704 (279h51m43.930071895s) [upload=290943]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:17:49.499000341 (279h51m43.930080522s) [upload=290943]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 09:17:49.712743519 (279h51m44.14382365s) [upload=290943]: Next segment err: metaclient: Too Many Requests Aug 20 09:17:49.712802652 (279h51m44.143882773s) [upload=290943]: Done uploading segments... Aug 20 09:17:49.712817550 (279h51m44.143897681s) [upload=290943]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.541645958s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...................................XX.......X............X..] duration:
5.528977081s
FAIL (2025-08-20 09:19:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:17:49.498326932 (279h51m43.929407103s) [upload=290943]: Starting upload Aug 20 09:17:49.498462862 (279h51m43.929543023s) [upload=290943]: Done starting upload Aug 20 09:17:49.498603711 (279h51m43.929683893s) [upload=290943]: Uploading segments... Aug 20 09:17:49.498936438 (279h51m43.930016619s) [upload=290943]: Got next segment. Inline: false Aug 20 09:17:49.498991704 (279h51m43.930071895s) [upload=290943]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:17:49.499000341 (279h51m43.930080522s) [upload=290943]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 09:17:49.712743519 (279h51m44.14382365s) [upload=290943]: Next segment err: metaclient: Too Many Requests Aug 20 09:17:49.712802652 (279h51m44.143882773s) [upload=290943]: Done uploading segments... Aug 20 09:17:49.712817550 (279h51m44.143897681s) [upload=290943]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.529007118s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............X..............X.....X...X...................] duration:
1.836859746s
FAIL (2025-08-20 09:19:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.836903819s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....................................XX.......X............X.] duration:
5.634887407s
FAIL (2025-08-20 09:18:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:17:49.498326932 (279h51m43.929407103s) [upload=290943]: Starting upload Aug 20 09:17:49.498462862 (279h51m43.929543023s) [upload=290943]: Done starting upload Aug 20 09:17:49.498603711 (279h51m43.929683893s) [upload=290943]: Uploading segments... Aug 20 09:17:49.498936438 (279h51m43.930016619s) [upload=290943]: Got next segment. Inline: false Aug 20 09:17:49.498991704 (279h51m43.930071895s) [upload=290943]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:17:49.499000341 (279h51m43.930080522s) [upload=290943]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 09:17:49.712743519 (279h51m44.14382365s) [upload=290943]: Next segment err: metaclient: Too Many Requests Aug 20 09:17:49.712802652 (279h51m44.143882773s) [upload=290943]: Done uploading segments... Aug 20 09:17:49.712817550 (279h51m44.143897681s) [upload=290943]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.634912365s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................X..............X.....X...X..................] duration:
1.826070844s
FAIL (2025-08-20 09:18:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.826097114s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....................................XX.......X............X] duration:
859.702144ms
FAIL (2025-08-20 09:17:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:17:49.498326932 (279h51m43.929407103s) [upload=290943]: Starting upload Aug 20 09:17:49.498462862 (279h51m43.929543023s) [upload=290943]: Done starting upload Aug 20 09:17:49.498603711 (279h51m43.929683893s) [upload=290943]: Uploading segments... Aug 20 09:17:49.498936438 (279h51m43.930016619s) [upload=290943]: Got next segment. Inline: false Aug 20 09:17:49.498991704 (279h51m43.930071895s) [upload=290943]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:17:49.499000341 (279h51m43.930080522s) [upload=290943]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 09:17:49.712743519 (279h51m44.14382365s) [upload=290943]: Next segment err: metaclient: Too Many Requests Aug 20 09:17:49.712802652 (279h51m44.143882773s) [upload=290943]: Done uploading segments... Aug 20 09:17:49.712817550 (279h51m44.143897681s) [upload=290943]: Upload finished. err: metaclient: Too Many Requests
Duration: 859.72086ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................................XX.......X............] duration:
5.534360841s
FAIL (2025-08-20 09:17:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:07:20.783618032 (279h41m15.214698163s) [upload=290762]: Starting upload Aug 20 09:07:20.783684169 (279h41m15.21476429s) [upload=290762]: Done starting upload Aug 20 09:07:20.783799179 (279h41m15.2148793s) [upload=290762]: Uploading segments... Aug 20 09:07:20.783886185 (279h41m15.214966316s) [upload=290762]: Got next segment. Inline: false Aug 20 09:07:20.783921513 (279h41m15.215001644s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:07:20.783925702 (279h41m15.215005833s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 09:07:21.067814505 (279h41m15.498894636s) [upload=290762]: Next segment err: metaclient: Too Many Requests Aug 20 09:07:21.067843992 (279h41m15.498924123s) [upload=290762]: Done uploading segments... Aug 20 09:07:21.067860463 (279h41m15.498940594s) [upload=290762]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.534386801s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.................X..............X.....X...X.................] duration:
2.269834245s
FAIL (2025-08-20 09:16:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.269872608s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................................XX.......X...........] duration:
5.690773766s
FAIL (2025-08-20 09:16:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:07:20.783618032 (279h41m15.214698163s) [upload=290762]: Starting upload Aug 20 09:07:20.783684169 (279h41m15.21476429s) [upload=290762]: Done starting upload Aug 20 09:07:20.783799179 (279h41m15.2148793s) [upload=290762]: Uploading segments... Aug 20 09:07:20.783886185 (279h41m15.214966316s) [upload=290762]: Got next segment. Inline: false Aug 20 09:07:20.783921513 (279h41m15.215001644s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:07:20.783925702 (279h41m15.215005833s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 09:07:21.067814505 (279h41m15.498894636s) [upload=290762]: Next segment err: metaclient: Too Many Requests Aug 20 09:07:21.067843992 (279h41m15.498924123s) [upload=290762]: Done uploading segments... Aug 20 09:07:21.067860463 (279h41m15.498940594s) [upload=290762]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.690798963s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..................X..............X.....X...X................] duration:
1.824835954s
FAIL (2025-08-20 09:15:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.824870008s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...................X..............X.....X...X...............] duration:
1.832234982s
FAIL (2025-08-20 09:15:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.832267062s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................................XX.......X..........] duration:
5.773156283s
FAIL (2025-08-20 09:15:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:07:20.783618032 (279h41m15.214698163s) [upload=290762]: Starting upload Aug 20 09:07:20.783684169 (279h41m15.21476429s) [upload=290762]: Done starting upload Aug 20 09:07:20.783799179 (279h41m15.2148793s) [upload=290762]: Uploading segments... Aug 20 09:07:20.783886185 (279h41m15.214966316s) [upload=290762]: Got next segment. Inline: false Aug 20 09:07:20.783921513 (279h41m15.215001644s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:07:20.783925702 (279h41m15.215005833s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 09:07:21.067814505 (279h41m15.498894636s) [upload=290762]: Next segment err: metaclient: Too Many Requests Aug 20 09:07:21.067843992 (279h41m15.498924123s) [upload=290762]: Done uploading segments... Aug 20 09:07:21.067860463 (279h41m15.498940594s) [upload=290762]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.773184177s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....................X..............X.....X...X..............] duration:
1.94786856s
FAIL (2025-08-20 09:14:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.947890291s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................................XX.......X.........] duration:
5.55660386s
FAIL (2025-08-20 09:14:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:07:20.783618032 (279h41m15.214698163s) [upload=290762]: Starting upload Aug 20 09:07:20.783684169 (279h41m15.21476429s) [upload=290762]: Done starting upload Aug 20 09:07:20.783799179 (279h41m15.2148793s) [upload=290762]: Uploading segments... Aug 20 09:07:20.783886185 (279h41m15.214966316s) [upload=290762]: Got next segment. Inline: false Aug 20 09:07:20.783921513 (279h41m15.215001644s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:07:20.783925702 (279h41m15.215005833s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 09:07:21.067814505 (279h41m15.498894636s) [upload=290762]: Next segment err: metaclient: Too Many Requests Aug 20 09:07:21.067843992 (279h41m15.498924123s) [upload=290762]: Done uploading segments... Aug 20 09:07:21.067860463 (279h41m15.498940594s) [upload=290762]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.556629448s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................................XX.......X........] duration:
5.690322754s
FAIL (2025-08-20 09:14:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:07:20.783618032 (279h41m15.214698163s) [upload=290762]: Starting upload Aug 20 09:07:20.783684169 (279h41m15.21476429s) [upload=290762]: Done starting upload Aug 20 09:07:20.783799179 (279h41m15.2148793s) [upload=290762]: Uploading segments... Aug 20 09:07:20.783886185 (279h41m15.214966316s) [upload=290762]: Got next segment. Inline: false Aug 20 09:07:20.783921513 (279h41m15.215001644s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:07:20.783925702 (279h41m15.215005833s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 09:07:21.067814505 (279h41m15.498894636s) [upload=290762]: Next segment err: metaclient: Too Many Requests Aug 20 09:07:21.067843992 (279h41m15.498924123s) [upload=290762]: Done uploading segments... Aug 20 09:07:21.067860463 (279h41m15.498940594s) [upload=290762]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.690402084s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....................X..............X.....X...X.............] duration:
2.017973617s
FAIL (2025-08-20 09:13:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.017998676s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................................XX.......X.......] duration:
5.717089399s
FAIL (2025-08-20 09:13:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:07:20.783618032 (279h41m15.214698163s) [upload=290762]: Starting upload Aug 20 09:07:20.783684169 (279h41m15.21476429s) [upload=290762]: Done starting upload Aug 20 09:07:20.783799179 (279h41m15.2148793s) [upload=290762]: Uploading segments... Aug 20 09:07:20.783886185 (279h41m15.214966316s) [upload=290762]: Got next segment. Inline: false Aug 20 09:07:20.783921513 (279h41m15.215001644s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:07:20.783925702 (279h41m15.215005833s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 09:07:21.067814505 (279h41m15.498894636s) [upload=290762]: Next segment err: metaclient: Too Many Requests Aug 20 09:07:21.067843992 (279h41m15.498924123s) [upload=290762]: Done uploading segments... Aug 20 09:07:21.067860463 (279h41m15.498940594s) [upload=290762]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.71712181s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......................X..............X.....X...X............] duration:
2.063650375s
FAIL (2025-08-20 09:13:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.063705119s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................................XX.......X......] duration:
5.697524003s
FAIL (2025-08-20 09:12:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:07:20.783618032 (279h41m15.214698163s) [upload=290762]: Starting upload Aug 20 09:07:20.783684169 (279h41m15.21476429s) [upload=290762]: Done starting upload Aug 20 09:07:20.783799179 (279h41m15.2148793s) [upload=290762]: Uploading segments... Aug 20 09:07:20.783886185 (279h41m15.214966316s) [upload=290762]: Got next segment. Inline: false Aug 20 09:07:20.783921513 (279h41m15.215001644s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:07:20.783925702 (279h41m15.215005833s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 09:07:21.067814505 (279h41m15.498894636s) [upload=290762]: Next segment err: metaclient: Too Many Requests Aug 20 09:07:21.067843992 (279h41m15.498924123s) [upload=290762]: Done uploading segments... Aug 20 09:07:21.067860463 (279h41m15.498940594s) [upload=290762]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.697557086s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......................X..............X.....X...X...........] duration:
1.978024038s
FAIL (2025-08-20 09:12:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.978057431s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............................................XX.......X.....] duration:
5.580755513s
FAIL (2025-08-20 09:11:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:07:20.783618032 (279h41m15.214698163s) [upload=290762]: Starting upload Aug 20 09:07:20.783684169 (279h41m15.21476429s) [upload=290762]: Done starting upload Aug 20 09:07:20.783799179 (279h41m15.2148793s) [upload=290762]: Uploading segments... Aug 20 09:07:20.783886185 (279h41m15.214966316s) [upload=290762]: Got next segment. Inline: false Aug 20 09:07:20.783921513 (279h41m15.215001644s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:07:20.783925702 (279h41m15.215005833s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 09:07:21.067814505 (279h41m15.498894636s) [upload=290762]: Next segment err: metaclient: Too Many Requests Aug 20 09:07:21.067843992 (279h41m15.498924123s) [upload=290762]: Done uploading segments... Aug 20 09:07:21.067860463 (279h41m15.498940594s) [upload=290762]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.580781193s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........................X..............X.....X...X..........] duration:
1.887473822s
FAIL (2025-08-20 09:11:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.887506624s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........................X..............X.....X...X.........] duration:
1.828110238s
FAIL (2025-08-20 09:10:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.828131329s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............................................XX.......X....] duration:
6.014069526s
FAIL (2025-08-20 09:10:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:07:20.783618032 (279h41m15.214698163s) [upload=290762]: Starting upload Aug 20 09:07:20.783684169 (279h41m15.21476429s) [upload=290762]: Done starting upload Aug 20 09:07:20.783799179 (279h41m15.2148793s) [upload=290762]: Uploading segments... Aug 20 09:07:20.783886185 (279h41m15.214966316s) [upload=290762]: Got next segment. Inline: false Aug 20 09:07:20.783921513 (279h41m15.215001644s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:07:20.783925702 (279h41m15.215005833s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 09:07:21.067814505 (279h41m15.498894636s) [upload=290762]: Next segment err: metaclient: Too Many Requests Aug 20 09:07:21.067843992 (279h41m15.498924123s) [upload=290762]: Done uploading segments... Aug 20 09:07:21.067860463 (279h41m15.498940594s) [upload=290762]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.014096487s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........................X..............X.....X...X........] duration:
1.836091278s
FAIL (2025-08-20 09:10:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.836122528s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............................................XX.......X...] duration:
5.708435731s
FAIL (2025-08-20 09:09:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:07:20.783618032 (279h41m15.214698163s) [upload=290762]: Starting upload Aug 20 09:07:20.783684169 (279h41m15.21476429s) [upload=290762]: Done starting upload Aug 20 09:07:20.783799179 (279h41m15.2148793s) [upload=290762]: Uploading segments... Aug 20 09:07:20.783886185 (279h41m15.214966316s) [upload=290762]: Got next segment. Inline: false Aug 20 09:07:20.783921513 (279h41m15.215001644s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:07:20.783925702 (279h41m15.215005833s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 09:07:21.067814505 (279h41m15.498894636s) [upload=290762]: Next segment err: metaclient: Too Many Requests Aug 20 09:07:21.067843992 (279h41m15.498924123s) [upload=290762]: Done uploading segments... Aug 20 09:07:21.067860463 (279h41m15.498940594s) [upload=290762]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.70846679s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................................................XX.......X..] duration:
5.669798519s
FAIL (2025-08-20 09:08:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:07:20.783618032 (279h41m15.214698163s) [upload=290762]: Starting upload Aug 20 09:07:20.783684169 (279h41m15.21476429s) [upload=290762]: Done starting upload Aug 20 09:07:20.783799179 (279h41m15.2148793s) [upload=290762]: Uploading segments... Aug 20 09:07:20.783886185 (279h41m15.214966316s) [upload=290762]: Got next segment. Inline: false Aug 20 09:07:20.783921513 (279h41m15.215001644s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:07:20.783925702 (279h41m15.215005833s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 09:07:21.067814505 (279h41m15.498894636s) [upload=290762]: Next segment err: metaclient: Too Many Requests Aug 20 09:07:21.067843992 (279h41m15.498924123s) [upload=290762]: Done uploading segments... Aug 20 09:07:21.067860463 (279h41m15.498940594s) [upload=290762]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.669826572s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........................X..............X.....X...X.......] duration:
1.962862988s
FAIL (2025-08-20 09:08:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.962888337s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............................X..............X.....X...X......] duration:
1.846040154s
FAIL (2025-08-20 09:07:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.846060704s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................................................XX.......X.] duration:
5.566099851s
FAIL (2025-08-20 09:07:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:07:20.783618032 (279h41m15.214698163s) [upload=290762]: Starting upload Aug 20 09:07:20.783684169 (279h41m15.21476429s) [upload=290762]: Done starting upload Aug 20 09:07:20.783799179 (279h41m15.2148793s) [upload=290762]: Uploading segments... Aug 20 09:07:20.783886185 (279h41m15.214966316s) [upload=290762]: Got next segment. Inline: false Aug 20 09:07:20.783921513 (279h41m15.215001644s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:07:20.783925702 (279h41m15.215005833s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 09:07:21.067814505 (279h41m15.498894636s) [upload=290762]: Next segment err: metaclient: Too Many Requests Aug 20 09:07:21.067843992 (279h41m15.498924123s) [upload=290762]: Done uploading segments... Aug 20 09:07:21.067860463 (279h41m15.498940594s) [upload=290762]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.566126873s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X.................................................XX.......X] duration:
1.144271732s
FAIL (2025-08-20 09:07:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:07:20.783618032 (279h41m15.214698163s) [upload=290762]: Starting upload Aug 20 09:07:20.783684169 (279h41m15.21476429s) [upload=290762]: Done starting upload Aug 20 09:07:20.783799179 (279h41m15.2148793s) [upload=290762]: Uploading segments... Aug 20 09:07:20.783886185 (279h41m15.214966316s) [upload=290762]: Got next segment. Inline: false Aug 20 09:07:20.783921513 (279h41m15.215001644s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:07:20.783925702 (279h41m15.215005833s) [upload=290762]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 09:07:21.067814505 (279h41m15.498894636s) [upload=290762]: Next segment err: metaclient: Too Many Requests Aug 20 09:07:21.067843992 (279h41m15.498924123s) [upload=290762]: Done uploading segments... Aug 20 09:07:21.067860463 (279h41m15.498940594s) [upload=290762]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.144292121s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............................X..............X.....X...X.....] duration:
1.82445876s
FAIL (2025-08-20 09:06:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.824476203s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X.................................................XX.......] duration:
5.74814895s
FAIL (2025-08-20 09:06:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 997197c9df9ec8fb288ad0b302fe92a83d35d62dc04c90afee33e6e6fc672bd7 != before b048aed2d865f86c9ad26b59519ae43b409a900e93a31fc1124728e0b892b99d
======LOGS======
Aug 20 09:00:03.842513480 (279h33m58.273593611s) [upload=290629]: Starting upload
Aug 20 09:00:03.842568956 (279h33m58.273649087s) [upload=290629]: Done starting upload
Aug 20 09:00:03.842706280 (279h33m58.273786411s) [upload=290629]: Uploading segments...
Aug 20 09:00:03.842792314 (279h33m58.273872456s) [upload=290629]: Got next segment. Inline: false
Aug 20 09:00:03.842851177 (279h33m58.273931318s) [upload=290629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 09:00:03.842857689 (279h33m58.27393783s) [upload=290629]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 09:00:04.334156776 (279h33m58.765236907s) [seg_pos={0 0}, upload=290629]: Begin upload segment...
Aug 20 09:00:04.334204898 (279h33m58.765285039s) [seg_pos={0 0}, upload=290629]: Done begin upload segment.
Aug 20 09:00:04.334222281 (279h33m58.765302412s) [noise=true , address=77.90.31.16:4753 , piece_id=CZBZVRFHMLMYNMM5KTDJZDBUAUXWTK2K2XCRM7C7FT777VVWAFAA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334232270 (279h33m58.765312402s) [noise=true , address=104.36.82.44:4884 , piece_id=5RF22M26NNHQ4TGUJHXU2DLU325QFWJIPHPCCW3APOPRMS7ATXYQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334281955 (279h33m58.765362086s) [noise=true , address=45.91.116.12:4259 , piece_id=U4SO5T45AYT2AYBPVVBC4K7B77FY7NRPZ2OKKA3TF63UHA7RD4LA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334576509 (279h33m58.76565664s) [noise=true , address=79.127.205.245:4248 , piece_id=DWZLQH6EIH2VCOQHANUKWJJTNQEF5BUHXQKC7BEKCG46I6FQQFXQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334622176 (279h33m58.765702317s) [noise=true , address=77.90.31.18:4812 , piece_id=LBYNQOU5RI37ZGOOAZWE4HWSM7KGOY35XZKPM7YAYW4CE2UE2XBA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334963659 (279h33m58.76604379s) [noise=true , address=104.36.82.20:4458 , piece_id=QV2QJYA2FPEHHNBXDKYIX6G7CNCHCGM7QVIUYSSUPLWSDQNXLWFQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.335225390 (279h33m58.766305522s) [noise=true , address=45.91.116.11:4129 , piece_id=M5QZNBBEPEP5OK57CU4RXJFH7XQD72RIJOHMCMV5YIQPZ4HBMWZA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.335507169 (279h33m58.7665873s) [noise=true , address=77.90.31.13:4653 , piece_id=E63P23K4B2OWIBIRAWQ75KFLFRZVOURZX74IJUQ6UYUTCQGEDJBQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.335792366 (279h33m58.766872507s) [noise=true , address=66.23.193.175:4557 , piece_id=BEFYM3LP6DI5NHTITCTP5ZPNATYHZM4GPPKSNDMLNZH4NGR4HRFQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.336188423 (279h33m58.767268554s) [noise=true , address=77.90.31.21:4903 , piece_id=IQQDS5AI2L64M3RTDSL2QAY5JUER3VSGALVVWQAWPEA7HJZ5D3CQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.336481624 (279h33m58.767561765s) [noise=true , address=77.90.31.17:4774 , piece_id=ACLZ6GABJT2IXMIEIH2VQMY7S6KPXJESSD74VBZPAERILYSWRNZQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.336742944 (279h33m58.767823075s) [noise=true , address=79.127.219.48:4091 , piece_id=MLJ27QEAQ2HXMW24JRPYDNUBWARXDYLHYMEOELSEELK5BG2BQLVQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.337037297 (279h33m58.768117428s) [noise=true , address=45.91.116.13:4181 , piece_id=2RAHUDUY6VACFPWYGZWGYZWIGUHVISK4YYTLR2GLIGU6WQSTDX3Q, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.337369312 (279h33m58.768449454s) [noise=true , address=104.36.82.5:4844 , piece_id=SK6RPNDW6FZDCBDOMTRCPKZRLTCP53X3WWE5ZAQ7OWWY5VZYFL2Q, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.337682040 (279h33m58.768762202s) [noise=true , address=79.127.219.47:4072 , piece_id=77OBALT5NYIL3FQCFFYYVGIOA6IMISQ6OJDN4Z5XQLYXNRNYTYVQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.338010529 (279h33m58.76909067s) [noise=true , address=45.91.116.6:4988 , piece_id=OMB3VVHXNOQTD2R4ERCRGME35HK3VFMM5ZLBR7VFXQ7MVBQD56PA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.338281718 (279h33m58.769361849s) [noise=true , address=77.90.31.11:4563 , piece_id=PO5QL6VEMQF7JFLYA3XUWLIUZROZM6LZSZXQX3NK7QFNOVZMMI6Q, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.338515766 (279h33m58.769595897s) [noise=true , address=77.90.31.19:4869 , piece_id=KOGRZCWI6NXC3O43OKPCCDWFC4RQZZ3CGJDUUMDUKGIYJGK6SRPA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:05.527576888 (279h33m59.958657029s) [upload=290629]: Next returned nil segment
Aug 20 09:00:05.527596145 (279h33m59.958676276s) [upload=290629]: Waiting for error group managing segments...
Aug 20 09:00:05.855631067 (279h34m0.286711198s) [noise=true , address=66.23.193.175:4557 , piece_id=BEFYM3LP6DI5NHTITCTP5ZPNATYHZM4GPPKSNDMLNZH4NGR4HRFQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:05.874786609 (279h34m0.30586674s) [noise=true , address=79.127.205.245:4248 , piece_id=DWZLQH6EIH2VCOQHANUKWJJTNQEF5BUHXQKC7BEKCG46I6FQQFXQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.219955715 (279h34m0.651035846s) [noise=true , address=79.127.219.48:4091 , piece_id=MLJ27QEAQ2HXMW24JRPYDNUBWARXDYLHYMEOELSEELK5BG2BQLVQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.220967280 (279h34m0.652047421s) [noise=true , address=79.127.219.47:4072 , piece_id=77OBALT5NYIL3FQCFFYYVGIOA6IMISQ6OJDN4Z5XQLYXNRNYTYVQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.232652899 (279h34m0.66373304s) [noise=true , address=45.91.116.11:4129 , piece_id=M5QZNBBEPEP5OK57CU4RXJFH7XQD72RIJOHMCMV5YIQPZ4HBMWZA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.234637186 (279h34m0.665717327s) [noise=true , address=45.91.116.12:4259 , piece_id=U4SO5T45AYT2AYBPVVBC4K7B77FY7NRPZ2OKKA3TF63UHA7RD4LA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.254195629 (279h34m0.68527576s) [noise=true , address=77.90.31.19:4869 , piece_id=KOGRZCWI6NXC3O43OKPCCDWFC4RQZZ3CGJDUUMDUKGIYJGK6SRPA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.315035417 (279h34m0.746115548s) [noise=true , address=104.36.82.5:4844 , piece_id=SK6RPNDW6FZDCBDOMTRCPKZRLTCP53X3WWE5ZAQ7OWWY5VZYFL2Q, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.320364894 (279h34m0.751445035s) [noise=true , address=77.90.31.21:4903 , piece_id=IQQDS5AI2L64M3RTDSL2QAY5JUER3VSGALVVWQAWPEA7HJZ5D3CQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.322269388 (279h34m0.753349519s) [noise=true , address=77.90.31.13:4653 , piece_id=E63P23K4B2OWIBIRAWQ75KFLFRZVOURZX74IJUQ6UYUTCQGEDJBQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.340622034 (279h34m0.771702175s) [noise=true , address=104.36.82.20:4458 , piece_id=QV2QJYA2FPEHHNBXDKYIX6G7CNCHCGM7QVIUYSSUPLWSDQNXLWFQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.352261244 (279h34m0.783341375s) [noise=true , address=77.90.31.16:4753 , piece_id=CZBZVRFHMLMYNMM5KTDJZDBUAUXWTK2K2XCRM7C7FT777VVWAFAA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.355070809 (279h34m0.78615094s) [noise=true , address=77.90.31.11:4563 , piece_id=PO5QL6VEMQF7JFLYA3XUWLIUZROZM6LZSZXQX3NK7QFNOVZMMI6Q, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.402968145 (279h34m0.834048276s) [noise=true , address=77.90.31.18:4812 , piece_id=LBYNQOU5RI37ZGOOAZWE4HWSM7KGOY35XZKPM7YAYW4CE2UE2XBA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.402995077 (279h34m0.834075208s) [seg_pos={0 0}, upload=290629]: Segment reached optimal threshold of 14 pieces.
Aug 20 09:00:06.403120486 (279h34m0.834200627s) [noise=true , address=104.36.82.44:4884 , piece_id=5RF22M26NNHQ4TGUJHXU2DLU325QFWJIPHPCCW3APOPRMS7ATXYQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 20 09:00:06.403163208 (279h34m0.83424334s) [noise=true , address=45.91.116.13:4181 , piece_id=2RAHUDUY6VACFPWYGZWGYZWIGUHVISK4YYTLR2GLIGU6WQSTDX3Q, seg_pos={0 0}, upload=290629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7LXGgUieZvwdvxcRGCLGSQVVV2PjFuEaze7ccG1hJLNB2aQ): protocol: expected piece hash; context canceled; EOF
Aug 20 09:00:06.403215288 (279h34m0.834295419s) [noise=true , address=77.90.31.17:4774 , piece_id=ACLZ6GABJT2IXMIEIH2VQMY7S6KPXJESSD74VBZPAERILYSWRNZQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mZTv2q5zT1Za4DTcdFbUwWs1897vv9GXuLqPcnY3FaxTdGv3Y): protocol: expected piece hash; context canceled; EOF
Aug 20 09:00:06.403248081 (279h34m0.834328212s) [noise=true , address=45.91.116.6:4988 , piece_id=OMB3VVHXNOQTD2R4ERCRGME35HK3VFMM5ZLBR7VFXQ7MVBQD56PA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TrcoCHhAJeEykP9hJNpygoPSdgFV5v6GzL48JpyNPiAj5ZJRS): protocol: expected piece hash; context canceled; EOF
Aug 20 09:00:06.403261225 (279h34m0.834341357s) [seg_pos={0 0}, upload=290629]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 09:00:06.403327403 (279h34m0.834407534s) [upload=290629]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 09:00:06.403332081 (279h34m0.834412223s) [upload=290629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 09:00:06.717671087 (279h34m1.148751228s) [upload=290629]: Done uploading segments...
Aug 20 09:00:06.717694332 (279h34m1.148774463s) [upload=290629]: Upload finished. err: <nil>
Duration: 5.748173807s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............................X..............X.....X...X....] duration:
1.812429325s
FAIL (2025-08-20 09:06:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.812455595s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X.................................................XX......] duration:
5.605076206s
FAIL (2025-08-20 09:05:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 997197c9df9ec8fb288ad0b302fe92a83d35d62dc04c90afee33e6e6fc672bd7 != before b048aed2d865f86c9ad26b59519ae43b409a900e93a31fc1124728e0b892b99d
======LOGS======
Aug 20 09:00:03.842513480 (279h33m58.273593611s) [upload=290629]: Starting upload
Aug 20 09:00:03.842568956 (279h33m58.273649087s) [upload=290629]: Done starting upload
Aug 20 09:00:03.842706280 (279h33m58.273786411s) [upload=290629]: Uploading segments...
Aug 20 09:00:03.842792314 (279h33m58.273872456s) [upload=290629]: Got next segment. Inline: false
Aug 20 09:00:03.842851177 (279h33m58.273931318s) [upload=290629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 09:00:03.842857689 (279h33m58.27393783s) [upload=290629]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 09:00:04.334156776 (279h33m58.765236907s) [seg_pos={0 0}, upload=290629]: Begin upload segment...
Aug 20 09:00:04.334204898 (279h33m58.765285039s) [seg_pos={0 0}, upload=290629]: Done begin upload segment.
Aug 20 09:00:04.334222281 (279h33m58.765302412s) [noise=true , address=77.90.31.16:4753 , piece_id=CZBZVRFHMLMYNMM5KTDJZDBUAUXWTK2K2XCRM7C7FT777VVWAFAA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334232270 (279h33m58.765312402s) [noise=true , address=104.36.82.44:4884 , piece_id=5RF22M26NNHQ4TGUJHXU2DLU325QFWJIPHPCCW3APOPRMS7ATXYQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334281955 (279h33m58.765362086s) [noise=true , address=45.91.116.12:4259 , piece_id=U4SO5T45AYT2AYBPVVBC4K7B77FY7NRPZ2OKKA3TF63UHA7RD4LA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334576509 (279h33m58.76565664s) [noise=true , address=79.127.205.245:4248 , piece_id=DWZLQH6EIH2VCOQHANUKWJJTNQEF5BUHXQKC7BEKCG46I6FQQFXQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334622176 (279h33m58.765702317s) [noise=true , address=77.90.31.18:4812 , piece_id=LBYNQOU5RI37ZGOOAZWE4HWSM7KGOY35XZKPM7YAYW4CE2UE2XBA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334963659 (279h33m58.76604379s) [noise=true , address=104.36.82.20:4458 , piece_id=QV2QJYA2FPEHHNBXDKYIX6G7CNCHCGM7QVIUYSSUPLWSDQNXLWFQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.335225390 (279h33m58.766305522s) [noise=true , address=45.91.116.11:4129 , piece_id=M5QZNBBEPEP5OK57CU4RXJFH7XQD72RIJOHMCMV5YIQPZ4HBMWZA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.335507169 (279h33m58.7665873s) [noise=true , address=77.90.31.13:4653 , piece_id=E63P23K4B2OWIBIRAWQ75KFLFRZVOURZX74IJUQ6UYUTCQGEDJBQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.335792366 (279h33m58.766872507s) [noise=true , address=66.23.193.175:4557 , piece_id=BEFYM3LP6DI5NHTITCTP5ZPNATYHZM4GPPKSNDMLNZH4NGR4HRFQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.336188423 (279h33m58.767268554s) [noise=true , address=77.90.31.21:4903 , piece_id=IQQDS5AI2L64M3RTDSL2QAY5JUER3VSGALVVWQAWPEA7HJZ5D3CQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.336481624 (279h33m58.767561765s) [noise=true , address=77.90.31.17:4774 , piece_id=ACLZ6GABJT2IXMIEIH2VQMY7S6KPXJESSD74VBZPAERILYSWRNZQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.336742944 (279h33m58.767823075s) [noise=true , address=79.127.219.48:4091 , piece_id=MLJ27QEAQ2HXMW24JRPYDNUBWARXDYLHYMEOELSEELK5BG2BQLVQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.337037297 (279h33m58.768117428s) [noise=true , address=45.91.116.13:4181 , piece_id=2RAHUDUY6VACFPWYGZWGYZWIGUHVISK4YYTLR2GLIGU6WQSTDX3Q, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.337369312 (279h33m58.768449454s) [noise=true , address=104.36.82.5:4844 , piece_id=SK6RPNDW6FZDCBDOMTRCPKZRLTCP53X3WWE5ZAQ7OWWY5VZYFL2Q, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.337682040 (279h33m58.768762202s) [noise=true , address=79.127.219.47:4072 , piece_id=77OBALT5NYIL3FQCFFYYVGIOA6IMISQ6OJDN4Z5XQLYXNRNYTYVQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.338010529 (279h33m58.76909067s) [noise=true , address=45.91.116.6:4988 , piece_id=OMB3VVHXNOQTD2R4ERCRGME35HK3VFMM5ZLBR7VFXQ7MVBQD56PA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.338281718 (279h33m58.769361849s) [noise=true , address=77.90.31.11:4563 , piece_id=PO5QL6VEMQF7JFLYA3XUWLIUZROZM6LZSZXQX3NK7QFNOVZMMI6Q, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.338515766 (279h33m58.769595897s) [noise=true , address=77.90.31.19:4869 , piece_id=KOGRZCWI6NXC3O43OKPCCDWFC4RQZZ3CGJDUUMDUKGIYJGK6SRPA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:05.527576888 (279h33m59.958657029s) [upload=290629]: Next returned nil segment
Aug 20 09:00:05.527596145 (279h33m59.958676276s) [upload=290629]: Waiting for error group managing segments...
Aug 20 09:00:05.855631067 (279h34m0.286711198s) [noise=true , address=66.23.193.175:4557 , piece_id=BEFYM3LP6DI5NHTITCTP5ZPNATYHZM4GPPKSNDMLNZH4NGR4HRFQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:05.874786609 (279h34m0.30586674s) [noise=true , address=79.127.205.245:4248 , piece_id=DWZLQH6EIH2VCOQHANUKWJJTNQEF5BUHXQKC7BEKCG46I6FQQFXQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.219955715 (279h34m0.651035846s) [noise=true , address=79.127.219.48:4091 , piece_id=MLJ27QEAQ2HXMW24JRPYDNUBWARXDYLHYMEOELSEELK5BG2BQLVQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.220967280 (279h34m0.652047421s) [noise=true , address=79.127.219.47:4072 , piece_id=77OBALT5NYIL3FQCFFYYVGIOA6IMISQ6OJDN4Z5XQLYXNRNYTYVQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.232652899 (279h34m0.66373304s) [noise=true , address=45.91.116.11:4129 , piece_id=M5QZNBBEPEP5OK57CU4RXJFH7XQD72RIJOHMCMV5YIQPZ4HBMWZA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.234637186 (279h34m0.665717327s) [noise=true , address=45.91.116.12:4259 , piece_id=U4SO5T45AYT2AYBPVVBC4K7B77FY7NRPZ2OKKA3TF63UHA7RD4LA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.254195629 (279h34m0.68527576s) [noise=true , address=77.90.31.19:4869 , piece_id=KOGRZCWI6NXC3O43OKPCCDWFC4RQZZ3CGJDUUMDUKGIYJGK6SRPA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.315035417 (279h34m0.746115548s) [noise=true , address=104.36.82.5:4844 , piece_id=SK6RPNDW6FZDCBDOMTRCPKZRLTCP53X3WWE5ZAQ7OWWY5VZYFL2Q, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.320364894 (279h34m0.751445035s) [noise=true , address=77.90.31.21:4903 , piece_id=IQQDS5AI2L64M3RTDSL2QAY5JUER3VSGALVVWQAWPEA7HJZ5D3CQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.322269388 (279h34m0.753349519s) [noise=true , address=77.90.31.13:4653 , piece_id=E63P23K4B2OWIBIRAWQ75KFLFRZVOURZX74IJUQ6UYUTCQGEDJBQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.340622034 (279h34m0.771702175s) [noise=true , address=104.36.82.20:4458 , piece_id=QV2QJYA2FPEHHNBXDKYIX6G7CNCHCGM7QVIUYSSUPLWSDQNXLWFQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.352261244 (279h34m0.783341375s) [noise=true , address=77.90.31.16:4753 , piece_id=CZBZVRFHMLMYNMM5KTDJZDBUAUXWTK2K2XCRM7C7FT777VVWAFAA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.355070809 (279h34m0.78615094s) [noise=true , address=77.90.31.11:4563 , piece_id=PO5QL6VEMQF7JFLYA3XUWLIUZROZM6LZSZXQX3NK7QFNOVZMMI6Q, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.402968145 (279h34m0.834048276s) [noise=true , address=77.90.31.18:4812 , piece_id=LBYNQOU5RI37ZGOOAZWE4HWSM7KGOY35XZKPM7YAYW4CE2UE2XBA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.402995077 (279h34m0.834075208s) [seg_pos={0 0}, upload=290629]: Segment reached optimal threshold of 14 pieces.
Aug 20 09:00:06.403120486 (279h34m0.834200627s) [noise=true , address=104.36.82.44:4884 , piece_id=5RF22M26NNHQ4TGUJHXU2DLU325QFWJIPHPCCW3APOPRMS7ATXYQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 20 09:00:06.403163208 (279h34m0.83424334s) [noise=true , address=45.91.116.13:4181 , piece_id=2RAHUDUY6VACFPWYGZWGYZWIGUHVISK4YYTLR2GLIGU6WQSTDX3Q, seg_pos={0 0}, upload=290629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7LXGgUieZvwdvxcRGCLGSQVVV2PjFuEaze7ccG1hJLNB2aQ): protocol: expected piece hash; context canceled; EOF
Aug 20 09:00:06.403215288 (279h34m0.834295419s) [noise=true , address=77.90.31.17:4774 , piece_id=ACLZ6GABJT2IXMIEIH2VQMY7S6KPXJESSD74VBZPAERILYSWRNZQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mZTv2q5zT1Za4DTcdFbUwWs1897vv9GXuLqPcnY3FaxTdGv3Y): protocol: expected piece hash; context canceled; EOF
Aug 20 09:00:06.403248081 (279h34m0.834328212s) [noise=true , address=45.91.116.6:4988 , piece_id=OMB3VVHXNOQTD2R4ERCRGME35HK3VFMM5ZLBR7VFXQ7MVBQD56PA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TrcoCHhAJeEykP9hJNpygoPSdgFV5v6GzL48JpyNPiAj5ZJRS): protocol: expected piece hash; context canceled; EOF
Aug 20 09:00:06.403261225 (279h34m0.834341357s) [seg_pos={0 0}, upload=290629]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 09:00:06.403327403 (279h34m0.834407534s) [upload=290629]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 09:00:06.403332081 (279h34m0.834412223s) [upload=290629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 09:00:06.717671087 (279h34m1.148751228s) [upload=290629]: Done uploading segments...
Aug 20 09:00:06.717694332 (279h34m1.148774463s) [upload=290629]: Upload finished. err: <nil>
Duration: 5.605102076s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............................X..............X.....X...X...] duration:
2.078343065s
FAIL (2025-08-20 09:05:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.078366881s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................................X..............X.....X...X..] duration:
1.858764021s
FAIL (2025-08-20 09:04:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.858796183s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X.................................................XX.....] duration:
5.828322699s
FAIL (2025-08-20 09:04:16 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 997197c9df9ec8fb288ad0b302fe92a83d35d62dc04c90afee33e6e6fc672bd7 != before b048aed2d865f86c9ad26b59519ae43b409a900e93a31fc1124728e0b892b99d
======LOGS======
Aug 20 09:00:03.842513480 (279h33m58.273593611s) [upload=290629]: Starting upload
Aug 20 09:00:03.842568956 (279h33m58.273649087s) [upload=290629]: Done starting upload
Aug 20 09:00:03.842706280 (279h33m58.273786411s) [upload=290629]: Uploading segments...
Aug 20 09:00:03.842792314 (279h33m58.273872456s) [upload=290629]: Got next segment. Inline: false
Aug 20 09:00:03.842851177 (279h33m58.273931318s) [upload=290629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 09:00:03.842857689 (279h33m58.27393783s) [upload=290629]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 09:00:04.334156776 (279h33m58.765236907s) [seg_pos={0 0}, upload=290629]: Begin upload segment...
Aug 20 09:00:04.334204898 (279h33m58.765285039s) [seg_pos={0 0}, upload=290629]: Done begin upload segment.
Aug 20 09:00:04.334222281 (279h33m58.765302412s) [noise=true , address=77.90.31.16:4753 , piece_id=CZBZVRFHMLMYNMM5KTDJZDBUAUXWTK2K2XCRM7C7FT777VVWAFAA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334232270 (279h33m58.765312402s) [noise=true , address=104.36.82.44:4884 , piece_id=5RF22M26NNHQ4TGUJHXU2DLU325QFWJIPHPCCW3APOPRMS7ATXYQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334281955 (279h33m58.765362086s) [noise=true , address=45.91.116.12:4259 , piece_id=U4SO5T45AYT2AYBPVVBC4K7B77FY7NRPZ2OKKA3TF63UHA7RD4LA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334576509 (279h33m58.76565664s) [noise=true , address=79.127.205.245:4248 , piece_id=DWZLQH6EIH2VCOQHANUKWJJTNQEF5BUHXQKC7BEKCG46I6FQQFXQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334622176 (279h33m58.765702317s) [noise=true , address=77.90.31.18:4812 , piece_id=LBYNQOU5RI37ZGOOAZWE4HWSM7KGOY35XZKPM7YAYW4CE2UE2XBA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334963659 (279h33m58.76604379s) [noise=true , address=104.36.82.20:4458 , piece_id=QV2QJYA2FPEHHNBXDKYIX6G7CNCHCGM7QVIUYSSUPLWSDQNXLWFQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.335225390 (279h33m58.766305522s) [noise=true , address=45.91.116.11:4129 , piece_id=M5QZNBBEPEP5OK57CU4RXJFH7XQD72RIJOHMCMV5YIQPZ4HBMWZA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.335507169 (279h33m58.7665873s) [noise=true , address=77.90.31.13:4653 , piece_id=E63P23K4B2OWIBIRAWQ75KFLFRZVOURZX74IJUQ6UYUTCQGEDJBQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.335792366 (279h33m58.766872507s) [noise=true , address=66.23.193.175:4557 , piece_id=BEFYM3LP6DI5NHTITCTP5ZPNATYHZM4GPPKSNDMLNZH4NGR4HRFQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.336188423 (279h33m58.767268554s) [noise=true , address=77.90.31.21:4903 , piece_id=IQQDS5AI2L64M3RTDSL2QAY5JUER3VSGALVVWQAWPEA7HJZ5D3CQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.336481624 (279h33m58.767561765s) [noise=true , address=77.90.31.17:4774 , piece_id=ACLZ6GABJT2IXMIEIH2VQMY7S6KPXJESSD74VBZPAERILYSWRNZQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.336742944 (279h33m58.767823075s) [noise=true , address=79.127.219.48:4091 , piece_id=MLJ27QEAQ2HXMW24JRPYDNUBWARXDYLHYMEOELSEELK5BG2BQLVQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.337037297 (279h33m58.768117428s) [noise=true , address=45.91.116.13:4181 , piece_id=2RAHUDUY6VACFPWYGZWGYZWIGUHVISK4YYTLR2GLIGU6WQSTDX3Q, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.337369312 (279h33m58.768449454s) [noise=true , address=104.36.82.5:4844 , piece_id=SK6RPNDW6FZDCBDOMTRCPKZRLTCP53X3WWE5ZAQ7OWWY5VZYFL2Q, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.337682040 (279h33m58.768762202s) [noise=true , address=79.127.219.47:4072 , piece_id=77OBALT5NYIL3FQCFFYYVGIOA6IMISQ6OJDN4Z5XQLYXNRNYTYVQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.338010529 (279h33m58.76909067s) [noise=true , address=45.91.116.6:4988 , piece_id=OMB3VVHXNOQTD2R4ERCRGME35HK3VFMM5ZLBR7VFXQ7MVBQD56PA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.338281718 (279h33m58.769361849s) [noise=true , address=77.90.31.11:4563 , piece_id=PO5QL6VEMQF7JFLYA3XUWLIUZROZM6LZSZXQX3NK7QFNOVZMMI6Q, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.338515766 (279h33m58.769595897s) [noise=true , address=77.90.31.19:4869 , piece_id=KOGRZCWI6NXC3O43OKPCCDWFC4RQZZ3CGJDUUMDUKGIYJGK6SRPA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:05.527576888 (279h33m59.958657029s) [upload=290629]: Next returned nil segment
Aug 20 09:00:05.527596145 (279h33m59.958676276s) [upload=290629]: Waiting for error group managing segments...
Aug 20 09:00:05.855631067 (279h34m0.286711198s) [noise=true , address=66.23.193.175:4557 , piece_id=BEFYM3LP6DI5NHTITCTP5ZPNATYHZM4GPPKSNDMLNZH4NGR4HRFQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:05.874786609 (279h34m0.30586674s) [noise=true , address=79.127.205.245:4248 , piece_id=DWZLQH6EIH2VCOQHANUKWJJTNQEF5BUHXQKC7BEKCG46I6FQQFXQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.219955715 (279h34m0.651035846s) [noise=true , address=79.127.219.48:4091 , piece_id=MLJ27QEAQ2HXMW24JRPYDNUBWARXDYLHYMEOELSEELK5BG2BQLVQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.220967280 (279h34m0.652047421s) [noise=true , address=79.127.219.47:4072 , piece_id=77OBALT5NYIL3FQCFFYYVGIOA6IMISQ6OJDN4Z5XQLYXNRNYTYVQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.232652899 (279h34m0.66373304s) [noise=true , address=45.91.116.11:4129 , piece_id=M5QZNBBEPEP5OK57CU4RXJFH7XQD72RIJOHMCMV5YIQPZ4HBMWZA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.234637186 (279h34m0.665717327s) [noise=true , address=45.91.116.12:4259 , piece_id=U4SO5T45AYT2AYBPVVBC4K7B77FY7NRPZ2OKKA3TF63UHA7RD4LA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.254195629 (279h34m0.68527576s) [noise=true , address=77.90.31.19:4869 , piece_id=KOGRZCWI6NXC3O43OKPCCDWFC4RQZZ3CGJDUUMDUKGIYJGK6SRPA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.315035417 (279h34m0.746115548s) [noise=true , address=104.36.82.5:4844 , piece_id=SK6RPNDW6FZDCBDOMTRCPKZRLTCP53X3WWE5ZAQ7OWWY5VZYFL2Q, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.320364894 (279h34m0.751445035s) [noise=true , address=77.90.31.21:4903 , piece_id=IQQDS5AI2L64M3RTDSL2QAY5JUER3VSGALVVWQAWPEA7HJZ5D3CQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.322269388 (279h34m0.753349519s) [noise=true , address=77.90.31.13:4653 , piece_id=E63P23K4B2OWIBIRAWQ75KFLFRZVOURZX74IJUQ6UYUTCQGEDJBQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.340622034 (279h34m0.771702175s) [noise=true , address=104.36.82.20:4458 , piece_id=QV2QJYA2FPEHHNBXDKYIX6G7CNCHCGM7QVIUYSSUPLWSDQNXLWFQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.352261244 (279h34m0.783341375s) [noise=true , address=77.90.31.16:4753 , piece_id=CZBZVRFHMLMYNMM5KTDJZDBUAUXWTK2K2XCRM7C7FT777VVWAFAA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.355070809 (279h34m0.78615094s) [noise=true , address=77.90.31.11:4563 , piece_id=PO5QL6VEMQF7JFLYA3XUWLIUZROZM6LZSZXQX3NK7QFNOVZMMI6Q, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.402968145 (279h34m0.834048276s) [noise=true , address=77.90.31.18:4812 , piece_id=LBYNQOU5RI37ZGOOAZWE4HWSM7KGOY35XZKPM7YAYW4CE2UE2XBA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.402995077 (279h34m0.834075208s) [seg_pos={0 0}, upload=290629]: Segment reached optimal threshold of 14 pieces.
Aug 20 09:00:06.403120486 (279h34m0.834200627s) [noise=true , address=104.36.82.44:4884 , piece_id=5RF22M26NNHQ4TGUJHXU2DLU325QFWJIPHPCCW3APOPRMS7ATXYQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 20 09:00:06.403163208 (279h34m0.83424334s) [noise=true , address=45.91.116.13:4181 , piece_id=2RAHUDUY6VACFPWYGZWGYZWIGUHVISK4YYTLR2GLIGU6WQSTDX3Q, seg_pos={0 0}, upload=290629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7LXGgUieZvwdvxcRGCLGSQVVV2PjFuEaze7ccG1hJLNB2aQ): protocol: expected piece hash; context canceled; EOF
Aug 20 09:00:06.403215288 (279h34m0.834295419s) [noise=true , address=77.90.31.17:4774 , piece_id=ACLZ6GABJT2IXMIEIH2VQMY7S6KPXJESSD74VBZPAERILYSWRNZQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mZTv2q5zT1Za4DTcdFbUwWs1897vv9GXuLqPcnY3FaxTdGv3Y): protocol: expected piece hash; context canceled; EOF
Aug 20 09:00:06.403248081 (279h34m0.834328212s) [noise=true , address=45.91.116.6:4988 , piece_id=OMB3VVHXNOQTD2R4ERCRGME35HK3VFMM5ZLBR7VFXQ7MVBQD56PA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TrcoCHhAJeEykP9hJNpygoPSdgFV5v6GzL48JpyNPiAj5ZJRS): protocol: expected piece hash; context canceled; EOF
Aug 20 09:00:06.403261225 (279h34m0.834341357s) [seg_pos={0 0}, upload=290629]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 09:00:06.403327403 (279h34m0.834407534s) [upload=290629]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 09:00:06.403332081 (279h34m0.834412223s) [upload=290629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 09:00:06.717671087 (279h34m1.148751228s) [upload=290629]: Done uploading segments...
Aug 20 09:00:06.717694332 (279h34m1.148774463s) [upload=290629]: Upload finished. err: <nil>
Duration: 5.828352516s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X.................................................XX....] duration:
5.721706882s
FAIL (2025-08-20 09:03:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 997197c9df9ec8fb288ad0b302fe92a83d35d62dc04c90afee33e6e6fc672bd7 != before b048aed2d865f86c9ad26b59519ae43b409a900e93a31fc1124728e0b892b99d
======LOGS======
Aug 20 09:00:03.842513480 (279h33m58.273593611s) [upload=290629]: Starting upload
Aug 20 09:00:03.842568956 (279h33m58.273649087s) [upload=290629]: Done starting upload
Aug 20 09:00:03.842706280 (279h33m58.273786411s) [upload=290629]: Uploading segments...
Aug 20 09:00:03.842792314 (279h33m58.273872456s) [upload=290629]: Got next segment. Inline: false
Aug 20 09:00:03.842851177 (279h33m58.273931318s) [upload=290629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 09:00:03.842857689 (279h33m58.27393783s) [upload=290629]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 09:00:04.334156776 (279h33m58.765236907s) [seg_pos={0 0}, upload=290629]: Begin upload segment...
Aug 20 09:00:04.334204898 (279h33m58.765285039s) [seg_pos={0 0}, upload=290629]: Done begin upload segment.
Aug 20 09:00:04.334222281 (279h33m58.765302412s) [noise=true , address=77.90.31.16:4753 , piece_id=CZBZVRFHMLMYNMM5KTDJZDBUAUXWTK2K2XCRM7C7FT777VVWAFAA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334232270 (279h33m58.765312402s) [noise=true , address=104.36.82.44:4884 , piece_id=5RF22M26NNHQ4TGUJHXU2DLU325QFWJIPHPCCW3APOPRMS7ATXYQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334281955 (279h33m58.765362086s) [noise=true , address=45.91.116.12:4259 , piece_id=U4SO5T45AYT2AYBPVVBC4K7B77FY7NRPZ2OKKA3TF63UHA7RD4LA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334576509 (279h33m58.76565664s) [noise=true , address=79.127.205.245:4248 , piece_id=DWZLQH6EIH2VCOQHANUKWJJTNQEF5BUHXQKC7BEKCG46I6FQQFXQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334622176 (279h33m58.765702317s) [noise=true , address=77.90.31.18:4812 , piece_id=LBYNQOU5RI37ZGOOAZWE4HWSM7KGOY35XZKPM7YAYW4CE2UE2XBA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334963659 (279h33m58.76604379s) [noise=true , address=104.36.82.20:4458 , piece_id=QV2QJYA2FPEHHNBXDKYIX6G7CNCHCGM7QVIUYSSUPLWSDQNXLWFQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.335225390 (279h33m58.766305522s) [noise=true , address=45.91.116.11:4129 , piece_id=M5QZNBBEPEP5OK57CU4RXJFH7XQD72RIJOHMCMV5YIQPZ4HBMWZA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.335507169 (279h33m58.7665873s) [noise=true , address=77.90.31.13:4653 , piece_id=E63P23K4B2OWIBIRAWQ75KFLFRZVOURZX74IJUQ6UYUTCQGEDJBQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.335792366 (279h33m58.766872507s) [noise=true , address=66.23.193.175:4557 , piece_id=BEFYM3LP6DI5NHTITCTP5ZPNATYHZM4GPPKSNDMLNZH4NGR4HRFQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.336188423 (279h33m58.767268554s) [noise=true , address=77.90.31.21:4903 , piece_id=IQQDS5AI2L64M3RTDSL2QAY5JUER3VSGALVVWQAWPEA7HJZ5D3CQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.336481624 (279h33m58.767561765s) [noise=true , address=77.90.31.17:4774 , piece_id=ACLZ6GABJT2IXMIEIH2VQMY7S6KPXJESSD74VBZPAERILYSWRNZQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.336742944 (279h33m58.767823075s) [noise=true , address=79.127.219.48:4091 , piece_id=MLJ27QEAQ2HXMW24JRPYDNUBWARXDYLHYMEOELSEELK5BG2BQLVQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.337037297 (279h33m58.768117428s) [noise=true , address=45.91.116.13:4181 , piece_id=2RAHUDUY6VACFPWYGZWGYZWIGUHVISK4YYTLR2GLIGU6WQSTDX3Q, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.337369312 (279h33m58.768449454s) [noise=true , address=104.36.82.5:4844 , piece_id=SK6RPNDW6FZDCBDOMTRCPKZRLTCP53X3WWE5ZAQ7OWWY5VZYFL2Q, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.337682040 (279h33m58.768762202s) [noise=true , address=79.127.219.47:4072 , piece_id=77OBALT5NYIL3FQCFFYYVGIOA6IMISQ6OJDN4Z5XQLYXNRNYTYVQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.338010529 (279h33m58.76909067s) [noise=true , address=45.91.116.6:4988 , piece_id=OMB3VVHXNOQTD2R4ERCRGME35HK3VFMM5ZLBR7VFXQ7MVBQD56PA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.338281718 (279h33m58.769361849s) [noise=true , address=77.90.31.11:4563 , piece_id=PO5QL6VEMQF7JFLYA3XUWLIUZROZM6LZSZXQX3NK7QFNOVZMMI6Q, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.338515766 (279h33m58.769595897s) [noise=true , address=77.90.31.19:4869 , piece_id=KOGRZCWI6NXC3O43OKPCCDWFC4RQZZ3CGJDUUMDUKGIYJGK6SRPA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:05.527576888 (279h33m59.958657029s) [upload=290629]: Next returned nil segment
Aug 20 09:00:05.527596145 (279h33m59.958676276s) [upload=290629]: Waiting for error group managing segments...
Aug 20 09:00:05.855631067 (279h34m0.286711198s) [noise=true , address=66.23.193.175:4557 , piece_id=BEFYM3LP6DI5NHTITCTP5ZPNATYHZM4GPPKSNDMLNZH4NGR4HRFQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:05.874786609 (279h34m0.30586674s) [noise=true , address=79.127.205.245:4248 , piece_id=DWZLQH6EIH2VCOQHANUKWJJTNQEF5BUHXQKC7BEKCG46I6FQQFXQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.219955715 (279h34m0.651035846s) [noise=true , address=79.127.219.48:4091 , piece_id=MLJ27QEAQ2HXMW24JRPYDNUBWARXDYLHYMEOELSEELK5BG2BQLVQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.220967280 (279h34m0.652047421s) [noise=true , address=79.127.219.47:4072 , piece_id=77OBALT5NYIL3FQCFFYYVGIOA6IMISQ6OJDN4Z5XQLYXNRNYTYVQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.232652899 (279h34m0.66373304s) [noise=true , address=45.91.116.11:4129 , piece_id=M5QZNBBEPEP5OK57CU4RXJFH7XQD72RIJOHMCMV5YIQPZ4HBMWZA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.234637186 (279h34m0.665717327s) [noise=true , address=45.91.116.12:4259 , piece_id=U4SO5T45AYT2AYBPVVBC4K7B77FY7NRPZ2OKKA3TF63UHA7RD4LA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.254195629 (279h34m0.68527576s) [noise=true , address=77.90.31.19:4869 , piece_id=KOGRZCWI6NXC3O43OKPCCDWFC4RQZZ3CGJDUUMDUKGIYJGK6SRPA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.315035417 (279h34m0.746115548s) [noise=true , address=104.36.82.5:4844 , piece_id=SK6RPNDW6FZDCBDOMTRCPKZRLTCP53X3WWE5ZAQ7OWWY5VZYFL2Q, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.320364894 (279h34m0.751445035s) [noise=true , address=77.90.31.21:4903 , piece_id=IQQDS5AI2L64M3RTDSL2QAY5JUER3VSGALVVWQAWPEA7HJZ5D3CQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.322269388 (279h34m0.753349519s) [noise=true , address=77.90.31.13:4653 , piece_id=E63P23K4B2OWIBIRAWQ75KFLFRZVOURZX74IJUQ6UYUTCQGEDJBQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.340622034 (279h34m0.771702175s) [noise=true , address=104.36.82.20:4458 , piece_id=QV2QJYA2FPEHHNBXDKYIX6G7CNCHCGM7QVIUYSSUPLWSDQNXLWFQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.352261244 (279h34m0.783341375s) [noise=true , address=77.90.31.16:4753 , piece_id=CZBZVRFHMLMYNMM5KTDJZDBUAUXWTK2K2XCRM7C7FT777VVWAFAA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.355070809 (279h34m0.78615094s) [noise=true , address=77.90.31.11:4563 , piece_id=PO5QL6VEMQF7JFLYA3XUWLIUZROZM6LZSZXQX3NK7QFNOVZMMI6Q, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.402968145 (279h34m0.834048276s) [noise=true , address=77.90.31.18:4812 , piece_id=LBYNQOU5RI37ZGOOAZWE4HWSM7KGOY35XZKPM7YAYW4CE2UE2XBA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.402995077 (279h34m0.834075208s) [seg_pos={0 0}, upload=290629]: Segment reached optimal threshold of 14 pieces.
Aug 20 09:00:06.403120486 (279h34m0.834200627s) [noise=true , address=104.36.82.44:4884 , piece_id=5RF22M26NNHQ4TGUJHXU2DLU325QFWJIPHPCCW3APOPRMS7ATXYQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 20 09:00:06.403163208 (279h34m0.83424334s) [noise=true , address=45.91.116.13:4181 , piece_id=2RAHUDUY6VACFPWYGZWGYZWIGUHVISK4YYTLR2GLIGU6WQSTDX3Q, seg_pos={0 0}, upload=290629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7LXGgUieZvwdvxcRGCLGSQVVV2PjFuEaze7ccG1hJLNB2aQ): protocol: expected piece hash; context canceled; EOF
Aug 20 09:00:06.403215288 (279h34m0.834295419s) [noise=true , address=77.90.31.17:4774 , piece_id=ACLZ6GABJT2IXMIEIH2VQMY7S6KPXJESSD74VBZPAERILYSWRNZQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mZTv2q5zT1Za4DTcdFbUwWs1897vv9GXuLqPcnY3FaxTdGv3Y): protocol: expected piece hash; context canceled; EOF
Aug 20 09:00:06.403248081 (279h34m0.834328212s) [noise=true , address=45.91.116.6:4988 , piece_id=OMB3VVHXNOQTD2R4ERCRGME35HK3VFMM5ZLBR7VFXQ7MVBQD56PA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TrcoCHhAJeEykP9hJNpygoPSdgFV5v6GzL48JpyNPiAj5ZJRS): protocol: expected piece hash; context canceled; EOF
Aug 20 09:00:06.403261225 (279h34m0.834341357s) [seg_pos={0 0}, upload=290629]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 09:00:06.403327403 (279h34m0.834407534s) [upload=290629]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 09:00:06.403332081 (279h34m0.834412223s) [upload=290629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 09:00:06.717671087 (279h34m1.148751228s) [upload=290629]: Done uploading segments...
Aug 20 09:00:06.717694332 (279h34m1.148774463s) [upload=290629]: Upload finished. err: <nil>
Duration: 5.721730479s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.................................X..............X.....X...X.] duration:
2.04546659s
FAIL (2025-08-20 09:03:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.045494683s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X.................................................XX...] duration:
5.891594415s
FAIL (2025-08-20 09:03:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 997197c9df9ec8fb288ad0b302fe92a83d35d62dc04c90afee33e6e6fc672bd7 != before b048aed2d865f86c9ad26b59519ae43b409a900e93a31fc1124728e0b892b99d
======LOGS======
Aug 20 09:00:03.842513480 (279h33m58.273593611s) [upload=290629]: Starting upload
Aug 20 09:00:03.842568956 (279h33m58.273649087s) [upload=290629]: Done starting upload
Aug 20 09:00:03.842706280 (279h33m58.273786411s) [upload=290629]: Uploading segments...
Aug 20 09:00:03.842792314 (279h33m58.273872456s) [upload=290629]: Got next segment. Inline: false
Aug 20 09:00:03.842851177 (279h33m58.273931318s) [upload=290629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 09:00:03.842857689 (279h33m58.27393783s) [upload=290629]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 09:00:04.334156776 (279h33m58.765236907s) [seg_pos={0 0}, upload=290629]: Begin upload segment...
Aug 20 09:00:04.334204898 (279h33m58.765285039s) [seg_pos={0 0}, upload=290629]: Done begin upload segment.
Aug 20 09:00:04.334222281 (279h33m58.765302412s) [noise=true , address=77.90.31.16:4753 , piece_id=CZBZVRFHMLMYNMM5KTDJZDBUAUXWTK2K2XCRM7C7FT777VVWAFAA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334232270 (279h33m58.765312402s) [noise=true , address=104.36.82.44:4884 , piece_id=5RF22M26NNHQ4TGUJHXU2DLU325QFWJIPHPCCW3APOPRMS7ATXYQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334281955 (279h33m58.765362086s) [noise=true , address=45.91.116.12:4259 , piece_id=U4SO5T45AYT2AYBPVVBC4K7B77FY7NRPZ2OKKA3TF63UHA7RD4LA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334576509 (279h33m58.76565664s) [noise=true , address=79.127.205.245:4248 , piece_id=DWZLQH6EIH2VCOQHANUKWJJTNQEF5BUHXQKC7BEKCG46I6FQQFXQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334622176 (279h33m58.765702317s) [noise=true , address=77.90.31.18:4812 , piece_id=LBYNQOU5RI37ZGOOAZWE4HWSM7KGOY35XZKPM7YAYW4CE2UE2XBA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.334963659 (279h33m58.76604379s) [noise=true , address=104.36.82.20:4458 , piece_id=QV2QJYA2FPEHHNBXDKYIX6G7CNCHCGM7QVIUYSSUPLWSDQNXLWFQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.335225390 (279h33m58.766305522s) [noise=true , address=45.91.116.11:4129 , piece_id=M5QZNBBEPEP5OK57CU4RXJFH7XQD72RIJOHMCMV5YIQPZ4HBMWZA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.335507169 (279h33m58.7665873s) [noise=true , address=77.90.31.13:4653 , piece_id=E63P23K4B2OWIBIRAWQ75KFLFRZVOURZX74IJUQ6UYUTCQGEDJBQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.335792366 (279h33m58.766872507s) [noise=true , address=66.23.193.175:4557 , piece_id=BEFYM3LP6DI5NHTITCTP5ZPNATYHZM4GPPKSNDMLNZH4NGR4HRFQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.336188423 (279h33m58.767268554s) [noise=true , address=77.90.31.21:4903 , piece_id=IQQDS5AI2L64M3RTDSL2QAY5JUER3VSGALVVWQAWPEA7HJZ5D3CQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.336481624 (279h33m58.767561765s) [noise=true , address=77.90.31.17:4774 , piece_id=ACLZ6GABJT2IXMIEIH2VQMY7S6KPXJESSD74VBZPAERILYSWRNZQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.336742944 (279h33m58.767823075s) [noise=true , address=79.127.219.48:4091 , piece_id=MLJ27QEAQ2HXMW24JRPYDNUBWARXDYLHYMEOELSEELK5BG2BQLVQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.337037297 (279h33m58.768117428s) [noise=true , address=45.91.116.13:4181 , piece_id=2RAHUDUY6VACFPWYGZWGYZWIGUHVISK4YYTLR2GLIGU6WQSTDX3Q, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.337369312 (279h33m58.768449454s) [noise=true , address=104.36.82.5:4844 , piece_id=SK6RPNDW6FZDCBDOMTRCPKZRLTCP53X3WWE5ZAQ7OWWY5VZYFL2Q, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.337682040 (279h33m58.768762202s) [noise=true , address=79.127.219.47:4072 , piece_id=77OBALT5NYIL3FQCFFYYVGIOA6IMISQ6OJDN4Z5XQLYXNRNYTYVQ, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.338010529 (279h33m58.76909067s) [noise=true , address=45.91.116.6:4988 , piece_id=OMB3VVHXNOQTD2R4ERCRGME35HK3VFMM5ZLBR7VFXQ7MVBQD56PA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.338281718 (279h33m58.769361849s) [noise=true , address=77.90.31.11:4563 , piece_id=PO5QL6VEMQF7JFLYA3XUWLIUZROZM6LZSZXQX3NK7QFNOVZMMI6Q, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:04.338515766 (279h33m58.769595897s) [noise=true , address=77.90.31.19:4869 , piece_id=KOGRZCWI6NXC3O43OKPCCDWFC4RQZZ3CGJDUUMDUKGIYJGK6SRPA, seg_pos={0 0}, upload=290629]: Uploading piece...
Aug 20 09:00:05.527576888 (279h33m59.958657029s) [upload=290629]: Next returned nil segment
Aug 20 09:00:05.527596145 (279h33m59.958676276s) [upload=290629]: Waiting for error group managing segments...
Aug 20 09:00:05.855631067 (279h34m0.286711198s) [noise=true , address=66.23.193.175:4557 , piece_id=BEFYM3LP6DI5NHTITCTP5ZPNATYHZM4GPPKSNDMLNZH4NGR4HRFQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:05.874786609 (279h34m0.30586674s) [noise=true , address=79.127.205.245:4248 , piece_id=DWZLQH6EIH2VCOQHANUKWJJTNQEF5BUHXQKC7BEKCG46I6FQQFXQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.219955715 (279h34m0.651035846s) [noise=true , address=79.127.219.48:4091 , piece_id=MLJ27QEAQ2HXMW24JRPYDNUBWARXDYLHYMEOELSEELK5BG2BQLVQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.220967280 (279h34m0.652047421s) [noise=true , address=79.127.219.47:4072 , piece_id=77OBALT5NYIL3FQCFFYYVGIOA6IMISQ6OJDN4Z5XQLYXNRNYTYVQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.232652899 (279h34m0.66373304s) [noise=true , address=45.91.116.11:4129 , piece_id=M5QZNBBEPEP5OK57CU4RXJFH7XQD72RIJOHMCMV5YIQPZ4HBMWZA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.234637186 (279h34m0.665717327s) [noise=true , address=45.91.116.12:4259 , piece_id=U4SO5T45AYT2AYBPVVBC4K7B77FY7NRPZ2OKKA3TF63UHA7RD4LA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.254195629 (279h34m0.68527576s) [noise=true , address=77.90.31.19:4869 , piece_id=KOGRZCWI6NXC3O43OKPCCDWFC4RQZZ3CGJDUUMDUKGIYJGK6SRPA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.315035417 (279h34m0.746115548s) [noise=true , address=104.36.82.5:4844 , piece_id=SK6RPNDW6FZDCBDOMTRCPKZRLTCP53X3WWE5ZAQ7OWWY5VZYFL2Q, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.320364894 (279h34m0.751445035s) [noise=true , address=77.90.31.21:4903 , piece_id=IQQDS5AI2L64M3RTDSL2QAY5JUER3VSGALVVWQAWPEA7HJZ5D3CQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.322269388 (279h34m0.753349519s) [noise=true , address=77.90.31.13:4653 , piece_id=E63P23K4B2OWIBIRAWQ75KFLFRZVOURZX74IJUQ6UYUTCQGEDJBQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.340622034 (279h34m0.771702175s) [noise=true , address=104.36.82.20:4458 , piece_id=QV2QJYA2FPEHHNBXDKYIX6G7CNCHCGM7QVIUYSSUPLWSDQNXLWFQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.352261244 (279h34m0.783341375s) [noise=true , address=77.90.31.16:4753 , piece_id=CZBZVRFHMLMYNMM5KTDJZDBUAUXWTK2K2XCRM7C7FT777VVWAFAA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.355070809 (279h34m0.78615094s) [noise=true , address=77.90.31.11:4563 , piece_id=PO5QL6VEMQF7JFLYA3XUWLIUZROZM6LZSZXQX3NK7QFNOVZMMI6Q, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.402968145 (279h34m0.834048276s) [noise=true , address=77.90.31.18:4812 , piece_id=LBYNQOU5RI37ZGOOAZWE4HWSM7KGOY35XZKPM7YAYW4CE2UE2XBA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: <nil>
Aug 20 09:00:06.402995077 (279h34m0.834075208s) [seg_pos={0 0}, upload=290629]: Segment reached optimal threshold of 14 pieces.
Aug 20 09:00:06.403120486 (279h34m0.834200627s) [noise=true , address=104.36.82.44:4884 , piece_id=5RF22M26NNHQ4TGUJHXU2DLU325QFWJIPHPCCW3APOPRMS7ATXYQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 20 09:00:06.403163208 (279h34m0.83424334s) [noise=true , address=45.91.116.13:4181 , piece_id=2RAHUDUY6VACFPWYGZWGYZWIGUHVISK4YYTLR2GLIGU6WQSTDX3Q, seg_pos={0 0}, upload=290629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7LXGgUieZvwdvxcRGCLGSQVVV2PjFuEaze7ccG1hJLNB2aQ): protocol: expected piece hash; context canceled; EOF
Aug 20 09:00:06.403215288 (279h34m0.834295419s) [noise=true , address=77.90.31.17:4774 , piece_id=ACLZ6GABJT2IXMIEIH2VQMY7S6KPXJESSD74VBZPAERILYSWRNZQ, seg_pos={0 0}, upload=290629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mZTv2q5zT1Za4DTcdFbUwWs1897vv9GXuLqPcnY3FaxTdGv3Y): protocol: expected piece hash; context canceled; EOF
Aug 20 09:00:06.403248081 (279h34m0.834328212s) [noise=true , address=45.91.116.6:4988 , piece_id=OMB3VVHXNOQTD2R4ERCRGME35HK3VFMM5ZLBR7VFXQ7MVBQD56PA, seg_pos={0 0}, upload=290629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TrcoCHhAJeEykP9hJNpygoPSdgFV5v6GzL48JpyNPiAj5ZJRS): protocol: expected piece hash; context canceled; EOF
Aug 20 09:00:06.403261225 (279h34m0.834341357s) [seg_pos={0 0}, upload=290629]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 09:00:06.403327403 (279h34m0.834407534s) [upload=290629]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 09:00:06.403332081 (279h34m0.834412223s) [upload=290629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 09:00:06.717671087 (279h34m1.148751228s) [upload=290629]: Done uploading segments...
Aug 20 09:00:06.717694332 (279h34m1.148774463s) [upload=290629]: Upload finished. err: <nil>
Duration: 5.891621517s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..................................X..............X.....X...X] duration:
864.368706ms
FAIL (2025-08-20 09:02:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 09:02:52.970132577 (279h36m47.401212708s) [upload=290682]: Starting upload Aug 20 09:02:52.970181701 (279h36m47.401261832s) [upload=290682]: Done starting upload Aug 20 09:02:52.970229031 (279h36m47.401309162s) [upload=290682]: Uploading segments... Aug 20 09:02:52.970265010 (279h36m47.401345141s) [upload=290682]: Got next segment. Inline: true Aug 20 09:02:52.970268747 (279h36m47.401348878s) [upload=290682]: Waiting for error group managing segments... Aug 20 09:02:52.970303443 (279h36m47.401383564s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:02:52.970307451 (279h36m47.401387582s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:02:52.970312210 (279h36m47.401392341s) [upload=290682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:02:53.185053680 (279h36m47.616133811s) [upload=290682]: Done uploading segments... Aug 20 09:02:53.185078908 (279h36m47.616159039s) [upload=290682]: Upload finished. err: metaclient: Too Many Requests
Duration: 864.413019ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................................X..............X.....X...] duration:
2.34121674s
FAIL (2025-08-20 09:02:13 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 09:00:31.746246281 (279h34m26.177326412s) [upload=290638]: Starting upload Aug 20 09:00:31.746334801 (279h34m26.177414932s) [upload=290638]: Done starting upload Aug 20 09:00:31.746385016 (279h34m26.177465137s) [upload=290638]: Uploading segments... Aug 20 09:00:31.746421707 (279h34m26.177501838s) [upload=290638]: Got next segment. Inline: true Aug 20 09:00:31.746425083 (279h34m26.177505214s) [upload=290638]: Waiting for error group managing segments... Aug 20 09:00:31.746456754 (279h34m26.177536885s) [upload=290638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 09:00:31.746460851 (279h34m26.177540982s) [upload=290638]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 09:00:31.746463366 (279h34m26.177543507s) [upload=290638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 09:00:32.048154451 (279h34m26.479234593s) [upload=290638]: Done uploading segments... Aug 20 09:00:32.048179419 (279h34m26.47925955s) [upload=290638]: Upload finished. err: <nil>
Duration: 2.341261284s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|