Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X.................X......X.................................] duration:
2.109786814s
FAIL (2025-08-25 14:27:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.109812985s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................................X................X..X......] duration:
6.23829851s
FAIL (2025-08-25 14:26:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 14:22:27.139269091 (404h56m21.570349252s) [upload=421197]: Starting upload Aug 25 14:22:27.139350888 (404h56m21.570431019s) [upload=421197]: Done starting upload Aug 25 14:22:27.139460167 (404h56m21.570540338s) [upload=421197]: Uploading segments... Aug 25 14:22:27.139798985 (404h56m21.570879126s) [upload=421197]: Got next segment. Inline: false Aug 25 14:22:27.139918414 (404h56m21.570998545s) [upload=421197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 14:22:27.139925527 (404h56m21.571005668s) [upload=421197]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 14:22:27.363059243 (404h56m21.794139374s) [upload=421197]: Next segment err: metaclient: Too Many Requests Aug 25 14:22:27.363080023 (404h56m21.794160154s) [upload=421197]: Done uploading segments... Aug 25 14:22:27.363094651 (404h56m21.794174782s) [upload=421197]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.238341392s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................................X................X..X.....] duration:
5.828040579s
FAIL (2025-08-25 14:26:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 14:22:27.139269091 (404h56m21.570349252s) [upload=421197]: Starting upload Aug 25 14:22:27.139350888 (404h56m21.570431019s) [upload=421197]: Done starting upload Aug 25 14:22:27.139460167 (404h56m21.570540338s) [upload=421197]: Uploading segments... Aug 25 14:22:27.139798985 (404h56m21.570879126s) [upload=421197]: Got next segment. Inline: false Aug 25 14:22:27.139918414 (404h56m21.570998545s) [upload=421197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 14:22:27.139925527 (404h56m21.571005668s) [upload=421197]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 14:22:27.363059243 (404h56m21.794139374s) [upload=421197]: Next segment err: metaclient: Too Many Requests Aug 25 14:22:27.363080023 (404h56m21.794160154s) [upload=421197]: Done uploading segments... Aug 25 14:22:27.363094651 (404h56m21.794174782s) [upload=421197]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.828067029s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X.................X......X................................] duration:
1.877677192s
FAIL (2025-08-25 14:26:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.877701849s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X.................X......X...............................] duration:
1.894674575s
FAIL (2025-08-25 14:25:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.894699995s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................................X................X..X....] duration:
5.859382951s
FAIL (2025-08-25 14:25:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 14:22:27.139269091 (404h56m21.570349252s) [upload=421197]: Starting upload Aug 25 14:22:27.139350888 (404h56m21.570431019s) [upload=421197]: Done starting upload Aug 25 14:22:27.139460167 (404h56m21.570540338s) [upload=421197]: Uploading segments... Aug 25 14:22:27.139798985 (404h56m21.570879126s) [upload=421197]: Got next segment. Inline: false Aug 25 14:22:27.139918414 (404h56m21.570998545s) [upload=421197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 14:22:27.139925527 (404h56m21.571005668s) [upload=421197]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 14:22:27.363059243 (404h56m21.794139374s) [upload=421197]: Next segment err: metaclient: Too Many Requests Aug 25 14:22:27.363080023 (404h56m21.794160154s) [upload=421197]: Done uploading segments... Aug 25 14:22:27.363094651 (404h56m21.794174782s) [upload=421197]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.859410143s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X.................X......X..............................] duration:
2.125831546s
FAIL (2025-08-25 14:24:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.125858818s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................................X................X..X...] duration:
5.885967259s
FAIL (2025-08-25 14:24:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 14:22:27.139269091 (404h56m21.570349252s) [upload=421197]: Starting upload Aug 25 14:22:27.139350888 (404h56m21.570431019s) [upload=421197]: Done starting upload Aug 25 14:22:27.139460167 (404h56m21.570540338s) [upload=421197]: Uploading segments... Aug 25 14:22:27.139798985 (404h56m21.570879126s) [upload=421197]: Got next segment. Inline: false Aug 25 14:22:27.139918414 (404h56m21.570998545s) [upload=421197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 14:22:27.139925527 (404h56m21.571005668s) [upload=421197]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 14:22:27.363059243 (404h56m21.794139374s) [upload=421197]: Next segment err: metaclient: Too Many Requests Aug 25 14:22:27.363080023 (404h56m21.794160154s) [upload=421197]: Done uploading segments... Aug 25 14:22:27.363094651 (404h56m21.794174782s) [upload=421197]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.88599386s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X....................................X................X..X..] duration:
6.041270964s
FAIL (2025-08-25 14:23:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 14:22:27.139269091 (404h56m21.570349252s) [upload=421197]: Starting upload Aug 25 14:22:27.139350888 (404h56m21.570431019s) [upload=421197]: Done starting upload Aug 25 14:22:27.139460167 (404h56m21.570540338s) [upload=421197]: Uploading segments... Aug 25 14:22:27.139798985 (404h56m21.570879126s) [upload=421197]: Got next segment. Inline: false Aug 25 14:22:27.139918414 (404h56m21.570998545s) [upload=421197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 14:22:27.139925527 (404h56m21.571005668s) [upload=421197]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 14:22:27.363059243 (404h56m21.794139374s) [upload=421197]: Next segment err: metaclient: Too Many Requests Aug 25 14:22:27.363080023 (404h56m21.794160154s) [upload=421197]: Done uploading segments... Aug 25 14:22:27.363094651 (404h56m21.794174782s) [upload=421197]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.041298277s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X.................X......X.............................] duration:
2.086243896s
FAIL (2025-08-25 14:23:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.086268031s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X....................................X................X..X.] duration:
6.03530884s
FAIL (2025-08-25 14:23:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 14:22:27.139269091 (404h56m21.570349252s) [upload=421197]: Starting upload Aug 25 14:22:27.139350888 (404h56m21.570431019s) [upload=421197]: Done starting upload Aug 25 14:22:27.139460167 (404h56m21.570540338s) [upload=421197]: Uploading segments... Aug 25 14:22:27.139798985 (404h56m21.570879126s) [upload=421197]: Got next segment. Inline: false Aug 25 14:22:27.139918414 (404h56m21.570998545s) [upload=421197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 14:22:27.139925527 (404h56m21.571005668s) [upload=421197]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 14:22:27.363059243 (404h56m21.794139374s) [upload=421197]: Next segment err: metaclient: Too Many Requests Aug 25 14:22:27.363080023 (404h56m21.794160154s) [upload=421197]: Done uploading segments... Aug 25 14:22:27.363094651 (404h56m21.794174782s) [upload=421197]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.035345129s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X.................X......X............................] duration:
3.067375584s
FAIL (2025-08-25 14:22:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.067395242s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X....................................X................X..X] duration:
873.774125ms
FAIL (2025-08-25 14:22:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 14:22:27.139269091 (404h56m21.570349252s) [upload=421197]: Starting upload Aug 25 14:22:27.139350888 (404h56m21.570431019s) [upload=421197]: Done starting upload Aug 25 14:22:27.139460167 (404h56m21.570540338s) [upload=421197]: Uploading segments... Aug 25 14:22:27.139798985 (404h56m21.570879126s) [upload=421197]: Got next segment. Inline: false Aug 25 14:22:27.139918414 (404h56m21.570998545s) [upload=421197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 14:22:27.139925527 (404h56m21.571005668s) [upload=421197]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 14:22:27.363059243 (404h56m21.794139374s) [upload=421197]: Next segment err: metaclient: Too Many Requests Aug 25 14:22:27.363080023 (404h56m21.794160154s) [upload=421197]: Done uploading segments... Aug 25 14:22:27.363094651 (404h56m21.794174782s) [upload=421197]: Upload finished. err: metaclient: Too Many Requests
Duration: 873.796729ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X.................X......X...........................] duration:
1.874723241s
FAIL (2025-08-25 14:22:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.874760213s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X....................................X................X..] duration:
5.898965525s
FAIL (2025-08-25 14:21:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after fc42c100537d1fdf406ccc1d51106de1e773cef96de2c91f0cc5f66ab7422532 != before 093d506bdaca206157f3a1d211da10c164f399a79dd6b130b10a533b42274326
======LOGS======
Aug 25 14:21:12.373976472 (404h55m6.805056603s) [upload=421174]: Starting upload
Aug 25 14:21:12.374045654 (404h55m6.805125775s) [upload=421174]: Done starting upload
Aug 25 14:21:12.374188347 (404h55m6.805268478s) [upload=421174]: Uploading segments...
Aug 25 14:21:12.374333495 (404h55m6.805413626s) [upload=421174]: Got next segment. Inline: false
Aug 25 14:21:12.374362521 (404h55m6.805442652s) [upload=421174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 14:21:12.374367740 (404h55m6.805447862s) [upload=421174]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 14:21:12.915071821 (404h55m7.346151952s) [seg_pos={0 0}, upload=421174]: Begin upload segment...
Aug 25 14:21:12.915142265 (404h55m7.346222396s) [noise=true , address=104.36.82.4:4814 , piece_id=ZLP5B2Y76A3UYRCB5TFJRXIQMHXPAJC23IQD3N7KI3EZI3ZDSEYA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.915602867 (404h55m7.346682998s) [noise=true , address=45.91.116.8:4070 , piece_id=OGL3BXWFB7VKB2OFB5R3YKHV2JCHUD2TCBQSC63WS5BWEKNV5L6Q, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.915986511 (404h55m7.347066642s) [noise=true , address=79.127.201.215:4358 , piece_id=KA5OUAGW3CLUTSXI3ZAT3GOGU7TAES43WWNV3PTMVYTWBSZMEPDA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.916501807 (404h55m7.347581938s) [seg_pos={0 0}, upload=421174]: Done begin upload segment.
Aug 25 14:21:12.916520964 (404h55m7.347601095s) [noise=true , address=79.127.219.47:4056 , piece_id=2MRVVVAPHDGY4PCZX3XPLZJKUIXCPMU7KT3LTLOAAJL2LIXKUIEQ, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.916965815 (404h55m7.348045946s) [noise=true , address=104.36.82.7:4919 , piece_id=W3R3G6NCUCJ2G4CBZVNLZ7W4TYLZBFY3NF5RWMHWQKHRXEPTRP6A, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.917245009 (404h55m7.34832514s) [noise=true , address=104.36.82.44:4892 , piece_id=DK37B637TXQI5RCEAMDFHBKJG54VWOTNQ2V23WKT3BGZUT5LZ4IQ, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.917387833 (404h55m7.348467964s) [noise=true , address=79.127.205.233:4641 , piece_id=QO56G2M6WSKZWKDSPX3T4EB6WYSEOYDVVCZGPWXUES44COFQHKYQ, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.917633012 (404h55m7.348713143s) [noise=true , address=45.91.116.8:4058 , piece_id=MBEPA2ZCQJUOZCQPJG6ELXAYOOPV6FM4SDMWMWGIIKE3IHWPZXKA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.917896085 (404h55m7.348976216s) [noise=true , address=77.90.31.21:4909 , piece_id=AVYVF4HYL524J7Y74ECX34AY6MRSBZC3N7JJ7QFW4I56SW7RTPUA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.918216979 (404h55m7.34929711s) [noise=true , address=77.90.31.18:4817 , piece_id=CKG5ANHRYJQQF6PLMY7TECZGCFG32MYE2QWO5FAZZVG45DR5OYPQ, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.918328262 (404h55m7.349408393s) [noise=true , address=104.36.82.49:4998 , piece_id=4VFTRN6EAZ7NWQL7NUCWWAR34XNTBUO2PZMMDNGUF6W7NAMABGBA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.918687730 (404h55m7.349767861s) [noise=true , address=104.36.82.15:4278 , piece_id=LCVM7P3KLKFT3IZ2LLXSS3ZOZXSJITH37IBMO52CDWZ5INCU7QXA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.919169201 (404h55m7.350249332s) [noise=true , address=77.90.31.16:4746 , piece_id=VGUSY7ELYTAQMH5BDG5NV7N4ZSH3KKH63PMT6AIQQOAE52DBMZVQ, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.920330984 (404h55m7.351411115s) [noise=true , address=77.90.31.12:4605 , piece_id=ANFIVLAK4ZSU7COP3EU6GMTQIWROB26QMEBECFGW7HIJEKSNSH7Q, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.920662117 (404h55m7.351742238s) [noise=true , address=79.127.219.48:4092 , piece_id=Q2PYB33EHANU4ZHO246GWEPEH4Z7T4VKYMRLW73NBWNICUJ7U5VQ, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.920987470 (404h55m7.352067601s) [noise=true , address=104.36.82.60:4354 , piece_id=MF4YOVZPTB2QG734DVRNDDYIB2NQUG467QHY755MUB7DC4DONZQA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.921534537 (404h55m7.352614668s) [noise=true , address=104.36.82.14:4243 , piece_id=IPGSU7J4FT5LWBUYSBYAUJ5R4O2AV5NGPEEWWTSRJ3RAPTY4TKUA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.922007062 (404h55m7.353087183s) [noise=true , address=104.36.82.13:4214 , piece_id=KYUHR3S3V2AXIA7RN7D25HI732MKGW5JJQCGVXMMHAYP2QUBXCWA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:14.052181807 (404h55m8.483261938s) [upload=421174]: Next returned nil segment
Aug 25 14:21:14.052227254 (404h55m8.483307385s) [upload=421174]: Waiting for error group managing segments...
Aug 25 14:21:14.377834397 (404h55m8.808914518s) [noise=true , address=79.127.205.233:4641 , piece_id=QO56G2M6WSKZWKDSPX3T4EB6WYSEOYDVVCZGPWXUES44COFQHKYQ, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:14.849103607 (404h55m9.280183768s) [noise=true , address=104.36.82.4:4814 , piece_id=ZLP5B2Y76A3UYRCB5TFJRXIQMHXPAJC23IQD3N7KI3EZI3ZDSEYA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:14.873951782 (404h55m9.305031903s) [noise=true , address=104.36.82.13:4214 , piece_id=KYUHR3S3V2AXIA7RN7D25HI732MKGW5JJQCGVXMMHAYP2QUBXCWA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:14.887018506 (404h55m9.318098637s) [noise=true , address=79.127.201.215:4358 , piece_id=KA5OUAGW3CLUTSXI3ZAT3GOGU7TAES43WWNV3PTMVYTWBSZMEPDA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:14.905066790 (404h55m9.336146921s) [noise=true , address=79.127.219.48:4092 , piece_id=Q2PYB33EHANU4ZHO246GWEPEH4Z7T4VKYMRLW73NBWNICUJ7U5VQ, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:14.925287130 (404h55m9.356367261s) [noise=true , address=104.36.82.7:4919 , piece_id=W3R3G6NCUCJ2G4CBZVNLZ7W4TYLZBFY3NF5RWMHWQKHRXEPTRP6A, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:14.930633049 (404h55m9.36171318s) [noise=true , address=79.127.219.47:4056 , piece_id=2MRVVVAPHDGY4PCZX3XPLZJKUIXCPMU7KT3LTLOAAJL2LIXKUIEQ, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:14.937251013 (404h55m9.368331144s) [noise=true , address=104.36.82.15:4278 , piece_id=LCVM7P3KLKFT3IZ2LLXSS3ZOZXSJITH37IBMO52CDWZ5INCU7QXA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:15.017583435 (404h55m9.448663566s) [noise=true , address=104.36.82.14:4243 , piece_id=IPGSU7J4FT5LWBUYSBYAUJ5R4O2AV5NGPEEWWTSRJ3RAPTY4TKUA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:15.025353523 (404h55m9.456433654s) [noise=true , address=104.36.82.60:4354 , piece_id=MF4YOVZPTB2QG734DVRNDDYIB2NQUG467QHY755MUB7DC4DONZQA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:15.049148473 (404h55m9.480228605s) [noise=true , address=104.36.82.49:4998 , piece_id=4VFTRN6EAZ7NWQL7NUCWWAR34XNTBUO2PZMMDNGUF6W7NAMABGBA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:15.069129415 (404h55m9.500209546s) [noise=true , address=104.36.82.44:4892 , piece_id=DK37B637TXQI5RCEAMDFHBKJG54VWOTNQ2V23WKT3BGZUT5LZ4IQ, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:15.126578341 (404h55m9.557658492s) [noise=true , address=45.91.116.8:4058 , piece_id=MBEPA2ZCQJUOZCQPJG6ELXAYOOPV6FM4SDMWMWGIIKE3IHWPZXKA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:15.133185333 (404h55m9.564265464s) [noise=true , address=77.90.31.16:4746 , piece_id=VGUSY7ELYTAQMH5BDG5NV7N4ZSH3KKH63PMT6AIQQOAE52DBMZVQ, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:15.133212234 (404h55m9.564292365s) [seg_pos={0 0}, upload=421174]: Segment reached optimal threshold of 14 pieces.
Aug 25 14:21:15.133345550 (404h55m9.564425681s) [noise=true , address=77.90.31.21:4909 , piece_id=AVYVF4HYL524J7Y74ECX34AY6MRSBZC3N7JJ7QFW4I56SW7RTPUA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 25 14:21:15.133418740 (404h55m9.564498871s) [noise=true , address=77.90.31.18:4817 , piece_id=CKG5ANHRYJQQF6PLMY7TECZGCFG32MYE2QWO5FAZZVG45DR5OYPQ, seg_pos={0 0}, upload=421174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Qv5LBuANP9vS2vbsVNrJ7Mkc3SqXwTNCBzLvN955RHFKQVv5x): protocol: expected piece hash; context canceled; EOF
Aug 25 14:21:15.133481139 (404h55m9.56456127s) [noise=true , address=77.90.31.12:4605 , piece_id=ANFIVLAK4ZSU7COP3EU6GMTQIWROB26QMEBECFGW7HIJEKSNSH7Q, seg_pos={0 0}, upload=421174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V4Dj8k4kAnrS6GfSJvvDDPvyHTiJziufBCWWjNoPe1Yvc6M53): protocol: expected piece hash; context canceled; EOF
Aug 25 14:21:15.133494494 (404h55m9.564574625s) [noise=true , address=45.91.116.8:4070 , piece_id=OGL3BXWFB7VKB2OFB5R3YKHV2JCHUD2TCBQSC63WS5BWEKNV5L6Q, seg_pos={0 0}, upload=421174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YxZG48z2Q69SDyEKeqUYZCLSw1FF2hMuUzciDYUX5SoyRbnJ9): protocol: expected piece hash; context canceled; EOF
Aug 25 14:21:15.133575720 (404h55m9.564655861s) [seg_pos={0 0}, upload=421174]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 14:21:15.133755404 (404h55m9.564835565s) [upload=421174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 14:21:15.133765413 (404h55m9.564845574s) [upload=421174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 14:21:16.308388646 (404h55m10.739468777s) [upload=421174]: Done uploading segments...
Aug 25 14:21:16.308411711 (404h55m10.739491872s) [upload=421174]: Upload finished. err: <nil>
Duration: 5.898993437s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X....................................X................X.] duration:
6.719311395s
FAIL (2025-08-25 14:21:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after fc42c100537d1fdf406ccc1d51106de1e773cef96de2c91f0cc5f66ab7422532 != before 093d506bdaca206157f3a1d211da10c164f399a79dd6b130b10a533b42274326
======LOGS======
Aug 25 14:21:12.373976472 (404h55m6.805056603s) [upload=421174]: Starting upload
Aug 25 14:21:12.374045654 (404h55m6.805125775s) [upload=421174]: Done starting upload
Aug 25 14:21:12.374188347 (404h55m6.805268478s) [upload=421174]: Uploading segments...
Aug 25 14:21:12.374333495 (404h55m6.805413626s) [upload=421174]: Got next segment. Inline: false
Aug 25 14:21:12.374362521 (404h55m6.805442652s) [upload=421174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 14:21:12.374367740 (404h55m6.805447862s) [upload=421174]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 14:21:12.915071821 (404h55m7.346151952s) [seg_pos={0 0}, upload=421174]: Begin upload segment...
Aug 25 14:21:12.915142265 (404h55m7.346222396s) [noise=true , address=104.36.82.4:4814 , piece_id=ZLP5B2Y76A3UYRCB5TFJRXIQMHXPAJC23IQD3N7KI3EZI3ZDSEYA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.915602867 (404h55m7.346682998s) [noise=true , address=45.91.116.8:4070 , piece_id=OGL3BXWFB7VKB2OFB5R3YKHV2JCHUD2TCBQSC63WS5BWEKNV5L6Q, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.915986511 (404h55m7.347066642s) [noise=true , address=79.127.201.215:4358 , piece_id=KA5OUAGW3CLUTSXI3ZAT3GOGU7TAES43WWNV3PTMVYTWBSZMEPDA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.916501807 (404h55m7.347581938s) [seg_pos={0 0}, upload=421174]: Done begin upload segment.
Aug 25 14:21:12.916520964 (404h55m7.347601095s) [noise=true , address=79.127.219.47:4056 , piece_id=2MRVVVAPHDGY4PCZX3XPLZJKUIXCPMU7KT3LTLOAAJL2LIXKUIEQ, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.916965815 (404h55m7.348045946s) [noise=true , address=104.36.82.7:4919 , piece_id=W3R3G6NCUCJ2G4CBZVNLZ7W4TYLZBFY3NF5RWMHWQKHRXEPTRP6A, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.917245009 (404h55m7.34832514s) [noise=true , address=104.36.82.44:4892 , piece_id=DK37B637TXQI5RCEAMDFHBKJG54VWOTNQ2V23WKT3BGZUT5LZ4IQ, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.917387833 (404h55m7.348467964s) [noise=true , address=79.127.205.233:4641 , piece_id=QO56G2M6WSKZWKDSPX3T4EB6WYSEOYDVVCZGPWXUES44COFQHKYQ, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.917633012 (404h55m7.348713143s) [noise=true , address=45.91.116.8:4058 , piece_id=MBEPA2ZCQJUOZCQPJG6ELXAYOOPV6FM4SDMWMWGIIKE3IHWPZXKA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.917896085 (404h55m7.348976216s) [noise=true , address=77.90.31.21:4909 , piece_id=AVYVF4HYL524J7Y74ECX34AY6MRSBZC3N7JJ7QFW4I56SW7RTPUA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.918216979 (404h55m7.34929711s) [noise=true , address=77.90.31.18:4817 , piece_id=CKG5ANHRYJQQF6PLMY7TECZGCFG32MYE2QWO5FAZZVG45DR5OYPQ, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.918328262 (404h55m7.349408393s) [noise=true , address=104.36.82.49:4998 , piece_id=4VFTRN6EAZ7NWQL7NUCWWAR34XNTBUO2PZMMDNGUF6W7NAMABGBA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.918687730 (404h55m7.349767861s) [noise=true , address=104.36.82.15:4278 , piece_id=LCVM7P3KLKFT3IZ2LLXSS3ZOZXSJITH37IBMO52CDWZ5INCU7QXA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.919169201 (404h55m7.350249332s) [noise=true , address=77.90.31.16:4746 , piece_id=VGUSY7ELYTAQMH5BDG5NV7N4ZSH3KKH63PMT6AIQQOAE52DBMZVQ, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.920330984 (404h55m7.351411115s) [noise=true , address=77.90.31.12:4605 , piece_id=ANFIVLAK4ZSU7COP3EU6GMTQIWROB26QMEBECFGW7HIJEKSNSH7Q, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.920662117 (404h55m7.351742238s) [noise=true , address=79.127.219.48:4092 , piece_id=Q2PYB33EHANU4ZHO246GWEPEH4Z7T4VKYMRLW73NBWNICUJ7U5VQ, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.920987470 (404h55m7.352067601s) [noise=true , address=104.36.82.60:4354 , piece_id=MF4YOVZPTB2QG734DVRNDDYIB2NQUG467QHY755MUB7DC4DONZQA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.921534537 (404h55m7.352614668s) [noise=true , address=104.36.82.14:4243 , piece_id=IPGSU7J4FT5LWBUYSBYAUJ5R4O2AV5NGPEEWWTSRJ3RAPTY4TKUA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.922007062 (404h55m7.353087183s) [noise=true , address=104.36.82.13:4214 , piece_id=KYUHR3S3V2AXIA7RN7D25HI732MKGW5JJQCGVXMMHAYP2QUBXCWA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:14.052181807 (404h55m8.483261938s) [upload=421174]: Next returned nil segment
Aug 25 14:21:14.052227254 (404h55m8.483307385s) [upload=421174]: Waiting for error group managing segments...
Aug 25 14:21:14.377834397 (404h55m8.808914518s) [noise=true , address=79.127.205.233:4641 , piece_id=QO56G2M6WSKZWKDSPX3T4EB6WYSEOYDVVCZGPWXUES44COFQHKYQ, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:14.849103607 (404h55m9.280183768s) [noise=true , address=104.36.82.4:4814 , piece_id=ZLP5B2Y76A3UYRCB5TFJRXIQMHXPAJC23IQD3N7KI3EZI3ZDSEYA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:14.873951782 (404h55m9.305031903s) [noise=true , address=104.36.82.13:4214 , piece_id=KYUHR3S3V2AXIA7RN7D25HI732MKGW5JJQCGVXMMHAYP2QUBXCWA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:14.887018506 (404h55m9.318098637s) [noise=true , address=79.127.201.215:4358 , piece_id=KA5OUAGW3CLUTSXI3ZAT3GOGU7TAES43WWNV3PTMVYTWBSZMEPDA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:14.905066790 (404h55m9.336146921s) [noise=true , address=79.127.219.48:4092 , piece_id=Q2PYB33EHANU4ZHO246GWEPEH4Z7T4VKYMRLW73NBWNICUJ7U5VQ, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:14.925287130 (404h55m9.356367261s) [noise=true , address=104.36.82.7:4919 , piece_id=W3R3G6NCUCJ2G4CBZVNLZ7W4TYLZBFY3NF5RWMHWQKHRXEPTRP6A, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:14.930633049 (404h55m9.36171318s) [noise=true , address=79.127.219.47:4056 , piece_id=2MRVVVAPHDGY4PCZX3XPLZJKUIXCPMU7KT3LTLOAAJL2LIXKUIEQ, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:14.937251013 (404h55m9.368331144s) [noise=true , address=104.36.82.15:4278 , piece_id=LCVM7P3KLKFT3IZ2LLXSS3ZOZXSJITH37IBMO52CDWZ5INCU7QXA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:15.017583435 (404h55m9.448663566s) [noise=true , address=104.36.82.14:4243 , piece_id=IPGSU7J4FT5LWBUYSBYAUJ5R4O2AV5NGPEEWWTSRJ3RAPTY4TKUA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:15.025353523 (404h55m9.456433654s) [noise=true , address=104.36.82.60:4354 , piece_id=MF4YOVZPTB2QG734DVRNDDYIB2NQUG467QHY755MUB7DC4DONZQA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:15.049148473 (404h55m9.480228605s) [noise=true , address=104.36.82.49:4998 , piece_id=4VFTRN6EAZ7NWQL7NUCWWAR34XNTBUO2PZMMDNGUF6W7NAMABGBA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:15.069129415 (404h55m9.500209546s) [noise=true , address=104.36.82.44:4892 , piece_id=DK37B637TXQI5RCEAMDFHBKJG54VWOTNQ2V23WKT3BGZUT5LZ4IQ, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:15.126578341 (404h55m9.557658492s) [noise=true , address=45.91.116.8:4058 , piece_id=MBEPA2ZCQJUOZCQPJG6ELXAYOOPV6FM4SDMWMWGIIKE3IHWPZXKA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:15.133185333 (404h55m9.564265464s) [noise=true , address=77.90.31.16:4746 , piece_id=VGUSY7ELYTAQMH5BDG5NV7N4ZSH3KKH63PMT6AIQQOAE52DBMZVQ, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:15.133212234 (404h55m9.564292365s) [seg_pos={0 0}, upload=421174]: Segment reached optimal threshold of 14 pieces.
Aug 25 14:21:15.133345550 (404h55m9.564425681s) [noise=true , address=77.90.31.21:4909 , piece_id=AVYVF4HYL524J7Y74ECX34AY6MRSBZC3N7JJ7QFW4I56SW7RTPUA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 25 14:21:15.133418740 (404h55m9.564498871s) [noise=true , address=77.90.31.18:4817 , piece_id=CKG5ANHRYJQQF6PLMY7TECZGCFG32MYE2QWO5FAZZVG45DR5OYPQ, seg_pos={0 0}, upload=421174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Qv5LBuANP9vS2vbsVNrJ7Mkc3SqXwTNCBzLvN955RHFKQVv5x): protocol: expected piece hash; context canceled; EOF
Aug 25 14:21:15.133481139 (404h55m9.56456127s) [noise=true , address=77.90.31.12:4605 , piece_id=ANFIVLAK4ZSU7COP3EU6GMTQIWROB26QMEBECFGW7HIJEKSNSH7Q, seg_pos={0 0}, upload=421174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V4Dj8k4kAnrS6GfSJvvDDPvyHTiJziufBCWWjNoPe1Yvc6M53): protocol: expected piece hash; context canceled; EOF
Aug 25 14:21:15.133494494 (404h55m9.564574625s) [noise=true , address=45.91.116.8:4070 , piece_id=OGL3BXWFB7VKB2OFB5R3YKHV2JCHUD2TCBQSC63WS5BWEKNV5L6Q, seg_pos={0 0}, upload=421174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YxZG48z2Q69SDyEKeqUYZCLSw1FF2hMuUzciDYUX5SoyRbnJ9): protocol: expected piece hash; context canceled; EOF
Aug 25 14:21:15.133575720 (404h55m9.564655861s) [seg_pos={0 0}, upload=421174]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 14:21:15.133755404 (404h55m9.564835565s) [upload=421174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 14:21:15.133765413 (404h55m9.564845574s) [upload=421174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 14:21:16.308388646 (404h55m10.739468777s) [upload=421174]: Done uploading segments...
Aug 25 14:21:16.308411711 (404h55m10.739491872s) [upload=421174]: Upload finished. err: <nil>
Duration: 6.719340371s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X....................................X................X] duration:
7.205737067s
FAIL (2025-08-25 14:21:18 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after fc42c100537d1fdf406ccc1d51106de1e773cef96de2c91f0cc5f66ab7422532 != before 093d506bdaca206157f3a1d211da10c164f399a79dd6b130b10a533b42274326
======LOGS======
Aug 25 14:21:12.373976472 (404h55m6.805056603s) [upload=421174]: Starting upload
Aug 25 14:21:12.374045654 (404h55m6.805125775s) [upload=421174]: Done starting upload
Aug 25 14:21:12.374188347 (404h55m6.805268478s) [upload=421174]: Uploading segments...
Aug 25 14:21:12.374333495 (404h55m6.805413626s) [upload=421174]: Got next segment. Inline: false
Aug 25 14:21:12.374362521 (404h55m6.805442652s) [upload=421174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 14:21:12.374367740 (404h55m6.805447862s) [upload=421174]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 14:21:12.915071821 (404h55m7.346151952s) [seg_pos={0 0}, upload=421174]: Begin upload segment...
Aug 25 14:21:12.915142265 (404h55m7.346222396s) [noise=true , address=104.36.82.4:4814 , piece_id=ZLP5B2Y76A3UYRCB5TFJRXIQMHXPAJC23IQD3N7KI3EZI3ZDSEYA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.915602867 (404h55m7.346682998s) [noise=true , address=45.91.116.8:4070 , piece_id=OGL3BXWFB7VKB2OFB5R3YKHV2JCHUD2TCBQSC63WS5BWEKNV5L6Q, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.915986511 (404h55m7.347066642s) [noise=true , address=79.127.201.215:4358 , piece_id=KA5OUAGW3CLUTSXI3ZAT3GOGU7TAES43WWNV3PTMVYTWBSZMEPDA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.916501807 (404h55m7.347581938s) [seg_pos={0 0}, upload=421174]: Done begin upload segment.
Aug 25 14:21:12.916520964 (404h55m7.347601095s) [noise=true , address=79.127.219.47:4056 , piece_id=2MRVVVAPHDGY4PCZX3XPLZJKUIXCPMU7KT3LTLOAAJL2LIXKUIEQ, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.916965815 (404h55m7.348045946s) [noise=true , address=104.36.82.7:4919 , piece_id=W3R3G6NCUCJ2G4CBZVNLZ7W4TYLZBFY3NF5RWMHWQKHRXEPTRP6A, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.917245009 (404h55m7.34832514s) [noise=true , address=104.36.82.44:4892 , piece_id=DK37B637TXQI5RCEAMDFHBKJG54VWOTNQ2V23WKT3BGZUT5LZ4IQ, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.917387833 (404h55m7.348467964s) [noise=true , address=79.127.205.233:4641 , piece_id=QO56G2M6WSKZWKDSPX3T4EB6WYSEOYDVVCZGPWXUES44COFQHKYQ, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.917633012 (404h55m7.348713143s) [noise=true , address=45.91.116.8:4058 , piece_id=MBEPA2ZCQJUOZCQPJG6ELXAYOOPV6FM4SDMWMWGIIKE3IHWPZXKA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.917896085 (404h55m7.348976216s) [noise=true , address=77.90.31.21:4909 , piece_id=AVYVF4HYL524J7Y74ECX34AY6MRSBZC3N7JJ7QFW4I56SW7RTPUA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.918216979 (404h55m7.34929711s) [noise=true , address=77.90.31.18:4817 , piece_id=CKG5ANHRYJQQF6PLMY7TECZGCFG32MYE2QWO5FAZZVG45DR5OYPQ, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.918328262 (404h55m7.349408393s) [noise=true , address=104.36.82.49:4998 , piece_id=4VFTRN6EAZ7NWQL7NUCWWAR34XNTBUO2PZMMDNGUF6W7NAMABGBA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.918687730 (404h55m7.349767861s) [noise=true , address=104.36.82.15:4278 , piece_id=LCVM7P3KLKFT3IZ2LLXSS3ZOZXSJITH37IBMO52CDWZ5INCU7QXA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.919169201 (404h55m7.350249332s) [noise=true , address=77.90.31.16:4746 , piece_id=VGUSY7ELYTAQMH5BDG5NV7N4ZSH3KKH63PMT6AIQQOAE52DBMZVQ, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.920330984 (404h55m7.351411115s) [noise=true , address=77.90.31.12:4605 , piece_id=ANFIVLAK4ZSU7COP3EU6GMTQIWROB26QMEBECFGW7HIJEKSNSH7Q, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.920662117 (404h55m7.351742238s) [noise=true , address=79.127.219.48:4092 , piece_id=Q2PYB33EHANU4ZHO246GWEPEH4Z7T4VKYMRLW73NBWNICUJ7U5VQ, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.920987470 (404h55m7.352067601s) [noise=true , address=104.36.82.60:4354 , piece_id=MF4YOVZPTB2QG734DVRNDDYIB2NQUG467QHY755MUB7DC4DONZQA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.921534537 (404h55m7.352614668s) [noise=true , address=104.36.82.14:4243 , piece_id=IPGSU7J4FT5LWBUYSBYAUJ5R4O2AV5NGPEEWWTSRJ3RAPTY4TKUA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:12.922007062 (404h55m7.353087183s) [noise=true , address=104.36.82.13:4214 , piece_id=KYUHR3S3V2AXIA7RN7D25HI732MKGW5JJQCGVXMMHAYP2QUBXCWA, seg_pos={0 0}, upload=421174]: Uploading piece...
Aug 25 14:21:14.052181807 (404h55m8.483261938s) [upload=421174]: Next returned nil segment
Aug 25 14:21:14.052227254 (404h55m8.483307385s) [upload=421174]: Waiting for error group managing segments...
Aug 25 14:21:14.377834397 (404h55m8.808914518s) [noise=true , address=79.127.205.233:4641 , piece_id=QO56G2M6WSKZWKDSPX3T4EB6WYSEOYDVVCZGPWXUES44COFQHKYQ, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:14.849103607 (404h55m9.280183768s) [noise=true , address=104.36.82.4:4814 , piece_id=ZLP5B2Y76A3UYRCB5TFJRXIQMHXPAJC23IQD3N7KI3EZI3ZDSEYA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:14.873951782 (404h55m9.305031903s) [noise=true , address=104.36.82.13:4214 , piece_id=KYUHR3S3V2AXIA7RN7D25HI732MKGW5JJQCGVXMMHAYP2QUBXCWA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:14.887018506 (404h55m9.318098637s) [noise=true , address=79.127.201.215:4358 , piece_id=KA5OUAGW3CLUTSXI3ZAT3GOGU7TAES43WWNV3PTMVYTWBSZMEPDA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:14.905066790 (404h55m9.336146921s) [noise=true , address=79.127.219.48:4092 , piece_id=Q2PYB33EHANU4ZHO246GWEPEH4Z7T4VKYMRLW73NBWNICUJ7U5VQ, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:14.925287130 (404h55m9.356367261s) [noise=true , address=104.36.82.7:4919 , piece_id=W3R3G6NCUCJ2G4CBZVNLZ7W4TYLZBFY3NF5RWMHWQKHRXEPTRP6A, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:14.930633049 (404h55m9.36171318s) [noise=true , address=79.127.219.47:4056 , piece_id=2MRVVVAPHDGY4PCZX3XPLZJKUIXCPMU7KT3LTLOAAJL2LIXKUIEQ, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:14.937251013 (404h55m9.368331144s) [noise=true , address=104.36.82.15:4278 , piece_id=LCVM7P3KLKFT3IZ2LLXSS3ZOZXSJITH37IBMO52CDWZ5INCU7QXA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:15.017583435 (404h55m9.448663566s) [noise=true , address=104.36.82.14:4243 , piece_id=IPGSU7J4FT5LWBUYSBYAUJ5R4O2AV5NGPEEWWTSRJ3RAPTY4TKUA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:15.025353523 (404h55m9.456433654s) [noise=true , address=104.36.82.60:4354 , piece_id=MF4YOVZPTB2QG734DVRNDDYIB2NQUG467QHY755MUB7DC4DONZQA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:15.049148473 (404h55m9.480228605s) [noise=true , address=104.36.82.49:4998 , piece_id=4VFTRN6EAZ7NWQL7NUCWWAR34XNTBUO2PZMMDNGUF6W7NAMABGBA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:15.069129415 (404h55m9.500209546s) [noise=true , address=104.36.82.44:4892 , piece_id=DK37B637TXQI5RCEAMDFHBKJG54VWOTNQ2V23WKT3BGZUT5LZ4IQ, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:15.126578341 (404h55m9.557658492s) [noise=true , address=45.91.116.8:4058 , piece_id=MBEPA2ZCQJUOZCQPJG6ELXAYOOPV6FM4SDMWMWGIIKE3IHWPZXKA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:15.133185333 (404h55m9.564265464s) [noise=true , address=77.90.31.16:4746 , piece_id=VGUSY7ELYTAQMH5BDG5NV7N4ZSH3KKH63PMT6AIQQOAE52DBMZVQ, seg_pos={0 0}, upload=421174]: Done uploading piece. err: <nil>
Aug 25 14:21:15.133212234 (404h55m9.564292365s) [seg_pos={0 0}, upload=421174]: Segment reached optimal threshold of 14 pieces.
Aug 25 14:21:15.133345550 (404h55m9.564425681s) [noise=true , address=77.90.31.21:4909 , piece_id=AVYVF4HYL524J7Y74ECX34AY6MRSBZC3N7JJ7QFW4I56SW7RTPUA, seg_pos={0 0}, upload=421174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 25 14:21:15.133418740 (404h55m9.564498871s) [noise=true , address=77.90.31.18:4817 , piece_id=CKG5ANHRYJQQF6PLMY7TECZGCFG32MYE2QWO5FAZZVG45DR5OYPQ, seg_pos={0 0}, upload=421174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Qv5LBuANP9vS2vbsVNrJ7Mkc3SqXwTNCBzLvN955RHFKQVv5x): protocol: expected piece hash; context canceled; EOF
Aug 25 14:21:15.133481139 (404h55m9.56456127s) [noise=true , address=77.90.31.12:4605 , piece_id=ANFIVLAK4ZSU7COP3EU6GMTQIWROB26QMEBECFGW7HIJEKSNSH7Q, seg_pos={0 0}, upload=421174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V4Dj8k4kAnrS6GfSJvvDDPvyHTiJziufBCWWjNoPe1Yvc6M53): protocol: expected piece hash; context canceled; EOF
Aug 25 14:21:15.133494494 (404h55m9.564574625s) [noise=true , address=45.91.116.8:4070 , piece_id=OGL3BXWFB7VKB2OFB5R3YKHV2JCHUD2TCBQSC63WS5BWEKNV5L6Q, seg_pos={0 0}, upload=421174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YxZG48z2Q69SDyEKeqUYZCLSw1FF2hMuUzciDYUX5SoyRbnJ9): protocol: expected piece hash; context canceled; EOF
Aug 25 14:21:15.133575720 (404h55m9.564655861s) [seg_pos={0 0}, upload=421174]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 14:21:15.133755404 (404h55m9.564835565s) [upload=421174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 14:21:15.133765413 (404h55m9.564845574s) [upload=421174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 14:21:16.308388646 (404h55m10.739468777s) [upload=421174]: Done uploading segments...
Aug 25 14:21:16.308411711 (404h55m10.739491872s) [upload=421174]: Upload finished. err: <nil>
Duration: 7.205767324s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X.................X......X..........................] duration:
1.842120868s
FAIL (2025-08-25 14:21:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.842150663s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X....................................X................] duration:
5.820687932s
FAIL (2025-08-25 14:20:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 14:08:01.001162783 (404h41m55.432242914s) [upload=420953]: Starting upload
Aug 25 14:08:01.001206165 (404h41m55.432286296s) [upload=420953]: Done starting upload
Aug 25 14:08:01.001379857 (404h41m55.432459988s) [upload=420953]: Uploading segments...
Aug 25 14:08:01.001412711 (404h41m55.432492842s) [upload=420953]: Got next segment. Inline: false
Aug 25 14:08:01.001435715 (404h41m55.432515856s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 14:08:01.001440283 (404h41m55.432520414s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 14:08:01.511647528 (404h41m55.942727699s) [seg_pos={0 0}, upload=420953]: Begin upload segment...
Aug 25 14:08:01.511707473 (404h41m55.942787604s) [seg_pos={0 0}, upload=420953]: Done begin upload segment.
Aug 25 14:08:01.511730126 (404h41m55.942810257s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512100555 (404h41m55.943180686s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512592316 (404h41m55.943672447s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512861461 (404h41m55.943941592s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513099737 (404h41m55.944179868s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513345005 (404h41m55.944425146s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513612748 (404h41m55.944692879s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513863497 (404h41m55.944943629s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514182478 (404h41m55.945262609s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514416426 (404h41m55.945496557s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514625926 (404h41m55.945706058s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514836119 (404h41m55.94591625s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515041772 (404h41m55.946121903s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515315987 (404h41m55.946396128s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515571737 (404h41m55.946651868s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515784363 (404h41m55.946864494s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516065171 (404h41m55.947145302s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516354504 (404h41m55.947434635s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:02.639123569 (404h41m57.07020371s) [upload=420953]: Next returned nil segment
Aug 25 14:08:02.639139881 (404h41m57.070220012s) [upload=420953]: Waiting for error group managing segments...
Aug 25 14:08:02.924924749 (404h41m57.35600488s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:02.927107757 (404h41m57.358187888s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.417003466 (404h41m57.848083597s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.419700437 (404h41m57.850780568s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.434733401 (404h41m57.865813532s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.466169262 (404h41m57.897249393s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.479536007 (404h41m57.910616138s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.488794573 (404h41m57.919874694s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.503753836 (404h41m57.934833968s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.520603607 (404h41m57.951683738s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.559036596 (404h41m57.990116727s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599458761 (404h41m58.030538892s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599566808 (404h41m58.030646939s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684072032 (404h41m58.115152163s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684100256 (404h41m58.115180387s) [seg_pos={0 0}, upload=420953]: Segment reached optimal threshold of 14 pieces.
Aug 25 14:08:03.684250324 (404h41m58.115330455s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684386034 (404h41m58.115466165s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rkh9uZUA5jXBVZvvt1jE7GHiEszKvR9PweKEry2AkdwoCiANs): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684409308 (404h41m58.115489439s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oSWAY52TJGVyZk4HTfifZBHQv42QsrAsk1Ks9PH6FoEmAZiN3): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684482858 (404h41m58.115562979s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection
Aug 25 14:08:03.684501635 (404h41m58.115581766s) [seg_pos={0 0}, upload=420953]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 14:08:03.684563573 (404h41m58.115643704s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 14:08:03.684567731 (404h41m58.115647862s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 14:08:04.727468188 (404h41m59.158548319s) [upload=420953]: Done uploading segments...
Aug 25 14:08:04.727486604 (404h41m59.158566735s) [upload=420953]: Upload finished. err: <nil>
Duration: 5.820713942s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X.................X......X.........................] duration:
2.05186299s
FAIL (2025-08-25 14:20:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.051924839s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X....................................X...............] duration:
6.473240128s
FAIL (2025-08-25 14:19:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 14:08:01.001162783 (404h41m55.432242914s) [upload=420953]: Starting upload
Aug 25 14:08:01.001206165 (404h41m55.432286296s) [upload=420953]: Done starting upload
Aug 25 14:08:01.001379857 (404h41m55.432459988s) [upload=420953]: Uploading segments...
Aug 25 14:08:01.001412711 (404h41m55.432492842s) [upload=420953]: Got next segment. Inline: false
Aug 25 14:08:01.001435715 (404h41m55.432515856s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 14:08:01.001440283 (404h41m55.432520414s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 14:08:01.511647528 (404h41m55.942727699s) [seg_pos={0 0}, upload=420953]: Begin upload segment...
Aug 25 14:08:01.511707473 (404h41m55.942787604s) [seg_pos={0 0}, upload=420953]: Done begin upload segment.
Aug 25 14:08:01.511730126 (404h41m55.942810257s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512100555 (404h41m55.943180686s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512592316 (404h41m55.943672447s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512861461 (404h41m55.943941592s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513099737 (404h41m55.944179868s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513345005 (404h41m55.944425146s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513612748 (404h41m55.944692879s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513863497 (404h41m55.944943629s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514182478 (404h41m55.945262609s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514416426 (404h41m55.945496557s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514625926 (404h41m55.945706058s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514836119 (404h41m55.94591625s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515041772 (404h41m55.946121903s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515315987 (404h41m55.946396128s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515571737 (404h41m55.946651868s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515784363 (404h41m55.946864494s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516065171 (404h41m55.947145302s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516354504 (404h41m55.947434635s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:02.639123569 (404h41m57.07020371s) [upload=420953]: Next returned nil segment
Aug 25 14:08:02.639139881 (404h41m57.070220012s) [upload=420953]: Waiting for error group managing segments...
Aug 25 14:08:02.924924749 (404h41m57.35600488s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:02.927107757 (404h41m57.358187888s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.417003466 (404h41m57.848083597s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.419700437 (404h41m57.850780568s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.434733401 (404h41m57.865813532s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.466169262 (404h41m57.897249393s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.479536007 (404h41m57.910616138s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.488794573 (404h41m57.919874694s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.503753836 (404h41m57.934833968s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.520603607 (404h41m57.951683738s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.559036596 (404h41m57.990116727s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599458761 (404h41m58.030538892s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599566808 (404h41m58.030646939s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684072032 (404h41m58.115152163s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684100256 (404h41m58.115180387s) [seg_pos={0 0}, upload=420953]: Segment reached optimal threshold of 14 pieces.
Aug 25 14:08:03.684250324 (404h41m58.115330455s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684386034 (404h41m58.115466165s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rkh9uZUA5jXBVZvvt1jE7GHiEszKvR9PweKEry2AkdwoCiANs): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684409308 (404h41m58.115489439s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oSWAY52TJGVyZk4HTfifZBHQv42QsrAsk1Ks9PH6FoEmAZiN3): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684482858 (404h41m58.115562979s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection
Aug 25 14:08:03.684501635 (404h41m58.115581766s) [seg_pos={0 0}, upload=420953]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 14:08:03.684563573 (404h41m58.115643704s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 14:08:03.684567731 (404h41m58.115647862s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 14:08:04.727468188 (404h41m59.158548319s) [upload=420953]: Done uploading segments...
Aug 25 14:08:04.727486604 (404h41m59.158566735s) [upload=420953]: Upload finished. err: <nil>
Duration: 6.473264877s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X.................X......X........................] duration:
1.952676762s
FAIL (2025-08-25 14:19:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.952700076s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X....................................X..............] duration:
6.160353421s
FAIL (2025-08-25 14:18:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 14:08:01.001162783 (404h41m55.432242914s) [upload=420953]: Starting upload
Aug 25 14:08:01.001206165 (404h41m55.432286296s) [upload=420953]: Done starting upload
Aug 25 14:08:01.001379857 (404h41m55.432459988s) [upload=420953]: Uploading segments...
Aug 25 14:08:01.001412711 (404h41m55.432492842s) [upload=420953]: Got next segment. Inline: false
Aug 25 14:08:01.001435715 (404h41m55.432515856s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 14:08:01.001440283 (404h41m55.432520414s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 14:08:01.511647528 (404h41m55.942727699s) [seg_pos={0 0}, upload=420953]: Begin upload segment...
Aug 25 14:08:01.511707473 (404h41m55.942787604s) [seg_pos={0 0}, upload=420953]: Done begin upload segment.
Aug 25 14:08:01.511730126 (404h41m55.942810257s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512100555 (404h41m55.943180686s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512592316 (404h41m55.943672447s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512861461 (404h41m55.943941592s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513099737 (404h41m55.944179868s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513345005 (404h41m55.944425146s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513612748 (404h41m55.944692879s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513863497 (404h41m55.944943629s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514182478 (404h41m55.945262609s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514416426 (404h41m55.945496557s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514625926 (404h41m55.945706058s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514836119 (404h41m55.94591625s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515041772 (404h41m55.946121903s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515315987 (404h41m55.946396128s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515571737 (404h41m55.946651868s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515784363 (404h41m55.946864494s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516065171 (404h41m55.947145302s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516354504 (404h41m55.947434635s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:02.639123569 (404h41m57.07020371s) [upload=420953]: Next returned nil segment
Aug 25 14:08:02.639139881 (404h41m57.070220012s) [upload=420953]: Waiting for error group managing segments...
Aug 25 14:08:02.924924749 (404h41m57.35600488s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:02.927107757 (404h41m57.358187888s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.417003466 (404h41m57.848083597s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.419700437 (404h41m57.850780568s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.434733401 (404h41m57.865813532s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.466169262 (404h41m57.897249393s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.479536007 (404h41m57.910616138s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.488794573 (404h41m57.919874694s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.503753836 (404h41m57.934833968s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.520603607 (404h41m57.951683738s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.559036596 (404h41m57.990116727s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599458761 (404h41m58.030538892s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599566808 (404h41m58.030646939s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684072032 (404h41m58.115152163s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684100256 (404h41m58.115180387s) [seg_pos={0 0}, upload=420953]: Segment reached optimal threshold of 14 pieces.
Aug 25 14:08:03.684250324 (404h41m58.115330455s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684386034 (404h41m58.115466165s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rkh9uZUA5jXBVZvvt1jE7GHiEszKvR9PweKEry2AkdwoCiANs): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684409308 (404h41m58.115489439s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oSWAY52TJGVyZk4HTfifZBHQv42QsrAsk1Ks9PH6FoEmAZiN3): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684482858 (404h41m58.115562979s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection
Aug 25 14:08:03.684501635 (404h41m58.115581766s) [seg_pos={0 0}, upload=420953]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 14:08:03.684563573 (404h41m58.115643704s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 14:08:03.684567731 (404h41m58.115647862s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 14:08:04.727468188 (404h41m59.158548319s) [upload=420953]: Done uploading segments...
Aug 25 14:08:04.727486604 (404h41m59.158566735s) [upload=420953]: Upload finished. err: <nil>
Duration: 6.160395272s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X....................................X.............] duration:
7.01762955s
FAIL (2025-08-25 14:18:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 14:08:01.001162783 (404h41m55.432242914s) [upload=420953]: Starting upload
Aug 25 14:08:01.001206165 (404h41m55.432286296s) [upload=420953]: Done starting upload
Aug 25 14:08:01.001379857 (404h41m55.432459988s) [upload=420953]: Uploading segments...
Aug 25 14:08:01.001412711 (404h41m55.432492842s) [upload=420953]: Got next segment. Inline: false
Aug 25 14:08:01.001435715 (404h41m55.432515856s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 14:08:01.001440283 (404h41m55.432520414s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 14:08:01.511647528 (404h41m55.942727699s) [seg_pos={0 0}, upload=420953]: Begin upload segment...
Aug 25 14:08:01.511707473 (404h41m55.942787604s) [seg_pos={0 0}, upload=420953]: Done begin upload segment.
Aug 25 14:08:01.511730126 (404h41m55.942810257s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512100555 (404h41m55.943180686s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512592316 (404h41m55.943672447s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512861461 (404h41m55.943941592s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513099737 (404h41m55.944179868s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513345005 (404h41m55.944425146s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513612748 (404h41m55.944692879s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513863497 (404h41m55.944943629s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514182478 (404h41m55.945262609s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514416426 (404h41m55.945496557s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514625926 (404h41m55.945706058s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514836119 (404h41m55.94591625s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515041772 (404h41m55.946121903s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515315987 (404h41m55.946396128s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515571737 (404h41m55.946651868s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515784363 (404h41m55.946864494s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516065171 (404h41m55.947145302s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516354504 (404h41m55.947434635s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:02.639123569 (404h41m57.07020371s) [upload=420953]: Next returned nil segment
Aug 25 14:08:02.639139881 (404h41m57.070220012s) [upload=420953]: Waiting for error group managing segments...
Aug 25 14:08:02.924924749 (404h41m57.35600488s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:02.927107757 (404h41m57.358187888s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.417003466 (404h41m57.848083597s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.419700437 (404h41m57.850780568s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.434733401 (404h41m57.865813532s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.466169262 (404h41m57.897249393s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.479536007 (404h41m57.910616138s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.488794573 (404h41m57.919874694s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.503753836 (404h41m57.934833968s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.520603607 (404h41m57.951683738s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.559036596 (404h41m57.990116727s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599458761 (404h41m58.030538892s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599566808 (404h41m58.030646939s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684072032 (404h41m58.115152163s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684100256 (404h41m58.115180387s) [seg_pos={0 0}, upload=420953]: Segment reached optimal threshold of 14 pieces.
Aug 25 14:08:03.684250324 (404h41m58.115330455s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684386034 (404h41m58.115466165s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rkh9uZUA5jXBVZvvt1jE7GHiEszKvR9PweKEry2AkdwoCiANs): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684409308 (404h41m58.115489439s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oSWAY52TJGVyZk4HTfifZBHQv42QsrAsk1Ks9PH6FoEmAZiN3): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684482858 (404h41m58.115562979s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection
Aug 25 14:08:03.684501635 (404h41m58.115581766s) [seg_pos={0 0}, upload=420953]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 14:08:03.684563573 (404h41m58.115643704s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 14:08:03.684567731 (404h41m58.115647862s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 14:08:04.727468188 (404h41m59.158548319s) [upload=420953]: Done uploading segments...
Aug 25 14:08:04.727486604 (404h41m59.158566735s) [upload=420953]: Upload finished. err: <nil>
Duration: 7.017653366s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X.................X......X.......................] duration:
1.878222044s
FAIL (2025-08-25 14:18:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.878252574s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X....................................X............] duration:
5.908937481s
FAIL (2025-08-25 14:18:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 14:08:01.001162783 (404h41m55.432242914s) [upload=420953]: Starting upload
Aug 25 14:08:01.001206165 (404h41m55.432286296s) [upload=420953]: Done starting upload
Aug 25 14:08:01.001379857 (404h41m55.432459988s) [upload=420953]: Uploading segments...
Aug 25 14:08:01.001412711 (404h41m55.432492842s) [upload=420953]: Got next segment. Inline: false
Aug 25 14:08:01.001435715 (404h41m55.432515856s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 14:08:01.001440283 (404h41m55.432520414s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 14:08:01.511647528 (404h41m55.942727699s) [seg_pos={0 0}, upload=420953]: Begin upload segment...
Aug 25 14:08:01.511707473 (404h41m55.942787604s) [seg_pos={0 0}, upload=420953]: Done begin upload segment.
Aug 25 14:08:01.511730126 (404h41m55.942810257s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512100555 (404h41m55.943180686s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512592316 (404h41m55.943672447s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512861461 (404h41m55.943941592s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513099737 (404h41m55.944179868s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513345005 (404h41m55.944425146s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513612748 (404h41m55.944692879s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513863497 (404h41m55.944943629s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514182478 (404h41m55.945262609s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514416426 (404h41m55.945496557s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514625926 (404h41m55.945706058s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514836119 (404h41m55.94591625s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515041772 (404h41m55.946121903s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515315987 (404h41m55.946396128s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515571737 (404h41m55.946651868s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515784363 (404h41m55.946864494s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516065171 (404h41m55.947145302s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516354504 (404h41m55.947434635s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:02.639123569 (404h41m57.07020371s) [upload=420953]: Next returned nil segment
Aug 25 14:08:02.639139881 (404h41m57.070220012s) [upload=420953]: Waiting for error group managing segments...
Aug 25 14:08:02.924924749 (404h41m57.35600488s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:02.927107757 (404h41m57.358187888s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.417003466 (404h41m57.848083597s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.419700437 (404h41m57.850780568s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.434733401 (404h41m57.865813532s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.466169262 (404h41m57.897249393s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.479536007 (404h41m57.910616138s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.488794573 (404h41m57.919874694s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.503753836 (404h41m57.934833968s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.520603607 (404h41m57.951683738s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.559036596 (404h41m57.990116727s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599458761 (404h41m58.030538892s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599566808 (404h41m58.030646939s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684072032 (404h41m58.115152163s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684100256 (404h41m58.115180387s) [seg_pos={0 0}, upload=420953]: Segment reached optimal threshold of 14 pieces.
Aug 25 14:08:03.684250324 (404h41m58.115330455s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684386034 (404h41m58.115466165s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rkh9uZUA5jXBVZvvt1jE7GHiEszKvR9PweKEry2AkdwoCiANs): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684409308 (404h41m58.115489439s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oSWAY52TJGVyZk4HTfifZBHQv42QsrAsk1Ks9PH6FoEmAZiN3): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684482858 (404h41m58.115562979s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection
Aug 25 14:08:03.684501635 (404h41m58.115581766s) [seg_pos={0 0}, upload=420953]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 14:08:03.684563573 (404h41m58.115643704s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 14:08:03.684567731 (404h41m58.115647862s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 14:08:04.727468188 (404h41m59.158548319s) [upload=420953]: Done uploading segments...
Aug 25 14:08:04.727486604 (404h41m59.158566735s) [upload=420953]: Upload finished. err: <nil>
Duration: 5.908966375s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X.................X......X......................] duration:
2.246675775s
FAIL (2025-08-25 14:17:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.246702766s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X....................................X...........] duration:
6.823517414s
FAIL (2025-08-25 14:17:44 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 14:08:01.001162783 (404h41m55.432242914s) [upload=420953]: Starting upload
Aug 25 14:08:01.001206165 (404h41m55.432286296s) [upload=420953]: Done starting upload
Aug 25 14:08:01.001379857 (404h41m55.432459988s) [upload=420953]: Uploading segments...
Aug 25 14:08:01.001412711 (404h41m55.432492842s) [upload=420953]: Got next segment. Inline: false
Aug 25 14:08:01.001435715 (404h41m55.432515856s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 14:08:01.001440283 (404h41m55.432520414s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 14:08:01.511647528 (404h41m55.942727699s) [seg_pos={0 0}, upload=420953]: Begin upload segment...
Aug 25 14:08:01.511707473 (404h41m55.942787604s) [seg_pos={0 0}, upload=420953]: Done begin upload segment.
Aug 25 14:08:01.511730126 (404h41m55.942810257s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512100555 (404h41m55.943180686s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512592316 (404h41m55.943672447s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512861461 (404h41m55.943941592s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513099737 (404h41m55.944179868s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513345005 (404h41m55.944425146s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513612748 (404h41m55.944692879s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513863497 (404h41m55.944943629s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514182478 (404h41m55.945262609s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514416426 (404h41m55.945496557s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514625926 (404h41m55.945706058s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514836119 (404h41m55.94591625s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515041772 (404h41m55.946121903s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515315987 (404h41m55.946396128s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515571737 (404h41m55.946651868s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515784363 (404h41m55.946864494s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516065171 (404h41m55.947145302s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516354504 (404h41m55.947434635s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:02.639123569 (404h41m57.07020371s) [upload=420953]: Next returned nil segment
Aug 25 14:08:02.639139881 (404h41m57.070220012s) [upload=420953]: Waiting for error group managing segments...
Aug 25 14:08:02.924924749 (404h41m57.35600488s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:02.927107757 (404h41m57.358187888s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.417003466 (404h41m57.848083597s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.419700437 (404h41m57.850780568s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.434733401 (404h41m57.865813532s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.466169262 (404h41m57.897249393s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.479536007 (404h41m57.910616138s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.488794573 (404h41m57.919874694s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.503753836 (404h41m57.934833968s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.520603607 (404h41m57.951683738s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.559036596 (404h41m57.990116727s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599458761 (404h41m58.030538892s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599566808 (404h41m58.030646939s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684072032 (404h41m58.115152163s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684100256 (404h41m58.115180387s) [seg_pos={0 0}, upload=420953]: Segment reached optimal threshold of 14 pieces.
Aug 25 14:08:03.684250324 (404h41m58.115330455s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684386034 (404h41m58.115466165s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rkh9uZUA5jXBVZvvt1jE7GHiEszKvR9PweKEry2AkdwoCiANs): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684409308 (404h41m58.115489439s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oSWAY52TJGVyZk4HTfifZBHQv42QsrAsk1Ks9PH6FoEmAZiN3): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684482858 (404h41m58.115562979s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection
Aug 25 14:08:03.684501635 (404h41m58.115581766s) [seg_pos={0 0}, upload=420953]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 14:08:03.684563573 (404h41m58.115643704s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 14:08:03.684567731 (404h41m58.115647862s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 14:08:04.727468188 (404h41m59.158548319s) [upload=420953]: Done uploading segments...
Aug 25 14:08:04.727486604 (404h41m59.158566735s) [upload=420953]: Upload finished. err: <nil>
Duration: 6.823544426s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X............X.................X......X.....................] duration:
1.911934054s
FAIL (2025-08-25 14:17:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.911966074s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X............X.................X......X....................] duration:
2.174060767s
FAIL (2025-08-25 14:16:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.174091135s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X....................................X..........] duration:
5.914877037s
FAIL (2025-08-25 14:16:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 14:08:01.001162783 (404h41m55.432242914s) [upload=420953]: Starting upload
Aug 25 14:08:01.001206165 (404h41m55.432286296s) [upload=420953]: Done starting upload
Aug 25 14:08:01.001379857 (404h41m55.432459988s) [upload=420953]: Uploading segments...
Aug 25 14:08:01.001412711 (404h41m55.432492842s) [upload=420953]: Got next segment. Inline: false
Aug 25 14:08:01.001435715 (404h41m55.432515856s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 14:08:01.001440283 (404h41m55.432520414s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 14:08:01.511647528 (404h41m55.942727699s) [seg_pos={0 0}, upload=420953]: Begin upload segment...
Aug 25 14:08:01.511707473 (404h41m55.942787604s) [seg_pos={0 0}, upload=420953]: Done begin upload segment.
Aug 25 14:08:01.511730126 (404h41m55.942810257s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512100555 (404h41m55.943180686s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512592316 (404h41m55.943672447s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512861461 (404h41m55.943941592s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513099737 (404h41m55.944179868s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513345005 (404h41m55.944425146s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513612748 (404h41m55.944692879s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513863497 (404h41m55.944943629s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514182478 (404h41m55.945262609s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514416426 (404h41m55.945496557s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514625926 (404h41m55.945706058s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514836119 (404h41m55.94591625s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515041772 (404h41m55.946121903s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515315987 (404h41m55.946396128s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515571737 (404h41m55.946651868s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515784363 (404h41m55.946864494s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516065171 (404h41m55.947145302s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516354504 (404h41m55.947434635s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:02.639123569 (404h41m57.07020371s) [upload=420953]: Next returned nil segment
Aug 25 14:08:02.639139881 (404h41m57.070220012s) [upload=420953]: Waiting for error group managing segments...
Aug 25 14:08:02.924924749 (404h41m57.35600488s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:02.927107757 (404h41m57.358187888s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.417003466 (404h41m57.848083597s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.419700437 (404h41m57.850780568s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.434733401 (404h41m57.865813532s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.466169262 (404h41m57.897249393s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.479536007 (404h41m57.910616138s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.488794573 (404h41m57.919874694s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.503753836 (404h41m57.934833968s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.520603607 (404h41m57.951683738s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.559036596 (404h41m57.990116727s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599458761 (404h41m58.030538892s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599566808 (404h41m58.030646939s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684072032 (404h41m58.115152163s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684100256 (404h41m58.115180387s) [seg_pos={0 0}, upload=420953]: Segment reached optimal threshold of 14 pieces.
Aug 25 14:08:03.684250324 (404h41m58.115330455s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684386034 (404h41m58.115466165s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rkh9uZUA5jXBVZvvt1jE7GHiEszKvR9PweKEry2AkdwoCiANs): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684409308 (404h41m58.115489439s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oSWAY52TJGVyZk4HTfifZBHQv42QsrAsk1Ks9PH6FoEmAZiN3): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684482858 (404h41m58.115562979s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection
Aug 25 14:08:03.684501635 (404h41m58.115581766s) [seg_pos={0 0}, upload=420953]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 14:08:03.684563573 (404h41m58.115643704s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 14:08:03.684567731 (404h41m58.115647862s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 14:08:04.727468188 (404h41m59.158548319s) [upload=420953]: Done uploading segments...
Aug 25 14:08:04.727486604 (404h41m59.158566735s) [upload=420953]: Upload finished. err: <nil>
Duration: 5.914902235s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X............X.................X......X...................] duration:
2.579262191s
FAIL (2025-08-25 14:15:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.57929348s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X....................................X.........] duration:
6.26517919s
FAIL (2025-08-25 14:15:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 14:08:01.001162783 (404h41m55.432242914s) [upload=420953]: Starting upload
Aug 25 14:08:01.001206165 (404h41m55.432286296s) [upload=420953]: Done starting upload
Aug 25 14:08:01.001379857 (404h41m55.432459988s) [upload=420953]: Uploading segments...
Aug 25 14:08:01.001412711 (404h41m55.432492842s) [upload=420953]: Got next segment. Inline: false
Aug 25 14:08:01.001435715 (404h41m55.432515856s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 14:08:01.001440283 (404h41m55.432520414s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 14:08:01.511647528 (404h41m55.942727699s) [seg_pos={0 0}, upload=420953]: Begin upload segment...
Aug 25 14:08:01.511707473 (404h41m55.942787604s) [seg_pos={0 0}, upload=420953]: Done begin upload segment.
Aug 25 14:08:01.511730126 (404h41m55.942810257s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512100555 (404h41m55.943180686s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512592316 (404h41m55.943672447s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512861461 (404h41m55.943941592s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513099737 (404h41m55.944179868s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513345005 (404h41m55.944425146s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513612748 (404h41m55.944692879s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513863497 (404h41m55.944943629s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514182478 (404h41m55.945262609s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514416426 (404h41m55.945496557s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514625926 (404h41m55.945706058s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514836119 (404h41m55.94591625s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515041772 (404h41m55.946121903s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515315987 (404h41m55.946396128s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515571737 (404h41m55.946651868s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515784363 (404h41m55.946864494s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516065171 (404h41m55.947145302s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516354504 (404h41m55.947434635s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:02.639123569 (404h41m57.07020371s) [upload=420953]: Next returned nil segment
Aug 25 14:08:02.639139881 (404h41m57.070220012s) [upload=420953]: Waiting for error group managing segments...
Aug 25 14:08:02.924924749 (404h41m57.35600488s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:02.927107757 (404h41m57.358187888s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.417003466 (404h41m57.848083597s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.419700437 (404h41m57.850780568s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.434733401 (404h41m57.865813532s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.466169262 (404h41m57.897249393s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.479536007 (404h41m57.910616138s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.488794573 (404h41m57.919874694s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.503753836 (404h41m57.934833968s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.520603607 (404h41m57.951683738s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.559036596 (404h41m57.990116727s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599458761 (404h41m58.030538892s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599566808 (404h41m58.030646939s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684072032 (404h41m58.115152163s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684100256 (404h41m58.115180387s) [seg_pos={0 0}, upload=420953]: Segment reached optimal threshold of 14 pieces.
Aug 25 14:08:03.684250324 (404h41m58.115330455s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684386034 (404h41m58.115466165s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rkh9uZUA5jXBVZvvt1jE7GHiEszKvR9PweKEry2AkdwoCiANs): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684409308 (404h41m58.115489439s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oSWAY52TJGVyZk4HTfifZBHQv42QsrAsk1Ks9PH6FoEmAZiN3): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684482858 (404h41m58.115562979s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection
Aug 25 14:08:03.684501635 (404h41m58.115581766s) [seg_pos={0 0}, upload=420953]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 14:08:03.684563573 (404h41m58.115643704s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 14:08:03.684567731 (404h41m58.115647862s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 14:08:04.727468188 (404h41m59.158548319s) [upload=420953]: Done uploading segments...
Aug 25 14:08:04.727486604 (404h41m59.158566735s) [upload=420953]: Upload finished. err: <nil>
Duration: 6.265208186s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X............X.................X......X..................] duration:
2.046492343s
FAIL (2025-08-25 14:14:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.04651677s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X............X.................X......X.................] duration:
2.023661938s
FAIL (2025-08-25 14:14:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.02368929s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X....................................X........] duration:
6.215645329s
FAIL (2025-08-25 14:14:22 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 14:08:01.001162783 (404h41m55.432242914s) [upload=420953]: Starting upload
Aug 25 14:08:01.001206165 (404h41m55.432286296s) [upload=420953]: Done starting upload
Aug 25 14:08:01.001379857 (404h41m55.432459988s) [upload=420953]: Uploading segments...
Aug 25 14:08:01.001412711 (404h41m55.432492842s) [upload=420953]: Got next segment. Inline: false
Aug 25 14:08:01.001435715 (404h41m55.432515856s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 14:08:01.001440283 (404h41m55.432520414s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 14:08:01.511647528 (404h41m55.942727699s) [seg_pos={0 0}, upload=420953]: Begin upload segment...
Aug 25 14:08:01.511707473 (404h41m55.942787604s) [seg_pos={0 0}, upload=420953]: Done begin upload segment.
Aug 25 14:08:01.511730126 (404h41m55.942810257s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512100555 (404h41m55.943180686s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512592316 (404h41m55.943672447s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512861461 (404h41m55.943941592s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513099737 (404h41m55.944179868s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513345005 (404h41m55.944425146s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513612748 (404h41m55.944692879s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513863497 (404h41m55.944943629s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514182478 (404h41m55.945262609s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514416426 (404h41m55.945496557s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514625926 (404h41m55.945706058s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514836119 (404h41m55.94591625s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515041772 (404h41m55.946121903s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515315987 (404h41m55.946396128s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515571737 (404h41m55.946651868s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515784363 (404h41m55.946864494s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516065171 (404h41m55.947145302s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516354504 (404h41m55.947434635s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:02.639123569 (404h41m57.07020371s) [upload=420953]: Next returned nil segment
Aug 25 14:08:02.639139881 (404h41m57.070220012s) [upload=420953]: Waiting for error group managing segments...
Aug 25 14:08:02.924924749 (404h41m57.35600488s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:02.927107757 (404h41m57.358187888s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.417003466 (404h41m57.848083597s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.419700437 (404h41m57.850780568s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.434733401 (404h41m57.865813532s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.466169262 (404h41m57.897249393s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.479536007 (404h41m57.910616138s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.488794573 (404h41m57.919874694s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.503753836 (404h41m57.934833968s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.520603607 (404h41m57.951683738s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.559036596 (404h41m57.990116727s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599458761 (404h41m58.030538892s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599566808 (404h41m58.030646939s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684072032 (404h41m58.115152163s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684100256 (404h41m58.115180387s) [seg_pos={0 0}, upload=420953]: Segment reached optimal threshold of 14 pieces.
Aug 25 14:08:03.684250324 (404h41m58.115330455s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684386034 (404h41m58.115466165s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rkh9uZUA5jXBVZvvt1jE7GHiEszKvR9PweKEry2AkdwoCiANs): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684409308 (404h41m58.115489439s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oSWAY52TJGVyZk4HTfifZBHQv42QsrAsk1Ks9PH6FoEmAZiN3): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684482858 (404h41m58.115562979s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection
Aug 25 14:08:03.684501635 (404h41m58.115581766s) [seg_pos={0 0}, upload=420953]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 14:08:03.684563573 (404h41m58.115643704s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 14:08:03.684567731 (404h41m58.115647862s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 14:08:04.727468188 (404h41m59.158548319s) [upload=420953]: Done uploading segments...
Aug 25 14:08:04.727486604 (404h41m59.158566735s) [upload=420953]: Upload finished. err: <nil>
Duration: 6.215684194s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X....................................X.......] duration:
5.784276566s
FAIL (2025-08-25 14:14:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 14:08:01.001162783 (404h41m55.432242914s) [upload=420953]: Starting upload
Aug 25 14:08:01.001206165 (404h41m55.432286296s) [upload=420953]: Done starting upload
Aug 25 14:08:01.001379857 (404h41m55.432459988s) [upload=420953]: Uploading segments...
Aug 25 14:08:01.001412711 (404h41m55.432492842s) [upload=420953]: Got next segment. Inline: false
Aug 25 14:08:01.001435715 (404h41m55.432515856s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 14:08:01.001440283 (404h41m55.432520414s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 14:08:01.511647528 (404h41m55.942727699s) [seg_pos={0 0}, upload=420953]: Begin upload segment...
Aug 25 14:08:01.511707473 (404h41m55.942787604s) [seg_pos={0 0}, upload=420953]: Done begin upload segment.
Aug 25 14:08:01.511730126 (404h41m55.942810257s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512100555 (404h41m55.943180686s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512592316 (404h41m55.943672447s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512861461 (404h41m55.943941592s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513099737 (404h41m55.944179868s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513345005 (404h41m55.944425146s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513612748 (404h41m55.944692879s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513863497 (404h41m55.944943629s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514182478 (404h41m55.945262609s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514416426 (404h41m55.945496557s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514625926 (404h41m55.945706058s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514836119 (404h41m55.94591625s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515041772 (404h41m55.946121903s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515315987 (404h41m55.946396128s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515571737 (404h41m55.946651868s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515784363 (404h41m55.946864494s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516065171 (404h41m55.947145302s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516354504 (404h41m55.947434635s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:02.639123569 (404h41m57.07020371s) [upload=420953]: Next returned nil segment
Aug 25 14:08:02.639139881 (404h41m57.070220012s) [upload=420953]: Waiting for error group managing segments...
Aug 25 14:08:02.924924749 (404h41m57.35600488s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:02.927107757 (404h41m57.358187888s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.417003466 (404h41m57.848083597s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.419700437 (404h41m57.850780568s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.434733401 (404h41m57.865813532s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.466169262 (404h41m57.897249393s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.479536007 (404h41m57.910616138s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.488794573 (404h41m57.919874694s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.503753836 (404h41m57.934833968s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.520603607 (404h41m57.951683738s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.559036596 (404h41m57.990116727s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599458761 (404h41m58.030538892s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599566808 (404h41m58.030646939s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684072032 (404h41m58.115152163s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684100256 (404h41m58.115180387s) [seg_pos={0 0}, upload=420953]: Segment reached optimal threshold of 14 pieces.
Aug 25 14:08:03.684250324 (404h41m58.115330455s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684386034 (404h41m58.115466165s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rkh9uZUA5jXBVZvvt1jE7GHiEszKvR9PweKEry2AkdwoCiANs): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684409308 (404h41m58.115489439s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oSWAY52TJGVyZk4HTfifZBHQv42QsrAsk1Ks9PH6FoEmAZiN3): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684482858 (404h41m58.115562979s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection
Aug 25 14:08:03.684501635 (404h41m58.115581766s) [seg_pos={0 0}, upload=420953]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 14:08:03.684563573 (404h41m58.115643704s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 14:08:03.684567731 (404h41m58.115647862s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 14:08:04.727468188 (404h41m59.158548319s) [upload=420953]: Done uploading segments...
Aug 25 14:08:04.727486604 (404h41m59.158566735s) [upload=420953]: Upload finished. err: <nil>
Duration: 5.784300421s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X....................................X......] duration:
5.936275066s
FAIL (2025-08-25 14:13:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 14:08:01.001162783 (404h41m55.432242914s) [upload=420953]: Starting upload
Aug 25 14:08:01.001206165 (404h41m55.432286296s) [upload=420953]: Done starting upload
Aug 25 14:08:01.001379857 (404h41m55.432459988s) [upload=420953]: Uploading segments...
Aug 25 14:08:01.001412711 (404h41m55.432492842s) [upload=420953]: Got next segment. Inline: false
Aug 25 14:08:01.001435715 (404h41m55.432515856s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 14:08:01.001440283 (404h41m55.432520414s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 14:08:01.511647528 (404h41m55.942727699s) [seg_pos={0 0}, upload=420953]: Begin upload segment...
Aug 25 14:08:01.511707473 (404h41m55.942787604s) [seg_pos={0 0}, upload=420953]: Done begin upload segment.
Aug 25 14:08:01.511730126 (404h41m55.942810257s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512100555 (404h41m55.943180686s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512592316 (404h41m55.943672447s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512861461 (404h41m55.943941592s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513099737 (404h41m55.944179868s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513345005 (404h41m55.944425146s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513612748 (404h41m55.944692879s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513863497 (404h41m55.944943629s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514182478 (404h41m55.945262609s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514416426 (404h41m55.945496557s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514625926 (404h41m55.945706058s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514836119 (404h41m55.94591625s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515041772 (404h41m55.946121903s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515315987 (404h41m55.946396128s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515571737 (404h41m55.946651868s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515784363 (404h41m55.946864494s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516065171 (404h41m55.947145302s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516354504 (404h41m55.947434635s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:02.639123569 (404h41m57.07020371s) [upload=420953]: Next returned nil segment
Aug 25 14:08:02.639139881 (404h41m57.070220012s) [upload=420953]: Waiting for error group managing segments...
Aug 25 14:08:02.924924749 (404h41m57.35600488s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:02.927107757 (404h41m57.358187888s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.417003466 (404h41m57.848083597s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.419700437 (404h41m57.850780568s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.434733401 (404h41m57.865813532s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.466169262 (404h41m57.897249393s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.479536007 (404h41m57.910616138s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.488794573 (404h41m57.919874694s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.503753836 (404h41m57.934833968s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.520603607 (404h41m57.951683738s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.559036596 (404h41m57.990116727s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599458761 (404h41m58.030538892s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599566808 (404h41m58.030646939s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684072032 (404h41m58.115152163s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684100256 (404h41m58.115180387s) [seg_pos={0 0}, upload=420953]: Segment reached optimal threshold of 14 pieces.
Aug 25 14:08:03.684250324 (404h41m58.115330455s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684386034 (404h41m58.115466165s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rkh9uZUA5jXBVZvvt1jE7GHiEszKvR9PweKEry2AkdwoCiANs): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684409308 (404h41m58.115489439s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oSWAY52TJGVyZk4HTfifZBHQv42QsrAsk1Ks9PH6FoEmAZiN3): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684482858 (404h41m58.115562979s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection
Aug 25 14:08:03.684501635 (404h41m58.115581766s) [seg_pos={0 0}, upload=420953]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 14:08:03.684563573 (404h41m58.115643704s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 14:08:03.684567731 (404h41m58.115647862s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 14:08:04.727468188 (404h41m59.158548319s) [upload=420953]: Done uploading segments...
Aug 25 14:08:04.727486604 (404h41m59.158566735s) [upload=420953]: Upload finished. err: <nil>
Duration: 5.936299382s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X............X.................X......X................] duration:
1.976033939s
FAIL (2025-08-25 14:13:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.976074686s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X............X.................X......X...............] duration:
1.983816008s
FAIL (2025-08-25 14:12:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.983842198s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X....................................X.....] duration:
5.926869197s
FAIL (2025-08-25 14:12:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 14:08:01.001162783 (404h41m55.432242914s) [upload=420953]: Starting upload
Aug 25 14:08:01.001206165 (404h41m55.432286296s) [upload=420953]: Done starting upload
Aug 25 14:08:01.001379857 (404h41m55.432459988s) [upload=420953]: Uploading segments...
Aug 25 14:08:01.001412711 (404h41m55.432492842s) [upload=420953]: Got next segment. Inline: false
Aug 25 14:08:01.001435715 (404h41m55.432515856s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 14:08:01.001440283 (404h41m55.432520414s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 14:08:01.511647528 (404h41m55.942727699s) [seg_pos={0 0}, upload=420953]: Begin upload segment...
Aug 25 14:08:01.511707473 (404h41m55.942787604s) [seg_pos={0 0}, upload=420953]: Done begin upload segment.
Aug 25 14:08:01.511730126 (404h41m55.942810257s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512100555 (404h41m55.943180686s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512592316 (404h41m55.943672447s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512861461 (404h41m55.943941592s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513099737 (404h41m55.944179868s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513345005 (404h41m55.944425146s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513612748 (404h41m55.944692879s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513863497 (404h41m55.944943629s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514182478 (404h41m55.945262609s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514416426 (404h41m55.945496557s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514625926 (404h41m55.945706058s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514836119 (404h41m55.94591625s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515041772 (404h41m55.946121903s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515315987 (404h41m55.946396128s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515571737 (404h41m55.946651868s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515784363 (404h41m55.946864494s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516065171 (404h41m55.947145302s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516354504 (404h41m55.947434635s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:02.639123569 (404h41m57.07020371s) [upload=420953]: Next returned nil segment
Aug 25 14:08:02.639139881 (404h41m57.070220012s) [upload=420953]: Waiting for error group managing segments...
Aug 25 14:08:02.924924749 (404h41m57.35600488s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:02.927107757 (404h41m57.358187888s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.417003466 (404h41m57.848083597s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.419700437 (404h41m57.850780568s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.434733401 (404h41m57.865813532s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.466169262 (404h41m57.897249393s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.479536007 (404h41m57.910616138s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.488794573 (404h41m57.919874694s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.503753836 (404h41m57.934833968s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.520603607 (404h41m57.951683738s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.559036596 (404h41m57.990116727s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599458761 (404h41m58.030538892s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599566808 (404h41m58.030646939s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684072032 (404h41m58.115152163s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684100256 (404h41m58.115180387s) [seg_pos={0 0}, upload=420953]: Segment reached optimal threshold of 14 pieces.
Aug 25 14:08:03.684250324 (404h41m58.115330455s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684386034 (404h41m58.115466165s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rkh9uZUA5jXBVZvvt1jE7GHiEszKvR9PweKEry2AkdwoCiANs): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684409308 (404h41m58.115489439s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oSWAY52TJGVyZk4HTfifZBHQv42QsrAsk1Ks9PH6FoEmAZiN3): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684482858 (404h41m58.115562979s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection
Aug 25 14:08:03.684501635 (404h41m58.115581766s) [seg_pos={0 0}, upload=420953]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 14:08:03.684563573 (404h41m58.115643704s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 14:08:03.684567731 (404h41m58.115647862s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 14:08:04.727468188 (404h41m59.158548319s) [upload=420953]: Done uploading segments...
Aug 25 14:08:04.727486604 (404h41m59.158566735s) [upload=420953]: Upload finished. err: <nil>
Duration: 5.926893121s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X......X............X.................X......X..............] duration:
1.98787705s
FAIL (2025-08-25 14:12:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.987900796s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X....................................X....] duration:
7.590185258s
FAIL (2025-08-25 14:11:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 14:08:01.001162783 (404h41m55.432242914s) [upload=420953]: Starting upload
Aug 25 14:08:01.001206165 (404h41m55.432286296s) [upload=420953]: Done starting upload
Aug 25 14:08:01.001379857 (404h41m55.432459988s) [upload=420953]: Uploading segments...
Aug 25 14:08:01.001412711 (404h41m55.432492842s) [upload=420953]: Got next segment. Inline: false
Aug 25 14:08:01.001435715 (404h41m55.432515856s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 14:08:01.001440283 (404h41m55.432520414s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 14:08:01.511647528 (404h41m55.942727699s) [seg_pos={0 0}, upload=420953]: Begin upload segment...
Aug 25 14:08:01.511707473 (404h41m55.942787604s) [seg_pos={0 0}, upload=420953]: Done begin upload segment.
Aug 25 14:08:01.511730126 (404h41m55.942810257s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512100555 (404h41m55.943180686s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512592316 (404h41m55.943672447s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512861461 (404h41m55.943941592s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513099737 (404h41m55.944179868s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513345005 (404h41m55.944425146s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513612748 (404h41m55.944692879s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513863497 (404h41m55.944943629s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514182478 (404h41m55.945262609s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514416426 (404h41m55.945496557s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514625926 (404h41m55.945706058s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514836119 (404h41m55.94591625s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515041772 (404h41m55.946121903s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515315987 (404h41m55.946396128s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515571737 (404h41m55.946651868s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515784363 (404h41m55.946864494s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516065171 (404h41m55.947145302s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516354504 (404h41m55.947434635s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:02.639123569 (404h41m57.07020371s) [upload=420953]: Next returned nil segment
Aug 25 14:08:02.639139881 (404h41m57.070220012s) [upload=420953]: Waiting for error group managing segments...
Aug 25 14:08:02.924924749 (404h41m57.35600488s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:02.927107757 (404h41m57.358187888s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.417003466 (404h41m57.848083597s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.419700437 (404h41m57.850780568s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.434733401 (404h41m57.865813532s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.466169262 (404h41m57.897249393s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.479536007 (404h41m57.910616138s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.488794573 (404h41m57.919874694s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.503753836 (404h41m57.934833968s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.520603607 (404h41m57.951683738s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.559036596 (404h41m57.990116727s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599458761 (404h41m58.030538892s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599566808 (404h41m58.030646939s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684072032 (404h41m58.115152163s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684100256 (404h41m58.115180387s) [seg_pos={0 0}, upload=420953]: Segment reached optimal threshold of 14 pieces.
Aug 25 14:08:03.684250324 (404h41m58.115330455s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684386034 (404h41m58.115466165s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rkh9uZUA5jXBVZvvt1jE7GHiEszKvR9PweKEry2AkdwoCiANs): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684409308 (404h41m58.115489439s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oSWAY52TJGVyZk4HTfifZBHQv42QsrAsk1Ks9PH6FoEmAZiN3): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684482858 (404h41m58.115562979s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection
Aug 25 14:08:03.684501635 (404h41m58.115581766s) [seg_pos={0 0}, upload=420953]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 14:08:03.684563573 (404h41m58.115643704s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 14:08:03.684567731 (404h41m58.115647862s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 14:08:04.727468188 (404h41m59.158548319s) [upload=420953]: Done uploading segments...
Aug 25 14:08:04.727486604 (404h41m59.158566735s) [upload=420953]: Upload finished. err: <nil>
Duration: 7.590210576s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X......X............X.................X......X.............] duration:
1.947064738s
FAIL (2025-08-25 14:11:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.94708774s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [X.X......X............X.................X......X............] duration:
1.982516852s
FAIL (2025-08-25 14:11:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.982551119s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X....................................X...] duration:
6.069807597s
FAIL (2025-08-25 14:10:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 14:08:01.001162783 (404h41m55.432242914s) [upload=420953]: Starting upload
Aug 25 14:08:01.001206165 (404h41m55.432286296s) [upload=420953]: Done starting upload
Aug 25 14:08:01.001379857 (404h41m55.432459988s) [upload=420953]: Uploading segments...
Aug 25 14:08:01.001412711 (404h41m55.432492842s) [upload=420953]: Got next segment. Inline: false
Aug 25 14:08:01.001435715 (404h41m55.432515856s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 14:08:01.001440283 (404h41m55.432520414s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 14:08:01.511647528 (404h41m55.942727699s) [seg_pos={0 0}, upload=420953]: Begin upload segment...
Aug 25 14:08:01.511707473 (404h41m55.942787604s) [seg_pos={0 0}, upload=420953]: Done begin upload segment.
Aug 25 14:08:01.511730126 (404h41m55.942810257s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512100555 (404h41m55.943180686s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512592316 (404h41m55.943672447s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512861461 (404h41m55.943941592s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513099737 (404h41m55.944179868s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513345005 (404h41m55.944425146s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513612748 (404h41m55.944692879s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513863497 (404h41m55.944943629s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514182478 (404h41m55.945262609s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514416426 (404h41m55.945496557s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514625926 (404h41m55.945706058s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514836119 (404h41m55.94591625s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515041772 (404h41m55.946121903s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515315987 (404h41m55.946396128s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515571737 (404h41m55.946651868s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515784363 (404h41m55.946864494s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516065171 (404h41m55.947145302s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516354504 (404h41m55.947434635s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:02.639123569 (404h41m57.07020371s) [upload=420953]: Next returned nil segment
Aug 25 14:08:02.639139881 (404h41m57.070220012s) [upload=420953]: Waiting for error group managing segments...
Aug 25 14:08:02.924924749 (404h41m57.35600488s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:02.927107757 (404h41m57.358187888s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.417003466 (404h41m57.848083597s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.419700437 (404h41m57.850780568s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.434733401 (404h41m57.865813532s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.466169262 (404h41m57.897249393s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.479536007 (404h41m57.910616138s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.488794573 (404h41m57.919874694s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.503753836 (404h41m57.934833968s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.520603607 (404h41m57.951683738s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.559036596 (404h41m57.990116727s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599458761 (404h41m58.030538892s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599566808 (404h41m58.030646939s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684072032 (404h41m58.115152163s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684100256 (404h41m58.115180387s) [seg_pos={0 0}, upload=420953]: Segment reached optimal threshold of 14 pieces.
Aug 25 14:08:03.684250324 (404h41m58.115330455s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684386034 (404h41m58.115466165s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rkh9uZUA5jXBVZvvt1jE7GHiEszKvR9PweKEry2AkdwoCiANs): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684409308 (404h41m58.115489439s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oSWAY52TJGVyZk4HTfifZBHQv42QsrAsk1Ks9PH6FoEmAZiN3): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684482858 (404h41m58.115562979s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection
Aug 25 14:08:03.684501635 (404h41m58.115581766s) [seg_pos={0 0}, upload=420953]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 14:08:03.684563573 (404h41m58.115643704s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 14:08:03.684567731 (404h41m58.115647862s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 14:08:04.727468188 (404h41m59.158548319s) [upload=420953]: Done uploading segments...
Aug 25 14:08:04.727486604 (404h41m59.158566735s) [upload=420953]: Upload finished. err: <nil>
Duration: 6.06989348s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.X.X......X............X.................X......X...........] duration:
2.193400605s
FAIL (2025-08-25 14:09:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.193426934s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X....................................X..] duration:
6.12154471s
FAIL (2025-08-25 14:09:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 14:08:01.001162783 (404h41m55.432242914s) [upload=420953]: Starting upload
Aug 25 14:08:01.001206165 (404h41m55.432286296s) [upload=420953]: Done starting upload
Aug 25 14:08:01.001379857 (404h41m55.432459988s) [upload=420953]: Uploading segments...
Aug 25 14:08:01.001412711 (404h41m55.432492842s) [upload=420953]: Got next segment. Inline: false
Aug 25 14:08:01.001435715 (404h41m55.432515856s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 14:08:01.001440283 (404h41m55.432520414s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 14:08:01.511647528 (404h41m55.942727699s) [seg_pos={0 0}, upload=420953]: Begin upload segment...
Aug 25 14:08:01.511707473 (404h41m55.942787604s) [seg_pos={0 0}, upload=420953]: Done begin upload segment.
Aug 25 14:08:01.511730126 (404h41m55.942810257s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512100555 (404h41m55.943180686s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512592316 (404h41m55.943672447s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512861461 (404h41m55.943941592s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513099737 (404h41m55.944179868s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513345005 (404h41m55.944425146s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513612748 (404h41m55.944692879s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513863497 (404h41m55.944943629s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514182478 (404h41m55.945262609s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514416426 (404h41m55.945496557s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514625926 (404h41m55.945706058s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514836119 (404h41m55.94591625s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515041772 (404h41m55.946121903s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515315987 (404h41m55.946396128s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515571737 (404h41m55.946651868s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515784363 (404h41m55.946864494s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516065171 (404h41m55.947145302s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516354504 (404h41m55.947434635s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:02.639123569 (404h41m57.07020371s) [upload=420953]: Next returned nil segment
Aug 25 14:08:02.639139881 (404h41m57.070220012s) [upload=420953]: Waiting for error group managing segments...
Aug 25 14:08:02.924924749 (404h41m57.35600488s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:02.927107757 (404h41m57.358187888s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.417003466 (404h41m57.848083597s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.419700437 (404h41m57.850780568s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.434733401 (404h41m57.865813532s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.466169262 (404h41m57.897249393s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.479536007 (404h41m57.910616138s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.488794573 (404h41m57.919874694s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.503753836 (404h41m57.934833968s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.520603607 (404h41m57.951683738s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.559036596 (404h41m57.990116727s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599458761 (404h41m58.030538892s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599566808 (404h41m58.030646939s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684072032 (404h41m58.115152163s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684100256 (404h41m58.115180387s) [seg_pos={0 0}, upload=420953]: Segment reached optimal threshold of 14 pieces.
Aug 25 14:08:03.684250324 (404h41m58.115330455s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684386034 (404h41m58.115466165s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rkh9uZUA5jXBVZvvt1jE7GHiEszKvR9PweKEry2AkdwoCiANs): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684409308 (404h41m58.115489439s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oSWAY52TJGVyZk4HTfifZBHQv42QsrAsk1Ks9PH6FoEmAZiN3): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684482858 (404h41m58.115562979s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection
Aug 25 14:08:03.684501635 (404h41m58.115581766s) [seg_pos={0 0}, upload=420953]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 14:08:03.684563573 (404h41m58.115643704s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 14:08:03.684567731 (404h41m58.115647862s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 14:08:04.727468188 (404h41m59.158548319s) [upload=420953]: Done uploading segments...
Aug 25 14:08:04.727486604 (404h41m59.158566735s) [upload=420953]: Upload finished. err: <nil>
Duration: 6.121572664s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X....................................X.] duration:
11.162796964s
FAIL (2025-08-25 14:09:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 14:08:01.001162783 (404h41m55.432242914s) [upload=420953]: Starting upload
Aug 25 14:08:01.001206165 (404h41m55.432286296s) [upload=420953]: Done starting upload
Aug 25 14:08:01.001379857 (404h41m55.432459988s) [upload=420953]: Uploading segments...
Aug 25 14:08:01.001412711 (404h41m55.432492842s) [upload=420953]: Got next segment. Inline: false
Aug 25 14:08:01.001435715 (404h41m55.432515856s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 14:08:01.001440283 (404h41m55.432520414s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 14:08:01.511647528 (404h41m55.942727699s) [seg_pos={0 0}, upload=420953]: Begin upload segment...
Aug 25 14:08:01.511707473 (404h41m55.942787604s) [seg_pos={0 0}, upload=420953]: Done begin upload segment.
Aug 25 14:08:01.511730126 (404h41m55.942810257s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512100555 (404h41m55.943180686s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512592316 (404h41m55.943672447s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.512861461 (404h41m55.943941592s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513099737 (404h41m55.944179868s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513345005 (404h41m55.944425146s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513612748 (404h41m55.944692879s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.513863497 (404h41m55.944943629s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514182478 (404h41m55.945262609s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514416426 (404h41m55.945496557s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514625926 (404h41m55.945706058s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.514836119 (404h41m55.94591625s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515041772 (404h41m55.946121903s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515315987 (404h41m55.946396128s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515571737 (404h41m55.946651868s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.515784363 (404h41m55.946864494s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516065171 (404h41m55.947145302s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:01.516354504 (404h41m55.947434635s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Uploading piece...
Aug 25 14:08:02.639123569 (404h41m57.07020371s) [upload=420953]: Next returned nil segment
Aug 25 14:08:02.639139881 (404h41m57.070220012s) [upload=420953]: Waiting for error group managing segments...
Aug 25 14:08:02.924924749 (404h41m57.35600488s) [noise=true , address=79.127.205.246:4260 , piece_id=R67TQH27NZMTR7HHMH7HV44MXN3UKE64SZJOZ2VPXN36T67KILWQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:02.927107757 (404h41m57.358187888s) [noise=true , address=79.127.205.233:4629 , piece_id=LZYH3AO5FHZ2OZM2G55GAHALJ2KFGLTHQ5QODMTZ2XL4LFYB6OLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.417003466 (404h41m57.848083597s) [noise=true , address=79.127.219.47:4069 , piece_id=72TEOFTEDIY2LKVLE5QTKGDWZKANZ7QF5KKDGMM34225UVKULTKA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.419700437 (404h41m57.850780568s) [noise=true , address=79.127.219.48:4108 , piece_id=YV3JO6PW2FTCN2V3Y2MECKKG24SEBP2OXEMZKDFHSQB3RZM44N2Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.434733401 (404h41m57.865813532s) [noise=true , address=77.90.31.19:4850 , piece_id=TEQNOOKJ37OMH3SYBGU3CKZFZK6M4AUOGPTGYSLINNB2KF5SAJRA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.466169262 (404h41m57.897249393s) [noise=true , address=104.36.82.43:4834 , piece_id=FQAG7IRE2ZP4EIPMEZJMLGW3MXBWBFHAAHYWUPCICZ3L5BRSXYQQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.479536007 (404h41m57.910616138s) [noise=true , address=79.127.201.215:4348 , piece_id=7KC3QQW6VMQBTFACC7UZMAFJNGAO2MW6COYSHGC2Z7DT36CEXA3Q, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.488794573 (404h41m57.919874694s) [noise=true , address=104.36.82.5:4858 , piece_id=5XF32TB3ICTRRT6GQ6TEC3W2FVC7QU2TRRCFEKKNQW6H63H3QXHQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.503753836 (404h41m57.934833968s) [noise=true , address=77.90.31.21:4887 , piece_id=NXTPWISQ64GN4JIFUUK2GZTFTNK6WLGPAQWDIWNPVKYJ6VD34UDA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.520603607 (404h41m57.951683738s) [noise=true , address=104.36.82.53:4148 , piece_id=INEC5JD6RM533WNNJIKRIFLAACVBMZYTL3RQBRSUVQC7ZNBQM4XA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.559036596 (404h41m57.990116727s) [noise=true , address=104.36.82.13:4205 , piece_id=3VHFABGUEF37NGBT2RKXNLUEBHVIM447W3WC6T4HJ4JUP7DCFVBQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599458761 (404h41m58.030538892s) [noise=true , address=104.36.82.60:4362 , piece_id=XVZDEG4LPWGLR44R5VSTKQS3UNZRZBETJ5M22YEMOXQFXMMKR4HA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.599566808 (404h41m58.030646939s) [noise=true , address=104.36.82.44:4874 , piece_id=2Z73XTN5YHPGHGKA2YDG4SOT3ZCP3WYDW7XX4G3Y5O7ODGEHNQKQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684072032 (404h41m58.115152163s) [noise=true , address=77.90.31.10:4542 , piece_id=UHOOA55UJDLX6JISAPYBEHGZLUBN7PVHLUNFRBQ344YQHSSGA7WQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: <nil>
Aug 25 14:08:03.684100256 (404h41m58.115180387s) [seg_pos={0 0}, upload=420953]: Segment reached optimal threshold of 14 pieces.
Aug 25 14:08:03.684250324 (404h41m58.115330455s) [noise=true , address=104.36.82.23:4454 , piece_id=SCCBMYU33MRG35VYDYUKDQCAL6GD47VABXOFIN7G4Y5XEIEWVKUQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684386034 (404h41m58.115466165s) [noise=true , address=104.36.82.11:4148 , piece_id=MSKOLMXW72E35PJQZDVCKIMS2SPOIIFUDHBHDX6NYAJIYX25FFUA, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rkh9uZUA5jXBVZvvt1jE7GHiEszKvR9PweKEry2AkdwoCiANs): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684409308 (404h41m58.115489439s) [noise=true , address=77.90.31.12:4621 , piece_id=NKM5VXV4ADDWBHWEPQTHKDSKYHHPSGL6YBCU54AVHIOQCN5DAGLQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oSWAY52TJGVyZk4HTfifZBHQv42QsrAsk1Ks9PH6FoEmAZiN3): protocol: expected piece hash; context canceled; EOF
Aug 25 14:08:03.684482858 (404h41m58.115562979s) [noise=true , address=104.36.82.49:4984 , piece_id=EOJJLVICDB3DEMKUX2NLBOMVW4BNR2DRML6Z5CBVUSPE3HT7UTPQ, seg_pos={0 0}, upload=420953]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42658->104.36.82.49:4984: use of closed network connection
Aug 25 14:08:03.684501635 (404h41m58.115581766s) [seg_pos={0 0}, upload=420953]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 14:08:03.684563573 (404h41m58.115643704s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 14:08:03.684567731 (404h41m58.115647862s) [upload=420953]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 14:08:04.727468188 (404h41m59.158548319s) [upload=420953]: Done uploading segments...
Aug 25 14:08:04.727486604 (404h41m59.158566735s) [upload=420953]: Upload finished. err: <nil>
Duration: 11.162822965s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..X.X......X............X.................X......X..........] duration:
2.032810467s
FAIL (2025-08-25 14:08:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 13:59:57.341095974 (404h33m51.772176105s) [upload=420806]: Starting upload Aug 25 13:59:57.341140739 (404h33m51.77222086s) [upload=420806]: Done starting upload Aug 25 13:59:57.341210172 (404h33m51.772290304s) [upload=420806]: Uploading segments... Aug 25 13:59:57.341275437 (404h33m51.772355568s) [upload=420806]: Got next segment. Inline: true Aug 25 13:59:57.341279394 (404h33m51.772359515s) [upload=420806]: Waiting for error group managing segments... Aug 25 13:59:57.341311836 (404h33m51.772391967s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 13:59:57.341317438 (404h33m51.772397559s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 13:59:57.341320003 (404h33m51.772400134s) [upload=420806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 13:59:57.579300370 (404h33m52.010380501s) [upload=420806]: Done uploading segments... Aug 25 13:59:57.579316260 (404h33m52.010396391s) [upload=420806]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.032830916s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|