Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X..........X.......................X....X.................] duration:
5.927030979s
FAIL (2025-08-17 18:32:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:19:10.723847290 (216h53m5.154927421s) [upload=225573]: Starting upload Aug 17 18:19:10.723902265 (216h53m5.154982396s) [upload=225573]: Done starting upload Aug 17 18:19:10.724015221 (216h53m5.155095362s) [upload=225573]: Uploading segments... Aug 17 18:19:10.724089813 (216h53m5.155169944s) [upload=225573]: Got next segment. Inline: false Aug 17 18:19:10.724130932 (216h53m5.155211063s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:19:10.724135791 (216h53m5.155215912s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:19:10.941486639 (216h53m5.37256676s) [upload=225573]: Next segment err: metaclient: Too Many Requests Aug 17 18:19:10.941507588 (216h53m5.372587719s) [upload=225573]: Done uploading segments... Aug 17 18:19:10.941522778 (216h53m5.372602909s) [upload=225573]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.927058841s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.......X...........XX......X.X...........X..............X...] duration:
1.928955472s
FAIL (2025-08-17 18:32:27 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 18:30:49.728292735 (217h4m44.159372866s) [upload=225770]: Starting upload Aug 17 18:30:49.728336950 (217h4m44.159417081s) [upload=225770]: Done starting upload Aug 17 18:30:49.728382898 (217h4m44.159463029s) [upload=225770]: Uploading segments... Aug 17 18:30:49.728414819 (217h4m44.15949494s) [upload=225770]: Got next segment. Inline: true Aug 17 18:30:49.728418816 (217h4m44.159498948s) [upload=225770]: Waiting for error group managing segments... Aug 17 18:30:49.728525451 (217h4m44.159605592s) [upload=225770]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:30:49.728532474 (217h4m44.159612665s) [upload=225770]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:30:49.728536922 (217h4m44.159617083s) [upload=225770]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:30:50.062537686 (217h4m44.493617827s) [upload=225770]: Done uploading segments... Aug 17 18:30:50.062563304 (217h4m44.493643485s) [upload=225770]: Upload finished. err: <nil>
Duration: 1.928982141s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X..........X.......................X....X................] duration:
5.774401412s
FAIL (2025-08-17 18:31:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:19:10.723847290 (216h53m5.154927421s) [upload=225573]: Starting upload Aug 17 18:19:10.723902265 (216h53m5.154982396s) [upload=225573]: Done starting upload Aug 17 18:19:10.724015221 (216h53m5.155095362s) [upload=225573]: Uploading segments... Aug 17 18:19:10.724089813 (216h53m5.155169944s) [upload=225573]: Got next segment. Inline: false Aug 17 18:19:10.724130932 (216h53m5.155211063s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:19:10.724135791 (216h53m5.155215912s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:19:10.941486639 (216h53m5.37256676s) [upload=225573]: Next segment err: metaclient: Too Many Requests Aug 17 18:19:10.941507588 (216h53m5.372587719s) [upload=225573]: Done uploading segments... Aug 17 18:19:10.941522778 (216h53m5.372602909s) [upload=225573]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.774431519s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [........X...........XX......X.X...........X..............X..] duration:
2.019134651s
FAIL (2025-08-17 18:31:47 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 18:30:49.728292735 (217h4m44.159372866s) [upload=225770]: Starting upload Aug 17 18:30:49.728336950 (217h4m44.159417081s) [upload=225770]: Done starting upload Aug 17 18:30:49.728382898 (217h4m44.159463029s) [upload=225770]: Uploading segments... Aug 17 18:30:49.728414819 (217h4m44.15949494s) [upload=225770]: Got next segment. Inline: true Aug 17 18:30:49.728418816 (217h4m44.159498948s) [upload=225770]: Waiting for error group managing segments... Aug 17 18:30:49.728525451 (217h4m44.159605592s) [upload=225770]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:30:49.728532474 (217h4m44.159612665s) [upload=225770]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:30:49.728536922 (217h4m44.159617083s) [upload=225770]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:30:50.062537686 (217h4m44.493617827s) [upload=225770]: Done uploading segments... Aug 17 18:30:50.062563304 (217h4m44.493643485s) [upload=225770]: Upload finished. err: <nil>
Duration: 2.01917072s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X..........X.......................X....X...............] duration:
5.918842164s
FAIL (2025-08-17 18:31:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:19:10.723847290 (216h53m5.154927421s) [upload=225573]: Starting upload Aug 17 18:19:10.723902265 (216h53m5.154982396s) [upload=225573]: Done starting upload Aug 17 18:19:10.724015221 (216h53m5.155095362s) [upload=225573]: Uploading segments... Aug 17 18:19:10.724089813 (216h53m5.155169944s) [upload=225573]: Got next segment. Inline: false Aug 17 18:19:10.724130932 (216h53m5.155211063s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:19:10.724135791 (216h53m5.155215912s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:19:10.941486639 (216h53m5.37256676s) [upload=225573]: Next segment err: metaclient: Too Many Requests Aug 17 18:19:10.941507588 (216h53m5.372587719s) [upload=225573]: Done uploading segments... Aug 17 18:19:10.941522778 (216h53m5.372602909s) [upload=225573]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.918870798s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.........X...........XX......X.X...........X..............X.] duration:
1.883992341s
FAIL (2025-08-17 18:31:10 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 18:30:49.728292735 (217h4m44.159372866s) [upload=225770]: Starting upload Aug 17 18:30:49.728336950 (217h4m44.159417081s) [upload=225770]: Done starting upload Aug 17 18:30:49.728382898 (217h4m44.159463029s) [upload=225770]: Uploading segments... Aug 17 18:30:49.728414819 (217h4m44.15949494s) [upload=225770]: Got next segment. Inline: true Aug 17 18:30:49.728418816 (217h4m44.159498948s) [upload=225770]: Waiting for error group managing segments... Aug 17 18:30:49.728525451 (217h4m44.159605592s) [upload=225770]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:30:49.728532474 (217h4m44.159612665s) [upload=225770]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:30:49.728536922 (217h4m44.159617083s) [upload=225770]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:30:50.062537686 (217h4m44.493617827s) [upload=225770]: Done uploading segments... Aug 17 18:30:50.062563304 (217h4m44.493643485s) [upload=225770]: Upload finished. err: <nil>
Duration: 1.884021266s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [..........X...........XX......X.X...........X..............X] duration:
1.442040114s
FAIL (2025-08-17 18:30:50 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 18:30:49.728292735 (217h4m44.159372866s) [upload=225770]: Starting upload Aug 17 18:30:49.728336950 (217h4m44.159417081s) [upload=225770]: Done starting upload Aug 17 18:30:49.728382898 (217h4m44.159463029s) [upload=225770]: Uploading segments... Aug 17 18:30:49.728414819 (217h4m44.15949494s) [upload=225770]: Got next segment. Inline: true Aug 17 18:30:49.728418816 (217h4m44.159498948s) [upload=225770]: Waiting for error group managing segments... Aug 17 18:30:49.728525451 (217h4m44.159605592s) [upload=225770]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:30:49.728532474 (217h4m44.159612665s) [upload=225770]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:30:49.728536922 (217h4m44.159617083s) [upload=225770]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:30:50.062537686 (217h4m44.493617827s) [upload=225770]: Done uploading segments... Aug 17 18:30:50.062563304 (217h4m44.493643485s) [upload=225770]: Upload finished. err: <nil>
Duration: 1.442064901s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X..........X.......................X....X..............] duration:
6.260600046s
FAIL (2025-08-17 18:30:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:19:10.723847290 (216h53m5.154927421s) [upload=225573]: Starting upload Aug 17 18:19:10.723902265 (216h53m5.154982396s) [upload=225573]: Done starting upload Aug 17 18:19:10.724015221 (216h53m5.155095362s) [upload=225573]: Uploading segments... Aug 17 18:19:10.724089813 (216h53m5.155169944s) [upload=225573]: Got next segment. Inline: false Aug 17 18:19:10.724130932 (216h53m5.155211063s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:19:10.724135791 (216h53m5.155215912s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:19:10.941486639 (216h53m5.37256676s) [upload=225573]: Next segment err: metaclient: Too Many Requests Aug 17 18:19:10.941507588 (216h53m5.372587719s) [upload=225573]: Done uploading segments... Aug 17 18:19:10.941522778 (216h53m5.372602909s) [upload=225573]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.260625353s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...........X...........XX......X.X...........X..............] duration:
1.946547802s
FAIL (2025-08-17 18:30:34 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:19:11.545926657 (216h53m5.977006788s) [upload=225574]: Starting upload
Aug 17 18:19:11.546002462 (216h53m5.977082594s) [upload=225574]: Done starting upload
Aug 17 18:19:11.546047358 (216h53m5.977127479s) [upload=225574]: Uploading segments...
Aug 17 18:19:11.546079480 (216h53m5.977159611s) [upload=225574]: Got next segment. Inline: true
Aug 17 18:19:11.546083738 (216h53m5.977163869s) [upload=225574]: Waiting for error group managing segments...
Aug 17 18:19:11.546115849 (216h53m5.97719598s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:19:11.546119646 (216h53m5.977199777s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:19:11.546122241 (216h53m5.977202372s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:19:11.846602999 (216h53m6.27768313s) [upload=225574]: Done uploading segments...
Aug 17 18:19:11.846621986 (216h53m6.277702117s) [upload=225574]: Upload finished. err: <nil>
Duration: 1.94657908s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X..........X.......................X....X.............] duration:
5.945486252s
FAIL (2025-08-17 18:29:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:19:10.723847290 (216h53m5.154927421s) [upload=225573]: Starting upload Aug 17 18:19:10.723902265 (216h53m5.154982396s) [upload=225573]: Done starting upload Aug 17 18:19:10.724015221 (216h53m5.155095362s) [upload=225573]: Uploading segments... Aug 17 18:19:10.724089813 (216h53m5.155169944s) [upload=225573]: Got next segment. Inline: false Aug 17 18:19:10.724130932 (216h53m5.155211063s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:19:10.724135791 (216h53m5.155215912s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:19:10.941486639 (216h53m5.37256676s) [upload=225573]: Next segment err: metaclient: Too Many Requests Aug 17 18:19:10.941507588 (216h53m5.372587719s) [upload=225573]: Done uploading segments... Aug 17 18:19:10.941522778 (216h53m5.372602909s) [upload=225573]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.945512703s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [............X...........XX......X.X...........X.............] duration:
1.919906739s
FAIL (2025-08-17 18:29:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:19:11.545926657 (216h53m5.977006788s) [upload=225574]: Starting upload
Aug 17 18:19:11.546002462 (216h53m5.977082594s) [upload=225574]: Done starting upload
Aug 17 18:19:11.546047358 (216h53m5.977127479s) [upload=225574]: Uploading segments...
Aug 17 18:19:11.546079480 (216h53m5.977159611s) [upload=225574]: Got next segment. Inline: true
Aug 17 18:19:11.546083738 (216h53m5.977163869s) [upload=225574]: Waiting for error group managing segments...
Aug 17 18:19:11.546115849 (216h53m5.97719598s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:19:11.546119646 (216h53m5.977199777s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:19:11.546122241 (216h53m5.977202372s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:19:11.846602999 (216h53m6.27768313s) [upload=225574]: Done uploading segments...
Aug 17 18:19:11.846621986 (216h53m6.277702117s) [upload=225574]: Upload finished. err: <nil>
Duration: 1.919935153s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.............X...........XX......X.X...........X............] duration:
2.288759696s
FAIL (2025-08-17 18:29:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:19:11.545926657 (216h53m5.977006788s) [upload=225574]: Starting upload
Aug 17 18:19:11.546002462 (216h53m5.977082594s) [upload=225574]: Done starting upload
Aug 17 18:19:11.546047358 (216h53m5.977127479s) [upload=225574]: Uploading segments...
Aug 17 18:19:11.546079480 (216h53m5.977159611s) [upload=225574]: Got next segment. Inline: true
Aug 17 18:19:11.546083738 (216h53m5.977163869s) [upload=225574]: Waiting for error group managing segments...
Aug 17 18:19:11.546115849 (216h53m5.97719598s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:19:11.546119646 (216h53m5.977199777s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:19:11.546122241 (216h53m5.977202372s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:19:11.846602999 (216h53m6.27768313s) [upload=225574]: Done uploading segments...
Aug 17 18:19:11.846621986 (216h53m6.277702117s) [upload=225574]: Upload finished. err: <nil>
Duration: 2.288790955s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X..........X.......................X....X............] duration:
5.956898929s
FAIL (2025-08-17 18:28:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:19:10.723847290 (216h53m5.154927421s) [upload=225573]: Starting upload Aug 17 18:19:10.723902265 (216h53m5.154982396s) [upload=225573]: Done starting upload Aug 17 18:19:10.724015221 (216h53m5.155095362s) [upload=225573]: Uploading segments... Aug 17 18:19:10.724089813 (216h53m5.155169944s) [upload=225573]: Got next segment. Inline: false Aug 17 18:19:10.724130932 (216h53m5.155211063s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:19:10.724135791 (216h53m5.155215912s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:19:10.941486639 (216h53m5.37256676s) [upload=225573]: Next segment err: metaclient: Too Many Requests Aug 17 18:19:10.941507588 (216h53m5.372587719s) [upload=225573]: Done uploading segments... Aug 17 18:19:10.941522778 (216h53m5.372602909s) [upload=225573]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.956923376s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..............X...........XX......X.X...........X...........] duration:
2.016613496s
FAIL (2025-08-17 18:28:24 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:19:11.545926657 (216h53m5.977006788s) [upload=225574]: Starting upload
Aug 17 18:19:11.546002462 (216h53m5.977082594s) [upload=225574]: Done starting upload
Aug 17 18:19:11.546047358 (216h53m5.977127479s) [upload=225574]: Uploading segments...
Aug 17 18:19:11.546079480 (216h53m5.977159611s) [upload=225574]: Got next segment. Inline: true
Aug 17 18:19:11.546083738 (216h53m5.977163869s) [upload=225574]: Waiting for error group managing segments...
Aug 17 18:19:11.546115849 (216h53m5.97719598s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:19:11.546119646 (216h53m5.977199777s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:19:11.546122241 (216h53m5.977202372s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:19:11.846602999 (216h53m6.27768313s) [upload=225574]: Done uploading segments...
Aug 17 18:19:11.846621986 (216h53m6.277702117s) [upload=225574]: Upload finished. err: <nil>
Duration: 2.016639305s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...............X...........XX......X.X...........X..........] duration:
1.947323747s
FAIL (2025-08-17 18:27:53 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:19:11.545926657 (216h53m5.977006788s) [upload=225574]: Starting upload
Aug 17 18:19:11.546002462 (216h53m5.977082594s) [upload=225574]: Done starting upload
Aug 17 18:19:11.546047358 (216h53m5.977127479s) [upload=225574]: Uploading segments...
Aug 17 18:19:11.546079480 (216h53m5.977159611s) [upload=225574]: Got next segment. Inline: true
Aug 17 18:19:11.546083738 (216h53m5.977163869s) [upload=225574]: Waiting for error group managing segments...
Aug 17 18:19:11.546115849 (216h53m5.97719598s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:19:11.546119646 (216h53m5.977199777s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:19:11.546122241 (216h53m5.977202372s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:19:11.846602999 (216h53m6.27768313s) [upload=225574]: Done uploading segments...
Aug 17 18:19:11.846621986 (216h53m6.277702117s) [upload=225574]: Upload finished. err: <nil>
Duration: 1.947343493s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X..........X.......................X....X...........] duration:
6.202678924s
FAIL (2025-08-17 18:27:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:19:10.723847290 (216h53m5.154927421s) [upload=225573]: Starting upload Aug 17 18:19:10.723902265 (216h53m5.154982396s) [upload=225573]: Done starting upload Aug 17 18:19:10.724015221 (216h53m5.155095362s) [upload=225573]: Uploading segments... Aug 17 18:19:10.724089813 (216h53m5.155169944s) [upload=225573]: Got next segment. Inline: false Aug 17 18:19:10.724130932 (216h53m5.155211063s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:19:10.724135791 (216h53m5.155215912s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:19:10.941486639 (216h53m5.37256676s) [upload=225573]: Next segment err: metaclient: Too Many Requests Aug 17 18:19:10.941507588 (216h53m5.372587719s) [upload=225573]: Done uploading segments... Aug 17 18:19:10.941522778 (216h53m5.372602909s) [upload=225573]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.202706325s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [................X...........XX......X.X...........X.........] duration:
2.170994727s
FAIL (2025-08-17 18:26:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:19:11.545926657 (216h53m5.977006788s) [upload=225574]: Starting upload
Aug 17 18:19:11.546002462 (216h53m5.977082594s) [upload=225574]: Done starting upload
Aug 17 18:19:11.546047358 (216h53m5.977127479s) [upload=225574]: Uploading segments...
Aug 17 18:19:11.546079480 (216h53m5.977159611s) [upload=225574]: Got next segment. Inline: true
Aug 17 18:19:11.546083738 (216h53m5.977163869s) [upload=225574]: Waiting for error group managing segments...
Aug 17 18:19:11.546115849 (216h53m5.97719598s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:19:11.546119646 (216h53m5.977199777s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:19:11.546122241 (216h53m5.977202372s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:19:11.846602999 (216h53m6.27768313s) [upload=225574]: Done uploading segments...
Aug 17 18:19:11.846621986 (216h53m6.277702117s) [upload=225574]: Upload finished. err: <nil>
Duration: 2.171016018s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........X..........X.......................X....X..........] duration:
6.088478808s
FAIL (2025-08-17 18:26:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:19:10.723847290 (216h53m5.154927421s) [upload=225573]: Starting upload Aug 17 18:19:10.723902265 (216h53m5.154982396s) [upload=225573]: Done starting upload Aug 17 18:19:10.724015221 (216h53m5.155095362s) [upload=225573]: Uploading segments... Aug 17 18:19:10.724089813 (216h53m5.155169944s) [upload=225573]: Got next segment. Inline: false Aug 17 18:19:10.724130932 (216h53m5.155211063s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:19:10.724135791 (216h53m5.155215912s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:19:10.941486639 (216h53m5.37256676s) [upload=225573]: Next segment err: metaclient: Too Many Requests Aug 17 18:19:10.941507588 (216h53m5.372587719s) [upload=225573]: Done uploading segments... Aug 17 18:19:10.941522778 (216h53m5.372602909s) [upload=225573]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.088538613s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........X..........X.......................X....X.........] duration:
5.879731861s
FAIL (2025-08-17 18:26:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:19:10.723847290 (216h53m5.154927421s) [upload=225573]: Starting upload Aug 17 18:19:10.723902265 (216h53m5.154982396s) [upload=225573]: Done starting upload Aug 17 18:19:10.724015221 (216h53m5.155095362s) [upload=225573]: Uploading segments... Aug 17 18:19:10.724089813 (216h53m5.155169944s) [upload=225573]: Got next segment. Inline: false Aug 17 18:19:10.724130932 (216h53m5.155211063s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:19:10.724135791 (216h53m5.155215912s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:19:10.941486639 (216h53m5.37256676s) [upload=225573]: Next segment err: metaclient: Too Many Requests Aug 17 18:19:10.941507588 (216h53m5.372587719s) [upload=225573]: Done uploading segments... Aug 17 18:19:10.941522778 (216h53m5.372602909s) [upload=225573]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.879768832s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........X..........X.......................X....X........] duration:
6.330815589s
FAIL (2025-08-17 18:25:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:19:10.723847290 (216h53m5.154927421s) [upload=225573]: Starting upload Aug 17 18:19:10.723902265 (216h53m5.154982396s) [upload=225573]: Done starting upload Aug 17 18:19:10.724015221 (216h53m5.155095362s) [upload=225573]: Uploading segments... Aug 17 18:19:10.724089813 (216h53m5.155169944s) [upload=225573]: Got next segment. Inline: false Aug 17 18:19:10.724130932 (216h53m5.155211063s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:19:10.724135791 (216h53m5.155215912s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:19:10.941486639 (216h53m5.37256676s) [upload=225573]: Next segment err: metaclient: Too Many Requests Aug 17 18:19:10.941507588 (216h53m5.372587719s) [upload=225573]: Done uploading segments... Aug 17 18:19:10.941522778 (216h53m5.372602909s) [upload=225573]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.330844313s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.................X...........XX......X.X...........X........] duration:
2.016636325s
FAIL (2025-08-17 18:25:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:19:11.545926657 (216h53m5.977006788s) [upload=225574]: Starting upload
Aug 17 18:19:11.546002462 (216h53m5.977082594s) [upload=225574]: Done starting upload
Aug 17 18:19:11.546047358 (216h53m5.977127479s) [upload=225574]: Uploading segments...
Aug 17 18:19:11.546079480 (216h53m5.977159611s) [upload=225574]: Got next segment. Inline: true
Aug 17 18:19:11.546083738 (216h53m5.977163869s) [upload=225574]: Waiting for error group managing segments...
Aug 17 18:19:11.546115849 (216h53m5.97719598s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:19:11.546119646 (216h53m5.977199777s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:19:11.546122241 (216h53m5.977202372s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:19:11.846602999 (216h53m6.27768313s) [upload=225574]: Done uploading segments...
Aug 17 18:19:11.846621986 (216h53m6.277702117s) [upload=225574]: Upload finished. err: <nil>
Duration: 2.016735104s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..................X...........XX......X.X...........X.......] duration:
2.263771173s
FAIL (2025-08-17 18:25:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:19:11.545926657 (216h53m5.977006788s) [upload=225574]: Starting upload
Aug 17 18:19:11.546002462 (216h53m5.977082594s) [upload=225574]: Done starting upload
Aug 17 18:19:11.546047358 (216h53m5.977127479s) [upload=225574]: Uploading segments...
Aug 17 18:19:11.546079480 (216h53m5.977159611s) [upload=225574]: Got next segment. Inline: true
Aug 17 18:19:11.546083738 (216h53m5.977163869s) [upload=225574]: Waiting for error group managing segments...
Aug 17 18:19:11.546115849 (216h53m5.97719598s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:19:11.546119646 (216h53m5.977199777s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:19:11.546122241 (216h53m5.977202372s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:19:11.846602999 (216h53m6.27768313s) [upload=225574]: Done uploading segments...
Aug 17 18:19:11.846621986 (216h53m6.277702117s) [upload=225574]: Upload finished. err: <nil>
Duration: 2.263799738s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...................X...........XX......X.X...........X......] duration:
2.025361573s
FAIL (2025-08-17 18:24:36 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:19:11.545926657 (216h53m5.977006788s) [upload=225574]: Starting upload
Aug 17 18:19:11.546002462 (216h53m5.977082594s) [upload=225574]: Done starting upload
Aug 17 18:19:11.546047358 (216h53m5.977127479s) [upload=225574]: Uploading segments...
Aug 17 18:19:11.546079480 (216h53m5.977159611s) [upload=225574]: Got next segment. Inline: true
Aug 17 18:19:11.546083738 (216h53m5.977163869s) [upload=225574]: Waiting for error group managing segments...
Aug 17 18:19:11.546115849 (216h53m5.97719598s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:19:11.546119646 (216h53m5.977199777s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:19:11.546122241 (216h53m5.977202372s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:19:11.846602999 (216h53m6.27768313s) [upload=225574]: Done uploading segments...
Aug 17 18:19:11.846621986 (216h53m6.277702117s) [upload=225574]: Upload finished. err: <nil>
Duration: 2.025388456s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [............X..........X.......................X....X.......] duration:
5.831489902s
FAIL (2025-08-17 18:24:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:19:10.723847290 (216h53m5.154927421s) [upload=225573]: Starting upload Aug 17 18:19:10.723902265 (216h53m5.154982396s) [upload=225573]: Done starting upload Aug 17 18:19:10.724015221 (216h53m5.155095362s) [upload=225573]: Uploading segments... Aug 17 18:19:10.724089813 (216h53m5.155169944s) [upload=225573]: Got next segment. Inline: false Aug 17 18:19:10.724130932 (216h53m5.155211063s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:19:10.724135791 (216h53m5.155215912s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:19:10.941486639 (216h53m5.37256676s) [upload=225573]: Next segment err: metaclient: Too Many Requests Aug 17 18:19:10.941507588 (216h53m5.372587719s) [upload=225573]: Done uploading segments... Aug 17 18:19:10.941522778 (216h53m5.372602909s) [upload=225573]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.831510762s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.............X..........X.......................X....X......] duration:
6.400693852s
FAIL (2025-08-17 18:24:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:19:10.723847290 (216h53m5.154927421s) [upload=225573]: Starting upload Aug 17 18:19:10.723902265 (216h53m5.154982396s) [upload=225573]: Done starting upload Aug 17 18:19:10.724015221 (216h53m5.155095362s) [upload=225573]: Uploading segments... Aug 17 18:19:10.724089813 (216h53m5.155169944s) [upload=225573]: Got next segment. Inline: false Aug 17 18:19:10.724130932 (216h53m5.155211063s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:19:10.724135791 (216h53m5.155215912s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:19:10.941486639 (216h53m5.37256676s) [upload=225573]: Next segment err: metaclient: Too Many Requests Aug 17 18:19:10.941507588 (216h53m5.372587719s) [upload=225573]: Done uploading segments... Aug 17 18:19:10.941522778 (216h53m5.372602909s) [upload=225573]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.400722877s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [....................X...........XX......X.X...........X.....] duration:
1.989738322s
FAIL (2025-08-17 18:23:37 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:19:11.545926657 (216h53m5.977006788s) [upload=225574]: Starting upload
Aug 17 18:19:11.546002462 (216h53m5.977082594s) [upload=225574]: Done starting upload
Aug 17 18:19:11.546047358 (216h53m5.977127479s) [upload=225574]: Uploading segments...
Aug 17 18:19:11.546079480 (216h53m5.977159611s) [upload=225574]: Got next segment. Inline: true
Aug 17 18:19:11.546083738 (216h53m5.977163869s) [upload=225574]: Waiting for error group managing segments...
Aug 17 18:19:11.546115849 (216h53m5.97719598s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:19:11.546119646 (216h53m5.977199777s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:19:11.546122241 (216h53m5.977202372s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:19:11.846602999 (216h53m6.27768313s) [upload=225574]: Done uploading segments...
Aug 17 18:19:11.846621986 (216h53m6.277702117s) [upload=225574]: Upload finished. err: <nil>
Duration: 1.989771485s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..............X..........X.......................X....X.....] duration:
5.825595795s
FAIL (2025-08-17 18:23:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:19:10.723847290 (216h53m5.154927421s) [upload=225573]: Starting upload Aug 17 18:19:10.723902265 (216h53m5.154982396s) [upload=225573]: Done starting upload Aug 17 18:19:10.724015221 (216h53m5.155095362s) [upload=225573]: Uploading segments... Aug 17 18:19:10.724089813 (216h53m5.155169944s) [upload=225573]: Got next segment. Inline: false Aug 17 18:19:10.724130932 (216h53m5.155211063s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:19:10.724135791 (216h53m5.155215912s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:19:10.941486639 (216h53m5.37256676s) [upload=225573]: Next segment err: metaclient: Too Many Requests Aug 17 18:19:10.941507588 (216h53m5.372587719s) [upload=225573]: Done uploading segments... Aug 17 18:19:10.941522778 (216h53m5.372602909s) [upload=225573]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.825619269s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.....................X...........XX......X.X...........X....] duration:
1.978341115s
FAIL (2025-08-17 18:22:32 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:19:11.545926657 (216h53m5.977006788s) [upload=225574]: Starting upload
Aug 17 18:19:11.546002462 (216h53m5.977082594s) [upload=225574]: Done starting upload
Aug 17 18:19:11.546047358 (216h53m5.977127479s) [upload=225574]: Uploading segments...
Aug 17 18:19:11.546079480 (216h53m5.977159611s) [upload=225574]: Got next segment. Inline: true
Aug 17 18:19:11.546083738 (216h53m5.977163869s) [upload=225574]: Waiting for error group managing segments...
Aug 17 18:19:11.546115849 (216h53m5.97719598s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:19:11.546119646 (216h53m5.977199777s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:19:11.546122241 (216h53m5.977202372s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:19:11.846602999 (216h53m6.27768313s) [upload=225574]: Done uploading segments...
Aug 17 18:19:11.846621986 (216h53m6.277702117s) [upload=225574]: Upload finished. err: <nil>
Duration: 1.978373518s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...............X..........X.......................X....X....] duration:
5.980984245s
FAIL (2025-08-17 18:22:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:19:10.723847290 (216h53m5.154927421s) [upload=225573]: Starting upload Aug 17 18:19:10.723902265 (216h53m5.154982396s) [upload=225573]: Done starting upload Aug 17 18:19:10.724015221 (216h53m5.155095362s) [upload=225573]: Uploading segments... Aug 17 18:19:10.724089813 (216h53m5.155169944s) [upload=225573]: Got next segment. Inline: false Aug 17 18:19:10.724130932 (216h53m5.155211063s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:19:10.724135791 (216h53m5.155215912s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:19:10.941486639 (216h53m5.37256676s) [upload=225573]: Next segment err: metaclient: Too Many Requests Aug 17 18:19:10.941507588 (216h53m5.372587719s) [upload=225573]: Done uploading segments... Aug 17 18:19:10.941522778 (216h53m5.372602909s) [upload=225573]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.981009945s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [................X..........X.......................X....X...] duration:
6.055832262s
FAIL (2025-08-17 18:22:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:19:10.723847290 (216h53m5.154927421s) [upload=225573]: Starting upload Aug 17 18:19:10.723902265 (216h53m5.154982396s) [upload=225573]: Done starting upload Aug 17 18:19:10.724015221 (216h53m5.155095362s) [upload=225573]: Uploading segments... Aug 17 18:19:10.724089813 (216h53m5.155169944s) [upload=225573]: Got next segment. Inline: false Aug 17 18:19:10.724130932 (216h53m5.155211063s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:19:10.724135791 (216h53m5.155215912s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:19:10.941486639 (216h53m5.37256676s) [upload=225573]: Next segment err: metaclient: Too Many Requests Aug 17 18:19:10.941507588 (216h53m5.372587719s) [upload=225573]: Done uploading segments... Aug 17 18:19:10.941522778 (216h53m5.372602909s) [upload=225573]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.05589933s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [......................X...........XX......X.X...........X...] duration:
1.963702453s
FAIL (2025-08-17 18:21:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:19:11.545926657 (216h53m5.977006788s) [upload=225574]: Starting upload
Aug 17 18:19:11.546002462 (216h53m5.977082594s) [upload=225574]: Done starting upload
Aug 17 18:19:11.546047358 (216h53m5.977127479s) [upload=225574]: Uploading segments...
Aug 17 18:19:11.546079480 (216h53m5.977159611s) [upload=225574]: Got next segment. Inline: true
Aug 17 18:19:11.546083738 (216h53m5.977163869s) [upload=225574]: Waiting for error group managing segments...
Aug 17 18:19:11.546115849 (216h53m5.97719598s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:19:11.546119646 (216h53m5.977199777s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:19:11.546122241 (216h53m5.977202372s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:19:11.846602999 (216h53m6.27768313s) [upload=225574]: Done uploading segments...
Aug 17 18:19:11.846621986 (216h53m6.277702117s) [upload=225574]: Upload finished. err: <nil>
Duration: 1.96373163s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.................X..........X.......................X....X..] duration:
6.073778776s
FAIL (2025-08-17 18:21:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:19:10.723847290 (216h53m5.154927421s) [upload=225573]: Starting upload Aug 17 18:19:10.723902265 (216h53m5.154982396s) [upload=225573]: Done starting upload Aug 17 18:19:10.724015221 (216h53m5.155095362s) [upload=225573]: Uploading segments... Aug 17 18:19:10.724089813 (216h53m5.155169944s) [upload=225573]: Got next segment. Inline: false Aug 17 18:19:10.724130932 (216h53m5.155211063s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:19:10.724135791 (216h53m5.155215912s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:19:10.941486639 (216h53m5.37256676s) [upload=225573]: Next segment err: metaclient: Too Many Requests Aug 17 18:19:10.941507588 (216h53m5.372587719s) [upload=225573]: Done uploading segments... Aug 17 18:19:10.941522778 (216h53m5.372602909s) [upload=225573]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.073806278s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.......................X...........XX......X.X...........X..] duration:
2.002595673s
FAIL (2025-08-17 18:20:56 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:19:11.545926657 (216h53m5.977006788s) [upload=225574]: Starting upload
Aug 17 18:19:11.546002462 (216h53m5.977082594s) [upload=225574]: Done starting upload
Aug 17 18:19:11.546047358 (216h53m5.977127479s) [upload=225574]: Uploading segments...
Aug 17 18:19:11.546079480 (216h53m5.977159611s) [upload=225574]: Got next segment. Inline: true
Aug 17 18:19:11.546083738 (216h53m5.977163869s) [upload=225574]: Waiting for error group managing segments...
Aug 17 18:19:11.546115849 (216h53m5.97719598s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:19:11.546119646 (216h53m5.977199777s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:19:11.546122241 (216h53m5.977202372s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:19:11.846602999 (216h53m6.27768313s) [upload=225574]: Done uploading segments...
Aug 17 18:19:11.846621986 (216h53m6.277702117s) [upload=225574]: Upload finished. err: <nil>
Duration: 2.002626472s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..................X..........X.......................X....X.] duration:
6.002360067s
FAIL (2025-08-17 18:20:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:19:10.723847290 (216h53m5.154927421s) [upload=225573]: Starting upload Aug 17 18:19:10.723902265 (216h53m5.154982396s) [upload=225573]: Done starting upload Aug 17 18:19:10.724015221 (216h53m5.155095362s) [upload=225573]: Uploading segments... Aug 17 18:19:10.724089813 (216h53m5.155169944s) [upload=225573]: Got next segment. Inline: false Aug 17 18:19:10.724130932 (216h53m5.155211063s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:19:10.724135791 (216h53m5.155215912s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:19:10.941486639 (216h53m5.37256676s) [upload=225573]: Next segment err: metaclient: Too Many Requests Aug 17 18:19:10.941507588 (216h53m5.372587719s) [upload=225573]: Done uploading segments... Aug 17 18:19:10.941522778 (216h53m5.372602909s) [upload=225573]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.002384042s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [........................X...........XX......X.X...........X.] duration:
1.965057452s
FAIL (2025-08-17 18:19:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:19:11.545926657 (216h53m5.977006788s) [upload=225574]: Starting upload
Aug 17 18:19:11.546002462 (216h53m5.977082594s) [upload=225574]: Done starting upload
Aug 17 18:19:11.546047358 (216h53m5.977127479s) [upload=225574]: Uploading segments...
Aug 17 18:19:11.546079480 (216h53m5.977159611s) [upload=225574]: Got next segment. Inline: true
Aug 17 18:19:11.546083738 (216h53m5.977163869s) [upload=225574]: Waiting for error group managing segments...
Aug 17 18:19:11.546115849 (216h53m5.97719598s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:19:11.546119646 (216h53m5.977199777s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:19:11.546122241 (216h53m5.977202372s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:19:11.846602999 (216h53m6.27768313s) [upload=225574]: Done uploading segments...
Aug 17 18:19:11.846621986 (216h53m6.277702117s) [upload=225574]: Upload finished. err: <nil>
Duration: 1.965096446s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.........................X...........XX......X.X...........X] duration:
1.673853536s
FAIL (2025-08-17 18:19:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:19:11.545926657 (216h53m5.977006788s) [upload=225574]: Starting upload
Aug 17 18:19:11.546002462 (216h53m5.977082594s) [upload=225574]: Done starting upload
Aug 17 18:19:11.546047358 (216h53m5.977127479s) [upload=225574]: Uploading segments...
Aug 17 18:19:11.546079480 (216h53m5.977159611s) [upload=225574]: Got next segment. Inline: true
Aug 17 18:19:11.546083738 (216h53m5.977163869s) [upload=225574]: Waiting for error group managing segments...
Aug 17 18:19:11.546115849 (216h53m5.97719598s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:19:11.546119646 (216h53m5.977199777s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:19:11.546122241 (216h53m5.977202372s) [upload=225574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:19:11.846602999 (216h53m6.27768313s) [upload=225574]: Done uploading segments...
Aug 17 18:19:11.846621986 (216h53m6.277702117s) [upload=225574]: Upload finished. err: <nil>
Duration: 1.673873584s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...................X..........X.......................X....X] duration:
875.985983ms
FAIL (2025-08-17 18:19:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:19:10.723847290 (216h53m5.154927421s) [upload=225573]: Starting upload Aug 17 18:19:10.723902265 (216h53m5.154982396s) [upload=225573]: Done starting upload Aug 17 18:19:10.724015221 (216h53m5.155095362s) [upload=225573]: Uploading segments... Aug 17 18:19:10.724089813 (216h53m5.155169944s) [upload=225573]: Got next segment. Inline: false Aug 17 18:19:10.724130932 (216h53m5.155211063s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:19:10.724135791 (216h53m5.155215912s) [upload=225573]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:19:10.941486639 (216h53m5.37256676s) [upload=225573]: Next segment err: metaclient: Too Many Requests Aug 17 18:19:10.941507588 (216h53m5.372587719s) [upload=225573]: Done uploading segments... Aug 17 18:19:10.941522778 (216h53m5.372602909s) [upload=225573]: Upload finished. err: metaclient: Too Many Requests
Duration: 876.007624ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..........................X...........XX......X.X...........] duration:
2.12733354s
FAIL (2025-08-17 18:18:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:08:46.337202054 (216h42m40.768282185s) [upload=225393]: Starting upload
Aug 17 18:08:46.337258151 (216h42m40.768338282s) [upload=225393]: Done starting upload
Aug 17 18:08:46.337301744 (216h42m40.768381875s) [upload=225393]: Uploading segments...
Aug 17 18:08:46.337332453 (216h42m40.768412584s) [upload=225393]: Got next segment. Inline: true
Aug 17 18:08:46.337336221 (216h42m40.768416352s) [upload=225393]: Waiting for error group managing segments...
Aug 17 18:08:46.337367711 (216h42m40.768447832s) [upload=225393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:46.337371488 (216h42m40.768451609s) [upload=225393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:08:46.337373882 (216h42m40.768454013s) [upload=225393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:47.123259538 (216h42m41.554339689s) [upload=225393]: Done uploading segments...
Aug 17 18:08:47.123282932 (216h42m41.554363064s) [upload=225393]: Upload finished. err: <nil>
Duration: 2.127369067s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................X..........X.......................X....] duration:
6.062737051s
FAIL (2025-08-17 18:18:04 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e3c669dd55204f7b5f24e76de66f26b0b32fcaee1d002f66f9a71f88402c4059 != before 29144d26e3639887c8fdef546a48a0f8e667f0c56ab03e64da9d3f5859af83e9
======LOGS======
Aug 17 18:15:11.950084161 (216h49m6.381164292s) [upload=225505]: Starting upload
Aug 17 18:15:11.950147211 (216h49m6.381227342s) [upload=225505]: Done starting upload
Aug 17 18:15:11.950270628 (216h49m6.381350759s) [upload=225505]: Uploading segments...
Aug 17 18:15:11.950388223 (216h49m6.381468354s) [upload=225505]: Got next segment. Inline: false
Aug 17 18:15:11.950422809 (216h49m6.38150294s) [upload=225505]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:15:11.950427177 (216h49m6.381507308s) [upload=225505]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:15:12.579106285 (216h49m7.010186466s) [seg_pos={0 0}, upload=225505]: Begin upload segment...
Aug 17 18:15:12.579166019 (216h49m7.01024616s) [seg_pos={0 0}, upload=225505]: Done begin upload segment.
Aug 17 18:15:12.579201788 (216h49m7.01028194s) [noise=true , address=45.91.116.5:4320 , piece_id=NFGVUDRKWTKUKOQVAAHERUYV4LEEBATJVYMIQEWSUVIFRHG4V32Q, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.579213140 (216h49m7.010293271s) [noise=true , address=104.36.82.19:4426 , piece_id=BTXYB6RS6FWBCF5XVGHOQBHZERISDOFSKCCWOOPTGJW6OS72ZSOA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.579292321 (216h49m7.010372462s) [noise=true , address=104.36.82.60:4341 , piece_id=BWRRXXI6LYZMWGEMUZY44PJTL247ODGOPDLFYMZOHW3FR46QEO7Q, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.580094236 (216h49m7.011174357s) [noise=true , address=77.90.31.13:4653 , piece_id=U7P4FCI7AXOBEYK765VFYLFSLF6U37GPNN23OOPF6FHY3HQKKKTA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.580107291 (216h49m7.011187432s) [noise=true , address=104.36.82.34:4550 , piece_id=IF4XHUITSWGXKGQ2FPUA7Y2VPKJL2LVLOYQO2XNNBIIUFC4SLSEQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.580679757 (216h49m7.011759888s) [noise=true , address=45.91.116.14:4215 , piece_id=SGLWURGXWBGF6TO23Q7SRAZG2EIIARQXGJNSZQ26P52V5A4R6WTQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.580686469 (216h49m7.01176661s) [noise=true , address=104.36.82.39:4737 , piece_id=4LD7YPXEF65SBQOVD2YKZRK6JG35BO2SNTOKB5VYGS7WXDJRGCLQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.581206274 (216h49m7.012286395s) [noise=true , address=104.36.82.17:4361 , piece_id=X4UBCWOE4VHY5FV2MDYYKON3XT5OEAQANDU642ML4YACG4VXM5DA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.581231973 (216h49m7.012312124s) [noise=true , address=104.36.82.62:4422 , piece_id=B4IWM2JI3I25WKXMLMOEWG3KJRRL6SK3TWOOO2KGUVICHTLOAECQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.581722792 (216h49m7.012802943s) [noise=true , address=104.36.82.44:4895 , piece_id=RKP7DLAOG74KFFCX3UZVYFJ2E3SAZ6M3TJ2QX3Z3BOKR62IONWKQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.581743511 (216h49m7.012823642s) [noise=true , address=104.36.82.3:4787 , piece_id=TGWWHAUZ33L6Z3HZKPRGPTBUQIAX4ITC6C74IOINHFKVPPCRAGEQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.582246374 (216h49m7.013326505s) [noise=true , address=77.90.31.16:4754 , piece_id=DSLKK6HE2DMBZBSUITH4KT7X7Q3NW5J6BBUISYZICZD33QRBAL2A, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.582380290 (216h49m7.013460431s) [noise=true , address=104.36.82.18:4369 , piece_id=F6AGTMSFKB3Z7YUPGVIWHJT4JCB7JXFKU42KBIXQ3VZW6A3IJWEQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.582635148 (216h49m7.013715289s) [noise=true , address=77.90.31.18:4835 , piece_id=QL5WXJMJBGSVGZGVTRWW4TCFMW53PJOWOZSHZ5GOPZ3IYSKNB5AQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.582941864 (216h49m7.014021995s) [noise=true , address=45.91.116.11:4125 , piece_id=247MGOOGJL3X7QWQGE7BOKHFH2FSQUREICJP3K3W23ZJ7TSK3OEQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.583683133 (216h49m7.014763274s) [noise=true , address=77.90.31.11:4557 , piece_id=PLL7RR6CQXRFMQOPGGF62GHC74S7KM3QYBQEBFEX4MSUWNJYNUFQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.584594707 (216h49m7.015674838s) [noise=true , address=45.91.116.7:4042 , piece_id=5LCUCTVTCL2GKKEZBNWWLNVAPLZCB7E3MSPSJBN4IZ3MIH7ZTHBA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.585175829 (216h49m7.01625596s) [noise=true , address=66.23.193.175:4554 , piece_id=SZ2VXXRXNE2CLKP4F5F7NG437NAJS66VZR25TILCCIDQ5G6SYLJA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:13.719907003 (216h49m8.150987124s) [upload=225505]: Next returned nil segment
Aug 17 18:15:13.719923554 (216h49m8.151003675s) [upload=225505]: Waiting for error group managing segments...
Aug 17 18:15:14.020809928 (216h49m8.451890059s) [noise=true , address=66.23.193.175:4554 , piece_id=SZ2VXXRXNE2CLKP4F5F7NG437NAJS66VZR25TILCCIDQ5G6SYLJA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.489372190 (216h49m8.920452321s) [noise=true , address=77.90.31.11:4557 , piece_id=PLL7RR6CQXRFMQOPGGF62GHC74S7KM3QYBQEBFEX4MSUWNJYNUFQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.536661843 (216h49m8.967741974s) [noise=true , address=45.91.116.11:4125 , piece_id=247MGOOGJL3X7QWQGE7BOKHFH2FSQUREICJP3K3W23ZJ7TSK3OEQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.564142234 (216h49m8.995222365s) [noise=true , address=45.91.116.7:4042 , piece_id=5LCUCTVTCL2GKKEZBNWWLNVAPLZCB7E3MSPSJBN4IZ3MIH7ZTHBA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.585454222 (216h49m9.016534353s) [noise=true , address=104.36.82.34:4550 , piece_id=IF4XHUITSWGXKGQ2FPUA7Y2VPKJL2LVLOYQO2XNNBIIUFC4SLSEQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.614718947 (216h49m9.045799068s) [noise=true , address=45.91.116.14:4215 , piece_id=SGLWURGXWBGF6TO23Q7SRAZG2EIIARQXGJNSZQ26P52V5A4R6WTQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.652116153 (216h49m9.083196284s) [noise=true , address=104.36.82.3:4787 , piece_id=TGWWHAUZ33L6Z3HZKPRGPTBUQIAX4ITC6C74IOINHFKVPPCRAGEQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.659379391 (216h49m9.090459512s) [noise=true , address=45.91.116.5:4320 , piece_id=NFGVUDRKWTKUKOQVAAHERUYV4LEEBATJVYMIQEWSUVIFRHG4V32Q, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.675028293 (216h49m9.106108424s) [noise=true , address=77.90.31.16:4754 , piece_id=DSLKK6HE2DMBZBSUITH4KT7X7Q3NW5J6BBUISYZICZD33QRBAL2A, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.704456751 (216h49m9.135536882s) [noise=true , address=104.36.82.19:4426 , piece_id=BTXYB6RS6FWBCF5XVGHOQBHZERISDOFSKCCWOOPTGJW6OS72ZSOA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.736757545 (216h49m9.167837666s) [noise=true , address=77.90.31.18:4835 , piece_id=QL5WXJMJBGSVGZGVTRWW4TCFMW53PJOWOZSHZ5GOPZ3IYSKNB5AQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.756095466 (216h49m9.187175597s) [noise=true , address=104.36.82.17:4361 , piece_id=X4UBCWOE4VHY5FV2MDYYKON3XT5OEAQANDU642ML4YACG4VXM5DA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.771064187 (216h49m9.202144308s) [noise=true , address=104.36.82.44:4895 , piece_id=RKP7DLAOG74KFFCX3UZVYFJ2E3SAZ6M3TJ2QX3Z3BOKR62IONWKQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.772398840 (216h49m9.203478971s) [noise=true , address=104.36.82.39:4737 , piece_id=4LD7YPXEF65SBQOVD2YKZRK6JG35BO2SNTOKB5VYGS7WXDJRGCLQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.772410603 (216h49m9.203490724s) [seg_pos={0 0}, upload=225505]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:15:14.772492420 (216h49m9.203572551s) [noise=true , address=104.36.82.18:4369 , piece_id=F6AGTMSFKB3Z7YUPGVIWHJT4JCB7JXFKU42KBIXQ3VZW6A3IJWEQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF
Aug 17 18:15:14.772674999 (216h49m9.20375512s) [noise=true , address=104.36.82.62:4422 , piece_id=B4IWM2JI3I25WKXMLMOEWG3KJRRL6SK3TWOOO2KGUVICHTLOAECQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12R4NKBjmChQ2wFrgn97FLVBMZSEsD14pXxuwze9QFnXVxumHd2): protocol: expected piece hash; context canceled; EOF
Aug 17 18:15:14.772711589 (216h49m9.20379172s) [noise=true , address=77.90.31.13:4653 , piece_id=U7P4FCI7AXOBEYK765VFYLFSLF6U37GPNN23OOPF6FHY3HQKKKTA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eaTnUhynF1XeuvMr68SjMyYKM9rLj5tShzpViHcMSjvMs9EBF): protocol: rpc: dial tcp 77.90.31.13:4653: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 18:15:14.772742268 (216h49m9.203822399s) [noise=true , address=104.36.82.60:4341 , piece_id=BWRRXXI6LYZMWGEMUZY44PJTL247ODGOPDLFYMZOHW3FR46QEO7Q, seg_pos={0 0}, upload=225505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 17 18:15:14.772762195 (216h49m9.203842326s) [seg_pos={0 0}, upload=225505]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:15:14.772817241 (216h49m9.203897372s) [upload=225505]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:15:14.772821249 (216h49m9.20390138s) [upload=225505]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:15:15.280022201 (216h49m9.711102333s) [upload=225505]: Done uploading segments...
Aug 17 18:15:15.280040105 (216h49m9.711120236s) [upload=225505]: Upload finished. err: <nil>
Duration: 6.062759514s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...........................X...........XX......X.X..........] duration:
2.063333903s
FAIL (2025-08-17 18:17:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:08:46.337202054 (216h42m40.768282185s) [upload=225393]: Starting upload
Aug 17 18:08:46.337258151 (216h42m40.768338282s) [upload=225393]: Done starting upload
Aug 17 18:08:46.337301744 (216h42m40.768381875s) [upload=225393]: Uploading segments...
Aug 17 18:08:46.337332453 (216h42m40.768412584s) [upload=225393]: Got next segment. Inline: true
Aug 17 18:08:46.337336221 (216h42m40.768416352s) [upload=225393]: Waiting for error group managing segments...
Aug 17 18:08:46.337367711 (216h42m40.768447832s) [upload=225393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:46.337371488 (216h42m40.768451609s) [upload=225393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:08:46.337373882 (216h42m40.768454013s) [upload=225393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:47.123259538 (216h42m41.554339689s) [upload=225393]: Done uploading segments...
Aug 17 18:08:47.123282932 (216h42m41.554363064s) [upload=225393]: Upload finished. err: <nil>
Duration: 2.063362748s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................X..........X.......................X...] duration:
5.737602405s
FAIL (2025-08-17 18:17:19 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e3c669dd55204f7b5f24e76de66f26b0b32fcaee1d002f66f9a71f88402c4059 != before 29144d26e3639887c8fdef546a48a0f8e667f0c56ab03e64da9d3f5859af83e9
======LOGS======
Aug 17 18:15:11.950084161 (216h49m6.381164292s) [upload=225505]: Starting upload
Aug 17 18:15:11.950147211 (216h49m6.381227342s) [upload=225505]: Done starting upload
Aug 17 18:15:11.950270628 (216h49m6.381350759s) [upload=225505]: Uploading segments...
Aug 17 18:15:11.950388223 (216h49m6.381468354s) [upload=225505]: Got next segment. Inline: false
Aug 17 18:15:11.950422809 (216h49m6.38150294s) [upload=225505]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:15:11.950427177 (216h49m6.381507308s) [upload=225505]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:15:12.579106285 (216h49m7.010186466s) [seg_pos={0 0}, upload=225505]: Begin upload segment...
Aug 17 18:15:12.579166019 (216h49m7.01024616s) [seg_pos={0 0}, upload=225505]: Done begin upload segment.
Aug 17 18:15:12.579201788 (216h49m7.01028194s) [noise=true , address=45.91.116.5:4320 , piece_id=NFGVUDRKWTKUKOQVAAHERUYV4LEEBATJVYMIQEWSUVIFRHG4V32Q, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.579213140 (216h49m7.010293271s) [noise=true , address=104.36.82.19:4426 , piece_id=BTXYB6RS6FWBCF5XVGHOQBHZERISDOFSKCCWOOPTGJW6OS72ZSOA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.579292321 (216h49m7.010372462s) [noise=true , address=104.36.82.60:4341 , piece_id=BWRRXXI6LYZMWGEMUZY44PJTL247ODGOPDLFYMZOHW3FR46QEO7Q, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.580094236 (216h49m7.011174357s) [noise=true , address=77.90.31.13:4653 , piece_id=U7P4FCI7AXOBEYK765VFYLFSLF6U37GPNN23OOPF6FHY3HQKKKTA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.580107291 (216h49m7.011187432s) [noise=true , address=104.36.82.34:4550 , piece_id=IF4XHUITSWGXKGQ2FPUA7Y2VPKJL2LVLOYQO2XNNBIIUFC4SLSEQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.580679757 (216h49m7.011759888s) [noise=true , address=45.91.116.14:4215 , piece_id=SGLWURGXWBGF6TO23Q7SRAZG2EIIARQXGJNSZQ26P52V5A4R6WTQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.580686469 (216h49m7.01176661s) [noise=true , address=104.36.82.39:4737 , piece_id=4LD7YPXEF65SBQOVD2YKZRK6JG35BO2SNTOKB5VYGS7WXDJRGCLQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.581206274 (216h49m7.012286395s) [noise=true , address=104.36.82.17:4361 , piece_id=X4UBCWOE4VHY5FV2MDYYKON3XT5OEAQANDU642ML4YACG4VXM5DA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.581231973 (216h49m7.012312124s) [noise=true , address=104.36.82.62:4422 , piece_id=B4IWM2JI3I25WKXMLMOEWG3KJRRL6SK3TWOOO2KGUVICHTLOAECQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.581722792 (216h49m7.012802943s) [noise=true , address=104.36.82.44:4895 , piece_id=RKP7DLAOG74KFFCX3UZVYFJ2E3SAZ6M3TJ2QX3Z3BOKR62IONWKQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.581743511 (216h49m7.012823642s) [noise=true , address=104.36.82.3:4787 , piece_id=TGWWHAUZ33L6Z3HZKPRGPTBUQIAX4ITC6C74IOINHFKVPPCRAGEQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.582246374 (216h49m7.013326505s) [noise=true , address=77.90.31.16:4754 , piece_id=DSLKK6HE2DMBZBSUITH4KT7X7Q3NW5J6BBUISYZICZD33QRBAL2A, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.582380290 (216h49m7.013460431s) [noise=true , address=104.36.82.18:4369 , piece_id=F6AGTMSFKB3Z7YUPGVIWHJT4JCB7JXFKU42KBIXQ3VZW6A3IJWEQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.582635148 (216h49m7.013715289s) [noise=true , address=77.90.31.18:4835 , piece_id=QL5WXJMJBGSVGZGVTRWW4TCFMW53PJOWOZSHZ5GOPZ3IYSKNB5AQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.582941864 (216h49m7.014021995s) [noise=true , address=45.91.116.11:4125 , piece_id=247MGOOGJL3X7QWQGE7BOKHFH2FSQUREICJP3K3W23ZJ7TSK3OEQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.583683133 (216h49m7.014763274s) [noise=true , address=77.90.31.11:4557 , piece_id=PLL7RR6CQXRFMQOPGGF62GHC74S7KM3QYBQEBFEX4MSUWNJYNUFQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.584594707 (216h49m7.015674838s) [noise=true , address=45.91.116.7:4042 , piece_id=5LCUCTVTCL2GKKEZBNWWLNVAPLZCB7E3MSPSJBN4IZ3MIH7ZTHBA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.585175829 (216h49m7.01625596s) [noise=true , address=66.23.193.175:4554 , piece_id=SZ2VXXRXNE2CLKP4F5F7NG437NAJS66VZR25TILCCIDQ5G6SYLJA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:13.719907003 (216h49m8.150987124s) [upload=225505]: Next returned nil segment
Aug 17 18:15:13.719923554 (216h49m8.151003675s) [upload=225505]: Waiting for error group managing segments...
Aug 17 18:15:14.020809928 (216h49m8.451890059s) [noise=true , address=66.23.193.175:4554 , piece_id=SZ2VXXRXNE2CLKP4F5F7NG437NAJS66VZR25TILCCIDQ5G6SYLJA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.489372190 (216h49m8.920452321s) [noise=true , address=77.90.31.11:4557 , piece_id=PLL7RR6CQXRFMQOPGGF62GHC74S7KM3QYBQEBFEX4MSUWNJYNUFQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.536661843 (216h49m8.967741974s) [noise=true , address=45.91.116.11:4125 , piece_id=247MGOOGJL3X7QWQGE7BOKHFH2FSQUREICJP3K3W23ZJ7TSK3OEQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.564142234 (216h49m8.995222365s) [noise=true , address=45.91.116.7:4042 , piece_id=5LCUCTVTCL2GKKEZBNWWLNVAPLZCB7E3MSPSJBN4IZ3MIH7ZTHBA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.585454222 (216h49m9.016534353s) [noise=true , address=104.36.82.34:4550 , piece_id=IF4XHUITSWGXKGQ2FPUA7Y2VPKJL2LVLOYQO2XNNBIIUFC4SLSEQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.614718947 (216h49m9.045799068s) [noise=true , address=45.91.116.14:4215 , piece_id=SGLWURGXWBGF6TO23Q7SRAZG2EIIARQXGJNSZQ26P52V5A4R6WTQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.652116153 (216h49m9.083196284s) [noise=true , address=104.36.82.3:4787 , piece_id=TGWWHAUZ33L6Z3HZKPRGPTBUQIAX4ITC6C74IOINHFKVPPCRAGEQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.659379391 (216h49m9.090459512s) [noise=true , address=45.91.116.5:4320 , piece_id=NFGVUDRKWTKUKOQVAAHERUYV4LEEBATJVYMIQEWSUVIFRHG4V32Q, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.675028293 (216h49m9.106108424s) [noise=true , address=77.90.31.16:4754 , piece_id=DSLKK6HE2DMBZBSUITH4KT7X7Q3NW5J6BBUISYZICZD33QRBAL2A, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.704456751 (216h49m9.135536882s) [noise=true , address=104.36.82.19:4426 , piece_id=BTXYB6RS6FWBCF5XVGHOQBHZERISDOFSKCCWOOPTGJW6OS72ZSOA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.736757545 (216h49m9.167837666s) [noise=true , address=77.90.31.18:4835 , piece_id=QL5WXJMJBGSVGZGVTRWW4TCFMW53PJOWOZSHZ5GOPZ3IYSKNB5AQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.756095466 (216h49m9.187175597s) [noise=true , address=104.36.82.17:4361 , piece_id=X4UBCWOE4VHY5FV2MDYYKON3XT5OEAQANDU642ML4YACG4VXM5DA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.771064187 (216h49m9.202144308s) [noise=true , address=104.36.82.44:4895 , piece_id=RKP7DLAOG74KFFCX3UZVYFJ2E3SAZ6M3TJ2QX3Z3BOKR62IONWKQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.772398840 (216h49m9.203478971s) [noise=true , address=104.36.82.39:4737 , piece_id=4LD7YPXEF65SBQOVD2YKZRK6JG35BO2SNTOKB5VYGS7WXDJRGCLQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.772410603 (216h49m9.203490724s) [seg_pos={0 0}, upload=225505]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:15:14.772492420 (216h49m9.203572551s) [noise=true , address=104.36.82.18:4369 , piece_id=F6AGTMSFKB3Z7YUPGVIWHJT4JCB7JXFKU42KBIXQ3VZW6A3IJWEQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF
Aug 17 18:15:14.772674999 (216h49m9.20375512s) [noise=true , address=104.36.82.62:4422 , piece_id=B4IWM2JI3I25WKXMLMOEWG3KJRRL6SK3TWOOO2KGUVICHTLOAECQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12R4NKBjmChQ2wFrgn97FLVBMZSEsD14pXxuwze9QFnXVxumHd2): protocol: expected piece hash; context canceled; EOF
Aug 17 18:15:14.772711589 (216h49m9.20379172s) [noise=true , address=77.90.31.13:4653 , piece_id=U7P4FCI7AXOBEYK765VFYLFSLF6U37GPNN23OOPF6FHY3HQKKKTA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eaTnUhynF1XeuvMr68SjMyYKM9rLj5tShzpViHcMSjvMs9EBF): protocol: rpc: dial tcp 77.90.31.13:4653: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 18:15:14.772742268 (216h49m9.203822399s) [noise=true , address=104.36.82.60:4341 , piece_id=BWRRXXI6LYZMWGEMUZY44PJTL247ODGOPDLFYMZOHW3FR46QEO7Q, seg_pos={0 0}, upload=225505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 17 18:15:14.772762195 (216h49m9.203842326s) [seg_pos={0 0}, upload=225505]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:15:14.772817241 (216h49m9.203897372s) [upload=225505]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:15:14.772821249 (216h49m9.20390138s) [upload=225505]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:15:15.280022201 (216h49m9.711102333s) [upload=225505]: Done uploading segments...
Aug 17 18:15:15.280040105 (216h49m9.711120236s) [upload=225505]: Upload finished. err: <nil>
Duration: 5.737627902s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [............................X...........XX......X.X.........] duration:
2.428494609s
FAIL (2025-08-17 18:17:16 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:08:46.337202054 (216h42m40.768282185s) [upload=225393]: Starting upload
Aug 17 18:08:46.337258151 (216h42m40.768338282s) [upload=225393]: Done starting upload
Aug 17 18:08:46.337301744 (216h42m40.768381875s) [upload=225393]: Uploading segments...
Aug 17 18:08:46.337332453 (216h42m40.768412584s) [upload=225393]: Got next segment. Inline: true
Aug 17 18:08:46.337336221 (216h42m40.768416352s) [upload=225393]: Waiting for error group managing segments...
Aug 17 18:08:46.337367711 (216h42m40.768447832s) [upload=225393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:46.337371488 (216h42m40.768451609s) [upload=225393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:08:46.337373882 (216h42m40.768454013s) [upload=225393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:47.123259538 (216h42m41.554339689s) [upload=225393]: Done uploading segments...
Aug 17 18:08:47.123282932 (216h42m41.554363064s) [upload=225393]: Upload finished. err: <nil>
Duration: 2.428523425s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.............................X...........XX......X.X........] duration:
1.91319437s
FAIL (2025-08-17 18:16:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:08:46.337202054 (216h42m40.768282185s) [upload=225393]: Starting upload
Aug 17 18:08:46.337258151 (216h42m40.768338282s) [upload=225393]: Done starting upload
Aug 17 18:08:46.337301744 (216h42m40.768381875s) [upload=225393]: Uploading segments...
Aug 17 18:08:46.337332453 (216h42m40.768412584s) [upload=225393]: Got next segment. Inline: true
Aug 17 18:08:46.337336221 (216h42m40.768416352s) [upload=225393]: Waiting for error group managing segments...
Aug 17 18:08:46.337367711 (216h42m40.768447832s) [upload=225393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:46.337371488 (216h42m40.768451609s) [upload=225393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:08:46.337373882 (216h42m40.768454013s) [upload=225393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:47.123259538 (216h42m41.554339689s) [upload=225393]: Done uploading segments...
Aug 17 18:08:47.123282932 (216h42m41.554363064s) [upload=225393]: Upload finished. err: <nil>
Duration: 1.913221741s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................X..........X.......................X..] duration:
6.193998037s
FAIL (2025-08-17 18:16:42 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e3c669dd55204f7b5f24e76de66f26b0b32fcaee1d002f66f9a71f88402c4059 != before 29144d26e3639887c8fdef546a48a0f8e667f0c56ab03e64da9d3f5859af83e9
======LOGS======
Aug 17 18:15:11.950084161 (216h49m6.381164292s) [upload=225505]: Starting upload
Aug 17 18:15:11.950147211 (216h49m6.381227342s) [upload=225505]: Done starting upload
Aug 17 18:15:11.950270628 (216h49m6.381350759s) [upload=225505]: Uploading segments...
Aug 17 18:15:11.950388223 (216h49m6.381468354s) [upload=225505]: Got next segment. Inline: false
Aug 17 18:15:11.950422809 (216h49m6.38150294s) [upload=225505]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:15:11.950427177 (216h49m6.381507308s) [upload=225505]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:15:12.579106285 (216h49m7.010186466s) [seg_pos={0 0}, upload=225505]: Begin upload segment...
Aug 17 18:15:12.579166019 (216h49m7.01024616s) [seg_pos={0 0}, upload=225505]: Done begin upload segment.
Aug 17 18:15:12.579201788 (216h49m7.01028194s) [noise=true , address=45.91.116.5:4320 , piece_id=NFGVUDRKWTKUKOQVAAHERUYV4LEEBATJVYMIQEWSUVIFRHG4V32Q, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.579213140 (216h49m7.010293271s) [noise=true , address=104.36.82.19:4426 , piece_id=BTXYB6RS6FWBCF5XVGHOQBHZERISDOFSKCCWOOPTGJW6OS72ZSOA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.579292321 (216h49m7.010372462s) [noise=true , address=104.36.82.60:4341 , piece_id=BWRRXXI6LYZMWGEMUZY44PJTL247ODGOPDLFYMZOHW3FR46QEO7Q, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.580094236 (216h49m7.011174357s) [noise=true , address=77.90.31.13:4653 , piece_id=U7P4FCI7AXOBEYK765VFYLFSLF6U37GPNN23OOPF6FHY3HQKKKTA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.580107291 (216h49m7.011187432s) [noise=true , address=104.36.82.34:4550 , piece_id=IF4XHUITSWGXKGQ2FPUA7Y2VPKJL2LVLOYQO2XNNBIIUFC4SLSEQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.580679757 (216h49m7.011759888s) [noise=true , address=45.91.116.14:4215 , piece_id=SGLWURGXWBGF6TO23Q7SRAZG2EIIARQXGJNSZQ26P52V5A4R6WTQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.580686469 (216h49m7.01176661s) [noise=true , address=104.36.82.39:4737 , piece_id=4LD7YPXEF65SBQOVD2YKZRK6JG35BO2SNTOKB5VYGS7WXDJRGCLQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.581206274 (216h49m7.012286395s) [noise=true , address=104.36.82.17:4361 , piece_id=X4UBCWOE4VHY5FV2MDYYKON3XT5OEAQANDU642ML4YACG4VXM5DA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.581231973 (216h49m7.012312124s) [noise=true , address=104.36.82.62:4422 , piece_id=B4IWM2JI3I25WKXMLMOEWG3KJRRL6SK3TWOOO2KGUVICHTLOAECQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.581722792 (216h49m7.012802943s) [noise=true , address=104.36.82.44:4895 , piece_id=RKP7DLAOG74KFFCX3UZVYFJ2E3SAZ6M3TJ2QX3Z3BOKR62IONWKQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.581743511 (216h49m7.012823642s) [noise=true , address=104.36.82.3:4787 , piece_id=TGWWHAUZ33L6Z3HZKPRGPTBUQIAX4ITC6C74IOINHFKVPPCRAGEQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.582246374 (216h49m7.013326505s) [noise=true , address=77.90.31.16:4754 , piece_id=DSLKK6HE2DMBZBSUITH4KT7X7Q3NW5J6BBUISYZICZD33QRBAL2A, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.582380290 (216h49m7.013460431s) [noise=true , address=104.36.82.18:4369 , piece_id=F6AGTMSFKB3Z7YUPGVIWHJT4JCB7JXFKU42KBIXQ3VZW6A3IJWEQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.582635148 (216h49m7.013715289s) [noise=true , address=77.90.31.18:4835 , piece_id=QL5WXJMJBGSVGZGVTRWW4TCFMW53PJOWOZSHZ5GOPZ3IYSKNB5AQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.582941864 (216h49m7.014021995s) [noise=true , address=45.91.116.11:4125 , piece_id=247MGOOGJL3X7QWQGE7BOKHFH2FSQUREICJP3K3W23ZJ7TSK3OEQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.583683133 (216h49m7.014763274s) [noise=true , address=77.90.31.11:4557 , piece_id=PLL7RR6CQXRFMQOPGGF62GHC74S7KM3QYBQEBFEX4MSUWNJYNUFQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.584594707 (216h49m7.015674838s) [noise=true , address=45.91.116.7:4042 , piece_id=5LCUCTVTCL2GKKEZBNWWLNVAPLZCB7E3MSPSJBN4IZ3MIH7ZTHBA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.585175829 (216h49m7.01625596s) [noise=true , address=66.23.193.175:4554 , piece_id=SZ2VXXRXNE2CLKP4F5F7NG437NAJS66VZR25TILCCIDQ5G6SYLJA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:13.719907003 (216h49m8.150987124s) [upload=225505]: Next returned nil segment
Aug 17 18:15:13.719923554 (216h49m8.151003675s) [upload=225505]: Waiting for error group managing segments...
Aug 17 18:15:14.020809928 (216h49m8.451890059s) [noise=true , address=66.23.193.175:4554 , piece_id=SZ2VXXRXNE2CLKP4F5F7NG437NAJS66VZR25TILCCIDQ5G6SYLJA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.489372190 (216h49m8.920452321s) [noise=true , address=77.90.31.11:4557 , piece_id=PLL7RR6CQXRFMQOPGGF62GHC74S7KM3QYBQEBFEX4MSUWNJYNUFQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.536661843 (216h49m8.967741974s) [noise=true , address=45.91.116.11:4125 , piece_id=247MGOOGJL3X7QWQGE7BOKHFH2FSQUREICJP3K3W23ZJ7TSK3OEQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.564142234 (216h49m8.995222365s) [noise=true , address=45.91.116.7:4042 , piece_id=5LCUCTVTCL2GKKEZBNWWLNVAPLZCB7E3MSPSJBN4IZ3MIH7ZTHBA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.585454222 (216h49m9.016534353s) [noise=true , address=104.36.82.34:4550 , piece_id=IF4XHUITSWGXKGQ2FPUA7Y2VPKJL2LVLOYQO2XNNBIIUFC4SLSEQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.614718947 (216h49m9.045799068s) [noise=true , address=45.91.116.14:4215 , piece_id=SGLWURGXWBGF6TO23Q7SRAZG2EIIARQXGJNSZQ26P52V5A4R6WTQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.652116153 (216h49m9.083196284s) [noise=true , address=104.36.82.3:4787 , piece_id=TGWWHAUZ33L6Z3HZKPRGPTBUQIAX4ITC6C74IOINHFKVPPCRAGEQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.659379391 (216h49m9.090459512s) [noise=true , address=45.91.116.5:4320 , piece_id=NFGVUDRKWTKUKOQVAAHERUYV4LEEBATJVYMIQEWSUVIFRHG4V32Q, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.675028293 (216h49m9.106108424s) [noise=true , address=77.90.31.16:4754 , piece_id=DSLKK6HE2DMBZBSUITH4KT7X7Q3NW5J6BBUISYZICZD33QRBAL2A, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.704456751 (216h49m9.135536882s) [noise=true , address=104.36.82.19:4426 , piece_id=BTXYB6RS6FWBCF5XVGHOQBHZERISDOFSKCCWOOPTGJW6OS72ZSOA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.736757545 (216h49m9.167837666s) [noise=true , address=77.90.31.18:4835 , piece_id=QL5WXJMJBGSVGZGVTRWW4TCFMW53PJOWOZSHZ5GOPZ3IYSKNB5AQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.756095466 (216h49m9.187175597s) [noise=true , address=104.36.82.17:4361 , piece_id=X4UBCWOE4VHY5FV2MDYYKON3XT5OEAQANDU642ML4YACG4VXM5DA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.771064187 (216h49m9.202144308s) [noise=true , address=104.36.82.44:4895 , piece_id=RKP7DLAOG74KFFCX3UZVYFJ2E3SAZ6M3TJ2QX3Z3BOKR62IONWKQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.772398840 (216h49m9.203478971s) [noise=true , address=104.36.82.39:4737 , piece_id=4LD7YPXEF65SBQOVD2YKZRK6JG35BO2SNTOKB5VYGS7WXDJRGCLQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.772410603 (216h49m9.203490724s) [seg_pos={0 0}, upload=225505]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:15:14.772492420 (216h49m9.203572551s) [noise=true , address=104.36.82.18:4369 , piece_id=F6AGTMSFKB3Z7YUPGVIWHJT4JCB7JXFKU42KBIXQ3VZW6A3IJWEQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF
Aug 17 18:15:14.772674999 (216h49m9.20375512s) [noise=true , address=104.36.82.62:4422 , piece_id=B4IWM2JI3I25WKXMLMOEWG3KJRRL6SK3TWOOO2KGUVICHTLOAECQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12R4NKBjmChQ2wFrgn97FLVBMZSEsD14pXxuwze9QFnXVxumHd2): protocol: expected piece hash; context canceled; EOF
Aug 17 18:15:14.772711589 (216h49m9.20379172s) [noise=true , address=77.90.31.13:4653 , piece_id=U7P4FCI7AXOBEYK765VFYLFSLF6U37GPNN23OOPF6FHY3HQKKKTA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eaTnUhynF1XeuvMr68SjMyYKM9rLj5tShzpViHcMSjvMs9EBF): protocol: rpc: dial tcp 77.90.31.13:4653: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 18:15:14.772742268 (216h49m9.203822399s) [noise=true , address=104.36.82.60:4341 , piece_id=BWRRXXI6LYZMWGEMUZY44PJTL247ODGOPDLFYMZOHW3FR46QEO7Q, seg_pos={0 0}, upload=225505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 17 18:15:14.772762195 (216h49m9.203842326s) [seg_pos={0 0}, upload=225505]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:15:14.772817241 (216h49m9.203897372s) [upload=225505]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:15:14.772821249 (216h49m9.20390138s) [upload=225505]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:15:15.280022201 (216h49m9.711102333s) [upload=225505]: Done uploading segments...
Aug 17 18:15:15.280040105 (216h49m9.711120236s) [upload=225505]: Upload finished. err: <nil>
Duration: 6.194039316s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................X..........X.......................X.] duration:
6.859982218s
FAIL (2025-08-17 18:15:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e3c669dd55204f7b5f24e76de66f26b0b32fcaee1d002f66f9a71f88402c4059 != before 29144d26e3639887c8fdef546a48a0f8e667f0c56ab03e64da9d3f5859af83e9
======LOGS======
Aug 17 18:15:11.950084161 (216h49m6.381164292s) [upload=225505]: Starting upload
Aug 17 18:15:11.950147211 (216h49m6.381227342s) [upload=225505]: Done starting upload
Aug 17 18:15:11.950270628 (216h49m6.381350759s) [upload=225505]: Uploading segments...
Aug 17 18:15:11.950388223 (216h49m6.381468354s) [upload=225505]: Got next segment. Inline: false
Aug 17 18:15:11.950422809 (216h49m6.38150294s) [upload=225505]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:15:11.950427177 (216h49m6.381507308s) [upload=225505]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:15:12.579106285 (216h49m7.010186466s) [seg_pos={0 0}, upload=225505]: Begin upload segment...
Aug 17 18:15:12.579166019 (216h49m7.01024616s) [seg_pos={0 0}, upload=225505]: Done begin upload segment.
Aug 17 18:15:12.579201788 (216h49m7.01028194s) [noise=true , address=45.91.116.5:4320 , piece_id=NFGVUDRKWTKUKOQVAAHERUYV4LEEBATJVYMIQEWSUVIFRHG4V32Q, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.579213140 (216h49m7.010293271s) [noise=true , address=104.36.82.19:4426 , piece_id=BTXYB6RS6FWBCF5XVGHOQBHZERISDOFSKCCWOOPTGJW6OS72ZSOA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.579292321 (216h49m7.010372462s) [noise=true , address=104.36.82.60:4341 , piece_id=BWRRXXI6LYZMWGEMUZY44PJTL247ODGOPDLFYMZOHW3FR46QEO7Q, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.580094236 (216h49m7.011174357s) [noise=true , address=77.90.31.13:4653 , piece_id=U7P4FCI7AXOBEYK765VFYLFSLF6U37GPNN23OOPF6FHY3HQKKKTA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.580107291 (216h49m7.011187432s) [noise=true , address=104.36.82.34:4550 , piece_id=IF4XHUITSWGXKGQ2FPUA7Y2VPKJL2LVLOYQO2XNNBIIUFC4SLSEQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.580679757 (216h49m7.011759888s) [noise=true , address=45.91.116.14:4215 , piece_id=SGLWURGXWBGF6TO23Q7SRAZG2EIIARQXGJNSZQ26P52V5A4R6WTQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.580686469 (216h49m7.01176661s) [noise=true , address=104.36.82.39:4737 , piece_id=4LD7YPXEF65SBQOVD2YKZRK6JG35BO2SNTOKB5VYGS7WXDJRGCLQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.581206274 (216h49m7.012286395s) [noise=true , address=104.36.82.17:4361 , piece_id=X4UBCWOE4VHY5FV2MDYYKON3XT5OEAQANDU642ML4YACG4VXM5DA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.581231973 (216h49m7.012312124s) [noise=true , address=104.36.82.62:4422 , piece_id=B4IWM2JI3I25WKXMLMOEWG3KJRRL6SK3TWOOO2KGUVICHTLOAECQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.581722792 (216h49m7.012802943s) [noise=true , address=104.36.82.44:4895 , piece_id=RKP7DLAOG74KFFCX3UZVYFJ2E3SAZ6M3TJ2QX3Z3BOKR62IONWKQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.581743511 (216h49m7.012823642s) [noise=true , address=104.36.82.3:4787 , piece_id=TGWWHAUZ33L6Z3HZKPRGPTBUQIAX4ITC6C74IOINHFKVPPCRAGEQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.582246374 (216h49m7.013326505s) [noise=true , address=77.90.31.16:4754 , piece_id=DSLKK6HE2DMBZBSUITH4KT7X7Q3NW5J6BBUISYZICZD33QRBAL2A, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.582380290 (216h49m7.013460431s) [noise=true , address=104.36.82.18:4369 , piece_id=F6AGTMSFKB3Z7YUPGVIWHJT4JCB7JXFKU42KBIXQ3VZW6A3IJWEQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.582635148 (216h49m7.013715289s) [noise=true , address=77.90.31.18:4835 , piece_id=QL5WXJMJBGSVGZGVTRWW4TCFMW53PJOWOZSHZ5GOPZ3IYSKNB5AQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.582941864 (216h49m7.014021995s) [noise=true , address=45.91.116.11:4125 , piece_id=247MGOOGJL3X7QWQGE7BOKHFH2FSQUREICJP3K3W23ZJ7TSK3OEQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.583683133 (216h49m7.014763274s) [noise=true , address=77.90.31.11:4557 , piece_id=PLL7RR6CQXRFMQOPGGF62GHC74S7KM3QYBQEBFEX4MSUWNJYNUFQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.584594707 (216h49m7.015674838s) [noise=true , address=45.91.116.7:4042 , piece_id=5LCUCTVTCL2GKKEZBNWWLNVAPLZCB7E3MSPSJBN4IZ3MIH7ZTHBA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.585175829 (216h49m7.01625596s) [noise=true , address=66.23.193.175:4554 , piece_id=SZ2VXXRXNE2CLKP4F5F7NG437NAJS66VZR25TILCCIDQ5G6SYLJA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:13.719907003 (216h49m8.150987124s) [upload=225505]: Next returned nil segment
Aug 17 18:15:13.719923554 (216h49m8.151003675s) [upload=225505]: Waiting for error group managing segments...
Aug 17 18:15:14.020809928 (216h49m8.451890059s) [noise=true , address=66.23.193.175:4554 , piece_id=SZ2VXXRXNE2CLKP4F5F7NG437NAJS66VZR25TILCCIDQ5G6SYLJA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.489372190 (216h49m8.920452321s) [noise=true , address=77.90.31.11:4557 , piece_id=PLL7RR6CQXRFMQOPGGF62GHC74S7KM3QYBQEBFEX4MSUWNJYNUFQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.536661843 (216h49m8.967741974s) [noise=true , address=45.91.116.11:4125 , piece_id=247MGOOGJL3X7QWQGE7BOKHFH2FSQUREICJP3K3W23ZJ7TSK3OEQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.564142234 (216h49m8.995222365s) [noise=true , address=45.91.116.7:4042 , piece_id=5LCUCTVTCL2GKKEZBNWWLNVAPLZCB7E3MSPSJBN4IZ3MIH7ZTHBA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.585454222 (216h49m9.016534353s) [noise=true , address=104.36.82.34:4550 , piece_id=IF4XHUITSWGXKGQ2FPUA7Y2VPKJL2LVLOYQO2XNNBIIUFC4SLSEQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.614718947 (216h49m9.045799068s) [noise=true , address=45.91.116.14:4215 , piece_id=SGLWURGXWBGF6TO23Q7SRAZG2EIIARQXGJNSZQ26P52V5A4R6WTQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.652116153 (216h49m9.083196284s) [noise=true , address=104.36.82.3:4787 , piece_id=TGWWHAUZ33L6Z3HZKPRGPTBUQIAX4ITC6C74IOINHFKVPPCRAGEQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.659379391 (216h49m9.090459512s) [noise=true , address=45.91.116.5:4320 , piece_id=NFGVUDRKWTKUKOQVAAHERUYV4LEEBATJVYMIQEWSUVIFRHG4V32Q, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.675028293 (216h49m9.106108424s) [noise=true , address=77.90.31.16:4754 , piece_id=DSLKK6HE2DMBZBSUITH4KT7X7Q3NW5J6BBUISYZICZD33QRBAL2A, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.704456751 (216h49m9.135536882s) [noise=true , address=104.36.82.19:4426 , piece_id=BTXYB6RS6FWBCF5XVGHOQBHZERISDOFSKCCWOOPTGJW6OS72ZSOA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.736757545 (216h49m9.167837666s) [noise=true , address=77.90.31.18:4835 , piece_id=QL5WXJMJBGSVGZGVTRWW4TCFMW53PJOWOZSHZ5GOPZ3IYSKNB5AQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.756095466 (216h49m9.187175597s) [noise=true , address=104.36.82.17:4361 , piece_id=X4UBCWOE4VHY5FV2MDYYKON3XT5OEAQANDU642ML4YACG4VXM5DA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.771064187 (216h49m9.202144308s) [noise=true , address=104.36.82.44:4895 , piece_id=RKP7DLAOG74KFFCX3UZVYFJ2E3SAZ6M3TJ2QX3Z3BOKR62IONWKQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.772398840 (216h49m9.203478971s) [noise=true , address=104.36.82.39:4737 , piece_id=4LD7YPXEF65SBQOVD2YKZRK6JG35BO2SNTOKB5VYGS7WXDJRGCLQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.772410603 (216h49m9.203490724s) [seg_pos={0 0}, upload=225505]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:15:14.772492420 (216h49m9.203572551s) [noise=true , address=104.36.82.18:4369 , piece_id=F6AGTMSFKB3Z7YUPGVIWHJT4JCB7JXFKU42KBIXQ3VZW6A3IJWEQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF
Aug 17 18:15:14.772674999 (216h49m9.20375512s) [noise=true , address=104.36.82.62:4422 , piece_id=B4IWM2JI3I25WKXMLMOEWG3KJRRL6SK3TWOOO2KGUVICHTLOAECQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12R4NKBjmChQ2wFrgn97FLVBMZSEsD14pXxuwze9QFnXVxumHd2): protocol: expected piece hash; context canceled; EOF
Aug 17 18:15:14.772711589 (216h49m9.20379172s) [noise=true , address=77.90.31.13:4653 , piece_id=U7P4FCI7AXOBEYK765VFYLFSLF6U37GPNN23OOPF6FHY3HQKKKTA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eaTnUhynF1XeuvMr68SjMyYKM9rLj5tShzpViHcMSjvMs9EBF): protocol: rpc: dial tcp 77.90.31.13:4653: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 18:15:14.772742268 (216h49m9.203822399s) [noise=true , address=104.36.82.60:4341 , piece_id=BWRRXXI6LYZMWGEMUZY44PJTL247ODGOPDLFYMZOHW3FR46QEO7Q, seg_pos={0 0}, upload=225505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 17 18:15:14.772762195 (216h49m9.203842326s) [seg_pos={0 0}, upload=225505]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:15:14.772817241 (216h49m9.203897372s) [upload=225505]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:15:14.772821249 (216h49m9.20390138s) [upload=225505]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:15:15.280022201 (216h49m9.711102333s) [upload=225505]: Done uploading segments...
Aug 17 18:15:15.280040105 (216h49m9.711120236s) [upload=225505]: Upload finished. err: <nil>
Duration: 6.860005923s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..............................X...........XX......X.X.......] duration:
1.910406173s
FAIL (2025-08-17 18:15:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:08:46.337202054 (216h42m40.768282185s) [upload=225393]: Starting upload
Aug 17 18:08:46.337258151 (216h42m40.768338282s) [upload=225393]: Done starting upload
Aug 17 18:08:46.337301744 (216h42m40.768381875s) [upload=225393]: Uploading segments...
Aug 17 18:08:46.337332453 (216h42m40.768412584s) [upload=225393]: Got next segment. Inline: true
Aug 17 18:08:46.337336221 (216h42m40.768416352s) [upload=225393]: Waiting for error group managing segments...
Aug 17 18:08:46.337367711 (216h42m40.768447832s) [upload=225393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:46.337371488 (216h42m40.768451609s) [upload=225393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:08:46.337373882 (216h42m40.768454013s) [upload=225393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:47.123259538 (216h42m41.554339689s) [upload=225393]: Done uploading segments...
Aug 17 18:08:47.123282932 (216h42m41.554363064s) [upload=225393]: Upload finished. err: <nil>
Duration: 1.91042635s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X..........X.......................X] duration:
6.603541862s
FAIL (2025-08-17 18:15:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e3c669dd55204f7b5f24e76de66f26b0b32fcaee1d002f66f9a71f88402c4059 != before 29144d26e3639887c8fdef546a48a0f8e667f0c56ab03e64da9d3f5859af83e9
======LOGS======
Aug 17 18:15:11.950084161 (216h49m6.381164292s) [upload=225505]: Starting upload
Aug 17 18:15:11.950147211 (216h49m6.381227342s) [upload=225505]: Done starting upload
Aug 17 18:15:11.950270628 (216h49m6.381350759s) [upload=225505]: Uploading segments...
Aug 17 18:15:11.950388223 (216h49m6.381468354s) [upload=225505]: Got next segment. Inline: false
Aug 17 18:15:11.950422809 (216h49m6.38150294s) [upload=225505]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:15:11.950427177 (216h49m6.381507308s) [upload=225505]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:15:12.579106285 (216h49m7.010186466s) [seg_pos={0 0}, upload=225505]: Begin upload segment...
Aug 17 18:15:12.579166019 (216h49m7.01024616s) [seg_pos={0 0}, upload=225505]: Done begin upload segment.
Aug 17 18:15:12.579201788 (216h49m7.01028194s) [noise=true , address=45.91.116.5:4320 , piece_id=NFGVUDRKWTKUKOQVAAHERUYV4LEEBATJVYMIQEWSUVIFRHG4V32Q, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.579213140 (216h49m7.010293271s) [noise=true , address=104.36.82.19:4426 , piece_id=BTXYB6RS6FWBCF5XVGHOQBHZERISDOFSKCCWOOPTGJW6OS72ZSOA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.579292321 (216h49m7.010372462s) [noise=true , address=104.36.82.60:4341 , piece_id=BWRRXXI6LYZMWGEMUZY44PJTL247ODGOPDLFYMZOHW3FR46QEO7Q, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.580094236 (216h49m7.011174357s) [noise=true , address=77.90.31.13:4653 , piece_id=U7P4FCI7AXOBEYK765VFYLFSLF6U37GPNN23OOPF6FHY3HQKKKTA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.580107291 (216h49m7.011187432s) [noise=true , address=104.36.82.34:4550 , piece_id=IF4XHUITSWGXKGQ2FPUA7Y2VPKJL2LVLOYQO2XNNBIIUFC4SLSEQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.580679757 (216h49m7.011759888s) [noise=true , address=45.91.116.14:4215 , piece_id=SGLWURGXWBGF6TO23Q7SRAZG2EIIARQXGJNSZQ26P52V5A4R6WTQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.580686469 (216h49m7.01176661s) [noise=true , address=104.36.82.39:4737 , piece_id=4LD7YPXEF65SBQOVD2YKZRK6JG35BO2SNTOKB5VYGS7WXDJRGCLQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.581206274 (216h49m7.012286395s) [noise=true , address=104.36.82.17:4361 , piece_id=X4UBCWOE4VHY5FV2MDYYKON3XT5OEAQANDU642ML4YACG4VXM5DA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.581231973 (216h49m7.012312124s) [noise=true , address=104.36.82.62:4422 , piece_id=B4IWM2JI3I25WKXMLMOEWG3KJRRL6SK3TWOOO2KGUVICHTLOAECQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.581722792 (216h49m7.012802943s) [noise=true , address=104.36.82.44:4895 , piece_id=RKP7DLAOG74KFFCX3UZVYFJ2E3SAZ6M3TJ2QX3Z3BOKR62IONWKQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.581743511 (216h49m7.012823642s) [noise=true , address=104.36.82.3:4787 , piece_id=TGWWHAUZ33L6Z3HZKPRGPTBUQIAX4ITC6C74IOINHFKVPPCRAGEQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.582246374 (216h49m7.013326505s) [noise=true , address=77.90.31.16:4754 , piece_id=DSLKK6HE2DMBZBSUITH4KT7X7Q3NW5J6BBUISYZICZD33QRBAL2A, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.582380290 (216h49m7.013460431s) [noise=true , address=104.36.82.18:4369 , piece_id=F6AGTMSFKB3Z7YUPGVIWHJT4JCB7JXFKU42KBIXQ3VZW6A3IJWEQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.582635148 (216h49m7.013715289s) [noise=true , address=77.90.31.18:4835 , piece_id=QL5WXJMJBGSVGZGVTRWW4TCFMW53PJOWOZSHZ5GOPZ3IYSKNB5AQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.582941864 (216h49m7.014021995s) [noise=true , address=45.91.116.11:4125 , piece_id=247MGOOGJL3X7QWQGE7BOKHFH2FSQUREICJP3K3W23ZJ7TSK3OEQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.583683133 (216h49m7.014763274s) [noise=true , address=77.90.31.11:4557 , piece_id=PLL7RR6CQXRFMQOPGGF62GHC74S7KM3QYBQEBFEX4MSUWNJYNUFQ, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.584594707 (216h49m7.015674838s) [noise=true , address=45.91.116.7:4042 , piece_id=5LCUCTVTCL2GKKEZBNWWLNVAPLZCB7E3MSPSJBN4IZ3MIH7ZTHBA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:12.585175829 (216h49m7.01625596s) [noise=true , address=66.23.193.175:4554 , piece_id=SZ2VXXRXNE2CLKP4F5F7NG437NAJS66VZR25TILCCIDQ5G6SYLJA, seg_pos={0 0}, upload=225505]: Uploading piece...
Aug 17 18:15:13.719907003 (216h49m8.150987124s) [upload=225505]: Next returned nil segment
Aug 17 18:15:13.719923554 (216h49m8.151003675s) [upload=225505]: Waiting for error group managing segments...
Aug 17 18:15:14.020809928 (216h49m8.451890059s) [noise=true , address=66.23.193.175:4554 , piece_id=SZ2VXXRXNE2CLKP4F5F7NG437NAJS66VZR25TILCCIDQ5G6SYLJA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.489372190 (216h49m8.920452321s) [noise=true , address=77.90.31.11:4557 , piece_id=PLL7RR6CQXRFMQOPGGF62GHC74S7KM3QYBQEBFEX4MSUWNJYNUFQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.536661843 (216h49m8.967741974s) [noise=true , address=45.91.116.11:4125 , piece_id=247MGOOGJL3X7QWQGE7BOKHFH2FSQUREICJP3K3W23ZJ7TSK3OEQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.564142234 (216h49m8.995222365s) [noise=true , address=45.91.116.7:4042 , piece_id=5LCUCTVTCL2GKKEZBNWWLNVAPLZCB7E3MSPSJBN4IZ3MIH7ZTHBA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.585454222 (216h49m9.016534353s) [noise=true , address=104.36.82.34:4550 , piece_id=IF4XHUITSWGXKGQ2FPUA7Y2VPKJL2LVLOYQO2XNNBIIUFC4SLSEQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.614718947 (216h49m9.045799068s) [noise=true , address=45.91.116.14:4215 , piece_id=SGLWURGXWBGF6TO23Q7SRAZG2EIIARQXGJNSZQ26P52V5A4R6WTQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.652116153 (216h49m9.083196284s) [noise=true , address=104.36.82.3:4787 , piece_id=TGWWHAUZ33L6Z3HZKPRGPTBUQIAX4ITC6C74IOINHFKVPPCRAGEQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.659379391 (216h49m9.090459512s) [noise=true , address=45.91.116.5:4320 , piece_id=NFGVUDRKWTKUKOQVAAHERUYV4LEEBATJVYMIQEWSUVIFRHG4V32Q, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.675028293 (216h49m9.106108424s) [noise=true , address=77.90.31.16:4754 , piece_id=DSLKK6HE2DMBZBSUITH4KT7X7Q3NW5J6BBUISYZICZD33QRBAL2A, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.704456751 (216h49m9.135536882s) [noise=true , address=104.36.82.19:4426 , piece_id=BTXYB6RS6FWBCF5XVGHOQBHZERISDOFSKCCWOOPTGJW6OS72ZSOA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.736757545 (216h49m9.167837666s) [noise=true , address=77.90.31.18:4835 , piece_id=QL5WXJMJBGSVGZGVTRWW4TCFMW53PJOWOZSHZ5GOPZ3IYSKNB5AQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.756095466 (216h49m9.187175597s) [noise=true , address=104.36.82.17:4361 , piece_id=X4UBCWOE4VHY5FV2MDYYKON3XT5OEAQANDU642ML4YACG4VXM5DA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.771064187 (216h49m9.202144308s) [noise=true , address=104.36.82.44:4895 , piece_id=RKP7DLAOG74KFFCX3UZVYFJ2E3SAZ6M3TJ2QX3Z3BOKR62IONWKQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.772398840 (216h49m9.203478971s) [noise=true , address=104.36.82.39:4737 , piece_id=4LD7YPXEF65SBQOVD2YKZRK6JG35BO2SNTOKB5VYGS7WXDJRGCLQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: <nil>
Aug 17 18:15:14.772410603 (216h49m9.203490724s) [seg_pos={0 0}, upload=225505]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:15:14.772492420 (216h49m9.203572551s) [noise=true , address=104.36.82.18:4369 , piece_id=F6AGTMSFKB3Z7YUPGVIWHJT4JCB7JXFKU42KBIXQ3VZW6A3IJWEQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF
Aug 17 18:15:14.772674999 (216h49m9.20375512s) [noise=true , address=104.36.82.62:4422 , piece_id=B4IWM2JI3I25WKXMLMOEWG3KJRRL6SK3TWOOO2KGUVICHTLOAECQ, seg_pos={0 0}, upload=225505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12R4NKBjmChQ2wFrgn97FLVBMZSEsD14pXxuwze9QFnXVxumHd2): protocol: expected piece hash; context canceled; EOF
Aug 17 18:15:14.772711589 (216h49m9.20379172s) [noise=true , address=77.90.31.13:4653 , piece_id=U7P4FCI7AXOBEYK765VFYLFSLF6U37GPNN23OOPF6FHY3HQKKKTA, seg_pos={0 0}, upload=225505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eaTnUhynF1XeuvMr68SjMyYKM9rLj5tShzpViHcMSjvMs9EBF): protocol: rpc: dial tcp 77.90.31.13:4653: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 18:15:14.772742268 (216h49m9.203822399s) [noise=true , address=104.36.82.60:4341 , piece_id=BWRRXXI6LYZMWGEMUZY44PJTL247ODGOPDLFYMZOHW3FR46QEO7Q, seg_pos={0 0}, upload=225505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 17 18:15:14.772762195 (216h49m9.203842326s) [seg_pos={0 0}, upload=225505]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:15:14.772817241 (216h49m9.203897372s) [upload=225505]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:15:14.772821249 (216h49m9.20390138s) [upload=225505]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:15:15.280022201 (216h49m9.711102333s) [upload=225505]: Done uploading segments...
Aug 17 18:15:15.280040105 (216h49m9.711120236s) [upload=225505]: Upload finished. err: <nil>
Duration: 6.603573684s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X..........X.......................] duration:
6.407460499s
FAIL (2025-08-17 18:14:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:56:47.083222149 (216h30m41.51430228s) [upload=225182]: Starting upload Aug 17 17:56:47.083272546 (216h30m41.514352677s) [upload=225182]: Done starting upload Aug 17 17:56:47.083340405 (216h30m41.514420526s) [upload=225182]: Uploading segments... Aug 17 17:56:47.083485533 (216h30m41.514565664s) [upload=225182]: Got next segment. Inline: false Aug 17 17:56:47.083515451 (216h30m41.514595582s) [upload=225182]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:56:47.083519879 (216h30m41.51460001s) [upload=225182]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 17:56:47.299486989 (216h30m41.73056712s) [upload=225182]: Next segment err: metaclient: Too Many Requests Aug 17 17:56:47.299530673 (216h30m41.730610804s) [upload=225182]: Done uploading segments... Aug 17 17:56:47.299544951 (216h30m41.730625072s) [upload=225182]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.407482862s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [X..............................X...........XX......X.X......] duration:
3.084239955s
FAIL (2025-08-17 18:14:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:08:46.337202054 (216h42m40.768282185s) [upload=225393]: Starting upload
Aug 17 18:08:46.337258151 (216h42m40.768338282s) [upload=225393]: Done starting upload
Aug 17 18:08:46.337301744 (216h42m40.768381875s) [upload=225393]: Uploading segments...
Aug 17 18:08:46.337332453 (216h42m40.768412584s) [upload=225393]: Got next segment. Inline: true
Aug 17 18:08:46.337336221 (216h42m40.768416352s) [upload=225393]: Waiting for error group managing segments...
Aug 17 18:08:46.337367711 (216h42m40.768447832s) [upload=225393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:46.337371488 (216h42m40.768451609s) [upload=225393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:08:46.337373882 (216h42m40.768454013s) [upload=225393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:47.123259538 (216h42m41.554339689s) [upload=225393]: Done uploading segments...
Aug 17 18:08:47.123282932 (216h42m41.554363064s) [upload=225393]: Upload finished. err: <nil>
Duration: 3.084267747s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.X..............................X...........XX......X.X.....] duration:
2.121289766s
FAIL (2025-08-17 18:13:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:08:46.337202054 (216h42m40.768282185s) [upload=225393]: Starting upload
Aug 17 18:08:46.337258151 (216h42m40.768338282s) [upload=225393]: Done starting upload
Aug 17 18:08:46.337301744 (216h42m40.768381875s) [upload=225393]: Uploading segments...
Aug 17 18:08:46.337332453 (216h42m40.768412584s) [upload=225393]: Got next segment. Inline: true
Aug 17 18:08:46.337336221 (216h42m40.768416352s) [upload=225393]: Waiting for error group managing segments...
Aug 17 18:08:46.337367711 (216h42m40.768447832s) [upload=225393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:46.337371488 (216h42m40.768451609s) [upload=225393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:08:46.337373882 (216h42m40.768454013s) [upload=225393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:47.123259538 (216h42m41.554339689s) [upload=225393]: Done uploading segments...
Aug 17 18:08:47.123282932 (216h42m41.554363064s) [upload=225393]: Upload finished. err: <nil>
Duration: 2.121316748s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|