Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...X...XX...........X.........X............X................] duration:
7.51861713s
FAIL (2025-08-19 15:39:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 15:26:16.621347641 (262h0m11.052427772s) [upload=272399]: Starting upload Aug 19 15:26:16.621414899 (262h0m11.05249503s) [upload=272399]: Done starting upload Aug 19 15:26:16.621551370 (262h0m11.052631501s) [upload=272399]: Uploading segments... Aug 19 15:26:16.621681680 (262h0m11.052761811s) [upload=272399]: Got next segment. Inline: false Aug 19 15:26:16.621718049 (262h0m11.05279818s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:26:16.621726976 (262h0m11.052807107s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 15:26:16.834357129 (262h0m11.26543726s) [upload=272399]: Next segment err: metaclient: Too Many Requests Aug 19 15:26:16.834376987 (262h0m11.265457118s) [upload=272399]: Done uploading segments... Aug 19 15:26:16.834397417 (262h0m11.265477548s) [upload=272399]: Upload finished. err: metaclient: Too Many Requests
Duration: 7.518647869s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X....XX......................................] duration:
1.848195791s
FAIL (2025-08-19 15:39:25 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 1.848235316s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X....XX.....................................] duration:
2.429117117s
FAIL (2025-08-19 15:38:56 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 2.429165278s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [X...X...XX...........X.........X............X...............] duration:
7.238022827s
FAIL (2025-08-19 15:38:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 15:26:16.621347641 (262h0m11.052427772s) [upload=272399]: Starting upload Aug 19 15:26:16.621414899 (262h0m11.05249503s) [upload=272399]: Done starting upload Aug 19 15:26:16.621551370 (262h0m11.052631501s) [upload=272399]: Uploading segments... Aug 19 15:26:16.621681680 (262h0m11.052761811s) [upload=272399]: Got next segment. Inline: false Aug 19 15:26:16.621718049 (262h0m11.05279818s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:26:16.621726976 (262h0m11.052807107s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 15:26:16.834357129 (262h0m11.26543726s) [upload=272399]: Next segment err: metaclient: Too Many Requests Aug 19 15:26:16.834376987 (262h0m11.265457118s) [upload=272399]: Done uploading segments... Aug 19 15:26:16.834397417 (262h0m11.265477548s) [upload=272399]: Upload finished. err: metaclient: Too Many Requests
Duration: 7.238048224s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X................X....XX....................................] duration:
1.938334219s
FAIL (2025-08-19 15:37:49 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 1.93836115s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [XX...X...XX...........X.........X............X..............] duration:
10.301003284s
FAIL (2025-08-19 15:37:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 15:26:16.621347641 (262h0m11.052427772s) [upload=272399]: Starting upload Aug 19 15:26:16.621414899 (262h0m11.05249503s) [upload=272399]: Done starting upload Aug 19 15:26:16.621551370 (262h0m11.052631501s) [upload=272399]: Uploading segments... Aug 19 15:26:16.621681680 (262h0m11.052761811s) [upload=272399]: Got next segment. Inline: false Aug 19 15:26:16.621718049 (262h0m11.05279818s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:26:16.621726976 (262h0m11.052807107s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 15:26:16.834357129 (262h0m11.26543726s) [upload=272399]: Next segment err: metaclient: Too Many Requests Aug 19 15:26:16.834376987 (262h0m11.265457118s) [upload=272399]: Done uploading segments... Aug 19 15:26:16.834397417 (262h0m11.265477548s) [upload=272399]: Upload finished. err: metaclient: Too Many Requests
Duration: 10.301031809s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X................X....XX...................................] duration:
1.969173109s
FAIL (2025-08-19 15:36:42 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 1.969198057s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [.XX...X...XX...........X.........X............X.............] duration:
6.163519093s
FAIL (2025-08-19 15:36:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 15:26:16.621347641 (262h0m11.052427772s) [upload=272399]: Starting upload Aug 19 15:26:16.621414899 (262h0m11.05249503s) [upload=272399]: Done starting upload Aug 19 15:26:16.621551370 (262h0m11.052631501s) [upload=272399]: Uploading segments... Aug 19 15:26:16.621681680 (262h0m11.052761811s) [upload=272399]: Got next segment. Inline: false Aug 19 15:26:16.621718049 (262h0m11.05279818s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:26:16.621726976 (262h0m11.052807107s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 15:26:16.834357129 (262h0m11.26543726s) [upload=272399]: Next segment err: metaclient: Too Many Requests Aug 19 15:26:16.834376987 (262h0m11.265457118s) [upload=272399]: Done uploading segments... Aug 19 15:26:16.834397417 (262h0m11.265477548s) [upload=272399]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.163545764s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X................X....XX..................................] duration:
2.090703425s
FAIL (2025-08-19 15:36:04 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 2.090749344s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [..XX...X...XX...........X.........X............X............] duration:
6.462922283s
FAIL (2025-08-19 15:35:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 15:26:16.621347641 (262h0m11.052427772s) [upload=272399]: Starting upload Aug 19 15:26:16.621414899 (262h0m11.05249503s) [upload=272399]: Done starting upload Aug 19 15:26:16.621551370 (262h0m11.052631501s) [upload=272399]: Uploading segments... Aug 19 15:26:16.621681680 (262h0m11.052761811s) [upload=272399]: Got next segment. Inline: false Aug 19 15:26:16.621718049 (262h0m11.05279818s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:26:16.621726976 (262h0m11.052807107s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 15:26:16.834357129 (262h0m11.26543726s) [upload=272399]: Next segment err: metaclient: Too Many Requests Aug 19 15:26:16.834376987 (262h0m11.265457118s) [upload=272399]: Done uploading segments... Aug 19 15:26:16.834397417 (262h0m11.265477548s) [upload=272399]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.462945907s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X................X....XX.................................] duration:
2.986712787s
FAIL (2025-08-19 15:35:32 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 2.986738116s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [...XX...X...XX...........X.........X............X...........] duration:
6.4337482s
FAIL (2025-08-19 15:35:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 15:26:16.621347641 (262h0m11.052427772s) [upload=272399]: Starting upload Aug 19 15:26:16.621414899 (262h0m11.05249503s) [upload=272399]: Done starting upload Aug 19 15:26:16.621551370 (262h0m11.052631501s) [upload=272399]: Uploading segments... Aug 19 15:26:16.621681680 (262h0m11.052761811s) [upload=272399]: Got next segment. Inline: false Aug 19 15:26:16.621718049 (262h0m11.05279818s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:26:16.621726976 (262h0m11.052807107s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 15:26:16.834357129 (262h0m11.26543726s) [upload=272399]: Next segment err: metaclient: Too Many Requests Aug 19 15:26:16.834376987 (262h0m11.265457118s) [upload=272399]: Done uploading segments... Aug 19 15:26:16.834397417 (262h0m11.265477548s) [upload=272399]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.433777987s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X................X....XX................................] duration:
2.062460585s
FAIL (2025-08-19 15:35:05 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 2.062497086s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [....XX...X...XX...........X.........X............X..........] duration:
6.301021368s
FAIL (2025-08-19 15:34:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 15:26:16.621347641 (262h0m11.052427772s) [upload=272399]: Starting upload Aug 19 15:26:16.621414899 (262h0m11.05249503s) [upload=272399]: Done starting upload Aug 19 15:26:16.621551370 (262h0m11.052631501s) [upload=272399]: Uploading segments... Aug 19 15:26:16.621681680 (262h0m11.052761811s) [upload=272399]: Got next segment. Inline: false Aug 19 15:26:16.621718049 (262h0m11.05279818s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:26:16.621726976 (262h0m11.052807107s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 15:26:16.834357129 (262h0m11.26543726s) [upload=272399]: Next segment err: metaclient: Too Many Requests Aug 19 15:26:16.834376987 (262h0m11.265457118s) [upload=272399]: Done uploading segments... Aug 19 15:26:16.834397417 (262h0m11.265477548s) [upload=272399]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.301051275s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [.....XX...X...XX...........X.........X............X.........] duration:
6.026509375s
FAIL (2025-08-19 15:34:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 15:26:16.621347641 (262h0m11.052427772s) [upload=272399]: Starting upload Aug 19 15:26:16.621414899 (262h0m11.05249503s) [upload=272399]: Done starting upload Aug 19 15:26:16.621551370 (262h0m11.052631501s) [upload=272399]: Uploading segments... Aug 19 15:26:16.621681680 (262h0m11.052761811s) [upload=272399]: Got next segment. Inline: false Aug 19 15:26:16.621718049 (262h0m11.05279818s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:26:16.621726976 (262h0m11.052807107s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 15:26:16.834357129 (262h0m11.26543726s) [upload=272399]: Next segment err: metaclient: Too Many Requests Aug 19 15:26:16.834376987 (262h0m11.265457118s) [upload=272399]: Done uploading segments... Aug 19 15:26:16.834397417 (262h0m11.265477548s) [upload=272399]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.026530266s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X................X....XX...............................] duration:
1.822320953s
FAIL (2025-08-19 15:34:18 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 1.822359198s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [......XX...X...XX...........X.........X............X........] duration:
6.114978597s
FAIL (2025-08-19 15:33:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 15:26:16.621347641 (262h0m11.052427772s) [upload=272399]: Starting upload Aug 19 15:26:16.621414899 (262h0m11.05249503s) [upload=272399]: Done starting upload Aug 19 15:26:16.621551370 (262h0m11.052631501s) [upload=272399]: Uploading segments... Aug 19 15:26:16.621681680 (262h0m11.052761811s) [upload=272399]: Got next segment. Inline: false Aug 19 15:26:16.621718049 (262h0m11.05279818s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:26:16.621726976 (262h0m11.052807107s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 15:26:16.834357129 (262h0m11.26543726s) [upload=272399]: Next segment err: metaclient: Too Many Requests Aug 19 15:26:16.834376987 (262h0m11.265457118s) [upload=272399]: Done uploading segments... Aug 19 15:26:16.834397417 (262h0m11.265477548s) [upload=272399]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.115005057s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X................X....XX..............................] duration:
1.852821627s
FAIL (2025-08-19 15:33:23 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 1.852858646s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [.......XX...X...XX...........X.........X............X.......] duration:
6.284735359s
FAIL (2025-08-19 15:33:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 15:26:16.621347641 (262h0m11.052427772s) [upload=272399]: Starting upload Aug 19 15:26:16.621414899 (262h0m11.05249503s) [upload=272399]: Done starting upload Aug 19 15:26:16.621551370 (262h0m11.052631501s) [upload=272399]: Uploading segments... Aug 19 15:26:16.621681680 (262h0m11.052761811s) [upload=272399]: Got next segment. Inline: false Aug 19 15:26:16.621718049 (262h0m11.05279818s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:26:16.621726976 (262h0m11.052807107s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 15:26:16.834357129 (262h0m11.26543726s) [upload=272399]: Next segment err: metaclient: Too Many Requests Aug 19 15:26:16.834376987 (262h0m11.265457118s) [upload=272399]: Done uploading segments... Aug 19 15:26:16.834397417 (262h0m11.265477548s) [upload=272399]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.28476203s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X................X....XX.............................] duration:
2.223315438s
FAIL (2025-08-19 15:32:44 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 2.223336948s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [........XX...X...XX...........X.........X............X......] duration:
5.999497169s
FAIL (2025-08-19 15:32:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 15:26:16.621347641 (262h0m11.052427772s) [upload=272399]: Starting upload Aug 19 15:26:16.621414899 (262h0m11.05249503s) [upload=272399]: Done starting upload Aug 19 15:26:16.621551370 (262h0m11.052631501s) [upload=272399]: Uploading segments... Aug 19 15:26:16.621681680 (262h0m11.052761811s) [upload=272399]: Got next segment. Inline: false Aug 19 15:26:16.621718049 (262h0m11.05279818s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:26:16.621726976 (262h0m11.052807107s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 15:26:16.834357129 (262h0m11.26543726s) [upload=272399]: Next segment err: metaclient: Too Many Requests Aug 19 15:26:16.834376987 (262h0m11.265457118s) [upload=272399]: Done uploading segments... Aug 19 15:26:16.834397417 (262h0m11.265477548s) [upload=272399]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.999521277s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X................X....XX............................] duration:
2.106708111s
FAIL (2025-08-19 15:31:52 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 2.106732396s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [.........XX...X...XX...........X.........X............X.....] duration:
6.296185685s
FAIL (2025-08-19 15:31:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 15:26:16.621347641 (262h0m11.052427772s) [upload=272399]: Starting upload Aug 19 15:26:16.621414899 (262h0m11.05249503s) [upload=272399]: Done starting upload Aug 19 15:26:16.621551370 (262h0m11.052631501s) [upload=272399]: Uploading segments... Aug 19 15:26:16.621681680 (262h0m11.052761811s) [upload=272399]: Got next segment. Inline: false Aug 19 15:26:16.621718049 (262h0m11.05279818s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:26:16.621726976 (262h0m11.052807107s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 15:26:16.834357129 (262h0m11.26543726s) [upload=272399]: Next segment err: metaclient: Too Many Requests Aug 19 15:26:16.834376987 (262h0m11.265457118s) [upload=272399]: Done uploading segments... Aug 19 15:26:16.834397417 (262h0m11.265477548s) [upload=272399]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.296205241s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [..........XX...X...XX...........X.........X............X....] duration:
6.399654784s
FAIL (2025-08-19 15:30:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 15:26:16.621347641 (262h0m11.052427772s) [upload=272399]: Starting upload Aug 19 15:26:16.621414899 (262h0m11.05249503s) [upload=272399]: Done starting upload Aug 19 15:26:16.621551370 (262h0m11.052631501s) [upload=272399]: Uploading segments... Aug 19 15:26:16.621681680 (262h0m11.052761811s) [upload=272399]: Got next segment. Inline: false Aug 19 15:26:16.621718049 (262h0m11.05279818s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:26:16.621726976 (262h0m11.052807107s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 15:26:16.834357129 (262h0m11.26543726s) [upload=272399]: Next segment err: metaclient: Too Many Requests Aug 19 15:26:16.834376987 (262h0m11.265457118s) [upload=272399]: Done uploading segments... Aug 19 15:26:16.834397417 (262h0m11.265477548s) [upload=272399]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.399678499s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X................X....XX...........................] duration:
1.912535412s
FAIL (2025-08-19 15:30:40 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 1.91255005s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X................X....XX..........................] duration:
1.854429442s
FAIL (2025-08-19 15:30:22 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 1.854455893s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X................X....XX.........................] duration:
1.963167395s
FAIL (2025-08-19 15:30:05 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 1.96320175s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [...........XX...X...XX...........X.........X............X...] duration:
6.126294384s
FAIL (2025-08-19 15:29:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 15:26:16.621347641 (262h0m11.052427772s) [upload=272399]: Starting upload Aug 19 15:26:16.621414899 (262h0m11.05249503s) [upload=272399]: Done starting upload Aug 19 15:26:16.621551370 (262h0m11.052631501s) [upload=272399]: Uploading segments... Aug 19 15:26:16.621681680 (262h0m11.052761811s) [upload=272399]: Got next segment. Inline: false Aug 19 15:26:16.621718049 (262h0m11.05279818s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:26:16.621726976 (262h0m11.052807107s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 15:26:16.834357129 (262h0m11.26543726s) [upload=272399]: Next segment err: metaclient: Too Many Requests Aug 19 15:26:16.834376987 (262h0m11.265457118s) [upload=272399]: Done uploading segments... Aug 19 15:26:16.834397417 (262h0m11.265477548s) [upload=272399]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.126318208s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X................X....XX........................] duration:
1.86905535s
FAIL (2025-08-19 15:29:19 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 1.869088214s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X............X................X....XX.......................] duration:
2.076555576s
FAIL (2025-08-19 15:28:38 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 2.076581395s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [............XX...X...XX...........X.........X............X..] duration:
6.15317808s
FAIL (2025-08-19 15:28:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 15:26:16.621347641 (262h0m11.052427772s) [upload=272399]: Starting upload Aug 19 15:26:16.621414899 (262h0m11.05249503s) [upload=272399]: Done starting upload Aug 19 15:26:16.621551370 (262h0m11.052631501s) [upload=272399]: Uploading segments... Aug 19 15:26:16.621681680 (262h0m11.052761811s) [upload=272399]: Got next segment. Inline: false Aug 19 15:26:16.621718049 (262h0m11.05279818s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:26:16.621726976 (262h0m11.052807107s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 15:26:16.834357129 (262h0m11.26543726s) [upload=272399]: Next segment err: metaclient: Too Many Requests Aug 19 15:26:16.834376987 (262h0m11.265457118s) [upload=272399]: Done uploading segments... Aug 19 15:26:16.834397417 (262h0m11.265477548s) [upload=272399]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.153212175s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [XX............X................X....XX......................] duration:
1.872811924s
FAIL (2025-08-19 15:27:56 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 1.872865165s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [.............XX...X...XX...........X.........X............X.] duration:
6.978978021s
FAIL (2025-08-19 15:27:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 15:26:16.621347641 (262h0m11.052427772s) [upload=272399]: Starting upload Aug 19 15:26:16.621414899 (262h0m11.05249503s) [upload=272399]: Done starting upload Aug 19 15:26:16.621551370 (262h0m11.052631501s) [upload=272399]: Uploading segments... Aug 19 15:26:16.621681680 (262h0m11.052761811s) [upload=272399]: Got next segment. Inline: false Aug 19 15:26:16.621718049 (262h0m11.05279818s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:26:16.621726976 (262h0m11.052807107s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 15:26:16.834357129 (262h0m11.26543726s) [upload=272399]: Next segment err: metaclient: Too Many Requests Aug 19 15:26:16.834376987 (262h0m11.265457118s) [upload=272399]: Done uploading segments... Aug 19 15:26:16.834397417 (262h0m11.265477548s) [upload=272399]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.979004794s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.XX............X................X....XX.....................] duration:
2.087085695s
FAIL (2025-08-19 15:26:42 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 2.087111755s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [..............XX...X...XX...........X.........X............X] duration:
856.772846ms
FAIL (2025-08-19 15:26:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 15:26:16.621347641 (262h0m11.052427772s) [upload=272399]: Starting upload Aug 19 15:26:16.621414899 (262h0m11.05249503s) [upload=272399]: Done starting upload Aug 19 15:26:16.621551370 (262h0m11.052631501s) [upload=272399]: Uploading segments... Aug 19 15:26:16.621681680 (262h0m11.052761811s) [upload=272399]: Got next segment. Inline: false Aug 19 15:26:16.621718049 (262h0m11.05279818s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:26:16.621726976 (262h0m11.052807107s) [upload=272399]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 15:26:16.834357129 (262h0m11.26543726s) [upload=272399]: Next segment err: metaclient: Too Many Requests Aug 19 15:26:16.834376987 (262h0m11.265457118s) [upload=272399]: Done uploading segments... Aug 19 15:26:16.834397417 (262h0m11.265477548s) [upload=272399]: Upload finished. err: metaclient: Too Many Requests
Duration: 856.799787ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [...............XX...X...XX...........X.........X............] duration:
6.10469436s
FAIL (2025-08-19 15:26:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 74cf1d8288b89f92a202eeac6422d061b61f5ccdcb161d2b7230426c38ae6018 != before a10a524abb8f34470d816a878c4740fc05a2a4ae9a4b3e6039a6b26ba0794cad
======LOGS======
Aug 19 15:15:40.160052396 (261h49m34.591132527s) [upload=272217]: Starting upload
Aug 19 15:15:40.160096681 (261h49m34.591176812s) [upload=272217]: Done starting upload
Aug 19 15:15:40.160161885 (261h49m34.591242016s) [upload=272217]: Uploading segments...
Aug 19 15:15:40.160363141 (261h49m34.591443262s) [upload=272217]: Got next segment. Inline: false
Aug 19 15:15:40.160756463 (261h49m34.591836594s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 15:15:40.160762465 (261h49m34.591842586s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 15:15:41.057528060 (261h49m35.488608231s) [seg_pos={0 0}, upload=272217]: Begin upload segment...
Aug 19 15:15:41.057589076 (261h49m35.488669207s) [seg_pos={0 0}, upload=272217]: Done begin upload segment.
Aug 19 15:15:41.057612461 (261h49m35.488692602s) [noise=true , address=79.127.219.38:4025 , piece_id=BASZ7JOMBIZVBHOXALHUUV7CVUALSTUCTBA2R2ODZNYK7OABXFCQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.057626778 (261h49m35.488706949s) [noise=true , address=104.36.82.12:4156 , piece_id=SVCFWJ74Z6GJEZSHY743AFWEFNTIP5JPKHC4LU4NEYT6PSAZYIQA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.058335164 (261h49m35.489415295s) [noise=true , address=66.23.193.175:4562 , piece_id=D3R4FTGGK6ZGUUKQN3LBX6BSRZXNS3LWNNY5J6VKKRMVRF3AF3FA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.058437159 (261h49m35.4895173s) [noise=true , address=77.90.31.11:4564 , piece_id=GOYROAJCALHKI3V52WDRQ4JVWG4SIZZNKJFGZF2PJKX3WM2KZA7Q, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059121228 (261h49m35.490201389s) [noise=true , address=104.36.82.60:4363 , piece_id=IN2OIQ56FNLQVLPU4HO2TBJPC545J7HSSKAYSOJNJYVO7ORFTD3A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059259663 (261h49m35.490339794s) [noise=true , address=77.90.31.19:4869 , piece_id=6RF3K4HAOQRWBELTOI4CM43O22BPL5QFZKXIH7KFPYGRXD4GKNUA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059594614 (261h49m35.490674745s) [noise=true , address=77.90.31.12:4595 , piece_id=3XCXGS7OJH2JA3SJPBGXG3PY7FYXCB6FWYEGZQTXKEAF6K6GRTGQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059640191 (261h49m35.490720322s) [noise=true , address=77.90.31.10:4541 , piece_id=NBMDP5MVJ2OWIWQOAH2CYIIOOG5SEQMGKRCVOUBUWYMAEFKDPWJQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059906039 (261h49m35.49098617s) [noise=true , address=104.36.82.23:4462 , piece_id=FCLJW4BLOHL4HTPB2UH3GDNWC7J23Q5N4FZGA3WUJO5BVXJQWZQQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060143233 (261h49m35.491223364s) [noise=true , address=45.91.116.6:4999 , piece_id=FSTOSV52TUVRCAM5AE2QZLE476LOORHQCWVJT3FZ6PDUW75XZWTQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060421215 (261h49m35.491501346s) [noise=true , address=77.90.31.17:4802 , piece_id=JNCEOZFZABN26HPHI534W3OJPUZPQLJTEABBJY5XRRYUEUWAPT2A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060658810 (261h49m35.491738941s) [noise=true , address=77.90.31.15:4717 , piece_id=U3IBZTYW3IGZA3FBQYX5P3VZRSZDZMJMEFWMOLZF2LPDPEZIE5BA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060840277 (261h49m35.491920408s) [noise=true , address=104.36.82.37:4653 , piece_id=PZEXDTWRC4HUMW73R6XQL6SBL6TDBDJAGWNVAPQERNDAUGK3L3IA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061092350 (261h49m35.492172481s) [noise=true , address=79.127.201.215:4345 , piece_id=U5ICQ7PLMA4XJ5WAZ5UXLPZE7C43TMDRERWHJSSIS3V67KIFWKEQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061222568 (261h49m35.492302689s) [noise=true , address=104.36.82.5:4843 , piece_id=NX4KKRG4R5UBWWHC5JNDBO3HPU34EC6R5OLYPL5APDMME5EDKZ5A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061457648 (261h49m35.492537769s) [noise=true , address=104.36.82.44:4873 , piece_id=NJ5IGY6HCYF7Q4EVTE4YTJ6UXVJV7ULVXRFEZAKAOZILMDRFLCZA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061549404 (261h49m35.492629535s) [noise=true , address=104.36.82.17:4351 , piece_id=3M6ZKAVKETYYCJWUXRAZX77YAW6DUZJ2C4TBYVSIC46BNQBHGLBA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061772120 (261h49m35.492852241s) [noise=true , address=45.91.116.12:4233 , piece_id=ZLUELTXZAKZVM23BB6YMQXNMHG7SBHHGPBRQAY65JGUZN75W744A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:42.223926388 (261h49m36.655006509s) [upload=272217]: Next returned nil segment
Aug 19 15:15:42.223946215 (261h49m36.655026346s) [upload=272217]: Waiting for error group managing segments...
Aug 19 15:15:42.540440708 (261h49m36.971520839s) [noise=true , address=66.23.193.175:4562 , piece_id=D3R4FTGGK6ZGUUKQN3LBX6BSRZXNS3LWNNY5J6VKKRMVRF3AF3FA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:42.946845408 (261h49m37.377925539s) [noise=true , address=79.127.219.38:4025 , piece_id=BASZ7JOMBIZVBHOXALHUUV7CVUALSTUCTBA2R2ODZNYK7OABXFCQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:42.985177514 (261h49m37.416257645s) [noise=true , address=104.36.82.12:4156 , piece_id=SVCFWJ74Z6GJEZSHY743AFWEFNTIP5JPKHC4LU4NEYT6PSAZYIQA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.017180800 (261h49m37.448260931s) [noise=true , address=104.36.82.23:4462 , piece_id=FCLJW4BLOHL4HTPB2UH3GDNWC7J23Q5N4FZGA3WUJO5BVXJQWZQQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.043667891 (261h49m37.474748052s) [noise=true , address=104.36.82.60:4363 , piece_id=IN2OIQ56FNLQVLPU4HO2TBJPC545J7HSSKAYSOJNJYVO7ORFTD3A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.047060473 (261h49m37.478140614s) [noise=true , address=79.127.201.215:4345 , piece_id=U5ICQ7PLMA4XJ5WAZ5UXLPZE7C43TMDRERWHJSSIS3V67KIFWKEQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.354414857 (261h49m37.785494988s) [noise=true , address=77.90.31.19:4869 , piece_id=6RF3K4HAOQRWBELTOI4CM43O22BPL5QFZKXIH7KFPYGRXD4GKNUA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.374343759 (261h49m37.80542389s) [noise=true , address=77.90.31.15:4717 , piece_id=U3IBZTYW3IGZA3FBQYX5P3VZRSZDZMJMEFWMOLZF2LPDPEZIE5BA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.560782768 (261h49m37.991862899s) [noise=true , address=45.91.116.6:4999 , piece_id=FSTOSV52TUVRCAM5AE2QZLE476LOORHQCWVJT3FZ6PDUW75XZWTQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.670237443 (261h49m38.101317574s) [noise=true , address=77.90.31.11:4564 , piece_id=GOYROAJCALHKI3V52WDRQ4JVWG4SIZZNKJFGZF2PJKX3WM2KZA7Q, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.671262815 (261h49m38.102342946s) [noise=true , address=77.90.31.17:4802 , piece_id=JNCEOZFZABN26HPHI534W3OJPUZPQLJTEABBJY5XRRYUEUWAPT2A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.683328472 (261h49m38.114408603s) [noise=true , address=104.36.82.17:4351 , piece_id=3M6ZKAVKETYYCJWUXRAZX77YAW6DUZJ2C4TBYVSIC46BNQBHGLBA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.810007024 (261h49m38.241087155s) [noise=true , address=104.36.82.37:4653 , piece_id=PZEXDTWRC4HUMW73R6XQL6SBL6TDBDJAGWNVAPQERNDAUGK3L3IA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:44.039379203 (261h49m38.470459384s) [noise=true , address=45.91.116.12:4233 , piece_id=ZLUELTXZAKZVM23BB6YMQXNMHG7SBHHGPBRQAY65JGUZN75W744A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:44.039411985 (261h49m38.470492167s) [seg_pos={0 0}, upload=272217]: Segment reached optimal threshold of 14 pieces.
Aug 19 15:15:44.039664017 (261h49m38.470744158s) [noise=true , address=77.90.31.10:4541 , piece_id=NBMDP5MVJ2OWIWQOAH2CYIIOOG5SEQMGKRCVOUBUWYMAEFKDPWJQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 19 15:15:44.039776584 (261h49m38.470856735s) [noise=true , address=104.36.82.5:4843 , piece_id=NX4KKRG4R5UBWWHC5JNDBO3HPU34EC6R5OLYPL5APDMME5EDKZ5A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS): protocol: write tcp 188.166.225.170:46136->104.36.82.5:4843: use of closed network connection; write tcp 188.166.225.170:46136->104.36.82.5:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46136->104.36.82.5:4843: use of closed network connection
Aug 19 15:15:44.039801450 (261h49m38.470881581s) [noise=true , address=77.90.31.12:4595 , piece_id=3XCXGS7OJH2JA3SJPBGXG3PY7FYXCB6FWYEGZQTXKEAF6K6GRTGQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1he15nyRz78fmHLkMRs8Hxi2HntmzNsPTqKEbHNUthhSjGMmuj): protocol: write tcp 188.166.225.170:54828->77.90.31.12:4595: use of closed network connection; write tcp 188.166.225.170:54828->77.90.31.12:4595: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54828->77.90.31.12:4595: use of closed network connection
Aug 19 15:15:44.039948192 (261h49m38.471028333s) [noise=true , address=104.36.82.44:4873 , piece_id=NJ5IGY6HCYF7Q4EVTE4YTJ6UXVJV7ULVXRFEZAKAOZILMDRFLCZA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: read tcp 188.166.225.170:40526->104.36.82.44:4873: use of closed network connection; context canceled
Aug 19 15:15:44.039971376 (261h49m38.471051537s) [seg_pos={0 0}, upload=272217]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 15:15:44.040048122 (261h49m38.471128283s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 15:15:44.040054335 (261h49m38.471134466s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 15:15:44.803500811 (261h49m39.234580942s) [upload=272217]: Done uploading segments...
Aug 19 15:15:44.803519337 (261h49m39.234599468s) [upload=272217]: Upload finished. err: <nil>
Duration: 6.104753352s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..XX............X................X....XX....................] duration:
1.880635857s
FAIL (2025-08-19 15:25:43 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 1.880658499s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...XX............X................X....XX...................] duration:
2.09178248s
FAIL (2025-08-19 15:25:06 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 2.091805614s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [................XX...X...XX...........X.........X...........] duration:
6.07213528s
FAIL (2025-08-19 15:25:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 74cf1d8288b89f92a202eeac6422d061b61f5ccdcb161d2b7230426c38ae6018 != before a10a524abb8f34470d816a878c4740fc05a2a4ae9a4b3e6039a6b26ba0794cad
======LOGS======
Aug 19 15:15:40.160052396 (261h49m34.591132527s) [upload=272217]: Starting upload
Aug 19 15:15:40.160096681 (261h49m34.591176812s) [upload=272217]: Done starting upload
Aug 19 15:15:40.160161885 (261h49m34.591242016s) [upload=272217]: Uploading segments...
Aug 19 15:15:40.160363141 (261h49m34.591443262s) [upload=272217]: Got next segment. Inline: false
Aug 19 15:15:40.160756463 (261h49m34.591836594s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 15:15:40.160762465 (261h49m34.591842586s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 15:15:41.057528060 (261h49m35.488608231s) [seg_pos={0 0}, upload=272217]: Begin upload segment...
Aug 19 15:15:41.057589076 (261h49m35.488669207s) [seg_pos={0 0}, upload=272217]: Done begin upload segment.
Aug 19 15:15:41.057612461 (261h49m35.488692602s) [noise=true , address=79.127.219.38:4025 , piece_id=BASZ7JOMBIZVBHOXALHUUV7CVUALSTUCTBA2R2ODZNYK7OABXFCQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.057626778 (261h49m35.488706949s) [noise=true , address=104.36.82.12:4156 , piece_id=SVCFWJ74Z6GJEZSHY743AFWEFNTIP5JPKHC4LU4NEYT6PSAZYIQA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.058335164 (261h49m35.489415295s) [noise=true , address=66.23.193.175:4562 , piece_id=D3R4FTGGK6ZGUUKQN3LBX6BSRZXNS3LWNNY5J6VKKRMVRF3AF3FA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.058437159 (261h49m35.4895173s) [noise=true , address=77.90.31.11:4564 , piece_id=GOYROAJCALHKI3V52WDRQ4JVWG4SIZZNKJFGZF2PJKX3WM2KZA7Q, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059121228 (261h49m35.490201389s) [noise=true , address=104.36.82.60:4363 , piece_id=IN2OIQ56FNLQVLPU4HO2TBJPC545J7HSSKAYSOJNJYVO7ORFTD3A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059259663 (261h49m35.490339794s) [noise=true , address=77.90.31.19:4869 , piece_id=6RF3K4HAOQRWBELTOI4CM43O22BPL5QFZKXIH7KFPYGRXD4GKNUA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059594614 (261h49m35.490674745s) [noise=true , address=77.90.31.12:4595 , piece_id=3XCXGS7OJH2JA3SJPBGXG3PY7FYXCB6FWYEGZQTXKEAF6K6GRTGQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059640191 (261h49m35.490720322s) [noise=true , address=77.90.31.10:4541 , piece_id=NBMDP5MVJ2OWIWQOAH2CYIIOOG5SEQMGKRCVOUBUWYMAEFKDPWJQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059906039 (261h49m35.49098617s) [noise=true , address=104.36.82.23:4462 , piece_id=FCLJW4BLOHL4HTPB2UH3GDNWC7J23Q5N4FZGA3WUJO5BVXJQWZQQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060143233 (261h49m35.491223364s) [noise=true , address=45.91.116.6:4999 , piece_id=FSTOSV52TUVRCAM5AE2QZLE476LOORHQCWVJT3FZ6PDUW75XZWTQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060421215 (261h49m35.491501346s) [noise=true , address=77.90.31.17:4802 , piece_id=JNCEOZFZABN26HPHI534W3OJPUZPQLJTEABBJY5XRRYUEUWAPT2A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060658810 (261h49m35.491738941s) [noise=true , address=77.90.31.15:4717 , piece_id=U3IBZTYW3IGZA3FBQYX5P3VZRSZDZMJMEFWMOLZF2LPDPEZIE5BA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060840277 (261h49m35.491920408s) [noise=true , address=104.36.82.37:4653 , piece_id=PZEXDTWRC4HUMW73R6XQL6SBL6TDBDJAGWNVAPQERNDAUGK3L3IA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061092350 (261h49m35.492172481s) [noise=true , address=79.127.201.215:4345 , piece_id=U5ICQ7PLMA4XJ5WAZ5UXLPZE7C43TMDRERWHJSSIS3V67KIFWKEQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061222568 (261h49m35.492302689s) [noise=true , address=104.36.82.5:4843 , piece_id=NX4KKRG4R5UBWWHC5JNDBO3HPU34EC6R5OLYPL5APDMME5EDKZ5A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061457648 (261h49m35.492537769s) [noise=true , address=104.36.82.44:4873 , piece_id=NJ5IGY6HCYF7Q4EVTE4YTJ6UXVJV7ULVXRFEZAKAOZILMDRFLCZA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061549404 (261h49m35.492629535s) [noise=true , address=104.36.82.17:4351 , piece_id=3M6ZKAVKETYYCJWUXRAZX77YAW6DUZJ2C4TBYVSIC46BNQBHGLBA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061772120 (261h49m35.492852241s) [noise=true , address=45.91.116.12:4233 , piece_id=ZLUELTXZAKZVM23BB6YMQXNMHG7SBHHGPBRQAY65JGUZN75W744A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:42.223926388 (261h49m36.655006509s) [upload=272217]: Next returned nil segment
Aug 19 15:15:42.223946215 (261h49m36.655026346s) [upload=272217]: Waiting for error group managing segments...
Aug 19 15:15:42.540440708 (261h49m36.971520839s) [noise=true , address=66.23.193.175:4562 , piece_id=D3R4FTGGK6ZGUUKQN3LBX6BSRZXNS3LWNNY5J6VKKRMVRF3AF3FA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:42.946845408 (261h49m37.377925539s) [noise=true , address=79.127.219.38:4025 , piece_id=BASZ7JOMBIZVBHOXALHUUV7CVUALSTUCTBA2R2ODZNYK7OABXFCQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:42.985177514 (261h49m37.416257645s) [noise=true , address=104.36.82.12:4156 , piece_id=SVCFWJ74Z6GJEZSHY743AFWEFNTIP5JPKHC4LU4NEYT6PSAZYIQA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.017180800 (261h49m37.448260931s) [noise=true , address=104.36.82.23:4462 , piece_id=FCLJW4BLOHL4HTPB2UH3GDNWC7J23Q5N4FZGA3WUJO5BVXJQWZQQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.043667891 (261h49m37.474748052s) [noise=true , address=104.36.82.60:4363 , piece_id=IN2OIQ56FNLQVLPU4HO2TBJPC545J7HSSKAYSOJNJYVO7ORFTD3A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.047060473 (261h49m37.478140614s) [noise=true , address=79.127.201.215:4345 , piece_id=U5ICQ7PLMA4XJ5WAZ5UXLPZE7C43TMDRERWHJSSIS3V67KIFWKEQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.354414857 (261h49m37.785494988s) [noise=true , address=77.90.31.19:4869 , piece_id=6RF3K4HAOQRWBELTOI4CM43O22BPL5QFZKXIH7KFPYGRXD4GKNUA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.374343759 (261h49m37.80542389s) [noise=true , address=77.90.31.15:4717 , piece_id=U3IBZTYW3IGZA3FBQYX5P3VZRSZDZMJMEFWMOLZF2LPDPEZIE5BA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.560782768 (261h49m37.991862899s) [noise=true , address=45.91.116.6:4999 , piece_id=FSTOSV52TUVRCAM5AE2QZLE476LOORHQCWVJT3FZ6PDUW75XZWTQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.670237443 (261h49m38.101317574s) [noise=true , address=77.90.31.11:4564 , piece_id=GOYROAJCALHKI3V52WDRQ4JVWG4SIZZNKJFGZF2PJKX3WM2KZA7Q, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.671262815 (261h49m38.102342946s) [noise=true , address=77.90.31.17:4802 , piece_id=JNCEOZFZABN26HPHI534W3OJPUZPQLJTEABBJY5XRRYUEUWAPT2A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.683328472 (261h49m38.114408603s) [noise=true , address=104.36.82.17:4351 , piece_id=3M6ZKAVKETYYCJWUXRAZX77YAW6DUZJ2C4TBYVSIC46BNQBHGLBA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.810007024 (261h49m38.241087155s) [noise=true , address=104.36.82.37:4653 , piece_id=PZEXDTWRC4HUMW73R6XQL6SBL6TDBDJAGWNVAPQERNDAUGK3L3IA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:44.039379203 (261h49m38.470459384s) [noise=true , address=45.91.116.12:4233 , piece_id=ZLUELTXZAKZVM23BB6YMQXNMHG7SBHHGPBRQAY65JGUZN75W744A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:44.039411985 (261h49m38.470492167s) [seg_pos={0 0}, upload=272217]: Segment reached optimal threshold of 14 pieces.
Aug 19 15:15:44.039664017 (261h49m38.470744158s) [noise=true , address=77.90.31.10:4541 , piece_id=NBMDP5MVJ2OWIWQOAH2CYIIOOG5SEQMGKRCVOUBUWYMAEFKDPWJQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 19 15:15:44.039776584 (261h49m38.470856735s) [noise=true , address=104.36.82.5:4843 , piece_id=NX4KKRG4R5UBWWHC5JNDBO3HPU34EC6R5OLYPL5APDMME5EDKZ5A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS): protocol: write tcp 188.166.225.170:46136->104.36.82.5:4843: use of closed network connection; write tcp 188.166.225.170:46136->104.36.82.5:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46136->104.36.82.5:4843: use of closed network connection
Aug 19 15:15:44.039801450 (261h49m38.470881581s) [noise=true , address=77.90.31.12:4595 , piece_id=3XCXGS7OJH2JA3SJPBGXG3PY7FYXCB6FWYEGZQTXKEAF6K6GRTGQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1he15nyRz78fmHLkMRs8Hxi2HntmzNsPTqKEbHNUthhSjGMmuj): protocol: write tcp 188.166.225.170:54828->77.90.31.12:4595: use of closed network connection; write tcp 188.166.225.170:54828->77.90.31.12:4595: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54828->77.90.31.12:4595: use of closed network connection
Aug 19 15:15:44.039948192 (261h49m38.471028333s) [noise=true , address=104.36.82.44:4873 , piece_id=NJ5IGY6HCYF7Q4EVTE4YTJ6UXVJV7ULVXRFEZAKAOZILMDRFLCZA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: read tcp 188.166.225.170:40526->104.36.82.44:4873: use of closed network connection; context canceled
Aug 19 15:15:44.039971376 (261h49m38.471051537s) [seg_pos={0 0}, upload=272217]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 15:15:44.040048122 (261h49m38.471128283s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 15:15:44.040054335 (261h49m38.471134466s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 15:15:44.803500811 (261h49m39.234580942s) [upload=272217]: Done uploading segments...
Aug 19 15:15:44.803519337 (261h49m39.234599468s) [upload=272217]: Upload finished. err: <nil>
Duration: 6.072159746s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [X................XX...X...XX...........X.........X..........] duration:
6.351807003s
FAIL (2025-08-19 15:24:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 74cf1d8288b89f92a202eeac6422d061b61f5ccdcb161d2b7230426c38ae6018 != before a10a524abb8f34470d816a878c4740fc05a2a4ae9a4b3e6039a6b26ba0794cad
======LOGS======
Aug 19 15:15:40.160052396 (261h49m34.591132527s) [upload=272217]: Starting upload
Aug 19 15:15:40.160096681 (261h49m34.591176812s) [upload=272217]: Done starting upload
Aug 19 15:15:40.160161885 (261h49m34.591242016s) [upload=272217]: Uploading segments...
Aug 19 15:15:40.160363141 (261h49m34.591443262s) [upload=272217]: Got next segment. Inline: false
Aug 19 15:15:40.160756463 (261h49m34.591836594s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 15:15:40.160762465 (261h49m34.591842586s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 15:15:41.057528060 (261h49m35.488608231s) [seg_pos={0 0}, upload=272217]: Begin upload segment...
Aug 19 15:15:41.057589076 (261h49m35.488669207s) [seg_pos={0 0}, upload=272217]: Done begin upload segment.
Aug 19 15:15:41.057612461 (261h49m35.488692602s) [noise=true , address=79.127.219.38:4025 , piece_id=BASZ7JOMBIZVBHOXALHUUV7CVUALSTUCTBA2R2ODZNYK7OABXFCQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.057626778 (261h49m35.488706949s) [noise=true , address=104.36.82.12:4156 , piece_id=SVCFWJ74Z6GJEZSHY743AFWEFNTIP5JPKHC4LU4NEYT6PSAZYIQA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.058335164 (261h49m35.489415295s) [noise=true , address=66.23.193.175:4562 , piece_id=D3R4FTGGK6ZGUUKQN3LBX6BSRZXNS3LWNNY5J6VKKRMVRF3AF3FA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.058437159 (261h49m35.4895173s) [noise=true , address=77.90.31.11:4564 , piece_id=GOYROAJCALHKI3V52WDRQ4JVWG4SIZZNKJFGZF2PJKX3WM2KZA7Q, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059121228 (261h49m35.490201389s) [noise=true , address=104.36.82.60:4363 , piece_id=IN2OIQ56FNLQVLPU4HO2TBJPC545J7HSSKAYSOJNJYVO7ORFTD3A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059259663 (261h49m35.490339794s) [noise=true , address=77.90.31.19:4869 , piece_id=6RF3K4HAOQRWBELTOI4CM43O22BPL5QFZKXIH7KFPYGRXD4GKNUA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059594614 (261h49m35.490674745s) [noise=true , address=77.90.31.12:4595 , piece_id=3XCXGS7OJH2JA3SJPBGXG3PY7FYXCB6FWYEGZQTXKEAF6K6GRTGQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059640191 (261h49m35.490720322s) [noise=true , address=77.90.31.10:4541 , piece_id=NBMDP5MVJ2OWIWQOAH2CYIIOOG5SEQMGKRCVOUBUWYMAEFKDPWJQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059906039 (261h49m35.49098617s) [noise=true , address=104.36.82.23:4462 , piece_id=FCLJW4BLOHL4HTPB2UH3GDNWC7J23Q5N4FZGA3WUJO5BVXJQWZQQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060143233 (261h49m35.491223364s) [noise=true , address=45.91.116.6:4999 , piece_id=FSTOSV52TUVRCAM5AE2QZLE476LOORHQCWVJT3FZ6PDUW75XZWTQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060421215 (261h49m35.491501346s) [noise=true , address=77.90.31.17:4802 , piece_id=JNCEOZFZABN26HPHI534W3OJPUZPQLJTEABBJY5XRRYUEUWAPT2A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060658810 (261h49m35.491738941s) [noise=true , address=77.90.31.15:4717 , piece_id=U3IBZTYW3IGZA3FBQYX5P3VZRSZDZMJMEFWMOLZF2LPDPEZIE5BA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060840277 (261h49m35.491920408s) [noise=true , address=104.36.82.37:4653 , piece_id=PZEXDTWRC4HUMW73R6XQL6SBL6TDBDJAGWNVAPQERNDAUGK3L3IA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061092350 (261h49m35.492172481s) [noise=true , address=79.127.201.215:4345 , piece_id=U5ICQ7PLMA4XJ5WAZ5UXLPZE7C43TMDRERWHJSSIS3V67KIFWKEQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061222568 (261h49m35.492302689s) [noise=true , address=104.36.82.5:4843 , piece_id=NX4KKRG4R5UBWWHC5JNDBO3HPU34EC6R5OLYPL5APDMME5EDKZ5A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061457648 (261h49m35.492537769s) [noise=true , address=104.36.82.44:4873 , piece_id=NJ5IGY6HCYF7Q4EVTE4YTJ6UXVJV7ULVXRFEZAKAOZILMDRFLCZA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061549404 (261h49m35.492629535s) [noise=true , address=104.36.82.17:4351 , piece_id=3M6ZKAVKETYYCJWUXRAZX77YAW6DUZJ2C4TBYVSIC46BNQBHGLBA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061772120 (261h49m35.492852241s) [noise=true , address=45.91.116.12:4233 , piece_id=ZLUELTXZAKZVM23BB6YMQXNMHG7SBHHGPBRQAY65JGUZN75W744A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:42.223926388 (261h49m36.655006509s) [upload=272217]: Next returned nil segment
Aug 19 15:15:42.223946215 (261h49m36.655026346s) [upload=272217]: Waiting for error group managing segments...
Aug 19 15:15:42.540440708 (261h49m36.971520839s) [noise=true , address=66.23.193.175:4562 , piece_id=D3R4FTGGK6ZGUUKQN3LBX6BSRZXNS3LWNNY5J6VKKRMVRF3AF3FA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:42.946845408 (261h49m37.377925539s) [noise=true , address=79.127.219.38:4025 , piece_id=BASZ7JOMBIZVBHOXALHUUV7CVUALSTUCTBA2R2ODZNYK7OABXFCQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:42.985177514 (261h49m37.416257645s) [noise=true , address=104.36.82.12:4156 , piece_id=SVCFWJ74Z6GJEZSHY743AFWEFNTIP5JPKHC4LU4NEYT6PSAZYIQA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.017180800 (261h49m37.448260931s) [noise=true , address=104.36.82.23:4462 , piece_id=FCLJW4BLOHL4HTPB2UH3GDNWC7J23Q5N4FZGA3WUJO5BVXJQWZQQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.043667891 (261h49m37.474748052s) [noise=true , address=104.36.82.60:4363 , piece_id=IN2OIQ56FNLQVLPU4HO2TBJPC545J7HSSKAYSOJNJYVO7ORFTD3A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.047060473 (261h49m37.478140614s) [noise=true , address=79.127.201.215:4345 , piece_id=U5ICQ7PLMA4XJ5WAZ5UXLPZE7C43TMDRERWHJSSIS3V67KIFWKEQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.354414857 (261h49m37.785494988s) [noise=true , address=77.90.31.19:4869 , piece_id=6RF3K4HAOQRWBELTOI4CM43O22BPL5QFZKXIH7KFPYGRXD4GKNUA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.374343759 (261h49m37.80542389s) [noise=true , address=77.90.31.15:4717 , piece_id=U3IBZTYW3IGZA3FBQYX5P3VZRSZDZMJMEFWMOLZF2LPDPEZIE5BA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.560782768 (261h49m37.991862899s) [noise=true , address=45.91.116.6:4999 , piece_id=FSTOSV52TUVRCAM5AE2QZLE476LOORHQCWVJT3FZ6PDUW75XZWTQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.670237443 (261h49m38.101317574s) [noise=true , address=77.90.31.11:4564 , piece_id=GOYROAJCALHKI3V52WDRQ4JVWG4SIZZNKJFGZF2PJKX3WM2KZA7Q, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.671262815 (261h49m38.102342946s) [noise=true , address=77.90.31.17:4802 , piece_id=JNCEOZFZABN26HPHI534W3OJPUZPQLJTEABBJY5XRRYUEUWAPT2A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.683328472 (261h49m38.114408603s) [noise=true , address=104.36.82.17:4351 , piece_id=3M6ZKAVKETYYCJWUXRAZX77YAW6DUZJ2C4TBYVSIC46BNQBHGLBA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.810007024 (261h49m38.241087155s) [noise=true , address=104.36.82.37:4653 , piece_id=PZEXDTWRC4HUMW73R6XQL6SBL6TDBDJAGWNVAPQERNDAUGK3L3IA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:44.039379203 (261h49m38.470459384s) [noise=true , address=45.91.116.12:4233 , piece_id=ZLUELTXZAKZVM23BB6YMQXNMHG7SBHHGPBRQAY65JGUZN75W744A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:44.039411985 (261h49m38.470492167s) [seg_pos={0 0}, upload=272217]: Segment reached optimal threshold of 14 pieces.
Aug 19 15:15:44.039664017 (261h49m38.470744158s) [noise=true , address=77.90.31.10:4541 , piece_id=NBMDP5MVJ2OWIWQOAH2CYIIOOG5SEQMGKRCVOUBUWYMAEFKDPWJQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 19 15:15:44.039776584 (261h49m38.470856735s) [noise=true , address=104.36.82.5:4843 , piece_id=NX4KKRG4R5UBWWHC5JNDBO3HPU34EC6R5OLYPL5APDMME5EDKZ5A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS): protocol: write tcp 188.166.225.170:46136->104.36.82.5:4843: use of closed network connection; write tcp 188.166.225.170:46136->104.36.82.5:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46136->104.36.82.5:4843: use of closed network connection
Aug 19 15:15:44.039801450 (261h49m38.470881581s) [noise=true , address=77.90.31.12:4595 , piece_id=3XCXGS7OJH2JA3SJPBGXG3PY7FYXCB6FWYEGZQTXKEAF6K6GRTGQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1he15nyRz78fmHLkMRs8Hxi2HntmzNsPTqKEbHNUthhSjGMmuj): protocol: write tcp 188.166.225.170:54828->77.90.31.12:4595: use of closed network connection; write tcp 188.166.225.170:54828->77.90.31.12:4595: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54828->77.90.31.12:4595: use of closed network connection
Aug 19 15:15:44.039948192 (261h49m38.471028333s) [noise=true , address=104.36.82.44:4873 , piece_id=NJ5IGY6HCYF7Q4EVTE4YTJ6UXVJV7ULVXRFEZAKAOZILMDRFLCZA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: read tcp 188.166.225.170:40526->104.36.82.44:4873: use of closed network connection; context canceled
Aug 19 15:15:44.039971376 (261h49m38.471051537s) [seg_pos={0 0}, upload=272217]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 15:15:44.040048122 (261h49m38.471128283s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 15:15:44.040054335 (261h49m38.471134466s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 15:15:44.803500811 (261h49m39.234580942s) [upload=272217]: Done uploading segments...
Aug 19 15:15:44.803519337 (261h49m39.234599468s) [upload=272217]: Upload finished. err: <nil>
Duration: 6.351832071s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [....XX............X................X....XX..................] duration:
1.988288544s
FAIL (2025-08-19 15:24:15 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 1.988309746s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [.X................XX...X...XX...........X.........X.........] duration:
6.065415666s
FAIL (2025-08-19 15:23:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 74cf1d8288b89f92a202eeac6422d061b61f5ccdcb161d2b7230426c38ae6018 != before a10a524abb8f34470d816a878c4740fc05a2a4ae9a4b3e6039a6b26ba0794cad
======LOGS======
Aug 19 15:15:40.160052396 (261h49m34.591132527s) [upload=272217]: Starting upload
Aug 19 15:15:40.160096681 (261h49m34.591176812s) [upload=272217]: Done starting upload
Aug 19 15:15:40.160161885 (261h49m34.591242016s) [upload=272217]: Uploading segments...
Aug 19 15:15:40.160363141 (261h49m34.591443262s) [upload=272217]: Got next segment. Inline: false
Aug 19 15:15:40.160756463 (261h49m34.591836594s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 15:15:40.160762465 (261h49m34.591842586s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 15:15:41.057528060 (261h49m35.488608231s) [seg_pos={0 0}, upload=272217]: Begin upload segment...
Aug 19 15:15:41.057589076 (261h49m35.488669207s) [seg_pos={0 0}, upload=272217]: Done begin upload segment.
Aug 19 15:15:41.057612461 (261h49m35.488692602s) [noise=true , address=79.127.219.38:4025 , piece_id=BASZ7JOMBIZVBHOXALHUUV7CVUALSTUCTBA2R2ODZNYK7OABXFCQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.057626778 (261h49m35.488706949s) [noise=true , address=104.36.82.12:4156 , piece_id=SVCFWJ74Z6GJEZSHY743AFWEFNTIP5JPKHC4LU4NEYT6PSAZYIQA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.058335164 (261h49m35.489415295s) [noise=true , address=66.23.193.175:4562 , piece_id=D3R4FTGGK6ZGUUKQN3LBX6BSRZXNS3LWNNY5J6VKKRMVRF3AF3FA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.058437159 (261h49m35.4895173s) [noise=true , address=77.90.31.11:4564 , piece_id=GOYROAJCALHKI3V52WDRQ4JVWG4SIZZNKJFGZF2PJKX3WM2KZA7Q, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059121228 (261h49m35.490201389s) [noise=true , address=104.36.82.60:4363 , piece_id=IN2OIQ56FNLQVLPU4HO2TBJPC545J7HSSKAYSOJNJYVO7ORFTD3A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059259663 (261h49m35.490339794s) [noise=true , address=77.90.31.19:4869 , piece_id=6RF3K4HAOQRWBELTOI4CM43O22BPL5QFZKXIH7KFPYGRXD4GKNUA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059594614 (261h49m35.490674745s) [noise=true , address=77.90.31.12:4595 , piece_id=3XCXGS7OJH2JA3SJPBGXG3PY7FYXCB6FWYEGZQTXKEAF6K6GRTGQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059640191 (261h49m35.490720322s) [noise=true , address=77.90.31.10:4541 , piece_id=NBMDP5MVJ2OWIWQOAH2CYIIOOG5SEQMGKRCVOUBUWYMAEFKDPWJQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059906039 (261h49m35.49098617s) [noise=true , address=104.36.82.23:4462 , piece_id=FCLJW4BLOHL4HTPB2UH3GDNWC7J23Q5N4FZGA3WUJO5BVXJQWZQQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060143233 (261h49m35.491223364s) [noise=true , address=45.91.116.6:4999 , piece_id=FSTOSV52TUVRCAM5AE2QZLE476LOORHQCWVJT3FZ6PDUW75XZWTQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060421215 (261h49m35.491501346s) [noise=true , address=77.90.31.17:4802 , piece_id=JNCEOZFZABN26HPHI534W3OJPUZPQLJTEABBJY5XRRYUEUWAPT2A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060658810 (261h49m35.491738941s) [noise=true , address=77.90.31.15:4717 , piece_id=U3IBZTYW3IGZA3FBQYX5P3VZRSZDZMJMEFWMOLZF2LPDPEZIE5BA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060840277 (261h49m35.491920408s) [noise=true , address=104.36.82.37:4653 , piece_id=PZEXDTWRC4HUMW73R6XQL6SBL6TDBDJAGWNVAPQERNDAUGK3L3IA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061092350 (261h49m35.492172481s) [noise=true , address=79.127.201.215:4345 , piece_id=U5ICQ7PLMA4XJ5WAZ5UXLPZE7C43TMDRERWHJSSIS3V67KIFWKEQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061222568 (261h49m35.492302689s) [noise=true , address=104.36.82.5:4843 , piece_id=NX4KKRG4R5UBWWHC5JNDBO3HPU34EC6R5OLYPL5APDMME5EDKZ5A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061457648 (261h49m35.492537769s) [noise=true , address=104.36.82.44:4873 , piece_id=NJ5IGY6HCYF7Q4EVTE4YTJ6UXVJV7ULVXRFEZAKAOZILMDRFLCZA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061549404 (261h49m35.492629535s) [noise=true , address=104.36.82.17:4351 , piece_id=3M6ZKAVKETYYCJWUXRAZX77YAW6DUZJ2C4TBYVSIC46BNQBHGLBA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061772120 (261h49m35.492852241s) [noise=true , address=45.91.116.12:4233 , piece_id=ZLUELTXZAKZVM23BB6YMQXNMHG7SBHHGPBRQAY65JGUZN75W744A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:42.223926388 (261h49m36.655006509s) [upload=272217]: Next returned nil segment
Aug 19 15:15:42.223946215 (261h49m36.655026346s) [upload=272217]: Waiting for error group managing segments...
Aug 19 15:15:42.540440708 (261h49m36.971520839s) [noise=true , address=66.23.193.175:4562 , piece_id=D3R4FTGGK6ZGUUKQN3LBX6BSRZXNS3LWNNY5J6VKKRMVRF3AF3FA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:42.946845408 (261h49m37.377925539s) [noise=true , address=79.127.219.38:4025 , piece_id=BASZ7JOMBIZVBHOXALHUUV7CVUALSTUCTBA2R2ODZNYK7OABXFCQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:42.985177514 (261h49m37.416257645s) [noise=true , address=104.36.82.12:4156 , piece_id=SVCFWJ74Z6GJEZSHY743AFWEFNTIP5JPKHC4LU4NEYT6PSAZYIQA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.017180800 (261h49m37.448260931s) [noise=true , address=104.36.82.23:4462 , piece_id=FCLJW4BLOHL4HTPB2UH3GDNWC7J23Q5N4FZGA3WUJO5BVXJQWZQQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.043667891 (261h49m37.474748052s) [noise=true , address=104.36.82.60:4363 , piece_id=IN2OIQ56FNLQVLPU4HO2TBJPC545J7HSSKAYSOJNJYVO7ORFTD3A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.047060473 (261h49m37.478140614s) [noise=true , address=79.127.201.215:4345 , piece_id=U5ICQ7PLMA4XJ5WAZ5UXLPZE7C43TMDRERWHJSSIS3V67KIFWKEQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.354414857 (261h49m37.785494988s) [noise=true , address=77.90.31.19:4869 , piece_id=6RF3K4HAOQRWBELTOI4CM43O22BPL5QFZKXIH7KFPYGRXD4GKNUA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.374343759 (261h49m37.80542389s) [noise=true , address=77.90.31.15:4717 , piece_id=U3IBZTYW3IGZA3FBQYX5P3VZRSZDZMJMEFWMOLZF2LPDPEZIE5BA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.560782768 (261h49m37.991862899s) [noise=true , address=45.91.116.6:4999 , piece_id=FSTOSV52TUVRCAM5AE2QZLE476LOORHQCWVJT3FZ6PDUW75XZWTQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.670237443 (261h49m38.101317574s) [noise=true , address=77.90.31.11:4564 , piece_id=GOYROAJCALHKI3V52WDRQ4JVWG4SIZZNKJFGZF2PJKX3WM2KZA7Q, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.671262815 (261h49m38.102342946s) [noise=true , address=77.90.31.17:4802 , piece_id=JNCEOZFZABN26HPHI534W3OJPUZPQLJTEABBJY5XRRYUEUWAPT2A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.683328472 (261h49m38.114408603s) [noise=true , address=104.36.82.17:4351 , piece_id=3M6ZKAVKETYYCJWUXRAZX77YAW6DUZJ2C4TBYVSIC46BNQBHGLBA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.810007024 (261h49m38.241087155s) [noise=true , address=104.36.82.37:4653 , piece_id=PZEXDTWRC4HUMW73R6XQL6SBL6TDBDJAGWNVAPQERNDAUGK3L3IA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:44.039379203 (261h49m38.470459384s) [noise=true , address=45.91.116.12:4233 , piece_id=ZLUELTXZAKZVM23BB6YMQXNMHG7SBHHGPBRQAY65JGUZN75W744A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:44.039411985 (261h49m38.470492167s) [seg_pos={0 0}, upload=272217]: Segment reached optimal threshold of 14 pieces.
Aug 19 15:15:44.039664017 (261h49m38.470744158s) [noise=true , address=77.90.31.10:4541 , piece_id=NBMDP5MVJ2OWIWQOAH2CYIIOOG5SEQMGKRCVOUBUWYMAEFKDPWJQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 19 15:15:44.039776584 (261h49m38.470856735s) [noise=true , address=104.36.82.5:4843 , piece_id=NX4KKRG4R5UBWWHC5JNDBO3HPU34EC6R5OLYPL5APDMME5EDKZ5A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS): protocol: write tcp 188.166.225.170:46136->104.36.82.5:4843: use of closed network connection; write tcp 188.166.225.170:46136->104.36.82.5:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46136->104.36.82.5:4843: use of closed network connection
Aug 19 15:15:44.039801450 (261h49m38.470881581s) [noise=true , address=77.90.31.12:4595 , piece_id=3XCXGS7OJH2JA3SJPBGXG3PY7FYXCB6FWYEGZQTXKEAF6K6GRTGQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1he15nyRz78fmHLkMRs8Hxi2HntmzNsPTqKEbHNUthhSjGMmuj): protocol: write tcp 188.166.225.170:54828->77.90.31.12:4595: use of closed network connection; write tcp 188.166.225.170:54828->77.90.31.12:4595: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54828->77.90.31.12:4595: use of closed network connection
Aug 19 15:15:44.039948192 (261h49m38.471028333s) [noise=true , address=104.36.82.44:4873 , piece_id=NJ5IGY6HCYF7Q4EVTE4YTJ6UXVJV7ULVXRFEZAKAOZILMDRFLCZA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: read tcp 188.166.225.170:40526->104.36.82.44:4873: use of closed network connection; context canceled
Aug 19 15:15:44.039971376 (261h49m38.471051537s) [seg_pos={0 0}, upload=272217]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 15:15:44.040048122 (261h49m38.471128283s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 15:15:44.040054335 (261h49m38.471134466s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 15:15:44.803500811 (261h49m39.234580942s) [upload=272217]: Done uploading segments...
Aug 19 15:15:44.803519337 (261h49m39.234599468s) [upload=272217]: Upload finished. err: <nil>
Duration: 6.065452265s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.....XX............X................X....XX.................] duration:
2.184041969s
FAIL (2025-08-19 15:23:47 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 2.184066696s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [..X................XX...X...XX...........X.........X........] duration:
5.998325349s
FAIL (2025-08-19 15:23:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 74cf1d8288b89f92a202eeac6422d061b61f5ccdcb161d2b7230426c38ae6018 != before a10a524abb8f34470d816a878c4740fc05a2a4ae9a4b3e6039a6b26ba0794cad
======LOGS======
Aug 19 15:15:40.160052396 (261h49m34.591132527s) [upload=272217]: Starting upload
Aug 19 15:15:40.160096681 (261h49m34.591176812s) [upload=272217]: Done starting upload
Aug 19 15:15:40.160161885 (261h49m34.591242016s) [upload=272217]: Uploading segments...
Aug 19 15:15:40.160363141 (261h49m34.591443262s) [upload=272217]: Got next segment. Inline: false
Aug 19 15:15:40.160756463 (261h49m34.591836594s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 15:15:40.160762465 (261h49m34.591842586s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 15:15:41.057528060 (261h49m35.488608231s) [seg_pos={0 0}, upload=272217]: Begin upload segment...
Aug 19 15:15:41.057589076 (261h49m35.488669207s) [seg_pos={0 0}, upload=272217]: Done begin upload segment.
Aug 19 15:15:41.057612461 (261h49m35.488692602s) [noise=true , address=79.127.219.38:4025 , piece_id=BASZ7JOMBIZVBHOXALHUUV7CVUALSTUCTBA2R2ODZNYK7OABXFCQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.057626778 (261h49m35.488706949s) [noise=true , address=104.36.82.12:4156 , piece_id=SVCFWJ74Z6GJEZSHY743AFWEFNTIP5JPKHC4LU4NEYT6PSAZYIQA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.058335164 (261h49m35.489415295s) [noise=true , address=66.23.193.175:4562 , piece_id=D3R4FTGGK6ZGUUKQN3LBX6BSRZXNS3LWNNY5J6VKKRMVRF3AF3FA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.058437159 (261h49m35.4895173s) [noise=true , address=77.90.31.11:4564 , piece_id=GOYROAJCALHKI3V52WDRQ4JVWG4SIZZNKJFGZF2PJKX3WM2KZA7Q, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059121228 (261h49m35.490201389s) [noise=true , address=104.36.82.60:4363 , piece_id=IN2OIQ56FNLQVLPU4HO2TBJPC545J7HSSKAYSOJNJYVO7ORFTD3A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059259663 (261h49m35.490339794s) [noise=true , address=77.90.31.19:4869 , piece_id=6RF3K4HAOQRWBELTOI4CM43O22BPL5QFZKXIH7KFPYGRXD4GKNUA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059594614 (261h49m35.490674745s) [noise=true , address=77.90.31.12:4595 , piece_id=3XCXGS7OJH2JA3SJPBGXG3PY7FYXCB6FWYEGZQTXKEAF6K6GRTGQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059640191 (261h49m35.490720322s) [noise=true , address=77.90.31.10:4541 , piece_id=NBMDP5MVJ2OWIWQOAH2CYIIOOG5SEQMGKRCVOUBUWYMAEFKDPWJQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059906039 (261h49m35.49098617s) [noise=true , address=104.36.82.23:4462 , piece_id=FCLJW4BLOHL4HTPB2UH3GDNWC7J23Q5N4FZGA3WUJO5BVXJQWZQQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060143233 (261h49m35.491223364s) [noise=true , address=45.91.116.6:4999 , piece_id=FSTOSV52TUVRCAM5AE2QZLE476LOORHQCWVJT3FZ6PDUW75XZWTQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060421215 (261h49m35.491501346s) [noise=true , address=77.90.31.17:4802 , piece_id=JNCEOZFZABN26HPHI534W3OJPUZPQLJTEABBJY5XRRYUEUWAPT2A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060658810 (261h49m35.491738941s) [noise=true , address=77.90.31.15:4717 , piece_id=U3IBZTYW3IGZA3FBQYX5P3VZRSZDZMJMEFWMOLZF2LPDPEZIE5BA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060840277 (261h49m35.491920408s) [noise=true , address=104.36.82.37:4653 , piece_id=PZEXDTWRC4HUMW73R6XQL6SBL6TDBDJAGWNVAPQERNDAUGK3L3IA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061092350 (261h49m35.492172481s) [noise=true , address=79.127.201.215:4345 , piece_id=U5ICQ7PLMA4XJ5WAZ5UXLPZE7C43TMDRERWHJSSIS3V67KIFWKEQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061222568 (261h49m35.492302689s) [noise=true , address=104.36.82.5:4843 , piece_id=NX4KKRG4R5UBWWHC5JNDBO3HPU34EC6R5OLYPL5APDMME5EDKZ5A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061457648 (261h49m35.492537769s) [noise=true , address=104.36.82.44:4873 , piece_id=NJ5IGY6HCYF7Q4EVTE4YTJ6UXVJV7ULVXRFEZAKAOZILMDRFLCZA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061549404 (261h49m35.492629535s) [noise=true , address=104.36.82.17:4351 , piece_id=3M6ZKAVKETYYCJWUXRAZX77YAW6DUZJ2C4TBYVSIC46BNQBHGLBA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061772120 (261h49m35.492852241s) [noise=true , address=45.91.116.12:4233 , piece_id=ZLUELTXZAKZVM23BB6YMQXNMHG7SBHHGPBRQAY65JGUZN75W744A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:42.223926388 (261h49m36.655006509s) [upload=272217]: Next returned nil segment
Aug 19 15:15:42.223946215 (261h49m36.655026346s) [upload=272217]: Waiting for error group managing segments...
Aug 19 15:15:42.540440708 (261h49m36.971520839s) [noise=true , address=66.23.193.175:4562 , piece_id=D3R4FTGGK6ZGUUKQN3LBX6BSRZXNS3LWNNY5J6VKKRMVRF3AF3FA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:42.946845408 (261h49m37.377925539s) [noise=true , address=79.127.219.38:4025 , piece_id=BASZ7JOMBIZVBHOXALHUUV7CVUALSTUCTBA2R2ODZNYK7OABXFCQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:42.985177514 (261h49m37.416257645s) [noise=true , address=104.36.82.12:4156 , piece_id=SVCFWJ74Z6GJEZSHY743AFWEFNTIP5JPKHC4LU4NEYT6PSAZYIQA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.017180800 (261h49m37.448260931s) [noise=true , address=104.36.82.23:4462 , piece_id=FCLJW4BLOHL4HTPB2UH3GDNWC7J23Q5N4FZGA3WUJO5BVXJQWZQQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.043667891 (261h49m37.474748052s) [noise=true , address=104.36.82.60:4363 , piece_id=IN2OIQ56FNLQVLPU4HO2TBJPC545J7HSSKAYSOJNJYVO7ORFTD3A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.047060473 (261h49m37.478140614s) [noise=true , address=79.127.201.215:4345 , piece_id=U5ICQ7PLMA4XJ5WAZ5UXLPZE7C43TMDRERWHJSSIS3V67KIFWKEQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.354414857 (261h49m37.785494988s) [noise=true , address=77.90.31.19:4869 , piece_id=6RF3K4HAOQRWBELTOI4CM43O22BPL5QFZKXIH7KFPYGRXD4GKNUA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.374343759 (261h49m37.80542389s) [noise=true , address=77.90.31.15:4717 , piece_id=U3IBZTYW3IGZA3FBQYX5P3VZRSZDZMJMEFWMOLZF2LPDPEZIE5BA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.560782768 (261h49m37.991862899s) [noise=true , address=45.91.116.6:4999 , piece_id=FSTOSV52TUVRCAM5AE2QZLE476LOORHQCWVJT3FZ6PDUW75XZWTQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.670237443 (261h49m38.101317574s) [noise=true , address=77.90.31.11:4564 , piece_id=GOYROAJCALHKI3V52WDRQ4JVWG4SIZZNKJFGZF2PJKX3WM2KZA7Q, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.671262815 (261h49m38.102342946s) [noise=true , address=77.90.31.17:4802 , piece_id=JNCEOZFZABN26HPHI534W3OJPUZPQLJTEABBJY5XRRYUEUWAPT2A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.683328472 (261h49m38.114408603s) [noise=true , address=104.36.82.17:4351 , piece_id=3M6ZKAVKETYYCJWUXRAZX77YAW6DUZJ2C4TBYVSIC46BNQBHGLBA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.810007024 (261h49m38.241087155s) [noise=true , address=104.36.82.37:4653 , piece_id=PZEXDTWRC4HUMW73R6XQL6SBL6TDBDJAGWNVAPQERNDAUGK3L3IA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:44.039379203 (261h49m38.470459384s) [noise=true , address=45.91.116.12:4233 , piece_id=ZLUELTXZAKZVM23BB6YMQXNMHG7SBHHGPBRQAY65JGUZN75W744A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:44.039411985 (261h49m38.470492167s) [seg_pos={0 0}, upload=272217]: Segment reached optimal threshold of 14 pieces.
Aug 19 15:15:44.039664017 (261h49m38.470744158s) [noise=true , address=77.90.31.10:4541 , piece_id=NBMDP5MVJ2OWIWQOAH2CYIIOOG5SEQMGKRCVOUBUWYMAEFKDPWJQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 19 15:15:44.039776584 (261h49m38.470856735s) [noise=true , address=104.36.82.5:4843 , piece_id=NX4KKRG4R5UBWWHC5JNDBO3HPU34EC6R5OLYPL5APDMME5EDKZ5A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS): protocol: write tcp 188.166.225.170:46136->104.36.82.5:4843: use of closed network connection; write tcp 188.166.225.170:46136->104.36.82.5:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46136->104.36.82.5:4843: use of closed network connection
Aug 19 15:15:44.039801450 (261h49m38.470881581s) [noise=true , address=77.90.31.12:4595 , piece_id=3XCXGS7OJH2JA3SJPBGXG3PY7FYXCB6FWYEGZQTXKEAF6K6GRTGQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1he15nyRz78fmHLkMRs8Hxi2HntmzNsPTqKEbHNUthhSjGMmuj): protocol: write tcp 188.166.225.170:54828->77.90.31.12:4595: use of closed network connection; write tcp 188.166.225.170:54828->77.90.31.12:4595: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54828->77.90.31.12:4595: use of closed network connection
Aug 19 15:15:44.039948192 (261h49m38.471028333s) [noise=true , address=104.36.82.44:4873 , piece_id=NJ5IGY6HCYF7Q4EVTE4YTJ6UXVJV7ULVXRFEZAKAOZILMDRFLCZA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: read tcp 188.166.225.170:40526->104.36.82.44:4873: use of closed network connection; context canceled
Aug 19 15:15:44.039971376 (261h49m38.471051537s) [seg_pos={0 0}, upload=272217]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 15:15:44.040048122 (261h49m38.471128283s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 15:15:44.040054335 (261h49m38.471134466s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 15:15:44.803500811 (261h49m39.234580942s) [upload=272217]: Done uploading segments...
Aug 19 15:15:44.803519337 (261h49m39.234599468s) [upload=272217]: Upload finished. err: <nil>
Duration: 5.998348022s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [......XX............X................X....XX................] duration:
1.96910623s
FAIL (2025-08-19 15:23:31 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 1.969135096s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.......XX............X................X....XX...............] duration:
2.157283374s
FAIL (2025-08-19 15:22:51 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 2.157314374s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [........XX............X................X....XX..............] duration:
1.952974503s
FAIL (2025-08-19 15:22:29 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 1.952997978s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [...X................XX...X...XX...........X.........X.......] duration:
6.404697897s
FAIL (2025-08-19 15:22:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 74cf1d8288b89f92a202eeac6422d061b61f5ccdcb161d2b7230426c38ae6018 != before a10a524abb8f34470d816a878c4740fc05a2a4ae9a4b3e6039a6b26ba0794cad
======LOGS======
Aug 19 15:15:40.160052396 (261h49m34.591132527s) [upload=272217]: Starting upload
Aug 19 15:15:40.160096681 (261h49m34.591176812s) [upload=272217]: Done starting upload
Aug 19 15:15:40.160161885 (261h49m34.591242016s) [upload=272217]: Uploading segments...
Aug 19 15:15:40.160363141 (261h49m34.591443262s) [upload=272217]: Got next segment. Inline: false
Aug 19 15:15:40.160756463 (261h49m34.591836594s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 15:15:40.160762465 (261h49m34.591842586s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 15:15:41.057528060 (261h49m35.488608231s) [seg_pos={0 0}, upload=272217]: Begin upload segment...
Aug 19 15:15:41.057589076 (261h49m35.488669207s) [seg_pos={0 0}, upload=272217]: Done begin upload segment.
Aug 19 15:15:41.057612461 (261h49m35.488692602s) [noise=true , address=79.127.219.38:4025 , piece_id=BASZ7JOMBIZVBHOXALHUUV7CVUALSTUCTBA2R2ODZNYK7OABXFCQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.057626778 (261h49m35.488706949s) [noise=true , address=104.36.82.12:4156 , piece_id=SVCFWJ74Z6GJEZSHY743AFWEFNTIP5JPKHC4LU4NEYT6PSAZYIQA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.058335164 (261h49m35.489415295s) [noise=true , address=66.23.193.175:4562 , piece_id=D3R4FTGGK6ZGUUKQN3LBX6BSRZXNS3LWNNY5J6VKKRMVRF3AF3FA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.058437159 (261h49m35.4895173s) [noise=true , address=77.90.31.11:4564 , piece_id=GOYROAJCALHKI3V52WDRQ4JVWG4SIZZNKJFGZF2PJKX3WM2KZA7Q, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059121228 (261h49m35.490201389s) [noise=true , address=104.36.82.60:4363 , piece_id=IN2OIQ56FNLQVLPU4HO2TBJPC545J7HSSKAYSOJNJYVO7ORFTD3A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059259663 (261h49m35.490339794s) [noise=true , address=77.90.31.19:4869 , piece_id=6RF3K4HAOQRWBELTOI4CM43O22BPL5QFZKXIH7KFPYGRXD4GKNUA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059594614 (261h49m35.490674745s) [noise=true , address=77.90.31.12:4595 , piece_id=3XCXGS7OJH2JA3SJPBGXG3PY7FYXCB6FWYEGZQTXKEAF6K6GRTGQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059640191 (261h49m35.490720322s) [noise=true , address=77.90.31.10:4541 , piece_id=NBMDP5MVJ2OWIWQOAH2CYIIOOG5SEQMGKRCVOUBUWYMAEFKDPWJQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059906039 (261h49m35.49098617s) [noise=true , address=104.36.82.23:4462 , piece_id=FCLJW4BLOHL4HTPB2UH3GDNWC7J23Q5N4FZGA3WUJO5BVXJQWZQQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060143233 (261h49m35.491223364s) [noise=true , address=45.91.116.6:4999 , piece_id=FSTOSV52TUVRCAM5AE2QZLE476LOORHQCWVJT3FZ6PDUW75XZWTQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060421215 (261h49m35.491501346s) [noise=true , address=77.90.31.17:4802 , piece_id=JNCEOZFZABN26HPHI534W3OJPUZPQLJTEABBJY5XRRYUEUWAPT2A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060658810 (261h49m35.491738941s) [noise=true , address=77.90.31.15:4717 , piece_id=U3IBZTYW3IGZA3FBQYX5P3VZRSZDZMJMEFWMOLZF2LPDPEZIE5BA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060840277 (261h49m35.491920408s) [noise=true , address=104.36.82.37:4653 , piece_id=PZEXDTWRC4HUMW73R6XQL6SBL6TDBDJAGWNVAPQERNDAUGK3L3IA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061092350 (261h49m35.492172481s) [noise=true , address=79.127.201.215:4345 , piece_id=U5ICQ7PLMA4XJ5WAZ5UXLPZE7C43TMDRERWHJSSIS3V67KIFWKEQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061222568 (261h49m35.492302689s) [noise=true , address=104.36.82.5:4843 , piece_id=NX4KKRG4R5UBWWHC5JNDBO3HPU34EC6R5OLYPL5APDMME5EDKZ5A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061457648 (261h49m35.492537769s) [noise=true , address=104.36.82.44:4873 , piece_id=NJ5IGY6HCYF7Q4EVTE4YTJ6UXVJV7ULVXRFEZAKAOZILMDRFLCZA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061549404 (261h49m35.492629535s) [noise=true , address=104.36.82.17:4351 , piece_id=3M6ZKAVKETYYCJWUXRAZX77YAW6DUZJ2C4TBYVSIC46BNQBHGLBA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061772120 (261h49m35.492852241s) [noise=true , address=45.91.116.12:4233 , piece_id=ZLUELTXZAKZVM23BB6YMQXNMHG7SBHHGPBRQAY65JGUZN75W744A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:42.223926388 (261h49m36.655006509s) [upload=272217]: Next returned nil segment
Aug 19 15:15:42.223946215 (261h49m36.655026346s) [upload=272217]: Waiting for error group managing segments...
Aug 19 15:15:42.540440708 (261h49m36.971520839s) [noise=true , address=66.23.193.175:4562 , piece_id=D3R4FTGGK6ZGUUKQN3LBX6BSRZXNS3LWNNY5J6VKKRMVRF3AF3FA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:42.946845408 (261h49m37.377925539s) [noise=true , address=79.127.219.38:4025 , piece_id=BASZ7JOMBIZVBHOXALHUUV7CVUALSTUCTBA2R2ODZNYK7OABXFCQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:42.985177514 (261h49m37.416257645s) [noise=true , address=104.36.82.12:4156 , piece_id=SVCFWJ74Z6GJEZSHY743AFWEFNTIP5JPKHC4LU4NEYT6PSAZYIQA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.017180800 (261h49m37.448260931s) [noise=true , address=104.36.82.23:4462 , piece_id=FCLJW4BLOHL4HTPB2UH3GDNWC7J23Q5N4FZGA3WUJO5BVXJQWZQQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.043667891 (261h49m37.474748052s) [noise=true , address=104.36.82.60:4363 , piece_id=IN2OIQ56FNLQVLPU4HO2TBJPC545J7HSSKAYSOJNJYVO7ORFTD3A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.047060473 (261h49m37.478140614s) [noise=true , address=79.127.201.215:4345 , piece_id=U5ICQ7PLMA4XJ5WAZ5UXLPZE7C43TMDRERWHJSSIS3V67KIFWKEQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.354414857 (261h49m37.785494988s) [noise=true , address=77.90.31.19:4869 , piece_id=6RF3K4HAOQRWBELTOI4CM43O22BPL5QFZKXIH7KFPYGRXD4GKNUA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.374343759 (261h49m37.80542389s) [noise=true , address=77.90.31.15:4717 , piece_id=U3IBZTYW3IGZA3FBQYX5P3VZRSZDZMJMEFWMOLZF2LPDPEZIE5BA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.560782768 (261h49m37.991862899s) [noise=true , address=45.91.116.6:4999 , piece_id=FSTOSV52TUVRCAM5AE2QZLE476LOORHQCWVJT3FZ6PDUW75XZWTQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.670237443 (261h49m38.101317574s) [noise=true , address=77.90.31.11:4564 , piece_id=GOYROAJCALHKI3V52WDRQ4JVWG4SIZZNKJFGZF2PJKX3WM2KZA7Q, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.671262815 (261h49m38.102342946s) [noise=true , address=77.90.31.17:4802 , piece_id=JNCEOZFZABN26HPHI534W3OJPUZPQLJTEABBJY5XRRYUEUWAPT2A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.683328472 (261h49m38.114408603s) [noise=true , address=104.36.82.17:4351 , piece_id=3M6ZKAVKETYYCJWUXRAZX77YAW6DUZJ2C4TBYVSIC46BNQBHGLBA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.810007024 (261h49m38.241087155s) [noise=true , address=104.36.82.37:4653 , piece_id=PZEXDTWRC4HUMW73R6XQL6SBL6TDBDJAGWNVAPQERNDAUGK3L3IA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:44.039379203 (261h49m38.470459384s) [noise=true , address=45.91.116.12:4233 , piece_id=ZLUELTXZAKZVM23BB6YMQXNMHG7SBHHGPBRQAY65JGUZN75W744A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:44.039411985 (261h49m38.470492167s) [seg_pos={0 0}, upload=272217]: Segment reached optimal threshold of 14 pieces.
Aug 19 15:15:44.039664017 (261h49m38.470744158s) [noise=true , address=77.90.31.10:4541 , piece_id=NBMDP5MVJ2OWIWQOAH2CYIIOOG5SEQMGKRCVOUBUWYMAEFKDPWJQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 19 15:15:44.039776584 (261h49m38.470856735s) [noise=true , address=104.36.82.5:4843 , piece_id=NX4KKRG4R5UBWWHC5JNDBO3HPU34EC6R5OLYPL5APDMME5EDKZ5A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS): protocol: write tcp 188.166.225.170:46136->104.36.82.5:4843: use of closed network connection; write tcp 188.166.225.170:46136->104.36.82.5:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46136->104.36.82.5:4843: use of closed network connection
Aug 19 15:15:44.039801450 (261h49m38.470881581s) [noise=true , address=77.90.31.12:4595 , piece_id=3XCXGS7OJH2JA3SJPBGXG3PY7FYXCB6FWYEGZQTXKEAF6K6GRTGQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1he15nyRz78fmHLkMRs8Hxi2HntmzNsPTqKEbHNUthhSjGMmuj): protocol: write tcp 188.166.225.170:54828->77.90.31.12:4595: use of closed network connection; write tcp 188.166.225.170:54828->77.90.31.12:4595: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54828->77.90.31.12:4595: use of closed network connection
Aug 19 15:15:44.039948192 (261h49m38.471028333s) [noise=true , address=104.36.82.44:4873 , piece_id=NJ5IGY6HCYF7Q4EVTE4YTJ6UXVJV7ULVXRFEZAKAOZILMDRFLCZA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: read tcp 188.166.225.170:40526->104.36.82.44:4873: use of closed network connection; context canceled
Aug 19 15:15:44.039971376 (261h49m38.471051537s) [seg_pos={0 0}, upload=272217]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 15:15:44.040048122 (261h49m38.471128283s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 15:15:44.040054335 (261h49m38.471134466s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 15:15:44.803500811 (261h49m39.234580942s) [upload=272217]: Done uploading segments...
Aug 19 15:15:44.803519337 (261h49m39.234599468s) [upload=272217]: Upload finished. err: <nil>
Duration: 6.404736039s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.........XX............X................X....XX.............] duration:
1.88233049s
FAIL (2025-08-19 15:21:28 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 15:11:50.009442051 (261h45m44.440522182s) [upload=272151]: Starting upload Aug 19 15:11:50.009498920 (261h45m44.440579051s) [upload=272151]: Done starting upload Aug 19 15:11:50.009575637 (261h45m44.440655768s) [upload=272151]: Uploading segments... Aug 19 15:11:50.009651623 (261h45m44.440731754s) [upload=272151]: Got next segment. Inline: true Aug 19 15:11:50.009656452 (261h45m44.440736583s) [upload=272151]: Waiting for error group managing segments... Aug 19 15:11:50.009697540 (261h45m44.440777671s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 15:11:50.009702801 (261h45m44.440782932s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 15:11:50.009705225 (261h45m44.440785356s) [upload=272151]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 15:11:50.588669618 (261h45m45.019749809s) [upload=272151]: Done uploading segments... Aug 19 15:11:50.588688815 (261h45m45.019768946s) [upload=272151]: Upload finished. err: <nil>
Duration: 1.88236189s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [....X................XX...X...XX...........X.........X......] duration:
7.833349753s
FAIL (2025-08-19 15:21:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 74cf1d8288b89f92a202eeac6422d061b61f5ccdcb161d2b7230426c38ae6018 != before a10a524abb8f34470d816a878c4740fc05a2a4ae9a4b3e6039a6b26ba0794cad
======LOGS======
Aug 19 15:15:40.160052396 (261h49m34.591132527s) [upload=272217]: Starting upload
Aug 19 15:15:40.160096681 (261h49m34.591176812s) [upload=272217]: Done starting upload
Aug 19 15:15:40.160161885 (261h49m34.591242016s) [upload=272217]: Uploading segments...
Aug 19 15:15:40.160363141 (261h49m34.591443262s) [upload=272217]: Got next segment. Inline: false
Aug 19 15:15:40.160756463 (261h49m34.591836594s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 15:15:40.160762465 (261h49m34.591842586s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 15:15:41.057528060 (261h49m35.488608231s) [seg_pos={0 0}, upload=272217]: Begin upload segment...
Aug 19 15:15:41.057589076 (261h49m35.488669207s) [seg_pos={0 0}, upload=272217]: Done begin upload segment.
Aug 19 15:15:41.057612461 (261h49m35.488692602s) [noise=true , address=79.127.219.38:4025 , piece_id=BASZ7JOMBIZVBHOXALHUUV7CVUALSTUCTBA2R2ODZNYK7OABXFCQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.057626778 (261h49m35.488706949s) [noise=true , address=104.36.82.12:4156 , piece_id=SVCFWJ74Z6GJEZSHY743AFWEFNTIP5JPKHC4LU4NEYT6PSAZYIQA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.058335164 (261h49m35.489415295s) [noise=true , address=66.23.193.175:4562 , piece_id=D3R4FTGGK6ZGUUKQN3LBX6BSRZXNS3LWNNY5J6VKKRMVRF3AF3FA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.058437159 (261h49m35.4895173s) [noise=true , address=77.90.31.11:4564 , piece_id=GOYROAJCALHKI3V52WDRQ4JVWG4SIZZNKJFGZF2PJKX3WM2KZA7Q, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059121228 (261h49m35.490201389s) [noise=true , address=104.36.82.60:4363 , piece_id=IN2OIQ56FNLQVLPU4HO2TBJPC545J7HSSKAYSOJNJYVO7ORFTD3A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059259663 (261h49m35.490339794s) [noise=true , address=77.90.31.19:4869 , piece_id=6RF3K4HAOQRWBELTOI4CM43O22BPL5QFZKXIH7KFPYGRXD4GKNUA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059594614 (261h49m35.490674745s) [noise=true , address=77.90.31.12:4595 , piece_id=3XCXGS7OJH2JA3SJPBGXG3PY7FYXCB6FWYEGZQTXKEAF6K6GRTGQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059640191 (261h49m35.490720322s) [noise=true , address=77.90.31.10:4541 , piece_id=NBMDP5MVJ2OWIWQOAH2CYIIOOG5SEQMGKRCVOUBUWYMAEFKDPWJQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.059906039 (261h49m35.49098617s) [noise=true , address=104.36.82.23:4462 , piece_id=FCLJW4BLOHL4HTPB2UH3GDNWC7J23Q5N4FZGA3WUJO5BVXJQWZQQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060143233 (261h49m35.491223364s) [noise=true , address=45.91.116.6:4999 , piece_id=FSTOSV52TUVRCAM5AE2QZLE476LOORHQCWVJT3FZ6PDUW75XZWTQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060421215 (261h49m35.491501346s) [noise=true , address=77.90.31.17:4802 , piece_id=JNCEOZFZABN26HPHI534W3OJPUZPQLJTEABBJY5XRRYUEUWAPT2A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060658810 (261h49m35.491738941s) [noise=true , address=77.90.31.15:4717 , piece_id=U3IBZTYW3IGZA3FBQYX5P3VZRSZDZMJMEFWMOLZF2LPDPEZIE5BA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.060840277 (261h49m35.491920408s) [noise=true , address=104.36.82.37:4653 , piece_id=PZEXDTWRC4HUMW73R6XQL6SBL6TDBDJAGWNVAPQERNDAUGK3L3IA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061092350 (261h49m35.492172481s) [noise=true , address=79.127.201.215:4345 , piece_id=U5ICQ7PLMA4XJ5WAZ5UXLPZE7C43TMDRERWHJSSIS3V67KIFWKEQ, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061222568 (261h49m35.492302689s) [noise=true , address=104.36.82.5:4843 , piece_id=NX4KKRG4R5UBWWHC5JNDBO3HPU34EC6R5OLYPL5APDMME5EDKZ5A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061457648 (261h49m35.492537769s) [noise=true , address=104.36.82.44:4873 , piece_id=NJ5IGY6HCYF7Q4EVTE4YTJ6UXVJV7ULVXRFEZAKAOZILMDRFLCZA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061549404 (261h49m35.492629535s) [noise=true , address=104.36.82.17:4351 , piece_id=3M6ZKAVKETYYCJWUXRAZX77YAW6DUZJ2C4TBYVSIC46BNQBHGLBA, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:41.061772120 (261h49m35.492852241s) [noise=true , address=45.91.116.12:4233 , piece_id=ZLUELTXZAKZVM23BB6YMQXNMHG7SBHHGPBRQAY65JGUZN75W744A, seg_pos={0 0}, upload=272217]: Uploading piece...
Aug 19 15:15:42.223926388 (261h49m36.655006509s) [upload=272217]: Next returned nil segment
Aug 19 15:15:42.223946215 (261h49m36.655026346s) [upload=272217]: Waiting for error group managing segments...
Aug 19 15:15:42.540440708 (261h49m36.971520839s) [noise=true , address=66.23.193.175:4562 , piece_id=D3R4FTGGK6ZGUUKQN3LBX6BSRZXNS3LWNNY5J6VKKRMVRF3AF3FA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:42.946845408 (261h49m37.377925539s) [noise=true , address=79.127.219.38:4025 , piece_id=BASZ7JOMBIZVBHOXALHUUV7CVUALSTUCTBA2R2ODZNYK7OABXFCQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:42.985177514 (261h49m37.416257645s) [noise=true , address=104.36.82.12:4156 , piece_id=SVCFWJ74Z6GJEZSHY743AFWEFNTIP5JPKHC4LU4NEYT6PSAZYIQA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.017180800 (261h49m37.448260931s) [noise=true , address=104.36.82.23:4462 , piece_id=FCLJW4BLOHL4HTPB2UH3GDNWC7J23Q5N4FZGA3WUJO5BVXJQWZQQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.043667891 (261h49m37.474748052s) [noise=true , address=104.36.82.60:4363 , piece_id=IN2OIQ56FNLQVLPU4HO2TBJPC545J7HSSKAYSOJNJYVO7ORFTD3A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.047060473 (261h49m37.478140614s) [noise=true , address=79.127.201.215:4345 , piece_id=U5ICQ7PLMA4XJ5WAZ5UXLPZE7C43TMDRERWHJSSIS3V67KIFWKEQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.354414857 (261h49m37.785494988s) [noise=true , address=77.90.31.19:4869 , piece_id=6RF3K4HAOQRWBELTOI4CM43O22BPL5QFZKXIH7KFPYGRXD4GKNUA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.374343759 (261h49m37.80542389s) [noise=true , address=77.90.31.15:4717 , piece_id=U3IBZTYW3IGZA3FBQYX5P3VZRSZDZMJMEFWMOLZF2LPDPEZIE5BA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.560782768 (261h49m37.991862899s) [noise=true , address=45.91.116.6:4999 , piece_id=FSTOSV52TUVRCAM5AE2QZLE476LOORHQCWVJT3FZ6PDUW75XZWTQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.670237443 (261h49m38.101317574s) [noise=true , address=77.90.31.11:4564 , piece_id=GOYROAJCALHKI3V52WDRQ4JVWG4SIZZNKJFGZF2PJKX3WM2KZA7Q, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.671262815 (261h49m38.102342946s) [noise=true , address=77.90.31.17:4802 , piece_id=JNCEOZFZABN26HPHI534W3OJPUZPQLJTEABBJY5XRRYUEUWAPT2A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.683328472 (261h49m38.114408603s) [noise=true , address=104.36.82.17:4351 , piece_id=3M6ZKAVKETYYCJWUXRAZX77YAW6DUZJ2C4TBYVSIC46BNQBHGLBA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:43.810007024 (261h49m38.241087155s) [noise=true , address=104.36.82.37:4653 , piece_id=PZEXDTWRC4HUMW73R6XQL6SBL6TDBDJAGWNVAPQERNDAUGK3L3IA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:44.039379203 (261h49m38.470459384s) [noise=true , address=45.91.116.12:4233 , piece_id=ZLUELTXZAKZVM23BB6YMQXNMHG7SBHHGPBRQAY65JGUZN75W744A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: <nil>
Aug 19 15:15:44.039411985 (261h49m38.470492167s) [seg_pos={0 0}, upload=272217]: Segment reached optimal threshold of 14 pieces.
Aug 19 15:15:44.039664017 (261h49m38.470744158s) [noise=true , address=77.90.31.10:4541 , piece_id=NBMDP5MVJ2OWIWQOAH2CYIIOOG5SEQMGKRCVOUBUWYMAEFKDPWJQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 19 15:15:44.039776584 (261h49m38.470856735s) [noise=true , address=104.36.82.5:4843 , piece_id=NX4KKRG4R5UBWWHC5JNDBO3HPU34EC6R5OLYPL5APDMME5EDKZ5A, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS): protocol: write tcp 188.166.225.170:46136->104.36.82.5:4843: use of closed network connection; write tcp 188.166.225.170:46136->104.36.82.5:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46136->104.36.82.5:4843: use of closed network connection
Aug 19 15:15:44.039801450 (261h49m38.470881581s) [noise=true , address=77.90.31.12:4595 , piece_id=3XCXGS7OJH2JA3SJPBGXG3PY7FYXCB6FWYEGZQTXKEAF6K6GRTGQ, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1he15nyRz78fmHLkMRs8Hxi2HntmzNsPTqKEbHNUthhSjGMmuj): protocol: write tcp 188.166.225.170:54828->77.90.31.12:4595: use of closed network connection; write tcp 188.166.225.170:54828->77.90.31.12:4595: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54828->77.90.31.12:4595: use of closed network connection
Aug 19 15:15:44.039948192 (261h49m38.471028333s) [noise=true , address=104.36.82.44:4873 , piece_id=NJ5IGY6HCYF7Q4EVTE4YTJ6UXVJV7ULVXRFEZAKAOZILMDRFLCZA, seg_pos={0 0}, upload=272217]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: read tcp 188.166.225.170:40526->104.36.82.44:4873: use of closed network connection; context canceled
Aug 19 15:15:44.039971376 (261h49m38.471051537s) [seg_pos={0 0}, upload=272217]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 15:15:44.040048122 (261h49m38.471128283s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 15:15:44.040054335 (261h49m38.471134466s) [upload=272217]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 15:15:44.803500811 (261h49m39.234580942s) [upload=272217]: Done uploading segments...
Aug 19 15:15:44.803519337 (261h49m39.234599468s) [upload=272217]: Upload finished. err: <nil>
Duration: 7.833383809s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|