Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [......X...X...................X.......X....................X] duration:
862.677568ms
FAIL (2025-08-17 08:01:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 08:01:48.644283296 (206h35m43.075363427s) [upload=214874]: Starting upload Aug 17 08:01:48.644365343 (206h35m43.075445484s) [upload=214874]: Done starting upload Aug 17 08:01:48.644471186 (206h35m43.075551307s) [upload=214874]: Uploading segments... Aug 17 08:01:48.644590415 (206h35m43.075670546s) [upload=214874]: Got next segment. Inline: true Aug 17 08:01:48.644596265 (206h35m43.075676387s) [upload=214874]: Waiting for error group managing segments... Aug 17 08:01:48.644672562 (206h35m43.075752693s) [upload=214874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 08:01:48.644684965 (206h35m43.075765096s) [upload=214874]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 08:01:48.644687790 (206h35m43.075767921s) [upload=214874]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 08:01:48.858470765 (206h35m43.289550896s) [upload=214874]: Done uploading segments... Aug 17 08:01:48.858482889 (206h35m43.28956302s) [upload=214874]: Upload finished. err: metaclient: Too Many Requests
Duration: 862.69977ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [................................X.......X........X.....X....] duration:
5.786929382s
FAIL (2025-08-17 08:01:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 07:58:10.834361609 (206h32m5.26544174s) [upload=214807]: Starting upload Aug 17 07:58:10.834419299 (206h32m5.26549943s) [upload=214807]: Done starting upload Aug 17 07:58:10.834532696 (206h32m5.265612837s) [upload=214807]: Uploading segments... Aug 17 07:58:10.834618850 (206h32m5.265698982s) [upload=214807]: Got next segment. Inline: false Aug 17 07:58:10.834658477 (206h32m5.265738608s) [upload=214807]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:58:10.834662905 (206h32m5.265743036s) [upload=214807]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 07:58:11.127095885 (206h32m5.558176006s) [upload=214807]: Next segment err: metaclient: Too Many Requests Aug 17 07:58:11.127119931 (206h32m5.558200062s) [upload=214807]: Done uploading segments... Aug 17 07:58:11.127134077 (206h32m5.558214209s) [upload=214807]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.786951505s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X...X...................X.......X....................] duration:
2.088051728s
FAIL (2025-08-17 08:01:06 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:49:17.683632787 (206h23m12.114712918s) [upload=214656]: Starting upload Aug 17 07:49:17.683680288 (206h23m12.114760419s) [upload=214656]: Done starting upload Aug 17 07:49:17.683757605 (206h23m12.114837736s) [upload=214656]: Uploading segments... Aug 17 07:49:17.683787674 (206h23m12.114867805s) [upload=214656]: Got next segment. Inline: true Aug 17 07:49:17.683791531 (206h23m12.114871662s) [upload=214656]: Waiting for error group managing segments... Aug 17 07:49:17.683834352 (206h23m12.114914483s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:49:17.683840394 (206h23m12.114920525s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:49:17.683843150 (206h23m12.114923281s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:49:18.039461475 (206h23m12.470541606s) [upload=214656]: Done uploading segments... Aug 17 07:49:18.039480291 (206h23m12.470560422s) [upload=214656]: Upload finished. err: <nil>
Duration: 2.088087346s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.................................X.......X........X.....X...] duration:
5.98587955s
FAIL (2025-08-17 08:00:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 07:58:10.834361609 (206h32m5.26544174s) [upload=214807]: Starting upload Aug 17 07:58:10.834419299 (206h32m5.26549943s) [upload=214807]: Done starting upload Aug 17 07:58:10.834532696 (206h32m5.265612837s) [upload=214807]: Uploading segments... Aug 17 07:58:10.834618850 (206h32m5.265698982s) [upload=214807]: Got next segment. Inline: false Aug 17 07:58:10.834658477 (206h32m5.265738608s) [upload=214807]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:58:10.834662905 (206h32m5.265743036s) [upload=214807]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 07:58:11.127095885 (206h32m5.558176006s) [upload=214807]: Next segment err: metaclient: Too Many Requests Aug 17 07:58:11.127119931 (206h32m5.558200062s) [upload=214807]: Done uploading segments... Aug 17 07:58:11.127134077 (206h32m5.558214209s) [upload=214807]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.985974782s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X...X...................X.......X...................] duration:
2.124216329s
FAIL (2025-08-17 07:59:56 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:49:17.683632787 (206h23m12.114712918s) [upload=214656]: Starting upload Aug 17 07:49:17.683680288 (206h23m12.114760419s) [upload=214656]: Done starting upload Aug 17 07:49:17.683757605 (206h23m12.114837736s) [upload=214656]: Uploading segments... Aug 17 07:49:17.683787674 (206h23m12.114867805s) [upload=214656]: Got next segment. Inline: true Aug 17 07:49:17.683791531 (206h23m12.114871662s) [upload=214656]: Waiting for error group managing segments... Aug 17 07:49:17.683834352 (206h23m12.114914483s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:49:17.683840394 (206h23m12.114920525s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:49:17.683843150 (206h23m12.114923281s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:49:18.039461475 (206h23m12.470541606s) [upload=214656]: Done uploading segments... Aug 17 07:49:18.039480291 (206h23m12.470560422s) [upload=214656]: Upload finished. err: <nil>
Duration: 2.124239633s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X.................................X.......X........X.....X..] duration:
5.579410791s
FAIL (2025-08-17 07:59:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 07:58:10.834361609 (206h32m5.26544174s) [upload=214807]: Starting upload Aug 17 07:58:10.834419299 (206h32m5.26549943s) [upload=214807]: Done starting upload Aug 17 07:58:10.834532696 (206h32m5.265612837s) [upload=214807]: Uploading segments... Aug 17 07:58:10.834618850 (206h32m5.265698982s) [upload=214807]: Got next segment. Inline: false Aug 17 07:58:10.834658477 (206h32m5.265738608s) [upload=214807]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:58:10.834662905 (206h32m5.265743036s) [upload=214807]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 07:58:11.127095885 (206h32m5.558176006s) [upload=214807]: Next segment err: metaclient: Too Many Requests Aug 17 07:58:11.127119931 (206h32m5.558200062s) [upload=214807]: Done uploading segments... Aug 17 07:58:11.127134077 (206h32m5.558214209s) [upload=214807]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.579452631s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X...X...................X.......X..................] duration:
2.197292528s
FAIL (2025-08-17 07:59:36 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:49:17.683632787 (206h23m12.114712918s) [upload=214656]: Starting upload Aug 17 07:49:17.683680288 (206h23m12.114760419s) [upload=214656]: Done starting upload Aug 17 07:49:17.683757605 (206h23m12.114837736s) [upload=214656]: Uploading segments... Aug 17 07:49:17.683787674 (206h23m12.114867805s) [upload=214656]: Got next segment. Inline: true Aug 17 07:49:17.683791531 (206h23m12.114871662s) [upload=214656]: Waiting for error group managing segments... Aug 17 07:49:17.683834352 (206h23m12.114914483s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:49:17.683840394 (206h23m12.114920525s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:49:17.683843150 (206h23m12.114923281s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:49:18.039461475 (206h23m12.470541606s) [upload=214656]: Done uploading segments... Aug 17 07:49:18.039480291 (206h23m12.470560422s) [upload=214656]: Upload finished. err: <nil>
Duration: 2.19731457s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X...X...................X.......X.................] duration:
2.059168226s
FAIL (2025-08-17 07:59:17 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:49:17.683632787 (206h23m12.114712918s) [upload=214656]: Starting upload Aug 17 07:49:17.683680288 (206h23m12.114760419s) [upload=214656]: Done starting upload Aug 17 07:49:17.683757605 (206h23m12.114837736s) [upload=214656]: Uploading segments... Aug 17 07:49:17.683787674 (206h23m12.114867805s) [upload=214656]: Got next segment. Inline: true Aug 17 07:49:17.683791531 (206h23m12.114871662s) [upload=214656]: Waiting for error group managing segments... Aug 17 07:49:17.683834352 (206h23m12.114914483s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:49:17.683840394 (206h23m12.114920525s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:49:17.683843150 (206h23m12.114923281s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:49:18.039461475 (206h23m12.470541606s) [upload=214656]: Done uploading segments... Aug 17 07:49:18.039480291 (206h23m12.470560422s) [upload=214656]: Upload finished. err: <nil>
Duration: 2.059189947s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X.................................X.......X........X.....X.] duration:
5.876274411s
FAIL (2025-08-17 07:59:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 07:58:10.834361609 (206h32m5.26544174s) [upload=214807]: Starting upload Aug 17 07:58:10.834419299 (206h32m5.26549943s) [upload=214807]: Done starting upload Aug 17 07:58:10.834532696 (206h32m5.265612837s) [upload=214807]: Uploading segments... Aug 17 07:58:10.834618850 (206h32m5.265698982s) [upload=214807]: Got next segment. Inline: false Aug 17 07:58:10.834658477 (206h32m5.265738608s) [upload=214807]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:58:10.834662905 (206h32m5.265743036s) [upload=214807]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 07:58:11.127095885 (206h32m5.558176006s) [upload=214807]: Next segment err: metaclient: Too Many Requests Aug 17 07:58:11.127119931 (206h32m5.558200062s) [upload=214807]: Done uploading segments... Aug 17 07:58:11.127134077 (206h32m5.558214209s) [upload=214807]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.876333033s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X...X...................X.......X................] duration:
1.798287601s
FAIL (2025-08-17 07:58:49 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:49:17.683632787 (206h23m12.114712918s) [upload=214656]: Starting upload Aug 17 07:49:17.683680288 (206h23m12.114760419s) [upload=214656]: Done starting upload Aug 17 07:49:17.683757605 (206h23m12.114837736s) [upload=214656]: Uploading segments... Aug 17 07:49:17.683787674 (206h23m12.114867805s) [upload=214656]: Got next segment. Inline: true Aug 17 07:49:17.683791531 (206h23m12.114871662s) [upload=214656]: Waiting for error group managing segments... Aug 17 07:49:17.683834352 (206h23m12.114914483s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:49:17.683840394 (206h23m12.114920525s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:49:17.683843150 (206h23m12.114923281s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:49:18.039461475 (206h23m12.470541606s) [upload=214656]: Done uploading segments... Aug 17 07:49:18.039480291 (206h23m12.470560422s) [upload=214656]: Upload finished. err: <nil>
Duration: 1.798312849s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X...X...................X.......X...............] duration:
1.817041521s
FAIL (2025-08-17 07:58:17 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:49:17.683632787 (206h23m12.114712918s) [upload=214656]: Starting upload Aug 17 07:49:17.683680288 (206h23m12.114760419s) [upload=214656]: Done starting upload Aug 17 07:49:17.683757605 (206h23m12.114837736s) [upload=214656]: Uploading segments... Aug 17 07:49:17.683787674 (206h23m12.114867805s) [upload=214656]: Got next segment. Inline: true Aug 17 07:49:17.683791531 (206h23m12.114871662s) [upload=214656]: Waiting for error group managing segments... Aug 17 07:49:17.683834352 (206h23m12.114914483s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:49:17.683840394 (206h23m12.114920525s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:49:17.683843150 (206h23m12.114923281s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:49:18.039461475 (206h23m12.470541606s) [upload=214656]: Done uploading segments... Aug 17 07:49:18.039480291 (206h23m12.470560422s) [upload=214656]: Upload finished. err: <nil>
Duration: 1.817066329s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X.................................X.......X........X.....X] duration:
946.16294ms
FAIL (2025-08-17 07:58:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 07:58:10.834361609 (206h32m5.26544174s) [upload=214807]: Starting upload Aug 17 07:58:10.834419299 (206h32m5.26549943s) [upload=214807]: Done starting upload Aug 17 07:58:10.834532696 (206h32m5.265612837s) [upload=214807]: Uploading segments... Aug 17 07:58:10.834618850 (206h32m5.265698982s) [upload=214807]: Got next segment. Inline: false Aug 17 07:58:10.834658477 (206h32m5.265738608s) [upload=214807]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:58:10.834662905 (206h32m5.265743036s) [upload=214807]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 07:58:11.127095885 (206h32m5.558176006s) [upload=214807]: Next segment err: metaclient: Too Many Requests Aug 17 07:58:11.127119931 (206h32m5.558200062s) [upload=214807]: Done uploading segments... Aug 17 07:58:11.127134077 (206h32m5.558214209s) [upload=214807]: Upload finished. err: metaclient: Too Many Requests
Duration: 946.183219ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............X...X...................X.......X..............] duration:
1.822712563s
FAIL (2025-08-17 07:57:53 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:49:17.683632787 (206h23m12.114712918s) [upload=214656]: Starting upload Aug 17 07:49:17.683680288 (206h23m12.114760419s) [upload=214656]: Done starting upload Aug 17 07:49:17.683757605 (206h23m12.114837736s) [upload=214656]: Uploading segments... Aug 17 07:49:17.683787674 (206h23m12.114867805s) [upload=214656]: Got next segment. Inline: true Aug 17 07:49:17.683791531 (206h23m12.114871662s) [upload=214656]: Waiting for error group managing segments... Aug 17 07:49:17.683834352 (206h23m12.114914483s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:49:17.683840394 (206h23m12.114920525s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:49:17.683843150 (206h23m12.114923281s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:49:18.039461475 (206h23m12.470541606s) [upload=214656]: Done uploading segments... Aug 17 07:49:18.039480291 (206h23m12.470560422s) [upload=214656]: Upload finished. err: <nil>
Duration: 1.822739044s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X.................................X.......X........X.....] duration:
5.785531327s
FAIL (2025-08-17 07:57:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 07:53:05.481974859 (206h26m59.91305498s) [upload=214718]: Starting upload Aug 17 07:53:05.482022641 (206h26m59.913102762s) [upload=214718]: Done starting upload Aug 17 07:53:05.482128974 (206h26m59.913209155s) [upload=214718]: Uploading segments... Aug 17 07:53:05.482224096 (206h26m59.913304257s) [upload=214718]: Got next segment. Inline: false Aug 17 07:53:05.482288499 (206h26m59.91336865s) [upload=214718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:53:05.482296134 (206h26m59.913376265s) [upload=214718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 07:53:05.698158646 (206h27m0.129238777s) [upload=214718]: Next segment err: metaclient: Too Many Requests Aug 17 07:53:05.698177022 (206h27m0.129257153s) [upload=214718]: Done uploading segments... Aug 17 07:53:05.698189785 (206h27m0.129269917s) [upload=214718]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.785557766s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X...X...................X.......X.............] duration:
1.841972069s
FAIL (2025-08-17 07:57:20 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:49:17.683632787 (206h23m12.114712918s) [upload=214656]: Starting upload Aug 17 07:49:17.683680288 (206h23m12.114760419s) [upload=214656]: Done starting upload Aug 17 07:49:17.683757605 (206h23m12.114837736s) [upload=214656]: Uploading segments... Aug 17 07:49:17.683787674 (206h23m12.114867805s) [upload=214656]: Got next segment. Inline: true Aug 17 07:49:17.683791531 (206h23m12.114871662s) [upload=214656]: Waiting for error group managing segments... Aug 17 07:49:17.683834352 (206h23m12.114914483s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:49:17.683840394 (206h23m12.114920525s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:49:17.683843150 (206h23m12.114923281s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:49:18.039461475 (206h23m12.470541606s) [upload=214656]: Done uploading segments... Aug 17 07:49:18.039480291 (206h23m12.470560422s) [upload=214656]: Upload finished. err: <nil>
Duration: 1.842010783s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............X...X...................X.......X............] duration:
1.900220735s
FAIL (2025-08-17 07:56:52 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:49:17.683632787 (206h23m12.114712918s) [upload=214656]: Starting upload Aug 17 07:49:17.683680288 (206h23m12.114760419s) [upload=214656]: Done starting upload Aug 17 07:49:17.683757605 (206h23m12.114837736s) [upload=214656]: Uploading segments... Aug 17 07:49:17.683787674 (206h23m12.114867805s) [upload=214656]: Got next segment. Inline: true Aug 17 07:49:17.683791531 (206h23m12.114871662s) [upload=214656]: Waiting for error group managing segments... Aug 17 07:49:17.683834352 (206h23m12.114914483s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:49:17.683840394 (206h23m12.114920525s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:49:17.683843150 (206h23m12.114923281s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:49:18.039461475 (206h23m12.470541606s) [upload=214656]: Done uploading segments... Aug 17 07:49:18.039480291 (206h23m12.470560422s) [upload=214656]: Upload finished. err: <nil>
Duration: 1.90024486s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X.................................X.......X........X....] duration:
5.625157361s
FAIL (2025-08-17 07:56:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 07:53:05.481974859 (206h26m59.91305498s) [upload=214718]: Starting upload Aug 17 07:53:05.482022641 (206h26m59.913102762s) [upload=214718]: Done starting upload Aug 17 07:53:05.482128974 (206h26m59.913209155s) [upload=214718]: Uploading segments... Aug 17 07:53:05.482224096 (206h26m59.913304257s) [upload=214718]: Got next segment. Inline: false Aug 17 07:53:05.482288499 (206h26m59.91336865s) [upload=214718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:53:05.482296134 (206h26m59.913376265s) [upload=214718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 07:53:05.698158646 (206h27m0.129238777s) [upload=214718]: Next segment err: metaclient: Too Many Requests Aug 17 07:53:05.698177022 (206h27m0.129257153s) [upload=214718]: Done uploading segments... Aug 17 07:53:05.698189785 (206h27m0.129269917s) [upload=214718]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.625192169s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................X...X...................X.......X...........] duration:
1.807999112s
FAIL (2025-08-17 07:56:18 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:49:17.683632787 (206h23m12.114712918s) [upload=214656]: Starting upload Aug 17 07:49:17.683680288 (206h23m12.114760419s) [upload=214656]: Done starting upload Aug 17 07:49:17.683757605 (206h23m12.114837736s) [upload=214656]: Uploading segments... Aug 17 07:49:17.683787674 (206h23m12.114867805s) [upload=214656]: Got next segment. Inline: true Aug 17 07:49:17.683791531 (206h23m12.114871662s) [upload=214656]: Waiting for error group managing segments... Aug 17 07:49:17.683834352 (206h23m12.114914483s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:49:17.683840394 (206h23m12.114920525s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:49:17.683843150 (206h23m12.114923281s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:49:18.039461475 (206h23m12.470541606s) [upload=214656]: Done uploading segments... Aug 17 07:49:18.039480291 (206h23m12.470560422s) [upload=214656]: Upload finished. err: <nil>
Duration: 1.80802875s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.................X...X...................X.......X..........] duration:
1.961772194s
FAIL (2025-08-17 07:56:01 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:49:17.683632787 (206h23m12.114712918s) [upload=214656]: Starting upload Aug 17 07:49:17.683680288 (206h23m12.114760419s) [upload=214656]: Done starting upload Aug 17 07:49:17.683757605 (206h23m12.114837736s) [upload=214656]: Uploading segments... Aug 17 07:49:17.683787674 (206h23m12.114867805s) [upload=214656]: Got next segment. Inline: true Aug 17 07:49:17.683791531 (206h23m12.114871662s) [upload=214656]: Waiting for error group managing segments... Aug 17 07:49:17.683834352 (206h23m12.114914483s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:49:17.683840394 (206h23m12.114920525s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:49:17.683843150 (206h23m12.114923281s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:49:18.039461475 (206h23m12.470541606s) [upload=214656]: Done uploading segments... Aug 17 07:49:18.039480291 (206h23m12.470560422s) [upload=214656]: Upload finished. err: <nil>
Duration: 1.961795529s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X.................................X.......X........X...] duration:
5.73301142s
FAIL (2025-08-17 07:55:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 07:53:05.481974859 (206h26m59.91305498s) [upload=214718]: Starting upload Aug 17 07:53:05.482022641 (206h26m59.913102762s) [upload=214718]: Done starting upload Aug 17 07:53:05.482128974 (206h26m59.913209155s) [upload=214718]: Uploading segments... Aug 17 07:53:05.482224096 (206h26m59.913304257s) [upload=214718]: Got next segment. Inline: false Aug 17 07:53:05.482288499 (206h26m59.91336865s) [upload=214718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:53:05.482296134 (206h26m59.913376265s) [upload=214718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 07:53:05.698158646 (206h27m0.129238777s) [upload=214718]: Next segment err: metaclient: Too Many Requests Aug 17 07:53:05.698177022 (206h27m0.129257153s) [upload=214718]: Done uploading segments... Aug 17 07:53:05.698189785 (206h27m0.129269917s) [upload=214718]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.733032379s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..................X...X...................X.......X.........] duration:
2.55398962s
FAIL (2025-08-17 07:55:38 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:49:17.683632787 (206h23m12.114712918s) [upload=214656]: Starting upload Aug 17 07:49:17.683680288 (206h23m12.114760419s) [upload=214656]: Done starting upload Aug 17 07:49:17.683757605 (206h23m12.114837736s) [upload=214656]: Uploading segments... Aug 17 07:49:17.683787674 (206h23m12.114867805s) [upload=214656]: Got next segment. Inline: true Aug 17 07:49:17.683791531 (206h23m12.114871662s) [upload=214656]: Waiting for error group managing segments... Aug 17 07:49:17.683834352 (206h23m12.114914483s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:49:17.683840394 (206h23m12.114920525s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:49:17.683843150 (206h23m12.114923281s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:49:18.039461475 (206h23m12.470541606s) [upload=214656]: Done uploading segments... Aug 17 07:49:18.039480291 (206h23m12.470560422s) [upload=214656]: Upload finished. err: <nil>
Duration: 2.554005771s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X.................................X.......X........X..] duration:
5.805891932s
FAIL (2025-08-17 07:55:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 07:53:05.481974859 (206h26m59.91305498s) [upload=214718]: Starting upload Aug 17 07:53:05.482022641 (206h26m59.913102762s) [upload=214718]: Done starting upload Aug 17 07:53:05.482128974 (206h26m59.913209155s) [upload=214718]: Uploading segments... Aug 17 07:53:05.482224096 (206h26m59.913304257s) [upload=214718]: Got next segment. Inline: false Aug 17 07:53:05.482288499 (206h26m59.91336865s) [upload=214718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:53:05.482296134 (206h26m59.913376265s) [upload=214718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 07:53:05.698158646 (206h27m0.129238777s) [upload=214718]: Next segment err: metaclient: Too Many Requests Aug 17 07:53:05.698177022 (206h27m0.129257153s) [upload=214718]: Done uploading segments... Aug 17 07:53:05.698189785 (206h27m0.129269917s) [upload=214718]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.805929495s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...................X...X...................X.......X........] duration:
1.816063592s
FAIL (2025-08-17 07:55:00 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:49:17.683632787 (206h23m12.114712918s) [upload=214656]: Starting upload Aug 17 07:49:17.683680288 (206h23m12.114760419s) [upload=214656]: Done starting upload Aug 17 07:49:17.683757605 (206h23m12.114837736s) [upload=214656]: Uploading segments... Aug 17 07:49:17.683787674 (206h23m12.114867805s) [upload=214656]: Got next segment. Inline: true Aug 17 07:49:17.683791531 (206h23m12.114871662s) [upload=214656]: Waiting for error group managing segments... Aug 17 07:49:17.683834352 (206h23m12.114914483s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:49:17.683840394 (206h23m12.114920525s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:49:17.683843150 (206h23m12.114923281s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:49:18.039461475 (206h23m12.470541606s) [upload=214656]: Done uploading segments... Aug 17 07:49:18.039480291 (206h23m12.470560422s) [upload=214656]: Upload finished. err: <nil>
Duration: 1.816090822s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....................X...X...................X.......X.......] duration:
1.828858784s
FAIL (2025-08-17 07:54:44 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:49:17.683632787 (206h23m12.114712918s) [upload=214656]: Starting upload Aug 17 07:49:17.683680288 (206h23m12.114760419s) [upload=214656]: Done starting upload Aug 17 07:49:17.683757605 (206h23m12.114837736s) [upload=214656]: Uploading segments... Aug 17 07:49:17.683787674 (206h23m12.114867805s) [upload=214656]: Got next segment. Inline: true Aug 17 07:49:17.683791531 (206h23m12.114871662s) [upload=214656]: Waiting for error group managing segments... Aug 17 07:49:17.683834352 (206h23m12.114914483s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:49:17.683840394 (206h23m12.114920525s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:49:17.683843150 (206h23m12.114923281s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:49:18.039461475 (206h23m12.470541606s) [upload=214656]: Done uploading segments... Aug 17 07:49:18.039480291 (206h23m12.470560422s) [upload=214656]: Upload finished. err: <nil>
Duration: 1.828887639s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....................X...X...................X.......X......] duration:
1.808164727s
FAIL (2025-08-17 07:54:15 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:49:17.683632787 (206h23m12.114712918s) [upload=214656]: Starting upload Aug 17 07:49:17.683680288 (206h23m12.114760419s) [upload=214656]: Done starting upload Aug 17 07:49:17.683757605 (206h23m12.114837736s) [upload=214656]: Uploading segments... Aug 17 07:49:17.683787674 (206h23m12.114867805s) [upload=214656]: Got next segment. Inline: true Aug 17 07:49:17.683791531 (206h23m12.114871662s) [upload=214656]: Waiting for error group managing segments... Aug 17 07:49:17.683834352 (206h23m12.114914483s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:49:17.683840394 (206h23m12.114920525s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:49:17.683843150 (206h23m12.114923281s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:49:18.039461475 (206h23m12.470541606s) [upload=214656]: Done uploading segments... Aug 17 07:49:18.039480291 (206h23m12.470560422s) [upload=214656]: Upload finished. err: <nil>
Duration: 1.808189684s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X.................................X.......X........X.] duration:
5.582634441s
FAIL (2025-08-17 07:54:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 07:53:05.481974859 (206h26m59.91305498s) [upload=214718]: Starting upload Aug 17 07:53:05.482022641 (206h26m59.913102762s) [upload=214718]: Done starting upload Aug 17 07:53:05.482128974 (206h26m59.913209155s) [upload=214718]: Uploading segments... Aug 17 07:53:05.482224096 (206h26m59.913304257s) [upload=214718]: Got next segment. Inline: false Aug 17 07:53:05.482288499 (206h26m59.91336865s) [upload=214718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:53:05.482296134 (206h26m59.913376265s) [upload=214718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 07:53:05.698158646 (206h27m0.129238777s) [upload=214718]: Next segment err: metaclient: Too Many Requests Aug 17 07:53:05.698177022 (206h27m0.129257153s) [upload=214718]: Done uploading segments... Aug 17 07:53:05.698189785 (206h27m0.129269917s) [upload=214718]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.582659029s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......................X...X...................X.......X.....] duration:
1.869227782s
FAIL (2025-08-17 07:53:11 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:49:17.683632787 (206h23m12.114712918s) [upload=214656]: Starting upload Aug 17 07:49:17.683680288 (206h23m12.114760419s) [upload=214656]: Done starting upload Aug 17 07:49:17.683757605 (206h23m12.114837736s) [upload=214656]: Uploading segments... Aug 17 07:49:17.683787674 (206h23m12.114867805s) [upload=214656]: Got next segment. Inline: true Aug 17 07:49:17.683791531 (206h23m12.114871662s) [upload=214656]: Waiting for error group managing segments... Aug 17 07:49:17.683834352 (206h23m12.114914483s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:49:17.683840394 (206h23m12.114920525s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:49:17.683843150 (206h23m12.114923281s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:49:18.039461475 (206h23m12.470541606s) [upload=214656]: Done uploading segments... Aug 17 07:49:18.039480291 (206h23m12.470560422s) [upload=214656]: Upload finished. err: <nil>
Duration: 1.869244153s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X.................................X.......X........X] duration:
873.524034ms
FAIL (2025-08-17 07:53:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 07:53:05.481974859 (206h26m59.91305498s) [upload=214718]: Starting upload Aug 17 07:53:05.482022641 (206h26m59.913102762s) [upload=214718]: Done starting upload Aug 17 07:53:05.482128974 (206h26m59.913209155s) [upload=214718]: Uploading segments... Aug 17 07:53:05.482224096 (206h26m59.913304257s) [upload=214718]: Got next segment. Inline: false Aug 17 07:53:05.482288499 (206h26m59.91336865s) [upload=214718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:53:05.482296134 (206h26m59.913376265s) [upload=214718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 07:53:05.698158646 (206h27m0.129238777s) [upload=214718]: Next segment err: metaclient: Too Many Requests Aug 17 07:53:05.698177022 (206h27m0.129257153s) [upload=214718]: Done uploading segments... Aug 17 07:53:05.698189785 (206h27m0.129269917s) [upload=214718]: Upload finished. err: metaclient: Too Many Requests
Duration: 873.548342ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X.................................X.......X........] duration:
5.789742037s
FAIL (2025-08-17 07:52:19 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 4fec11e0ae57174b45d52c98e298e2bb47632c0d50913e23618aba51922b9827 != before d36f52834a41803072fb052287b8d4e72dbe3326a8ad23c28f9b67f71ef041b3
======LOGS======
Aug 17 07:45:13.620538576 (206h19m8.051618707s) [upload=214590]: Starting upload
Aug 17 07:45:13.620606657 (206h19m8.051686788s) [upload=214590]: Done starting upload
Aug 17 07:45:13.620743158 (206h19m8.051823289s) [upload=214590]: Uploading segments...
Aug 17 07:45:13.621019707 (206h19m8.052099838s) [upload=214590]: Got next segment. Inline: false
Aug 17 07:45:13.621050977 (206h19m8.052131108s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 07:45:13.621055936 (206h19m8.052136067s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 07:45:14.090546760 (206h19m8.521626891s) [seg_pos={0 0}, upload=214590]: Begin upload segment...
Aug 17 07:45:14.090598500 (206h19m8.521678631s) [seg_pos={0 0}, upload=214590]: Done begin upload segment.
Aug 17 07:45:14.090622556 (206h19m8.521702687s) [noise=true , address=77.90.31.14:4673 , piece_id=5PJFFLNYYQPZZO4GN2EFLODVQ5I5FBDW4QS635DFBEXPNBHUV4OQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.090668424 (206h19m8.521748555s) [noise=true , address=45.91.116.13:4179 , piece_id=6YPKZEMV2XGUOXGVKYE4VY3HUB2SJZ4EBHZEFVX5INTP3GV4EP2Q, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091127582 (206h19m8.522207723s) [noise=true , address=104.36.82.51:4079 , piece_id=5GQQMLYQLR7NFHXIBLAHP54E4YL4QUPAAFOX2I66ARCWXLDUIXDQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091510745 (206h19m8.522590876s) [noise=true , address=77.90.31.11:4564 , piece_id=OIAOZVVXED4MPGWG3B3GJ27H5NSEXBLXF24MDHYB6WVQU7AVWGBA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091579216 (206h19m8.522659357s) [noise=true , address=104.36.82.40:4958 , piece_id=CBI7KKYO3VPYYLN5E6ADA67TG2ZUN6S36JL6Y7VWNBS4K5V3IATQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091831068 (206h19m8.522911199s) [noise=true , address=104.36.82.5:4847 , piece_id=QIVSPIJVDTHKE2DUU5TKLLAK7FQWPTVCGLKR6BRPJG3EJHMRK3JQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091916982 (206h19m8.522997103s) [noise=true , address=77.90.31.12:4623 , piece_id=MNWEVMIT4MJ45Y6TNHOVUMJCL74DARWFE544SCOAKJD65K6G3K5A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092127385 (206h19m8.523207516s) [noise=true , address=104.36.82.34:4553 , piece_id=YUQJN4FA453JPCOJ7AZ3E72B3B7MPIV54ONID7CIVYJX7RLPM6ZQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092241313 (206h19m8.523321444s) [noise=true , address=104.36.82.4:4816 , piece_id=6V4HMEGAV6NE7ZZFYF3HE52YALSS4LFXTYGHWYCNRTA675CPLAGQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092480551 (206h19m8.523560682s) [noise=true , address=45.91.116.12:4228 , piece_id=GTUW6GCCRQPLYFNW4ODN26NNX6TAP7VV5R657MT4DGGWGEXGWHAA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092531499 (206h19m8.52361162s) [noise=true , address=104.36.82.23:4478 , piece_id=LYXQ6HBIXBA2U5ZRFT3MYD5PGYVDQ3LH44M5YLIEN4R2R56OSR3A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092889484 (206h19m8.523969615s) [noise=true , address=66.23.193.175:4555 , piece_id=ZUD4HML6YWUZPGBDTB6LQ7C7RVMXAC4MZDCBA74N2NUUHFUB4OXQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093179808 (206h19m8.52425994s) [noise=true , address=104.36.82.50:4047 , piece_id=KWXBCKR42P2MYO7QAALEMW7U5N6LRCR4KSIWRZNXRVLMW2CKDHIQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093442351 (206h19m8.524522482s) [noise=true , address=104.36.82.36:4625 , piece_id=CRGMWD5LBQL44ZX4HFCO6D6R66MTGQ53WTRSSS24HHYBEWN4WOGA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093701787 (206h19m8.524781918s) [noise=true , address=104.36.82.17:4347 , piece_id=WWNAQLZF4YNJDB4XNPTZOXVOTIGSHUA3LYIVSGJCR4BUIL4ESC5A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094480037 (206h19m8.525560158s) [noise=true , address=104.36.82.60:4341 , piece_id=MJ4GT6LKULH4HHZLH3IK6237MTDAO2ITJAFBCDM7GLSRFKYC5Y2A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094685860 (206h19m8.525765991s) [noise=true , address=104.36.82.58:4293 , piece_id=DQUHLEJLKMUUOLMRO6EVNDHZROJYPOHCBW54SNRUKHJTGVM3F6GQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094906172 (206h19m8.525986303s) [noise=true , address=79.127.205.234:4608 , piece_id=P5DUHLGTJP6L3HFWSLEZYFR5UJMWK2LGCEZAREPU3DM2TI4DYHKQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:15.225169591 (206h19m9.656249722s) [upload=214590]: Next returned nil segment
Aug 17 07:45:15.225182507 (206h19m9.656262638s) [upload=214590]: Waiting for error group managing segments...
Aug 17 07:45:15.515447978 (206h19m9.946528109s) [noise=true , address=66.23.193.175:4555 , piece_id=ZUD4HML6YWUZPGBDTB6LQ7C7RVMXAC4MZDCBA74N2NUUHFUB4OXQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.528626353 (206h19m9.959706474s) [noise=true , address=79.127.205.234:4608 , piece_id=P5DUHLGTJP6L3HFWSLEZYFR5UJMWK2LGCEZAREPU3DM2TI4DYHKQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.971468539 (206h19m10.40254867s) [noise=true , address=77.90.31.11:4564 , piece_id=OIAOZVVXED4MPGWG3B3GJ27H5NSEXBLXF24MDHYB6WVQU7AVWGBA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.977919312 (206h19m10.408999443s) [noise=true , address=45.91.116.12:4228 , piece_id=GTUW6GCCRQPLYFNW4ODN26NNX6TAP7VV5R657MT4DGGWGEXGWHAA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.009399344 (206h19m10.440479475s) [noise=true , address=104.36.82.36:4625 , piece_id=CRGMWD5LBQL44ZX4HFCO6D6R66MTGQ53WTRSSS24HHYBEWN4WOGA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.014706840 (206h19m10.445786971s) [noise=true , address=104.36.82.4:4816 , piece_id=6V4HMEGAV6NE7ZZFYF3HE52YALSS4LFXTYGHWYCNRTA675CPLAGQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.037909114 (206h19m10.468989245s) [noise=true , address=77.90.31.12:4623 , piece_id=MNWEVMIT4MJ45Y6TNHOVUMJCL74DARWFE544SCOAKJD65K6G3K5A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.068949626 (206h19m10.500029757s) [noise=true , address=104.36.82.40:4958 , piece_id=CBI7KKYO3VPYYLN5E6ADA67TG2ZUN6S36JL6Y7VWNBS4K5V3IATQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.069334071 (206h19m10.500414202s) [noise=true , address=104.36.82.51:4079 , piece_id=5GQQMLYQLR7NFHXIBLAHP54E4YL4QUPAAFOX2I66ARCWXLDUIXDQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.069399476 (206h19m10.500479607s) [noise=true , address=104.36.82.17:4347 , piece_id=WWNAQLZF4YNJDB4XNPTZOXVOTIGSHUA3LYIVSGJCR4BUIL4ESC5A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.085835583 (206h19m10.516915714s) [noise=true , address=104.36.82.60:4341 , piece_id=MJ4GT6LKULH4HHZLH3IK6237MTDAO2ITJAFBCDM7GLSRFKYC5Y2A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.091441440 (206h19m10.522521571s) [noise=true , address=104.36.82.34:4553 , piece_id=YUQJN4FA453JPCOJ7AZ3E72B3B7MPIV54ONID7CIVYJX7RLPM6ZQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.101678267 (206h19m10.532758398s) [noise=true , address=104.36.82.58:4293 , piece_id=DQUHLEJLKMUUOLMRO6EVNDHZROJYPOHCBW54SNRUKHJTGVM3F6GQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.110842181 (206h19m10.541922312s) [noise=true , address=77.90.31.14:4673 , piece_id=5PJFFLNYYQPZZO4GN2EFLODVQ5I5FBDW4QS635DFBEXPNBHUV4OQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.110862269 (206h19m10.5419424s) [seg_pos={0 0}, upload=214590]: Segment reached optimal threshold of 14 pieces.
Aug 17 07:45:16.110982259 (206h19m10.54206239s) [noise=true , address=104.36.82.23:4478 , piece_id=LYXQ6HBIXBA2U5ZRFT3MYD5PGYVDQ3LH44M5YLIEN4R2R56OSR3A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111085497 (206h19m10.542165618s) [noise=true , address=104.36.82.5:4847 , piece_id=QIVSPIJVDTHKE2DUU5TKLLAK7FQWPTVCGLKR6BRPJG3EJHMRK3JQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111114642 (206h19m10.542194783s) [noise=true , address=45.91.116.13:4179 , piece_id=6YPKZEMV2XGUOXGVKYE4VY3HUB2SJZ4EBHZEFVX5INTP3GV4EP2Q, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pFjszrBBZvWsoeXM43kLgX7uNqk8iwSG8nsE1zbj77GVfQcKn): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111179586 (206h19m10.542259717s) [noise=true , address=104.36.82.50:4047 , piece_id=KWXBCKR42P2MYO7QAALEMW7U5N6LRCR4KSIWRZNXRVLMW2CKDHIQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126Z6tvp49dLLdj3T5snJc4tBVGzcX5UBaGafFN3PkhF92vxpfs): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111195828 (206h19m10.542275959s) [seg_pos={0 0}, upload=214590]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 07:45:16.111255642 (206h19m10.542335773s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 07:45:16.111259339 (206h19m10.54233947s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 07:45:16.555705203 (206h19m10.986785394s) [upload=214590]: Done uploading segments...
Aug 17 07:45:16.555723579 (206h19m10.9868037s) [upload=214590]: Upload finished. err: <nil>
Duration: 5.789769199s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......................X...X...................X.......X....] duration:
1.806220238s
FAIL (2025-08-17 07:52:00 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:49:17.683632787 (206h23m12.114712918s) [upload=214656]: Starting upload Aug 17 07:49:17.683680288 (206h23m12.114760419s) [upload=214656]: Done starting upload Aug 17 07:49:17.683757605 (206h23m12.114837736s) [upload=214656]: Uploading segments... Aug 17 07:49:17.683787674 (206h23m12.114867805s) [upload=214656]: Got next segment. Inline: true Aug 17 07:49:17.683791531 (206h23m12.114871662s) [upload=214656]: Waiting for error group managing segments... Aug 17 07:49:17.683834352 (206h23m12.114914483s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:49:17.683840394 (206h23m12.114920525s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:49:17.683843150 (206h23m12.114923281s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:49:18.039461475 (206h23m12.470541606s) [upload=214656]: Done uploading segments... Aug 17 07:49:18.039480291 (206h23m12.470560422s) [upload=214656]: Upload finished. err: <nil>
Duration: 1.806253453s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........................X...X...................X.......X...] duration:
1.979608531s
FAIL (2025-08-17 07:51:41 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:49:17.683632787 (206h23m12.114712918s) [upload=214656]: Starting upload Aug 17 07:49:17.683680288 (206h23m12.114760419s) [upload=214656]: Done starting upload Aug 17 07:49:17.683757605 (206h23m12.114837736s) [upload=214656]: Uploading segments... Aug 17 07:49:17.683787674 (206h23m12.114867805s) [upload=214656]: Got next segment. Inline: true Aug 17 07:49:17.683791531 (206h23m12.114871662s) [upload=214656]: Waiting for error group managing segments... Aug 17 07:49:17.683834352 (206h23m12.114914483s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:49:17.683840394 (206h23m12.114920525s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:49:17.683843150 (206h23m12.114923281s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:49:18.039461475 (206h23m12.470541606s) [upload=214656]: Done uploading segments... Aug 17 07:49:18.039480291 (206h23m12.470560422s) [upload=214656]: Upload finished. err: <nil>
Duration: 1.979635492s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X.................................X.......X.......] duration:
5.755362641s
FAIL (2025-08-17 07:51:27 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 4fec11e0ae57174b45d52c98e298e2bb47632c0d50913e23618aba51922b9827 != before d36f52834a41803072fb052287b8d4e72dbe3326a8ad23c28f9b67f71ef041b3
======LOGS======
Aug 17 07:45:13.620538576 (206h19m8.051618707s) [upload=214590]: Starting upload
Aug 17 07:45:13.620606657 (206h19m8.051686788s) [upload=214590]: Done starting upload
Aug 17 07:45:13.620743158 (206h19m8.051823289s) [upload=214590]: Uploading segments...
Aug 17 07:45:13.621019707 (206h19m8.052099838s) [upload=214590]: Got next segment. Inline: false
Aug 17 07:45:13.621050977 (206h19m8.052131108s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 07:45:13.621055936 (206h19m8.052136067s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 07:45:14.090546760 (206h19m8.521626891s) [seg_pos={0 0}, upload=214590]: Begin upload segment...
Aug 17 07:45:14.090598500 (206h19m8.521678631s) [seg_pos={0 0}, upload=214590]: Done begin upload segment.
Aug 17 07:45:14.090622556 (206h19m8.521702687s) [noise=true , address=77.90.31.14:4673 , piece_id=5PJFFLNYYQPZZO4GN2EFLODVQ5I5FBDW4QS635DFBEXPNBHUV4OQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.090668424 (206h19m8.521748555s) [noise=true , address=45.91.116.13:4179 , piece_id=6YPKZEMV2XGUOXGVKYE4VY3HUB2SJZ4EBHZEFVX5INTP3GV4EP2Q, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091127582 (206h19m8.522207723s) [noise=true , address=104.36.82.51:4079 , piece_id=5GQQMLYQLR7NFHXIBLAHP54E4YL4QUPAAFOX2I66ARCWXLDUIXDQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091510745 (206h19m8.522590876s) [noise=true , address=77.90.31.11:4564 , piece_id=OIAOZVVXED4MPGWG3B3GJ27H5NSEXBLXF24MDHYB6WVQU7AVWGBA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091579216 (206h19m8.522659357s) [noise=true , address=104.36.82.40:4958 , piece_id=CBI7KKYO3VPYYLN5E6ADA67TG2ZUN6S36JL6Y7VWNBS4K5V3IATQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091831068 (206h19m8.522911199s) [noise=true , address=104.36.82.5:4847 , piece_id=QIVSPIJVDTHKE2DUU5TKLLAK7FQWPTVCGLKR6BRPJG3EJHMRK3JQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091916982 (206h19m8.522997103s) [noise=true , address=77.90.31.12:4623 , piece_id=MNWEVMIT4MJ45Y6TNHOVUMJCL74DARWFE544SCOAKJD65K6G3K5A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092127385 (206h19m8.523207516s) [noise=true , address=104.36.82.34:4553 , piece_id=YUQJN4FA453JPCOJ7AZ3E72B3B7MPIV54ONID7CIVYJX7RLPM6ZQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092241313 (206h19m8.523321444s) [noise=true , address=104.36.82.4:4816 , piece_id=6V4HMEGAV6NE7ZZFYF3HE52YALSS4LFXTYGHWYCNRTA675CPLAGQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092480551 (206h19m8.523560682s) [noise=true , address=45.91.116.12:4228 , piece_id=GTUW6GCCRQPLYFNW4ODN26NNX6TAP7VV5R657MT4DGGWGEXGWHAA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092531499 (206h19m8.52361162s) [noise=true , address=104.36.82.23:4478 , piece_id=LYXQ6HBIXBA2U5ZRFT3MYD5PGYVDQ3LH44M5YLIEN4R2R56OSR3A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092889484 (206h19m8.523969615s) [noise=true , address=66.23.193.175:4555 , piece_id=ZUD4HML6YWUZPGBDTB6LQ7C7RVMXAC4MZDCBA74N2NUUHFUB4OXQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093179808 (206h19m8.52425994s) [noise=true , address=104.36.82.50:4047 , piece_id=KWXBCKR42P2MYO7QAALEMW7U5N6LRCR4KSIWRZNXRVLMW2CKDHIQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093442351 (206h19m8.524522482s) [noise=true , address=104.36.82.36:4625 , piece_id=CRGMWD5LBQL44ZX4HFCO6D6R66MTGQ53WTRSSS24HHYBEWN4WOGA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093701787 (206h19m8.524781918s) [noise=true , address=104.36.82.17:4347 , piece_id=WWNAQLZF4YNJDB4XNPTZOXVOTIGSHUA3LYIVSGJCR4BUIL4ESC5A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094480037 (206h19m8.525560158s) [noise=true , address=104.36.82.60:4341 , piece_id=MJ4GT6LKULH4HHZLH3IK6237MTDAO2ITJAFBCDM7GLSRFKYC5Y2A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094685860 (206h19m8.525765991s) [noise=true , address=104.36.82.58:4293 , piece_id=DQUHLEJLKMUUOLMRO6EVNDHZROJYPOHCBW54SNRUKHJTGVM3F6GQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094906172 (206h19m8.525986303s) [noise=true , address=79.127.205.234:4608 , piece_id=P5DUHLGTJP6L3HFWSLEZYFR5UJMWK2LGCEZAREPU3DM2TI4DYHKQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:15.225169591 (206h19m9.656249722s) [upload=214590]: Next returned nil segment
Aug 17 07:45:15.225182507 (206h19m9.656262638s) [upload=214590]: Waiting for error group managing segments...
Aug 17 07:45:15.515447978 (206h19m9.946528109s) [noise=true , address=66.23.193.175:4555 , piece_id=ZUD4HML6YWUZPGBDTB6LQ7C7RVMXAC4MZDCBA74N2NUUHFUB4OXQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.528626353 (206h19m9.959706474s) [noise=true , address=79.127.205.234:4608 , piece_id=P5DUHLGTJP6L3HFWSLEZYFR5UJMWK2LGCEZAREPU3DM2TI4DYHKQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.971468539 (206h19m10.40254867s) [noise=true , address=77.90.31.11:4564 , piece_id=OIAOZVVXED4MPGWG3B3GJ27H5NSEXBLXF24MDHYB6WVQU7AVWGBA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.977919312 (206h19m10.408999443s) [noise=true , address=45.91.116.12:4228 , piece_id=GTUW6GCCRQPLYFNW4ODN26NNX6TAP7VV5R657MT4DGGWGEXGWHAA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.009399344 (206h19m10.440479475s) [noise=true , address=104.36.82.36:4625 , piece_id=CRGMWD5LBQL44ZX4HFCO6D6R66MTGQ53WTRSSS24HHYBEWN4WOGA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.014706840 (206h19m10.445786971s) [noise=true , address=104.36.82.4:4816 , piece_id=6V4HMEGAV6NE7ZZFYF3HE52YALSS4LFXTYGHWYCNRTA675CPLAGQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.037909114 (206h19m10.468989245s) [noise=true , address=77.90.31.12:4623 , piece_id=MNWEVMIT4MJ45Y6TNHOVUMJCL74DARWFE544SCOAKJD65K6G3K5A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.068949626 (206h19m10.500029757s) [noise=true , address=104.36.82.40:4958 , piece_id=CBI7KKYO3VPYYLN5E6ADA67TG2ZUN6S36JL6Y7VWNBS4K5V3IATQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.069334071 (206h19m10.500414202s) [noise=true , address=104.36.82.51:4079 , piece_id=5GQQMLYQLR7NFHXIBLAHP54E4YL4QUPAAFOX2I66ARCWXLDUIXDQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.069399476 (206h19m10.500479607s) [noise=true , address=104.36.82.17:4347 , piece_id=WWNAQLZF4YNJDB4XNPTZOXVOTIGSHUA3LYIVSGJCR4BUIL4ESC5A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.085835583 (206h19m10.516915714s) [noise=true , address=104.36.82.60:4341 , piece_id=MJ4GT6LKULH4HHZLH3IK6237MTDAO2ITJAFBCDM7GLSRFKYC5Y2A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.091441440 (206h19m10.522521571s) [noise=true , address=104.36.82.34:4553 , piece_id=YUQJN4FA453JPCOJ7AZ3E72B3B7MPIV54ONID7CIVYJX7RLPM6ZQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.101678267 (206h19m10.532758398s) [noise=true , address=104.36.82.58:4293 , piece_id=DQUHLEJLKMUUOLMRO6EVNDHZROJYPOHCBW54SNRUKHJTGVM3F6GQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.110842181 (206h19m10.541922312s) [noise=true , address=77.90.31.14:4673 , piece_id=5PJFFLNYYQPZZO4GN2EFLODVQ5I5FBDW4QS635DFBEXPNBHUV4OQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.110862269 (206h19m10.5419424s) [seg_pos={0 0}, upload=214590]: Segment reached optimal threshold of 14 pieces.
Aug 17 07:45:16.110982259 (206h19m10.54206239s) [noise=true , address=104.36.82.23:4478 , piece_id=LYXQ6HBIXBA2U5ZRFT3MYD5PGYVDQ3LH44M5YLIEN4R2R56OSR3A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111085497 (206h19m10.542165618s) [noise=true , address=104.36.82.5:4847 , piece_id=QIVSPIJVDTHKE2DUU5TKLLAK7FQWPTVCGLKR6BRPJG3EJHMRK3JQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111114642 (206h19m10.542194783s) [noise=true , address=45.91.116.13:4179 , piece_id=6YPKZEMV2XGUOXGVKYE4VY3HUB2SJZ4EBHZEFVX5INTP3GV4EP2Q, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pFjszrBBZvWsoeXM43kLgX7uNqk8iwSG8nsE1zbj77GVfQcKn): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111179586 (206h19m10.542259717s) [noise=true , address=104.36.82.50:4047 , piece_id=KWXBCKR42P2MYO7QAALEMW7U5N6LRCR4KSIWRZNXRVLMW2CKDHIQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126Z6tvp49dLLdj3T5snJc4tBVGzcX5UBaGafFN3PkhF92vxpfs): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111195828 (206h19m10.542275959s) [seg_pos={0 0}, upload=214590]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 07:45:16.111255642 (206h19m10.542335773s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 07:45:16.111259339 (206h19m10.54233947s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 07:45:16.555705203 (206h19m10.986785394s) [upload=214590]: Done uploading segments...
Aug 17 07:45:16.555723579 (206h19m10.9868037s) [upload=214590]: Upload finished. err: <nil>
Duration: 5.755386157s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........................X...X...................X.......X..] duration:
1.83960841s
FAIL (2025-08-17 07:51:09 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:49:17.683632787 (206h23m12.114712918s) [upload=214656]: Starting upload Aug 17 07:49:17.683680288 (206h23m12.114760419s) [upload=214656]: Done starting upload Aug 17 07:49:17.683757605 (206h23m12.114837736s) [upload=214656]: Uploading segments... Aug 17 07:49:17.683787674 (206h23m12.114867805s) [upload=214656]: Got next segment. Inline: true Aug 17 07:49:17.683791531 (206h23m12.114871662s) [upload=214656]: Waiting for error group managing segments... Aug 17 07:49:17.683834352 (206h23m12.114914483s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:49:17.683840394 (206h23m12.114920525s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:49:17.683843150 (206h23m12.114923281s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:49:18.039461475 (206h23m12.470541606s) [upload=214656]: Done uploading segments... Aug 17 07:49:18.039480291 (206h23m12.470560422s) [upload=214656]: Upload finished. err: <nil>
Duration: 1.839635894s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X..........X.................................X.......X......] duration:
5.752110689s
FAIL (2025-08-17 07:50:21 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 4fec11e0ae57174b45d52c98e298e2bb47632c0d50913e23618aba51922b9827 != before d36f52834a41803072fb052287b8d4e72dbe3326a8ad23c28f9b67f71ef041b3
======LOGS======
Aug 17 07:45:13.620538576 (206h19m8.051618707s) [upload=214590]: Starting upload
Aug 17 07:45:13.620606657 (206h19m8.051686788s) [upload=214590]: Done starting upload
Aug 17 07:45:13.620743158 (206h19m8.051823289s) [upload=214590]: Uploading segments...
Aug 17 07:45:13.621019707 (206h19m8.052099838s) [upload=214590]: Got next segment. Inline: false
Aug 17 07:45:13.621050977 (206h19m8.052131108s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 07:45:13.621055936 (206h19m8.052136067s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 07:45:14.090546760 (206h19m8.521626891s) [seg_pos={0 0}, upload=214590]: Begin upload segment...
Aug 17 07:45:14.090598500 (206h19m8.521678631s) [seg_pos={0 0}, upload=214590]: Done begin upload segment.
Aug 17 07:45:14.090622556 (206h19m8.521702687s) [noise=true , address=77.90.31.14:4673 , piece_id=5PJFFLNYYQPZZO4GN2EFLODVQ5I5FBDW4QS635DFBEXPNBHUV4OQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.090668424 (206h19m8.521748555s) [noise=true , address=45.91.116.13:4179 , piece_id=6YPKZEMV2XGUOXGVKYE4VY3HUB2SJZ4EBHZEFVX5INTP3GV4EP2Q, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091127582 (206h19m8.522207723s) [noise=true , address=104.36.82.51:4079 , piece_id=5GQQMLYQLR7NFHXIBLAHP54E4YL4QUPAAFOX2I66ARCWXLDUIXDQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091510745 (206h19m8.522590876s) [noise=true , address=77.90.31.11:4564 , piece_id=OIAOZVVXED4MPGWG3B3GJ27H5NSEXBLXF24MDHYB6WVQU7AVWGBA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091579216 (206h19m8.522659357s) [noise=true , address=104.36.82.40:4958 , piece_id=CBI7KKYO3VPYYLN5E6ADA67TG2ZUN6S36JL6Y7VWNBS4K5V3IATQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091831068 (206h19m8.522911199s) [noise=true , address=104.36.82.5:4847 , piece_id=QIVSPIJVDTHKE2DUU5TKLLAK7FQWPTVCGLKR6BRPJG3EJHMRK3JQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091916982 (206h19m8.522997103s) [noise=true , address=77.90.31.12:4623 , piece_id=MNWEVMIT4MJ45Y6TNHOVUMJCL74DARWFE544SCOAKJD65K6G3K5A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092127385 (206h19m8.523207516s) [noise=true , address=104.36.82.34:4553 , piece_id=YUQJN4FA453JPCOJ7AZ3E72B3B7MPIV54ONID7CIVYJX7RLPM6ZQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092241313 (206h19m8.523321444s) [noise=true , address=104.36.82.4:4816 , piece_id=6V4HMEGAV6NE7ZZFYF3HE52YALSS4LFXTYGHWYCNRTA675CPLAGQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092480551 (206h19m8.523560682s) [noise=true , address=45.91.116.12:4228 , piece_id=GTUW6GCCRQPLYFNW4ODN26NNX6TAP7VV5R657MT4DGGWGEXGWHAA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092531499 (206h19m8.52361162s) [noise=true , address=104.36.82.23:4478 , piece_id=LYXQ6HBIXBA2U5ZRFT3MYD5PGYVDQ3LH44M5YLIEN4R2R56OSR3A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092889484 (206h19m8.523969615s) [noise=true , address=66.23.193.175:4555 , piece_id=ZUD4HML6YWUZPGBDTB6LQ7C7RVMXAC4MZDCBA74N2NUUHFUB4OXQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093179808 (206h19m8.52425994s) [noise=true , address=104.36.82.50:4047 , piece_id=KWXBCKR42P2MYO7QAALEMW7U5N6LRCR4KSIWRZNXRVLMW2CKDHIQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093442351 (206h19m8.524522482s) [noise=true , address=104.36.82.36:4625 , piece_id=CRGMWD5LBQL44ZX4HFCO6D6R66MTGQ53WTRSSS24HHYBEWN4WOGA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093701787 (206h19m8.524781918s) [noise=true , address=104.36.82.17:4347 , piece_id=WWNAQLZF4YNJDB4XNPTZOXVOTIGSHUA3LYIVSGJCR4BUIL4ESC5A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094480037 (206h19m8.525560158s) [noise=true , address=104.36.82.60:4341 , piece_id=MJ4GT6LKULH4HHZLH3IK6237MTDAO2ITJAFBCDM7GLSRFKYC5Y2A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094685860 (206h19m8.525765991s) [noise=true , address=104.36.82.58:4293 , piece_id=DQUHLEJLKMUUOLMRO6EVNDHZROJYPOHCBW54SNRUKHJTGVM3F6GQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094906172 (206h19m8.525986303s) [noise=true , address=79.127.205.234:4608 , piece_id=P5DUHLGTJP6L3HFWSLEZYFR5UJMWK2LGCEZAREPU3DM2TI4DYHKQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:15.225169591 (206h19m9.656249722s) [upload=214590]: Next returned nil segment
Aug 17 07:45:15.225182507 (206h19m9.656262638s) [upload=214590]: Waiting for error group managing segments...
Aug 17 07:45:15.515447978 (206h19m9.946528109s) [noise=true , address=66.23.193.175:4555 , piece_id=ZUD4HML6YWUZPGBDTB6LQ7C7RVMXAC4MZDCBA74N2NUUHFUB4OXQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.528626353 (206h19m9.959706474s) [noise=true , address=79.127.205.234:4608 , piece_id=P5DUHLGTJP6L3HFWSLEZYFR5UJMWK2LGCEZAREPU3DM2TI4DYHKQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.971468539 (206h19m10.40254867s) [noise=true , address=77.90.31.11:4564 , piece_id=OIAOZVVXED4MPGWG3B3GJ27H5NSEXBLXF24MDHYB6WVQU7AVWGBA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.977919312 (206h19m10.408999443s) [noise=true , address=45.91.116.12:4228 , piece_id=GTUW6GCCRQPLYFNW4ODN26NNX6TAP7VV5R657MT4DGGWGEXGWHAA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.009399344 (206h19m10.440479475s) [noise=true , address=104.36.82.36:4625 , piece_id=CRGMWD5LBQL44ZX4HFCO6D6R66MTGQ53WTRSSS24HHYBEWN4WOGA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.014706840 (206h19m10.445786971s) [noise=true , address=104.36.82.4:4816 , piece_id=6V4HMEGAV6NE7ZZFYF3HE52YALSS4LFXTYGHWYCNRTA675CPLAGQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.037909114 (206h19m10.468989245s) [noise=true , address=77.90.31.12:4623 , piece_id=MNWEVMIT4MJ45Y6TNHOVUMJCL74DARWFE544SCOAKJD65K6G3K5A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.068949626 (206h19m10.500029757s) [noise=true , address=104.36.82.40:4958 , piece_id=CBI7KKYO3VPYYLN5E6ADA67TG2ZUN6S36JL6Y7VWNBS4K5V3IATQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.069334071 (206h19m10.500414202s) [noise=true , address=104.36.82.51:4079 , piece_id=5GQQMLYQLR7NFHXIBLAHP54E4YL4QUPAAFOX2I66ARCWXLDUIXDQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.069399476 (206h19m10.500479607s) [noise=true , address=104.36.82.17:4347 , piece_id=WWNAQLZF4YNJDB4XNPTZOXVOTIGSHUA3LYIVSGJCR4BUIL4ESC5A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.085835583 (206h19m10.516915714s) [noise=true , address=104.36.82.60:4341 , piece_id=MJ4GT6LKULH4HHZLH3IK6237MTDAO2ITJAFBCDM7GLSRFKYC5Y2A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.091441440 (206h19m10.522521571s) [noise=true , address=104.36.82.34:4553 , piece_id=YUQJN4FA453JPCOJ7AZ3E72B3B7MPIV54ONID7CIVYJX7RLPM6ZQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.101678267 (206h19m10.532758398s) [noise=true , address=104.36.82.58:4293 , piece_id=DQUHLEJLKMUUOLMRO6EVNDHZROJYPOHCBW54SNRUKHJTGVM3F6GQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.110842181 (206h19m10.541922312s) [noise=true , address=77.90.31.14:4673 , piece_id=5PJFFLNYYQPZZO4GN2EFLODVQ5I5FBDW4QS635DFBEXPNBHUV4OQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.110862269 (206h19m10.5419424s) [seg_pos={0 0}, upload=214590]: Segment reached optimal threshold of 14 pieces.
Aug 17 07:45:16.110982259 (206h19m10.54206239s) [noise=true , address=104.36.82.23:4478 , piece_id=LYXQ6HBIXBA2U5ZRFT3MYD5PGYVDQ3LH44M5YLIEN4R2R56OSR3A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111085497 (206h19m10.542165618s) [noise=true , address=104.36.82.5:4847 , piece_id=QIVSPIJVDTHKE2DUU5TKLLAK7FQWPTVCGLKR6BRPJG3EJHMRK3JQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111114642 (206h19m10.542194783s) [noise=true , address=45.91.116.13:4179 , piece_id=6YPKZEMV2XGUOXGVKYE4VY3HUB2SJZ4EBHZEFVX5INTP3GV4EP2Q, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pFjszrBBZvWsoeXM43kLgX7uNqk8iwSG8nsE1zbj77GVfQcKn): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111179586 (206h19m10.542259717s) [noise=true , address=104.36.82.50:4047 , piece_id=KWXBCKR42P2MYO7QAALEMW7U5N6LRCR4KSIWRZNXRVLMW2CKDHIQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126Z6tvp49dLLdj3T5snJc4tBVGzcX5UBaGafFN3PkhF92vxpfs): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111195828 (206h19m10.542275959s) [seg_pos={0 0}, upload=214590]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 07:45:16.111255642 (206h19m10.542335773s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 07:45:16.111259339 (206h19m10.54233947s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 07:45:16.555705203 (206h19m10.986785394s) [upload=214590]: Done uploading segments...
Aug 17 07:45:16.555723579 (206h19m10.9868037s) [upload=214590]: Upload finished. err: <nil>
Duration: 5.752137562s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........................X...X...................X.......X.] duration:
1.812474313s
FAIL (2025-08-17 07:50:18 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:49:17.683632787 (206h23m12.114712918s) [upload=214656]: Starting upload Aug 17 07:49:17.683680288 (206h23m12.114760419s) [upload=214656]: Done starting upload Aug 17 07:49:17.683757605 (206h23m12.114837736s) [upload=214656]: Uploading segments... Aug 17 07:49:17.683787674 (206h23m12.114867805s) [upload=214656]: Got next segment. Inline: true Aug 17 07:49:17.683791531 (206h23m12.114871662s) [upload=214656]: Waiting for error group managing segments... Aug 17 07:49:17.683834352 (206h23m12.114914483s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:49:17.683840394 (206h23m12.114920525s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:49:17.683843150 (206h23m12.114923281s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:49:18.039461475 (206h23m12.470541606s) [upload=214656]: Done uploading segments... Aug 17 07:49:18.039480291 (206h23m12.470560422s) [upload=214656]: Upload finished. err: <nil>
Duration: 1.812512295s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X..........X.................................X.......X.....] duration:
5.782197718s
FAIL (2025-08-17 07:49:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 4fec11e0ae57174b45d52c98e298e2bb47632c0d50913e23618aba51922b9827 != before d36f52834a41803072fb052287b8d4e72dbe3326a8ad23c28f9b67f71ef041b3
======LOGS======
Aug 17 07:45:13.620538576 (206h19m8.051618707s) [upload=214590]: Starting upload
Aug 17 07:45:13.620606657 (206h19m8.051686788s) [upload=214590]: Done starting upload
Aug 17 07:45:13.620743158 (206h19m8.051823289s) [upload=214590]: Uploading segments...
Aug 17 07:45:13.621019707 (206h19m8.052099838s) [upload=214590]: Got next segment. Inline: false
Aug 17 07:45:13.621050977 (206h19m8.052131108s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 07:45:13.621055936 (206h19m8.052136067s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 07:45:14.090546760 (206h19m8.521626891s) [seg_pos={0 0}, upload=214590]: Begin upload segment...
Aug 17 07:45:14.090598500 (206h19m8.521678631s) [seg_pos={0 0}, upload=214590]: Done begin upload segment.
Aug 17 07:45:14.090622556 (206h19m8.521702687s) [noise=true , address=77.90.31.14:4673 , piece_id=5PJFFLNYYQPZZO4GN2EFLODVQ5I5FBDW4QS635DFBEXPNBHUV4OQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.090668424 (206h19m8.521748555s) [noise=true , address=45.91.116.13:4179 , piece_id=6YPKZEMV2XGUOXGVKYE4VY3HUB2SJZ4EBHZEFVX5INTP3GV4EP2Q, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091127582 (206h19m8.522207723s) [noise=true , address=104.36.82.51:4079 , piece_id=5GQQMLYQLR7NFHXIBLAHP54E4YL4QUPAAFOX2I66ARCWXLDUIXDQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091510745 (206h19m8.522590876s) [noise=true , address=77.90.31.11:4564 , piece_id=OIAOZVVXED4MPGWG3B3GJ27H5NSEXBLXF24MDHYB6WVQU7AVWGBA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091579216 (206h19m8.522659357s) [noise=true , address=104.36.82.40:4958 , piece_id=CBI7KKYO3VPYYLN5E6ADA67TG2ZUN6S36JL6Y7VWNBS4K5V3IATQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091831068 (206h19m8.522911199s) [noise=true , address=104.36.82.5:4847 , piece_id=QIVSPIJVDTHKE2DUU5TKLLAK7FQWPTVCGLKR6BRPJG3EJHMRK3JQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091916982 (206h19m8.522997103s) [noise=true , address=77.90.31.12:4623 , piece_id=MNWEVMIT4MJ45Y6TNHOVUMJCL74DARWFE544SCOAKJD65K6G3K5A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092127385 (206h19m8.523207516s) [noise=true , address=104.36.82.34:4553 , piece_id=YUQJN4FA453JPCOJ7AZ3E72B3B7MPIV54ONID7CIVYJX7RLPM6ZQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092241313 (206h19m8.523321444s) [noise=true , address=104.36.82.4:4816 , piece_id=6V4HMEGAV6NE7ZZFYF3HE52YALSS4LFXTYGHWYCNRTA675CPLAGQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092480551 (206h19m8.523560682s) [noise=true , address=45.91.116.12:4228 , piece_id=GTUW6GCCRQPLYFNW4ODN26NNX6TAP7VV5R657MT4DGGWGEXGWHAA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092531499 (206h19m8.52361162s) [noise=true , address=104.36.82.23:4478 , piece_id=LYXQ6HBIXBA2U5ZRFT3MYD5PGYVDQ3LH44M5YLIEN4R2R56OSR3A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092889484 (206h19m8.523969615s) [noise=true , address=66.23.193.175:4555 , piece_id=ZUD4HML6YWUZPGBDTB6LQ7C7RVMXAC4MZDCBA74N2NUUHFUB4OXQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093179808 (206h19m8.52425994s) [noise=true , address=104.36.82.50:4047 , piece_id=KWXBCKR42P2MYO7QAALEMW7U5N6LRCR4KSIWRZNXRVLMW2CKDHIQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093442351 (206h19m8.524522482s) [noise=true , address=104.36.82.36:4625 , piece_id=CRGMWD5LBQL44ZX4HFCO6D6R66MTGQ53WTRSSS24HHYBEWN4WOGA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093701787 (206h19m8.524781918s) [noise=true , address=104.36.82.17:4347 , piece_id=WWNAQLZF4YNJDB4XNPTZOXVOTIGSHUA3LYIVSGJCR4BUIL4ESC5A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094480037 (206h19m8.525560158s) [noise=true , address=104.36.82.60:4341 , piece_id=MJ4GT6LKULH4HHZLH3IK6237MTDAO2ITJAFBCDM7GLSRFKYC5Y2A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094685860 (206h19m8.525765991s) [noise=true , address=104.36.82.58:4293 , piece_id=DQUHLEJLKMUUOLMRO6EVNDHZROJYPOHCBW54SNRUKHJTGVM3F6GQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094906172 (206h19m8.525986303s) [noise=true , address=79.127.205.234:4608 , piece_id=P5DUHLGTJP6L3HFWSLEZYFR5UJMWK2LGCEZAREPU3DM2TI4DYHKQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:15.225169591 (206h19m9.656249722s) [upload=214590]: Next returned nil segment
Aug 17 07:45:15.225182507 (206h19m9.656262638s) [upload=214590]: Waiting for error group managing segments...
Aug 17 07:45:15.515447978 (206h19m9.946528109s) [noise=true , address=66.23.193.175:4555 , piece_id=ZUD4HML6YWUZPGBDTB6LQ7C7RVMXAC4MZDCBA74N2NUUHFUB4OXQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.528626353 (206h19m9.959706474s) [noise=true , address=79.127.205.234:4608 , piece_id=P5DUHLGTJP6L3HFWSLEZYFR5UJMWK2LGCEZAREPU3DM2TI4DYHKQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.971468539 (206h19m10.40254867s) [noise=true , address=77.90.31.11:4564 , piece_id=OIAOZVVXED4MPGWG3B3GJ27H5NSEXBLXF24MDHYB6WVQU7AVWGBA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.977919312 (206h19m10.408999443s) [noise=true , address=45.91.116.12:4228 , piece_id=GTUW6GCCRQPLYFNW4ODN26NNX6TAP7VV5R657MT4DGGWGEXGWHAA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.009399344 (206h19m10.440479475s) [noise=true , address=104.36.82.36:4625 , piece_id=CRGMWD5LBQL44ZX4HFCO6D6R66MTGQ53WTRSSS24HHYBEWN4WOGA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.014706840 (206h19m10.445786971s) [noise=true , address=104.36.82.4:4816 , piece_id=6V4HMEGAV6NE7ZZFYF3HE52YALSS4LFXTYGHWYCNRTA675CPLAGQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.037909114 (206h19m10.468989245s) [noise=true , address=77.90.31.12:4623 , piece_id=MNWEVMIT4MJ45Y6TNHOVUMJCL74DARWFE544SCOAKJD65K6G3K5A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.068949626 (206h19m10.500029757s) [noise=true , address=104.36.82.40:4958 , piece_id=CBI7KKYO3VPYYLN5E6ADA67TG2ZUN6S36JL6Y7VWNBS4K5V3IATQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.069334071 (206h19m10.500414202s) [noise=true , address=104.36.82.51:4079 , piece_id=5GQQMLYQLR7NFHXIBLAHP54E4YL4QUPAAFOX2I66ARCWXLDUIXDQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.069399476 (206h19m10.500479607s) [noise=true , address=104.36.82.17:4347 , piece_id=WWNAQLZF4YNJDB4XNPTZOXVOTIGSHUA3LYIVSGJCR4BUIL4ESC5A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.085835583 (206h19m10.516915714s) [noise=true , address=104.36.82.60:4341 , piece_id=MJ4GT6LKULH4HHZLH3IK6237MTDAO2ITJAFBCDM7GLSRFKYC5Y2A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.091441440 (206h19m10.522521571s) [noise=true , address=104.36.82.34:4553 , piece_id=YUQJN4FA453JPCOJ7AZ3E72B3B7MPIV54ONID7CIVYJX7RLPM6ZQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.101678267 (206h19m10.532758398s) [noise=true , address=104.36.82.58:4293 , piece_id=DQUHLEJLKMUUOLMRO6EVNDHZROJYPOHCBW54SNRUKHJTGVM3F6GQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.110842181 (206h19m10.541922312s) [noise=true , address=77.90.31.14:4673 , piece_id=5PJFFLNYYQPZZO4GN2EFLODVQ5I5FBDW4QS635DFBEXPNBHUV4OQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.110862269 (206h19m10.5419424s) [seg_pos={0 0}, upload=214590]: Segment reached optimal threshold of 14 pieces.
Aug 17 07:45:16.110982259 (206h19m10.54206239s) [noise=true , address=104.36.82.23:4478 , piece_id=LYXQ6HBIXBA2U5ZRFT3MYD5PGYVDQ3LH44M5YLIEN4R2R56OSR3A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111085497 (206h19m10.542165618s) [noise=true , address=104.36.82.5:4847 , piece_id=QIVSPIJVDTHKE2DUU5TKLLAK7FQWPTVCGLKR6BRPJG3EJHMRK3JQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111114642 (206h19m10.542194783s) [noise=true , address=45.91.116.13:4179 , piece_id=6YPKZEMV2XGUOXGVKYE4VY3HUB2SJZ4EBHZEFVX5INTP3GV4EP2Q, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pFjszrBBZvWsoeXM43kLgX7uNqk8iwSG8nsE1zbj77GVfQcKn): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111179586 (206h19m10.542259717s) [noise=true , address=104.36.82.50:4047 , piece_id=KWXBCKR42P2MYO7QAALEMW7U5N6LRCR4KSIWRZNXRVLMW2CKDHIQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126Z6tvp49dLLdj3T5snJc4tBVGzcX5UBaGafFN3PkhF92vxpfs): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111195828 (206h19m10.542275959s) [seg_pos={0 0}, upload=214590]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 07:45:16.111255642 (206h19m10.542335773s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 07:45:16.111259339 (206h19m10.54233947s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 07:45:16.555705203 (206h19m10.986785394s) [upload=214590]: Done uploading segments...
Aug 17 07:45:16.555723579 (206h19m10.9868037s) [upload=214590]: Upload finished. err: <nil>
Duration: 5.78222552s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........................X...X...................X.......X] duration:
1.512030867s
FAIL (2025-08-17 07:49:18 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:49:17.683632787 (206h23m12.114712918s) [upload=214656]: Starting upload Aug 17 07:49:17.683680288 (206h23m12.114760419s) [upload=214656]: Done starting upload Aug 17 07:49:17.683757605 (206h23m12.114837736s) [upload=214656]: Uploading segments... Aug 17 07:49:17.683787674 (206h23m12.114867805s) [upload=214656]: Got next segment. Inline: true Aug 17 07:49:17.683791531 (206h23m12.114871662s) [upload=214656]: Waiting for error group managing segments... Aug 17 07:49:17.683834352 (206h23m12.114914483s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:49:17.683840394 (206h23m12.114920525s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:49:17.683843150 (206h23m12.114923281s) [upload=214656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:49:18.039461475 (206h23m12.470541606s) [upload=214656]: Done uploading segments... Aug 17 07:49:18.039480291 (206h23m12.470560422s) [upload=214656]: Upload finished. err: <nil>
Duration: 1.512055033s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............................X...X...................X.......] duration:
1.826058464s
FAIL (2025-08-17 07:48:44 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:43:14.550805329 (206h17m8.98188547s) [upload=214552]: Starting upload Aug 17 07:43:14.550882056 (206h17m8.981962197s) [upload=214552]: Done starting upload Aug 17 07:43:14.550932912 (206h17m8.982013063s) [upload=214552]: Uploading segments... Aug 17 07:43:14.551009279 (206h17m8.98208943s) [upload=214552]: Got next segment. Inline: true Aug 17 07:43:14.551016502 (206h17m8.982096633s) [upload=214552]: Waiting for error group managing segments... Aug 17 07:43:14.551084844 (206h17m8.982164975s) [upload=214552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:43:14.551091276 (206h17m8.982171397s) [upload=214552]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:43:14.551093961 (206h17m8.982174092s) [upload=214552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:43:14.830808364 (206h17m9.261888505s) [upload=214552]: Done uploading segments... Aug 17 07:43:14.830828873 (206h17m9.261909004s) [upload=214552]: Upload finished. err: <nil>
Duration: 1.826090887s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X..........X.................................X.......X....] duration:
5.535449095s
FAIL (2025-08-17 07:48:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 4fec11e0ae57174b45d52c98e298e2bb47632c0d50913e23618aba51922b9827 != before d36f52834a41803072fb052287b8d4e72dbe3326a8ad23c28f9b67f71ef041b3
======LOGS======
Aug 17 07:45:13.620538576 (206h19m8.051618707s) [upload=214590]: Starting upload
Aug 17 07:45:13.620606657 (206h19m8.051686788s) [upload=214590]: Done starting upload
Aug 17 07:45:13.620743158 (206h19m8.051823289s) [upload=214590]: Uploading segments...
Aug 17 07:45:13.621019707 (206h19m8.052099838s) [upload=214590]: Got next segment. Inline: false
Aug 17 07:45:13.621050977 (206h19m8.052131108s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 07:45:13.621055936 (206h19m8.052136067s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 07:45:14.090546760 (206h19m8.521626891s) [seg_pos={0 0}, upload=214590]: Begin upload segment...
Aug 17 07:45:14.090598500 (206h19m8.521678631s) [seg_pos={0 0}, upload=214590]: Done begin upload segment.
Aug 17 07:45:14.090622556 (206h19m8.521702687s) [noise=true , address=77.90.31.14:4673 , piece_id=5PJFFLNYYQPZZO4GN2EFLODVQ5I5FBDW4QS635DFBEXPNBHUV4OQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.090668424 (206h19m8.521748555s) [noise=true , address=45.91.116.13:4179 , piece_id=6YPKZEMV2XGUOXGVKYE4VY3HUB2SJZ4EBHZEFVX5INTP3GV4EP2Q, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091127582 (206h19m8.522207723s) [noise=true , address=104.36.82.51:4079 , piece_id=5GQQMLYQLR7NFHXIBLAHP54E4YL4QUPAAFOX2I66ARCWXLDUIXDQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091510745 (206h19m8.522590876s) [noise=true , address=77.90.31.11:4564 , piece_id=OIAOZVVXED4MPGWG3B3GJ27H5NSEXBLXF24MDHYB6WVQU7AVWGBA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091579216 (206h19m8.522659357s) [noise=true , address=104.36.82.40:4958 , piece_id=CBI7KKYO3VPYYLN5E6ADA67TG2ZUN6S36JL6Y7VWNBS4K5V3IATQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091831068 (206h19m8.522911199s) [noise=true , address=104.36.82.5:4847 , piece_id=QIVSPIJVDTHKE2DUU5TKLLAK7FQWPTVCGLKR6BRPJG3EJHMRK3JQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091916982 (206h19m8.522997103s) [noise=true , address=77.90.31.12:4623 , piece_id=MNWEVMIT4MJ45Y6TNHOVUMJCL74DARWFE544SCOAKJD65K6G3K5A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092127385 (206h19m8.523207516s) [noise=true , address=104.36.82.34:4553 , piece_id=YUQJN4FA453JPCOJ7AZ3E72B3B7MPIV54ONID7CIVYJX7RLPM6ZQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092241313 (206h19m8.523321444s) [noise=true , address=104.36.82.4:4816 , piece_id=6V4HMEGAV6NE7ZZFYF3HE52YALSS4LFXTYGHWYCNRTA675CPLAGQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092480551 (206h19m8.523560682s) [noise=true , address=45.91.116.12:4228 , piece_id=GTUW6GCCRQPLYFNW4ODN26NNX6TAP7VV5R657MT4DGGWGEXGWHAA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092531499 (206h19m8.52361162s) [noise=true , address=104.36.82.23:4478 , piece_id=LYXQ6HBIXBA2U5ZRFT3MYD5PGYVDQ3LH44M5YLIEN4R2R56OSR3A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092889484 (206h19m8.523969615s) [noise=true , address=66.23.193.175:4555 , piece_id=ZUD4HML6YWUZPGBDTB6LQ7C7RVMXAC4MZDCBA74N2NUUHFUB4OXQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093179808 (206h19m8.52425994s) [noise=true , address=104.36.82.50:4047 , piece_id=KWXBCKR42P2MYO7QAALEMW7U5N6LRCR4KSIWRZNXRVLMW2CKDHIQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093442351 (206h19m8.524522482s) [noise=true , address=104.36.82.36:4625 , piece_id=CRGMWD5LBQL44ZX4HFCO6D6R66MTGQ53WTRSSS24HHYBEWN4WOGA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093701787 (206h19m8.524781918s) [noise=true , address=104.36.82.17:4347 , piece_id=WWNAQLZF4YNJDB4XNPTZOXVOTIGSHUA3LYIVSGJCR4BUIL4ESC5A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094480037 (206h19m8.525560158s) [noise=true , address=104.36.82.60:4341 , piece_id=MJ4GT6LKULH4HHZLH3IK6237MTDAO2ITJAFBCDM7GLSRFKYC5Y2A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094685860 (206h19m8.525765991s) [noise=true , address=104.36.82.58:4293 , piece_id=DQUHLEJLKMUUOLMRO6EVNDHZROJYPOHCBW54SNRUKHJTGVM3F6GQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094906172 (206h19m8.525986303s) [noise=true , address=79.127.205.234:4608 , piece_id=P5DUHLGTJP6L3HFWSLEZYFR5UJMWK2LGCEZAREPU3DM2TI4DYHKQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:15.225169591 (206h19m9.656249722s) [upload=214590]: Next returned nil segment
Aug 17 07:45:15.225182507 (206h19m9.656262638s) [upload=214590]: Waiting for error group managing segments...
Aug 17 07:45:15.515447978 (206h19m9.946528109s) [noise=true , address=66.23.193.175:4555 , piece_id=ZUD4HML6YWUZPGBDTB6LQ7C7RVMXAC4MZDCBA74N2NUUHFUB4OXQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.528626353 (206h19m9.959706474s) [noise=true , address=79.127.205.234:4608 , piece_id=P5DUHLGTJP6L3HFWSLEZYFR5UJMWK2LGCEZAREPU3DM2TI4DYHKQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.971468539 (206h19m10.40254867s) [noise=true , address=77.90.31.11:4564 , piece_id=OIAOZVVXED4MPGWG3B3GJ27H5NSEXBLXF24MDHYB6WVQU7AVWGBA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.977919312 (206h19m10.408999443s) [noise=true , address=45.91.116.12:4228 , piece_id=GTUW6GCCRQPLYFNW4ODN26NNX6TAP7VV5R657MT4DGGWGEXGWHAA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.009399344 (206h19m10.440479475s) [noise=true , address=104.36.82.36:4625 , piece_id=CRGMWD5LBQL44ZX4HFCO6D6R66MTGQ53WTRSSS24HHYBEWN4WOGA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.014706840 (206h19m10.445786971s) [noise=true , address=104.36.82.4:4816 , piece_id=6V4HMEGAV6NE7ZZFYF3HE52YALSS4LFXTYGHWYCNRTA675CPLAGQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.037909114 (206h19m10.468989245s) [noise=true , address=77.90.31.12:4623 , piece_id=MNWEVMIT4MJ45Y6TNHOVUMJCL74DARWFE544SCOAKJD65K6G3K5A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.068949626 (206h19m10.500029757s) [noise=true , address=104.36.82.40:4958 , piece_id=CBI7KKYO3VPYYLN5E6ADA67TG2ZUN6S36JL6Y7VWNBS4K5V3IATQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.069334071 (206h19m10.500414202s) [noise=true , address=104.36.82.51:4079 , piece_id=5GQQMLYQLR7NFHXIBLAHP54E4YL4QUPAAFOX2I66ARCWXLDUIXDQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.069399476 (206h19m10.500479607s) [noise=true , address=104.36.82.17:4347 , piece_id=WWNAQLZF4YNJDB4XNPTZOXVOTIGSHUA3LYIVSGJCR4BUIL4ESC5A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.085835583 (206h19m10.516915714s) [noise=true , address=104.36.82.60:4341 , piece_id=MJ4GT6LKULH4HHZLH3IK6237MTDAO2ITJAFBCDM7GLSRFKYC5Y2A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.091441440 (206h19m10.522521571s) [noise=true , address=104.36.82.34:4553 , piece_id=YUQJN4FA453JPCOJ7AZ3E72B3B7MPIV54ONID7CIVYJX7RLPM6ZQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.101678267 (206h19m10.532758398s) [noise=true , address=104.36.82.58:4293 , piece_id=DQUHLEJLKMUUOLMRO6EVNDHZROJYPOHCBW54SNRUKHJTGVM3F6GQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.110842181 (206h19m10.541922312s) [noise=true , address=77.90.31.14:4673 , piece_id=5PJFFLNYYQPZZO4GN2EFLODVQ5I5FBDW4QS635DFBEXPNBHUV4OQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.110862269 (206h19m10.5419424s) [seg_pos={0 0}, upload=214590]: Segment reached optimal threshold of 14 pieces.
Aug 17 07:45:16.110982259 (206h19m10.54206239s) [noise=true , address=104.36.82.23:4478 , piece_id=LYXQ6HBIXBA2U5ZRFT3MYD5PGYVDQ3LH44M5YLIEN4R2R56OSR3A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111085497 (206h19m10.542165618s) [noise=true , address=104.36.82.5:4847 , piece_id=QIVSPIJVDTHKE2DUU5TKLLAK7FQWPTVCGLKR6BRPJG3EJHMRK3JQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111114642 (206h19m10.542194783s) [noise=true , address=45.91.116.13:4179 , piece_id=6YPKZEMV2XGUOXGVKYE4VY3HUB2SJZ4EBHZEFVX5INTP3GV4EP2Q, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pFjszrBBZvWsoeXM43kLgX7uNqk8iwSG8nsE1zbj77GVfQcKn): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111179586 (206h19m10.542259717s) [noise=true , address=104.36.82.50:4047 , piece_id=KWXBCKR42P2MYO7QAALEMW7U5N6LRCR4KSIWRZNXRVLMW2CKDHIQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126Z6tvp49dLLdj3T5snJc4tBVGzcX5UBaGafFN3PkhF92vxpfs): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111195828 (206h19m10.542275959s) [seg_pos={0 0}, upload=214590]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 07:45:16.111255642 (206h19m10.542335773s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 07:45:16.111259339 (206h19m10.54233947s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 07:45:16.555705203 (206h19m10.986785394s) [upload=214590]: Done uploading segments...
Aug 17 07:45:16.555723579 (206h19m10.9868037s) [upload=214590]: Upload finished. err: <nil>
Duration: 5.535474152s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............................X...X...................X......] duration:
1.845420311s
FAIL (2025-08-17 07:47:38 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:43:14.550805329 (206h17m8.98188547s) [upload=214552]: Starting upload Aug 17 07:43:14.550882056 (206h17m8.981962197s) [upload=214552]: Done starting upload Aug 17 07:43:14.550932912 (206h17m8.982013063s) [upload=214552]: Uploading segments... Aug 17 07:43:14.551009279 (206h17m8.98208943s) [upload=214552]: Got next segment. Inline: true Aug 17 07:43:14.551016502 (206h17m8.982096633s) [upload=214552]: Waiting for error group managing segments... Aug 17 07:43:14.551084844 (206h17m8.982164975s) [upload=214552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:43:14.551091276 (206h17m8.982171397s) [upload=214552]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:43:14.551093961 (206h17m8.982174092s) [upload=214552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:43:14.830808364 (206h17m9.261888505s) [upload=214552]: Done uploading segments... Aug 17 07:43:14.830828873 (206h17m9.261909004s) [upload=214552]: Upload finished. err: <nil>
Duration: 1.845453624s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X..........X.................................X.......X...] duration:
5.63203412s
FAIL (2025-08-17 07:47:19 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 4fec11e0ae57174b45d52c98e298e2bb47632c0d50913e23618aba51922b9827 != before d36f52834a41803072fb052287b8d4e72dbe3326a8ad23c28f9b67f71ef041b3
======LOGS======
Aug 17 07:45:13.620538576 (206h19m8.051618707s) [upload=214590]: Starting upload
Aug 17 07:45:13.620606657 (206h19m8.051686788s) [upload=214590]: Done starting upload
Aug 17 07:45:13.620743158 (206h19m8.051823289s) [upload=214590]: Uploading segments...
Aug 17 07:45:13.621019707 (206h19m8.052099838s) [upload=214590]: Got next segment. Inline: false
Aug 17 07:45:13.621050977 (206h19m8.052131108s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 07:45:13.621055936 (206h19m8.052136067s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 07:45:14.090546760 (206h19m8.521626891s) [seg_pos={0 0}, upload=214590]: Begin upload segment...
Aug 17 07:45:14.090598500 (206h19m8.521678631s) [seg_pos={0 0}, upload=214590]: Done begin upload segment.
Aug 17 07:45:14.090622556 (206h19m8.521702687s) [noise=true , address=77.90.31.14:4673 , piece_id=5PJFFLNYYQPZZO4GN2EFLODVQ5I5FBDW4QS635DFBEXPNBHUV4OQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.090668424 (206h19m8.521748555s) [noise=true , address=45.91.116.13:4179 , piece_id=6YPKZEMV2XGUOXGVKYE4VY3HUB2SJZ4EBHZEFVX5INTP3GV4EP2Q, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091127582 (206h19m8.522207723s) [noise=true , address=104.36.82.51:4079 , piece_id=5GQQMLYQLR7NFHXIBLAHP54E4YL4QUPAAFOX2I66ARCWXLDUIXDQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091510745 (206h19m8.522590876s) [noise=true , address=77.90.31.11:4564 , piece_id=OIAOZVVXED4MPGWG3B3GJ27H5NSEXBLXF24MDHYB6WVQU7AVWGBA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091579216 (206h19m8.522659357s) [noise=true , address=104.36.82.40:4958 , piece_id=CBI7KKYO3VPYYLN5E6ADA67TG2ZUN6S36JL6Y7VWNBS4K5V3IATQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091831068 (206h19m8.522911199s) [noise=true , address=104.36.82.5:4847 , piece_id=QIVSPIJVDTHKE2DUU5TKLLAK7FQWPTVCGLKR6BRPJG3EJHMRK3JQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091916982 (206h19m8.522997103s) [noise=true , address=77.90.31.12:4623 , piece_id=MNWEVMIT4MJ45Y6TNHOVUMJCL74DARWFE544SCOAKJD65K6G3K5A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092127385 (206h19m8.523207516s) [noise=true , address=104.36.82.34:4553 , piece_id=YUQJN4FA453JPCOJ7AZ3E72B3B7MPIV54ONID7CIVYJX7RLPM6ZQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092241313 (206h19m8.523321444s) [noise=true , address=104.36.82.4:4816 , piece_id=6V4HMEGAV6NE7ZZFYF3HE52YALSS4LFXTYGHWYCNRTA675CPLAGQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092480551 (206h19m8.523560682s) [noise=true , address=45.91.116.12:4228 , piece_id=GTUW6GCCRQPLYFNW4ODN26NNX6TAP7VV5R657MT4DGGWGEXGWHAA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092531499 (206h19m8.52361162s) [noise=true , address=104.36.82.23:4478 , piece_id=LYXQ6HBIXBA2U5ZRFT3MYD5PGYVDQ3LH44M5YLIEN4R2R56OSR3A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092889484 (206h19m8.523969615s) [noise=true , address=66.23.193.175:4555 , piece_id=ZUD4HML6YWUZPGBDTB6LQ7C7RVMXAC4MZDCBA74N2NUUHFUB4OXQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093179808 (206h19m8.52425994s) [noise=true , address=104.36.82.50:4047 , piece_id=KWXBCKR42P2MYO7QAALEMW7U5N6LRCR4KSIWRZNXRVLMW2CKDHIQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093442351 (206h19m8.524522482s) [noise=true , address=104.36.82.36:4625 , piece_id=CRGMWD5LBQL44ZX4HFCO6D6R66MTGQ53WTRSSS24HHYBEWN4WOGA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093701787 (206h19m8.524781918s) [noise=true , address=104.36.82.17:4347 , piece_id=WWNAQLZF4YNJDB4XNPTZOXVOTIGSHUA3LYIVSGJCR4BUIL4ESC5A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094480037 (206h19m8.525560158s) [noise=true , address=104.36.82.60:4341 , piece_id=MJ4GT6LKULH4HHZLH3IK6237MTDAO2ITJAFBCDM7GLSRFKYC5Y2A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094685860 (206h19m8.525765991s) [noise=true , address=104.36.82.58:4293 , piece_id=DQUHLEJLKMUUOLMRO6EVNDHZROJYPOHCBW54SNRUKHJTGVM3F6GQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094906172 (206h19m8.525986303s) [noise=true , address=79.127.205.234:4608 , piece_id=P5DUHLGTJP6L3HFWSLEZYFR5UJMWK2LGCEZAREPU3DM2TI4DYHKQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:15.225169591 (206h19m9.656249722s) [upload=214590]: Next returned nil segment
Aug 17 07:45:15.225182507 (206h19m9.656262638s) [upload=214590]: Waiting for error group managing segments...
Aug 17 07:45:15.515447978 (206h19m9.946528109s) [noise=true , address=66.23.193.175:4555 , piece_id=ZUD4HML6YWUZPGBDTB6LQ7C7RVMXAC4MZDCBA74N2NUUHFUB4OXQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.528626353 (206h19m9.959706474s) [noise=true , address=79.127.205.234:4608 , piece_id=P5DUHLGTJP6L3HFWSLEZYFR5UJMWK2LGCEZAREPU3DM2TI4DYHKQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.971468539 (206h19m10.40254867s) [noise=true , address=77.90.31.11:4564 , piece_id=OIAOZVVXED4MPGWG3B3GJ27H5NSEXBLXF24MDHYB6WVQU7AVWGBA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.977919312 (206h19m10.408999443s) [noise=true , address=45.91.116.12:4228 , piece_id=GTUW6GCCRQPLYFNW4ODN26NNX6TAP7VV5R657MT4DGGWGEXGWHAA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.009399344 (206h19m10.440479475s) [noise=true , address=104.36.82.36:4625 , piece_id=CRGMWD5LBQL44ZX4HFCO6D6R66MTGQ53WTRSSS24HHYBEWN4WOGA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.014706840 (206h19m10.445786971s) [noise=true , address=104.36.82.4:4816 , piece_id=6V4HMEGAV6NE7ZZFYF3HE52YALSS4LFXTYGHWYCNRTA675CPLAGQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.037909114 (206h19m10.468989245s) [noise=true , address=77.90.31.12:4623 , piece_id=MNWEVMIT4MJ45Y6TNHOVUMJCL74DARWFE544SCOAKJD65K6G3K5A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.068949626 (206h19m10.500029757s) [noise=true , address=104.36.82.40:4958 , piece_id=CBI7KKYO3VPYYLN5E6ADA67TG2ZUN6S36JL6Y7VWNBS4K5V3IATQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.069334071 (206h19m10.500414202s) [noise=true , address=104.36.82.51:4079 , piece_id=5GQQMLYQLR7NFHXIBLAHP54E4YL4QUPAAFOX2I66ARCWXLDUIXDQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.069399476 (206h19m10.500479607s) [noise=true , address=104.36.82.17:4347 , piece_id=WWNAQLZF4YNJDB4XNPTZOXVOTIGSHUA3LYIVSGJCR4BUIL4ESC5A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.085835583 (206h19m10.516915714s) [noise=true , address=104.36.82.60:4341 , piece_id=MJ4GT6LKULH4HHZLH3IK6237MTDAO2ITJAFBCDM7GLSRFKYC5Y2A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.091441440 (206h19m10.522521571s) [noise=true , address=104.36.82.34:4553 , piece_id=YUQJN4FA453JPCOJ7AZ3E72B3B7MPIV54ONID7CIVYJX7RLPM6ZQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.101678267 (206h19m10.532758398s) [noise=true , address=104.36.82.58:4293 , piece_id=DQUHLEJLKMUUOLMRO6EVNDHZROJYPOHCBW54SNRUKHJTGVM3F6GQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.110842181 (206h19m10.541922312s) [noise=true , address=77.90.31.14:4673 , piece_id=5PJFFLNYYQPZZO4GN2EFLODVQ5I5FBDW4QS635DFBEXPNBHUV4OQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.110862269 (206h19m10.5419424s) [seg_pos={0 0}, upload=214590]: Segment reached optimal threshold of 14 pieces.
Aug 17 07:45:16.110982259 (206h19m10.54206239s) [noise=true , address=104.36.82.23:4478 , piece_id=LYXQ6HBIXBA2U5ZRFT3MYD5PGYVDQ3LH44M5YLIEN4R2R56OSR3A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111085497 (206h19m10.542165618s) [noise=true , address=104.36.82.5:4847 , piece_id=QIVSPIJVDTHKE2DUU5TKLLAK7FQWPTVCGLKR6BRPJG3EJHMRK3JQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111114642 (206h19m10.542194783s) [noise=true , address=45.91.116.13:4179 , piece_id=6YPKZEMV2XGUOXGVKYE4VY3HUB2SJZ4EBHZEFVX5INTP3GV4EP2Q, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pFjszrBBZvWsoeXM43kLgX7uNqk8iwSG8nsE1zbj77GVfQcKn): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111179586 (206h19m10.542259717s) [noise=true , address=104.36.82.50:4047 , piece_id=KWXBCKR42P2MYO7QAALEMW7U5N6LRCR4KSIWRZNXRVLMW2CKDHIQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126Z6tvp49dLLdj3T5snJc4tBVGzcX5UBaGafFN3PkhF92vxpfs): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111195828 (206h19m10.542275959s) [seg_pos={0 0}, upload=214590]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 07:45:16.111255642 (206h19m10.542335773s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 07:45:16.111259339 (206h19m10.54233947s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 07:45:16.555705203 (206h19m10.986785394s) [upload=214590]: Done uploading segments...
Aug 17 07:45:16.555723579 (206h19m10.9868037s) [upload=214590]: Upload finished. err: <nil>
Duration: 5.632058909s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X...X..........X.................................X.......X..] duration:
5.603920846s
FAIL (2025-08-17 07:46:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 4fec11e0ae57174b45d52c98e298e2bb47632c0d50913e23618aba51922b9827 != before d36f52834a41803072fb052287b8d4e72dbe3326a8ad23c28f9b67f71ef041b3
======LOGS======
Aug 17 07:45:13.620538576 (206h19m8.051618707s) [upload=214590]: Starting upload
Aug 17 07:45:13.620606657 (206h19m8.051686788s) [upload=214590]: Done starting upload
Aug 17 07:45:13.620743158 (206h19m8.051823289s) [upload=214590]: Uploading segments...
Aug 17 07:45:13.621019707 (206h19m8.052099838s) [upload=214590]: Got next segment. Inline: false
Aug 17 07:45:13.621050977 (206h19m8.052131108s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 07:45:13.621055936 (206h19m8.052136067s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 07:45:14.090546760 (206h19m8.521626891s) [seg_pos={0 0}, upload=214590]: Begin upload segment...
Aug 17 07:45:14.090598500 (206h19m8.521678631s) [seg_pos={0 0}, upload=214590]: Done begin upload segment.
Aug 17 07:45:14.090622556 (206h19m8.521702687s) [noise=true , address=77.90.31.14:4673 , piece_id=5PJFFLNYYQPZZO4GN2EFLODVQ5I5FBDW4QS635DFBEXPNBHUV4OQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.090668424 (206h19m8.521748555s) [noise=true , address=45.91.116.13:4179 , piece_id=6YPKZEMV2XGUOXGVKYE4VY3HUB2SJZ4EBHZEFVX5INTP3GV4EP2Q, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091127582 (206h19m8.522207723s) [noise=true , address=104.36.82.51:4079 , piece_id=5GQQMLYQLR7NFHXIBLAHP54E4YL4QUPAAFOX2I66ARCWXLDUIXDQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091510745 (206h19m8.522590876s) [noise=true , address=77.90.31.11:4564 , piece_id=OIAOZVVXED4MPGWG3B3GJ27H5NSEXBLXF24MDHYB6WVQU7AVWGBA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091579216 (206h19m8.522659357s) [noise=true , address=104.36.82.40:4958 , piece_id=CBI7KKYO3VPYYLN5E6ADA67TG2ZUN6S36JL6Y7VWNBS4K5V3IATQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091831068 (206h19m8.522911199s) [noise=true , address=104.36.82.5:4847 , piece_id=QIVSPIJVDTHKE2DUU5TKLLAK7FQWPTVCGLKR6BRPJG3EJHMRK3JQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091916982 (206h19m8.522997103s) [noise=true , address=77.90.31.12:4623 , piece_id=MNWEVMIT4MJ45Y6TNHOVUMJCL74DARWFE544SCOAKJD65K6G3K5A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092127385 (206h19m8.523207516s) [noise=true , address=104.36.82.34:4553 , piece_id=YUQJN4FA453JPCOJ7AZ3E72B3B7MPIV54ONID7CIVYJX7RLPM6ZQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092241313 (206h19m8.523321444s) [noise=true , address=104.36.82.4:4816 , piece_id=6V4HMEGAV6NE7ZZFYF3HE52YALSS4LFXTYGHWYCNRTA675CPLAGQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092480551 (206h19m8.523560682s) [noise=true , address=45.91.116.12:4228 , piece_id=GTUW6GCCRQPLYFNW4ODN26NNX6TAP7VV5R657MT4DGGWGEXGWHAA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092531499 (206h19m8.52361162s) [noise=true , address=104.36.82.23:4478 , piece_id=LYXQ6HBIXBA2U5ZRFT3MYD5PGYVDQ3LH44M5YLIEN4R2R56OSR3A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092889484 (206h19m8.523969615s) [noise=true , address=66.23.193.175:4555 , piece_id=ZUD4HML6YWUZPGBDTB6LQ7C7RVMXAC4MZDCBA74N2NUUHFUB4OXQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093179808 (206h19m8.52425994s) [noise=true , address=104.36.82.50:4047 , piece_id=KWXBCKR42P2MYO7QAALEMW7U5N6LRCR4KSIWRZNXRVLMW2CKDHIQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093442351 (206h19m8.524522482s) [noise=true , address=104.36.82.36:4625 , piece_id=CRGMWD5LBQL44ZX4HFCO6D6R66MTGQ53WTRSSS24HHYBEWN4WOGA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093701787 (206h19m8.524781918s) [noise=true , address=104.36.82.17:4347 , piece_id=WWNAQLZF4YNJDB4XNPTZOXVOTIGSHUA3LYIVSGJCR4BUIL4ESC5A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094480037 (206h19m8.525560158s) [noise=true , address=104.36.82.60:4341 , piece_id=MJ4GT6LKULH4HHZLH3IK6237MTDAO2ITJAFBCDM7GLSRFKYC5Y2A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094685860 (206h19m8.525765991s) [noise=true , address=104.36.82.58:4293 , piece_id=DQUHLEJLKMUUOLMRO6EVNDHZROJYPOHCBW54SNRUKHJTGVM3F6GQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094906172 (206h19m8.525986303s) [noise=true , address=79.127.205.234:4608 , piece_id=P5DUHLGTJP6L3HFWSLEZYFR5UJMWK2LGCEZAREPU3DM2TI4DYHKQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:15.225169591 (206h19m9.656249722s) [upload=214590]: Next returned nil segment
Aug 17 07:45:15.225182507 (206h19m9.656262638s) [upload=214590]: Waiting for error group managing segments...
Aug 17 07:45:15.515447978 (206h19m9.946528109s) [noise=true , address=66.23.193.175:4555 , piece_id=ZUD4HML6YWUZPGBDTB6LQ7C7RVMXAC4MZDCBA74N2NUUHFUB4OXQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.528626353 (206h19m9.959706474s) [noise=true , address=79.127.205.234:4608 , piece_id=P5DUHLGTJP6L3HFWSLEZYFR5UJMWK2LGCEZAREPU3DM2TI4DYHKQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.971468539 (206h19m10.40254867s) [noise=true , address=77.90.31.11:4564 , piece_id=OIAOZVVXED4MPGWG3B3GJ27H5NSEXBLXF24MDHYB6WVQU7AVWGBA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.977919312 (206h19m10.408999443s) [noise=true , address=45.91.116.12:4228 , piece_id=GTUW6GCCRQPLYFNW4ODN26NNX6TAP7VV5R657MT4DGGWGEXGWHAA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.009399344 (206h19m10.440479475s) [noise=true , address=104.36.82.36:4625 , piece_id=CRGMWD5LBQL44ZX4HFCO6D6R66MTGQ53WTRSSS24HHYBEWN4WOGA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.014706840 (206h19m10.445786971s) [noise=true , address=104.36.82.4:4816 , piece_id=6V4HMEGAV6NE7ZZFYF3HE52YALSS4LFXTYGHWYCNRTA675CPLAGQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.037909114 (206h19m10.468989245s) [noise=true , address=77.90.31.12:4623 , piece_id=MNWEVMIT4MJ45Y6TNHOVUMJCL74DARWFE544SCOAKJD65K6G3K5A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.068949626 (206h19m10.500029757s) [noise=true , address=104.36.82.40:4958 , piece_id=CBI7KKYO3VPYYLN5E6ADA67TG2ZUN6S36JL6Y7VWNBS4K5V3IATQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.069334071 (206h19m10.500414202s) [noise=true , address=104.36.82.51:4079 , piece_id=5GQQMLYQLR7NFHXIBLAHP54E4YL4QUPAAFOX2I66ARCWXLDUIXDQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.069399476 (206h19m10.500479607s) [noise=true , address=104.36.82.17:4347 , piece_id=WWNAQLZF4YNJDB4XNPTZOXVOTIGSHUA3LYIVSGJCR4BUIL4ESC5A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.085835583 (206h19m10.516915714s) [noise=true , address=104.36.82.60:4341 , piece_id=MJ4GT6LKULH4HHZLH3IK6237MTDAO2ITJAFBCDM7GLSRFKYC5Y2A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.091441440 (206h19m10.522521571s) [noise=true , address=104.36.82.34:4553 , piece_id=YUQJN4FA453JPCOJ7AZ3E72B3B7MPIV54ONID7CIVYJX7RLPM6ZQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.101678267 (206h19m10.532758398s) [noise=true , address=104.36.82.58:4293 , piece_id=DQUHLEJLKMUUOLMRO6EVNDHZROJYPOHCBW54SNRUKHJTGVM3F6GQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.110842181 (206h19m10.541922312s) [noise=true , address=77.90.31.14:4673 , piece_id=5PJFFLNYYQPZZO4GN2EFLODVQ5I5FBDW4QS635DFBEXPNBHUV4OQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.110862269 (206h19m10.5419424s) [seg_pos={0 0}, upload=214590]: Segment reached optimal threshold of 14 pieces.
Aug 17 07:45:16.110982259 (206h19m10.54206239s) [noise=true , address=104.36.82.23:4478 , piece_id=LYXQ6HBIXBA2U5ZRFT3MYD5PGYVDQ3LH44M5YLIEN4R2R56OSR3A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111085497 (206h19m10.542165618s) [noise=true , address=104.36.82.5:4847 , piece_id=QIVSPIJVDTHKE2DUU5TKLLAK7FQWPTVCGLKR6BRPJG3EJHMRK3JQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111114642 (206h19m10.542194783s) [noise=true , address=45.91.116.13:4179 , piece_id=6YPKZEMV2XGUOXGVKYE4VY3HUB2SJZ4EBHZEFVX5INTP3GV4EP2Q, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pFjszrBBZvWsoeXM43kLgX7uNqk8iwSG8nsE1zbj77GVfQcKn): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111179586 (206h19m10.542259717s) [noise=true , address=104.36.82.50:4047 , piece_id=KWXBCKR42P2MYO7QAALEMW7U5N6LRCR4KSIWRZNXRVLMW2CKDHIQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126Z6tvp49dLLdj3T5snJc4tBVGzcX5UBaGafFN3PkhF92vxpfs): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111195828 (206h19m10.542275959s) [seg_pos={0 0}, upload=214590]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 07:45:16.111255642 (206h19m10.542335773s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 07:45:16.111259339 (206h19m10.54233947s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 07:45:16.555705203 (206h19m10.986785394s) [upload=214590]: Done uploading segments...
Aug 17 07:45:16.555723579 (206h19m10.9868037s) [upload=214590]: Upload finished. err: <nil>
Duration: 5.603977193s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............................X...X...................X.....] duration:
1.825875643s
FAIL (2025-08-17 07:46:34 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:43:14.550805329 (206h17m8.98188547s) [upload=214552]: Starting upload Aug 17 07:43:14.550882056 (206h17m8.981962197s) [upload=214552]: Done starting upload Aug 17 07:43:14.550932912 (206h17m8.982013063s) [upload=214552]: Uploading segments... Aug 17 07:43:14.551009279 (206h17m8.98208943s) [upload=214552]: Got next segment. Inline: true Aug 17 07:43:14.551016502 (206h17m8.982096633s) [upload=214552]: Waiting for error group managing segments... Aug 17 07:43:14.551084844 (206h17m8.982164975s) [upload=214552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:43:14.551091276 (206h17m8.982171397s) [upload=214552]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:43:14.551093961 (206h17m8.982174092s) [upload=214552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:43:14.830808364 (206h17m9.261888505s) [upload=214552]: Done uploading segments... Aug 17 07:43:14.830828873 (206h17m9.261909004s) [upload=214552]: Upload finished. err: <nil>
Duration: 1.825907213s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............................X...X...................X....] duration:
1.825668919s
FAIL (2025-08-17 07:46:03 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:43:14.550805329 (206h17m8.98188547s) [upload=214552]: Starting upload Aug 17 07:43:14.550882056 (206h17m8.981962197s) [upload=214552]: Done starting upload Aug 17 07:43:14.550932912 (206h17m8.982013063s) [upload=214552]: Uploading segments... Aug 17 07:43:14.551009279 (206h17m8.98208943s) [upload=214552]: Got next segment. Inline: true Aug 17 07:43:14.551016502 (206h17m8.982096633s) [upload=214552]: Waiting for error group managing segments... Aug 17 07:43:14.551084844 (206h17m8.982164975s) [upload=214552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:43:14.551091276 (206h17m8.982171397s) [upload=214552]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:43:14.551093961 (206h17m8.982174092s) [upload=214552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:43:14.830808364 (206h17m9.261888505s) [upload=214552]: Done uploading segments... Aug 17 07:43:14.830828873 (206h17m9.261909004s) [upload=214552]: Upload finished. err: <nil>
Duration: 1.825700991s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X...X..........X.................................X.......X.] duration:
5.512868513s
FAIL (2025-08-17 07:46:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 4fec11e0ae57174b45d52c98e298e2bb47632c0d50913e23618aba51922b9827 != before d36f52834a41803072fb052287b8d4e72dbe3326a8ad23c28f9b67f71ef041b3
======LOGS======
Aug 17 07:45:13.620538576 (206h19m8.051618707s) [upload=214590]: Starting upload
Aug 17 07:45:13.620606657 (206h19m8.051686788s) [upload=214590]: Done starting upload
Aug 17 07:45:13.620743158 (206h19m8.051823289s) [upload=214590]: Uploading segments...
Aug 17 07:45:13.621019707 (206h19m8.052099838s) [upload=214590]: Got next segment. Inline: false
Aug 17 07:45:13.621050977 (206h19m8.052131108s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 07:45:13.621055936 (206h19m8.052136067s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 07:45:14.090546760 (206h19m8.521626891s) [seg_pos={0 0}, upload=214590]: Begin upload segment...
Aug 17 07:45:14.090598500 (206h19m8.521678631s) [seg_pos={0 0}, upload=214590]: Done begin upload segment.
Aug 17 07:45:14.090622556 (206h19m8.521702687s) [noise=true , address=77.90.31.14:4673 , piece_id=5PJFFLNYYQPZZO4GN2EFLODVQ5I5FBDW4QS635DFBEXPNBHUV4OQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.090668424 (206h19m8.521748555s) [noise=true , address=45.91.116.13:4179 , piece_id=6YPKZEMV2XGUOXGVKYE4VY3HUB2SJZ4EBHZEFVX5INTP3GV4EP2Q, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091127582 (206h19m8.522207723s) [noise=true , address=104.36.82.51:4079 , piece_id=5GQQMLYQLR7NFHXIBLAHP54E4YL4QUPAAFOX2I66ARCWXLDUIXDQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091510745 (206h19m8.522590876s) [noise=true , address=77.90.31.11:4564 , piece_id=OIAOZVVXED4MPGWG3B3GJ27H5NSEXBLXF24MDHYB6WVQU7AVWGBA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091579216 (206h19m8.522659357s) [noise=true , address=104.36.82.40:4958 , piece_id=CBI7KKYO3VPYYLN5E6ADA67TG2ZUN6S36JL6Y7VWNBS4K5V3IATQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091831068 (206h19m8.522911199s) [noise=true , address=104.36.82.5:4847 , piece_id=QIVSPIJVDTHKE2DUU5TKLLAK7FQWPTVCGLKR6BRPJG3EJHMRK3JQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091916982 (206h19m8.522997103s) [noise=true , address=77.90.31.12:4623 , piece_id=MNWEVMIT4MJ45Y6TNHOVUMJCL74DARWFE544SCOAKJD65K6G3K5A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092127385 (206h19m8.523207516s) [noise=true , address=104.36.82.34:4553 , piece_id=YUQJN4FA453JPCOJ7AZ3E72B3B7MPIV54ONID7CIVYJX7RLPM6ZQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092241313 (206h19m8.523321444s) [noise=true , address=104.36.82.4:4816 , piece_id=6V4HMEGAV6NE7ZZFYF3HE52YALSS4LFXTYGHWYCNRTA675CPLAGQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092480551 (206h19m8.523560682s) [noise=true , address=45.91.116.12:4228 , piece_id=GTUW6GCCRQPLYFNW4ODN26NNX6TAP7VV5R657MT4DGGWGEXGWHAA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092531499 (206h19m8.52361162s) [noise=true , address=104.36.82.23:4478 , piece_id=LYXQ6HBIXBA2U5ZRFT3MYD5PGYVDQ3LH44M5YLIEN4R2R56OSR3A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092889484 (206h19m8.523969615s) [noise=true , address=66.23.193.175:4555 , piece_id=ZUD4HML6YWUZPGBDTB6LQ7C7RVMXAC4MZDCBA74N2NUUHFUB4OXQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093179808 (206h19m8.52425994s) [noise=true , address=104.36.82.50:4047 , piece_id=KWXBCKR42P2MYO7QAALEMW7U5N6LRCR4KSIWRZNXRVLMW2CKDHIQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093442351 (206h19m8.524522482s) [noise=true , address=104.36.82.36:4625 , piece_id=CRGMWD5LBQL44ZX4HFCO6D6R66MTGQ53WTRSSS24HHYBEWN4WOGA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093701787 (206h19m8.524781918s) [noise=true , address=104.36.82.17:4347 , piece_id=WWNAQLZF4YNJDB4XNPTZOXVOTIGSHUA3LYIVSGJCR4BUIL4ESC5A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094480037 (206h19m8.525560158s) [noise=true , address=104.36.82.60:4341 , piece_id=MJ4GT6LKULH4HHZLH3IK6237MTDAO2ITJAFBCDM7GLSRFKYC5Y2A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094685860 (206h19m8.525765991s) [noise=true , address=104.36.82.58:4293 , piece_id=DQUHLEJLKMUUOLMRO6EVNDHZROJYPOHCBW54SNRUKHJTGVM3F6GQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094906172 (206h19m8.525986303s) [noise=true , address=79.127.205.234:4608 , piece_id=P5DUHLGTJP6L3HFWSLEZYFR5UJMWK2LGCEZAREPU3DM2TI4DYHKQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:15.225169591 (206h19m9.656249722s) [upload=214590]: Next returned nil segment
Aug 17 07:45:15.225182507 (206h19m9.656262638s) [upload=214590]: Waiting for error group managing segments...
Aug 17 07:45:15.515447978 (206h19m9.946528109s) [noise=true , address=66.23.193.175:4555 , piece_id=ZUD4HML6YWUZPGBDTB6LQ7C7RVMXAC4MZDCBA74N2NUUHFUB4OXQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.528626353 (206h19m9.959706474s) [noise=true , address=79.127.205.234:4608 , piece_id=P5DUHLGTJP6L3HFWSLEZYFR5UJMWK2LGCEZAREPU3DM2TI4DYHKQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.971468539 (206h19m10.40254867s) [noise=true , address=77.90.31.11:4564 , piece_id=OIAOZVVXED4MPGWG3B3GJ27H5NSEXBLXF24MDHYB6WVQU7AVWGBA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.977919312 (206h19m10.408999443s) [noise=true , address=45.91.116.12:4228 , piece_id=GTUW6GCCRQPLYFNW4ODN26NNX6TAP7VV5R657MT4DGGWGEXGWHAA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.009399344 (206h19m10.440479475s) [noise=true , address=104.36.82.36:4625 , piece_id=CRGMWD5LBQL44ZX4HFCO6D6R66MTGQ53WTRSSS24HHYBEWN4WOGA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.014706840 (206h19m10.445786971s) [noise=true , address=104.36.82.4:4816 , piece_id=6V4HMEGAV6NE7ZZFYF3HE52YALSS4LFXTYGHWYCNRTA675CPLAGQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.037909114 (206h19m10.468989245s) [noise=true , address=77.90.31.12:4623 , piece_id=MNWEVMIT4MJ45Y6TNHOVUMJCL74DARWFE544SCOAKJD65K6G3K5A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.068949626 (206h19m10.500029757s) [noise=true , address=104.36.82.40:4958 , piece_id=CBI7KKYO3VPYYLN5E6ADA67TG2ZUN6S36JL6Y7VWNBS4K5V3IATQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.069334071 (206h19m10.500414202s) [noise=true , address=104.36.82.51:4079 , piece_id=5GQQMLYQLR7NFHXIBLAHP54E4YL4QUPAAFOX2I66ARCWXLDUIXDQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.069399476 (206h19m10.500479607s) [noise=true , address=104.36.82.17:4347 , piece_id=WWNAQLZF4YNJDB4XNPTZOXVOTIGSHUA3LYIVSGJCR4BUIL4ESC5A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.085835583 (206h19m10.516915714s) [noise=true , address=104.36.82.60:4341 , piece_id=MJ4GT6LKULH4HHZLH3IK6237MTDAO2ITJAFBCDM7GLSRFKYC5Y2A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.091441440 (206h19m10.522521571s) [noise=true , address=104.36.82.34:4553 , piece_id=YUQJN4FA453JPCOJ7AZ3E72B3B7MPIV54ONID7CIVYJX7RLPM6ZQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.101678267 (206h19m10.532758398s) [noise=true , address=104.36.82.58:4293 , piece_id=DQUHLEJLKMUUOLMRO6EVNDHZROJYPOHCBW54SNRUKHJTGVM3F6GQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.110842181 (206h19m10.541922312s) [noise=true , address=77.90.31.14:4673 , piece_id=5PJFFLNYYQPZZO4GN2EFLODVQ5I5FBDW4QS635DFBEXPNBHUV4OQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.110862269 (206h19m10.5419424s) [seg_pos={0 0}, upload=214590]: Segment reached optimal threshold of 14 pieces.
Aug 17 07:45:16.110982259 (206h19m10.54206239s) [noise=true , address=104.36.82.23:4478 , piece_id=LYXQ6HBIXBA2U5ZRFT3MYD5PGYVDQ3LH44M5YLIEN4R2R56OSR3A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111085497 (206h19m10.542165618s) [noise=true , address=104.36.82.5:4847 , piece_id=QIVSPIJVDTHKE2DUU5TKLLAK7FQWPTVCGLKR6BRPJG3EJHMRK3JQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111114642 (206h19m10.542194783s) [noise=true , address=45.91.116.13:4179 , piece_id=6YPKZEMV2XGUOXGVKYE4VY3HUB2SJZ4EBHZEFVX5INTP3GV4EP2Q, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pFjszrBBZvWsoeXM43kLgX7uNqk8iwSG8nsE1zbj77GVfQcKn): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111179586 (206h19m10.542259717s) [noise=true , address=104.36.82.50:4047 , piece_id=KWXBCKR42P2MYO7QAALEMW7U5N6LRCR4KSIWRZNXRVLMW2CKDHIQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126Z6tvp49dLLdj3T5snJc4tBVGzcX5UBaGafFN3PkhF92vxpfs): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111195828 (206h19m10.542275959s) [seg_pos={0 0}, upload=214590]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 07:45:16.111255642 (206h19m10.542335773s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 07:45:16.111259339 (206h19m10.54233947s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 07:45:16.555705203 (206h19m10.986785394s) [upload=214590]: Done uploading segments...
Aug 17 07:45:16.555723579 (206h19m10.9868037s) [upload=214590]: Upload finished. err: <nil>
Duration: 5.512889573s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X...X..........X.................................X.......X] duration:
5.80895881s
FAIL (2025-08-17 07:45:18 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 4fec11e0ae57174b45d52c98e298e2bb47632c0d50913e23618aba51922b9827 != before d36f52834a41803072fb052287b8d4e72dbe3326a8ad23c28f9b67f71ef041b3
======LOGS======
Aug 17 07:45:13.620538576 (206h19m8.051618707s) [upload=214590]: Starting upload
Aug 17 07:45:13.620606657 (206h19m8.051686788s) [upload=214590]: Done starting upload
Aug 17 07:45:13.620743158 (206h19m8.051823289s) [upload=214590]: Uploading segments...
Aug 17 07:45:13.621019707 (206h19m8.052099838s) [upload=214590]: Got next segment. Inline: false
Aug 17 07:45:13.621050977 (206h19m8.052131108s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 07:45:13.621055936 (206h19m8.052136067s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 07:45:14.090546760 (206h19m8.521626891s) [seg_pos={0 0}, upload=214590]: Begin upload segment...
Aug 17 07:45:14.090598500 (206h19m8.521678631s) [seg_pos={0 0}, upload=214590]: Done begin upload segment.
Aug 17 07:45:14.090622556 (206h19m8.521702687s) [noise=true , address=77.90.31.14:4673 , piece_id=5PJFFLNYYQPZZO4GN2EFLODVQ5I5FBDW4QS635DFBEXPNBHUV4OQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.090668424 (206h19m8.521748555s) [noise=true , address=45.91.116.13:4179 , piece_id=6YPKZEMV2XGUOXGVKYE4VY3HUB2SJZ4EBHZEFVX5INTP3GV4EP2Q, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091127582 (206h19m8.522207723s) [noise=true , address=104.36.82.51:4079 , piece_id=5GQQMLYQLR7NFHXIBLAHP54E4YL4QUPAAFOX2I66ARCWXLDUIXDQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091510745 (206h19m8.522590876s) [noise=true , address=77.90.31.11:4564 , piece_id=OIAOZVVXED4MPGWG3B3GJ27H5NSEXBLXF24MDHYB6WVQU7AVWGBA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091579216 (206h19m8.522659357s) [noise=true , address=104.36.82.40:4958 , piece_id=CBI7KKYO3VPYYLN5E6ADA67TG2ZUN6S36JL6Y7VWNBS4K5V3IATQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091831068 (206h19m8.522911199s) [noise=true , address=104.36.82.5:4847 , piece_id=QIVSPIJVDTHKE2DUU5TKLLAK7FQWPTVCGLKR6BRPJG3EJHMRK3JQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.091916982 (206h19m8.522997103s) [noise=true , address=77.90.31.12:4623 , piece_id=MNWEVMIT4MJ45Y6TNHOVUMJCL74DARWFE544SCOAKJD65K6G3K5A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092127385 (206h19m8.523207516s) [noise=true , address=104.36.82.34:4553 , piece_id=YUQJN4FA453JPCOJ7AZ3E72B3B7MPIV54ONID7CIVYJX7RLPM6ZQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092241313 (206h19m8.523321444s) [noise=true , address=104.36.82.4:4816 , piece_id=6V4HMEGAV6NE7ZZFYF3HE52YALSS4LFXTYGHWYCNRTA675CPLAGQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092480551 (206h19m8.523560682s) [noise=true , address=45.91.116.12:4228 , piece_id=GTUW6GCCRQPLYFNW4ODN26NNX6TAP7VV5R657MT4DGGWGEXGWHAA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092531499 (206h19m8.52361162s) [noise=true , address=104.36.82.23:4478 , piece_id=LYXQ6HBIXBA2U5ZRFT3MYD5PGYVDQ3LH44M5YLIEN4R2R56OSR3A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.092889484 (206h19m8.523969615s) [noise=true , address=66.23.193.175:4555 , piece_id=ZUD4HML6YWUZPGBDTB6LQ7C7RVMXAC4MZDCBA74N2NUUHFUB4OXQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093179808 (206h19m8.52425994s) [noise=true , address=104.36.82.50:4047 , piece_id=KWXBCKR42P2MYO7QAALEMW7U5N6LRCR4KSIWRZNXRVLMW2CKDHIQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093442351 (206h19m8.524522482s) [noise=true , address=104.36.82.36:4625 , piece_id=CRGMWD5LBQL44ZX4HFCO6D6R66MTGQ53WTRSSS24HHYBEWN4WOGA, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.093701787 (206h19m8.524781918s) [noise=true , address=104.36.82.17:4347 , piece_id=WWNAQLZF4YNJDB4XNPTZOXVOTIGSHUA3LYIVSGJCR4BUIL4ESC5A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094480037 (206h19m8.525560158s) [noise=true , address=104.36.82.60:4341 , piece_id=MJ4GT6LKULH4HHZLH3IK6237MTDAO2ITJAFBCDM7GLSRFKYC5Y2A, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094685860 (206h19m8.525765991s) [noise=true , address=104.36.82.58:4293 , piece_id=DQUHLEJLKMUUOLMRO6EVNDHZROJYPOHCBW54SNRUKHJTGVM3F6GQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:14.094906172 (206h19m8.525986303s) [noise=true , address=79.127.205.234:4608 , piece_id=P5DUHLGTJP6L3HFWSLEZYFR5UJMWK2LGCEZAREPU3DM2TI4DYHKQ, seg_pos={0 0}, upload=214590]: Uploading piece...
Aug 17 07:45:15.225169591 (206h19m9.656249722s) [upload=214590]: Next returned nil segment
Aug 17 07:45:15.225182507 (206h19m9.656262638s) [upload=214590]: Waiting for error group managing segments...
Aug 17 07:45:15.515447978 (206h19m9.946528109s) [noise=true , address=66.23.193.175:4555 , piece_id=ZUD4HML6YWUZPGBDTB6LQ7C7RVMXAC4MZDCBA74N2NUUHFUB4OXQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.528626353 (206h19m9.959706474s) [noise=true , address=79.127.205.234:4608 , piece_id=P5DUHLGTJP6L3HFWSLEZYFR5UJMWK2LGCEZAREPU3DM2TI4DYHKQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.971468539 (206h19m10.40254867s) [noise=true , address=77.90.31.11:4564 , piece_id=OIAOZVVXED4MPGWG3B3GJ27H5NSEXBLXF24MDHYB6WVQU7AVWGBA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:15.977919312 (206h19m10.408999443s) [noise=true , address=45.91.116.12:4228 , piece_id=GTUW6GCCRQPLYFNW4ODN26NNX6TAP7VV5R657MT4DGGWGEXGWHAA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.009399344 (206h19m10.440479475s) [noise=true , address=104.36.82.36:4625 , piece_id=CRGMWD5LBQL44ZX4HFCO6D6R66MTGQ53WTRSSS24HHYBEWN4WOGA, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.014706840 (206h19m10.445786971s) [noise=true , address=104.36.82.4:4816 , piece_id=6V4HMEGAV6NE7ZZFYF3HE52YALSS4LFXTYGHWYCNRTA675CPLAGQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.037909114 (206h19m10.468989245s) [noise=true , address=77.90.31.12:4623 , piece_id=MNWEVMIT4MJ45Y6TNHOVUMJCL74DARWFE544SCOAKJD65K6G3K5A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.068949626 (206h19m10.500029757s) [noise=true , address=104.36.82.40:4958 , piece_id=CBI7KKYO3VPYYLN5E6ADA67TG2ZUN6S36JL6Y7VWNBS4K5V3IATQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.069334071 (206h19m10.500414202s) [noise=true , address=104.36.82.51:4079 , piece_id=5GQQMLYQLR7NFHXIBLAHP54E4YL4QUPAAFOX2I66ARCWXLDUIXDQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.069399476 (206h19m10.500479607s) [noise=true , address=104.36.82.17:4347 , piece_id=WWNAQLZF4YNJDB4XNPTZOXVOTIGSHUA3LYIVSGJCR4BUIL4ESC5A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.085835583 (206h19m10.516915714s) [noise=true , address=104.36.82.60:4341 , piece_id=MJ4GT6LKULH4HHZLH3IK6237MTDAO2ITJAFBCDM7GLSRFKYC5Y2A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.091441440 (206h19m10.522521571s) [noise=true , address=104.36.82.34:4553 , piece_id=YUQJN4FA453JPCOJ7AZ3E72B3B7MPIV54ONID7CIVYJX7RLPM6ZQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.101678267 (206h19m10.532758398s) [noise=true , address=104.36.82.58:4293 , piece_id=DQUHLEJLKMUUOLMRO6EVNDHZROJYPOHCBW54SNRUKHJTGVM3F6GQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.110842181 (206h19m10.541922312s) [noise=true , address=77.90.31.14:4673 , piece_id=5PJFFLNYYQPZZO4GN2EFLODVQ5I5FBDW4QS635DFBEXPNBHUV4OQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: <nil>
Aug 17 07:45:16.110862269 (206h19m10.5419424s) [seg_pos={0 0}, upload=214590]: Segment reached optimal threshold of 14 pieces.
Aug 17 07:45:16.110982259 (206h19m10.54206239s) [noise=true , address=104.36.82.23:4478 , piece_id=LYXQ6HBIXBA2U5ZRFT3MYD5PGYVDQ3LH44M5YLIEN4R2R56OSR3A, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111085497 (206h19m10.542165618s) [noise=true , address=104.36.82.5:4847 , piece_id=QIVSPIJVDTHKE2DUU5TKLLAK7FQWPTVCGLKR6BRPJG3EJHMRK3JQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111114642 (206h19m10.542194783s) [noise=true , address=45.91.116.13:4179 , piece_id=6YPKZEMV2XGUOXGVKYE4VY3HUB2SJZ4EBHZEFVX5INTP3GV4EP2Q, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pFjszrBBZvWsoeXM43kLgX7uNqk8iwSG8nsE1zbj77GVfQcKn): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111179586 (206h19m10.542259717s) [noise=true , address=104.36.82.50:4047 , piece_id=KWXBCKR42P2MYO7QAALEMW7U5N6LRCR4KSIWRZNXRVLMW2CKDHIQ, seg_pos={0 0}, upload=214590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126Z6tvp49dLLdj3T5snJc4tBVGzcX5UBaGafFN3PkhF92vxpfs): protocol: expected piece hash; context canceled; EOF
Aug 17 07:45:16.111195828 (206h19m10.542275959s) [seg_pos={0 0}, upload=214590]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 07:45:16.111255642 (206h19m10.542335773s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 07:45:16.111259339 (206h19m10.54233947s) [upload=214590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 07:45:16.555705203 (206h19m10.986785394s) [upload=214590]: Done uploading segments...
Aug 17 07:45:16.555723579 (206h19m10.9868037s) [upload=214590]: Upload finished. err: <nil>
Duration: 5.808973678s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................................X...X...................X...] duration:
1.814236244s
FAIL (2025-08-17 07:45:04 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:43:14.550805329 (206h17m8.98188547s) [upload=214552]: Starting upload Aug 17 07:43:14.550882056 (206h17m8.981962197s) [upload=214552]: Done starting upload Aug 17 07:43:14.550932912 (206h17m8.982013063s) [upload=214552]: Uploading segments... Aug 17 07:43:14.551009279 (206h17m8.98208943s) [upload=214552]: Got next segment. Inline: true Aug 17 07:43:14.551016502 (206h17m8.982096633s) [upload=214552]: Waiting for error group managing segments... Aug 17 07:43:14.551084844 (206h17m8.982164975s) [upload=214552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:43:14.551091276 (206h17m8.982171397s) [upload=214552]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:43:14.551093961 (206h17m8.982174092s) [upload=214552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:43:14.830808364 (206h17m9.261888505s) [upload=214552]: Done uploading segments... Aug 17 07:43:14.830828873 (206h17m9.261909004s) [upload=214552]: Upload finished. err: <nil>
Duration: 1.814263886s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................................X...X...................X..] duration:
1.852258855s
FAIL (2025-08-17 07:44:35 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:43:14.550805329 (206h17m8.98188547s) [upload=214552]: Starting upload Aug 17 07:43:14.550882056 (206h17m8.981962197s) [upload=214552]: Done starting upload Aug 17 07:43:14.550932912 (206h17m8.982013063s) [upload=214552]: Uploading segments... Aug 17 07:43:14.551009279 (206h17m8.98208943s) [upload=214552]: Got next segment. Inline: true Aug 17 07:43:14.551016502 (206h17m8.982096633s) [upload=214552]: Waiting for error group managing segments... Aug 17 07:43:14.551084844 (206h17m8.982164975s) [upload=214552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:43:14.551091276 (206h17m8.982171397s) [upload=214552]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:43:14.551093961 (206h17m8.982174092s) [upload=214552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:43:14.830808364 (206h17m9.261888505s) [upload=214552]: Done uploading segments... Aug 17 07:43:14.830828873 (206h17m9.261909004s) [upload=214552]: Upload finished. err: <nil>
Duration: 1.852283212s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X...X..........X.................................X.......] duration:
5.847305622s
FAIL (2025-08-17 07:44:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 07:38:15.626491355 (206h12m10.057571486s) [upload=214464]: Starting upload Aug 17 07:38:15.626534126 (206h12m10.057614247s) [upload=214464]: Done starting upload Aug 17 07:38:15.626621003 (206h12m10.057701134s) [upload=214464]: Uploading segments... Aug 17 07:38:15.626762423 (206h12m10.057842544s) [upload=214464]: Got next segment. Inline: false Aug 17 07:38:15.626790587 (206h12m10.057870718s) [upload=214464]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:38:15.626795597 (206h12m10.057875728s) [upload=214464]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 07:38:15.842026002 (206h12m10.273106133s) [upload=214464]: Next segment err: metaclient: Too Many Requests Aug 17 07:38:15.842041781 (206h12m10.273121903s) [upload=214464]: Done uploading segments... Aug 17 07:38:15.842053424 (206h12m10.273133545s) [upload=214464]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.847326292s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................................X...X...................X.] duration:
1.817134457s
FAIL (2025-08-17 07:44:10 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 07:43:14.550805329 (206h17m8.98188547s) [upload=214552]: Starting upload Aug 17 07:43:14.550882056 (206h17m8.981962197s) [upload=214552]: Done starting upload Aug 17 07:43:14.550932912 (206h17m8.982013063s) [upload=214552]: Uploading segments... Aug 17 07:43:14.551009279 (206h17m8.98208943s) [upload=214552]: Got next segment. Inline: true Aug 17 07:43:14.551016502 (206h17m8.982096633s) [upload=214552]: Waiting for error group managing segments... Aug 17 07:43:14.551084844 (206h17m8.982164975s) [upload=214552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 07:43:14.551091276 (206h17m8.982171397s) [upload=214552]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 07:43:14.551093961 (206h17m8.982174092s) [upload=214552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 07:43:14.830808364 (206h17m9.261888505s) [upload=214552]: Done uploading segments... Aug 17 07:43:14.830828873 (206h17m9.261909004s) [upload=214552]: Upload finished. err: <nil>
Duration: 1.817164225s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|