Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X...........X...................X....................] duration:
1.87032261s
FAIL (2025-08-12 08:31:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:19:53.360416026 (86h53m47.791496157s) [upload=90531]: Starting upload Aug 12 08:19:53.360459740 (86h53m47.791539861s) [upload=90531]: Done starting upload Aug 12 08:19:53.360505187 (86h53m47.791585318s) [upload=90531]: Uploading segments... Aug 12 08:19:53.360542528 (86h53m47.791622659s) [upload=90531]: Got next segment. Inline: true Aug 12 08:19:53.360547267 (86h53m47.791627388s) [upload=90531]: Waiting for error group managing segments... Aug 12 08:19:53.360580851 (86h53m47.791660982s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:19:53.360585350 (86h53m47.791665481s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:19:53.360588046 (86h53m47.791668177s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:19:53.575072238 (86h53m48.006152369s) [upload=90531]: Done uploading segments... Aug 12 08:19:53.575094721 (86h53m48.006174852s) [upload=90531]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.870347057s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.............XXX.....X..........X...................X.......] duration:
5.704634421s
FAIL (2025-08-12 08:31:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:25:43.979203541 (86h59m38.410283672s) [upload=90630]: Starting upload Aug 12 08:25:43.979266882 (86h59m38.410347013s) [upload=90630]: Done starting upload Aug 12 08:25:43.979357245 (86h59m38.410437376s) [upload=90630]: Uploading segments... Aug 12 08:25:43.979439702 (86h59m38.410519833s) [upload=90630]: Got next segment. Inline: false Aug 12 08:25:43.979464390 (86h59m38.410544511s) [upload=90630]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:25:43.979468678 (86h59m38.410548799s) [upload=90630]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 08:25:44.191455513 (86h59m38.622535645s) [upload=90630]: Next segment err: metaclient: Too Many Requests Aug 12 08:25:44.191480320 (86h59m38.622560441s) [upload=90630]: Done uploading segments... Aug 12 08:25:44.191493666 (86h59m38.622573797s) [upload=90630]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.704657867s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X...........X...................X...................] duration:
1.820276875s
FAIL (2025-08-12 08:31:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:19:53.360416026 (86h53m47.791496157s) [upload=90531]: Starting upload Aug 12 08:19:53.360459740 (86h53m47.791539861s) [upload=90531]: Done starting upload Aug 12 08:19:53.360505187 (86h53m47.791585318s) [upload=90531]: Uploading segments... Aug 12 08:19:53.360542528 (86h53m47.791622659s) [upload=90531]: Got next segment. Inline: true Aug 12 08:19:53.360547267 (86h53m47.791627388s) [upload=90531]: Waiting for error group managing segments... Aug 12 08:19:53.360580851 (86h53m47.791660982s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:19:53.360585350 (86h53m47.791665481s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:19:53.360588046 (86h53m47.791668177s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:19:53.575072238 (86h53m48.006152369s) [upload=90531]: Done uploading segments... Aug 12 08:19:53.575094721 (86h53m48.006174852s) [upload=90531]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.820302474s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X...........X...................X..................] duration:
2.120465593s
FAIL (2025-08-12 08:30:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:19:53.360416026 (86h53m47.791496157s) [upload=90531]: Starting upload Aug 12 08:19:53.360459740 (86h53m47.791539861s) [upload=90531]: Done starting upload Aug 12 08:19:53.360505187 (86h53m47.791585318s) [upload=90531]: Uploading segments... Aug 12 08:19:53.360542528 (86h53m47.791622659s) [upload=90531]: Got next segment. Inline: true Aug 12 08:19:53.360547267 (86h53m47.791627388s) [upload=90531]: Waiting for error group managing segments... Aug 12 08:19:53.360580851 (86h53m47.791660982s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:19:53.360585350 (86h53m47.791665481s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:19:53.360588046 (86h53m47.791668177s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:19:53.575072238 (86h53m48.006152369s) [upload=90531]: Done uploading segments... Aug 12 08:19:53.575094721 (86h53m48.006174852s) [upload=90531]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.120499948s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..............XXX.....X..........X...................X......] duration:
5.760233088s
FAIL (2025-08-12 08:30:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:25:43.979203541 (86h59m38.410283672s) [upload=90630]: Starting upload Aug 12 08:25:43.979266882 (86h59m38.410347013s) [upload=90630]: Done starting upload Aug 12 08:25:43.979357245 (86h59m38.410437376s) [upload=90630]: Uploading segments... Aug 12 08:25:43.979439702 (86h59m38.410519833s) [upload=90630]: Got next segment. Inline: false Aug 12 08:25:43.979464390 (86h59m38.410544511s) [upload=90630]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:25:43.979468678 (86h59m38.410548799s) [upload=90630]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 08:25:44.191455513 (86h59m38.622535645s) [upload=90630]: Next segment err: metaclient: Too Many Requests Aug 12 08:25:44.191480320 (86h59m38.622560441s) [upload=90630]: Done uploading segments... Aug 12 08:25:44.191493666 (86h59m38.622573797s) [upload=90630]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.76026046s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X...........X...................X.................] duration:
1.847598941s
FAIL (2025-08-12 08:30:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:19:53.360416026 (86h53m47.791496157s) [upload=90531]: Starting upload Aug 12 08:19:53.360459740 (86h53m47.791539861s) [upload=90531]: Done starting upload Aug 12 08:19:53.360505187 (86h53m47.791585318s) [upload=90531]: Uploading segments... Aug 12 08:19:53.360542528 (86h53m47.791622659s) [upload=90531]: Got next segment. Inline: true Aug 12 08:19:53.360547267 (86h53m47.791627388s) [upload=90531]: Waiting for error group managing segments... Aug 12 08:19:53.360580851 (86h53m47.791660982s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:19:53.360585350 (86h53m47.791665481s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:19:53.360588046 (86h53m47.791668177s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:19:53.575072238 (86h53m48.006152369s) [upload=90531]: Done uploading segments... Aug 12 08:19:53.575094721 (86h53m48.006174852s) [upload=90531]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.847617678s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...............XXX.....X..........X...................X.....] duration:
5.842029049s
FAIL (2025-08-12 08:30:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:25:43.979203541 (86h59m38.410283672s) [upload=90630]: Starting upload Aug 12 08:25:43.979266882 (86h59m38.410347013s) [upload=90630]: Done starting upload Aug 12 08:25:43.979357245 (86h59m38.410437376s) [upload=90630]: Uploading segments... Aug 12 08:25:43.979439702 (86h59m38.410519833s) [upload=90630]: Got next segment. Inline: false Aug 12 08:25:43.979464390 (86h59m38.410544511s) [upload=90630]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:25:43.979468678 (86h59m38.410548799s) [upload=90630]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 08:25:44.191455513 (86h59m38.622535645s) [upload=90630]: Next segment err: metaclient: Too Many Requests Aug 12 08:25:44.191480320 (86h59m38.622560441s) [upload=90630]: Done uploading segments... Aug 12 08:25:44.191493666 (86h59m38.622573797s) [upload=90630]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.842053204s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X...........X...................X................] duration:
1.94485745s
FAIL (2025-08-12 08:29:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:19:53.360416026 (86h53m47.791496157s) [upload=90531]: Starting upload Aug 12 08:19:53.360459740 (86h53m47.791539861s) [upload=90531]: Done starting upload Aug 12 08:19:53.360505187 (86h53m47.791585318s) [upload=90531]: Uploading segments... Aug 12 08:19:53.360542528 (86h53m47.791622659s) [upload=90531]: Got next segment. Inline: true Aug 12 08:19:53.360547267 (86h53m47.791627388s) [upload=90531]: Waiting for error group managing segments... Aug 12 08:19:53.360580851 (86h53m47.791660982s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:19:53.360585350 (86h53m47.791665481s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:19:53.360588046 (86h53m47.791668177s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:19:53.575072238 (86h53m48.006152369s) [upload=90531]: Done uploading segments... Aug 12 08:19:53.575094721 (86h53m48.006174852s) [upload=90531]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.944895041s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X...........X...................X...............] duration:
1.97126031s
FAIL (2025-08-12 08:29:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:19:53.360416026 (86h53m47.791496157s) [upload=90531]: Starting upload Aug 12 08:19:53.360459740 (86h53m47.791539861s) [upload=90531]: Done starting upload Aug 12 08:19:53.360505187 (86h53m47.791585318s) [upload=90531]: Uploading segments... Aug 12 08:19:53.360542528 (86h53m47.791622659s) [upload=90531]: Got next segment. Inline: true Aug 12 08:19:53.360547267 (86h53m47.791627388s) [upload=90531]: Waiting for error group managing segments... Aug 12 08:19:53.360580851 (86h53m47.791660982s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:19:53.360585350 (86h53m47.791665481s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:19:53.360588046 (86h53m47.791668177s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:19:53.575072238 (86h53m48.006152369s) [upload=90531]: Done uploading segments... Aug 12 08:19:53.575094721 (86h53m48.006174852s) [upload=90531]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.97128719s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [X...............XXX.....X..........X...................X....] duration:
6.052794775s
FAIL (2025-08-12 08:29:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:25:43.979203541 (86h59m38.410283672s) [upload=90630]: Starting upload Aug 12 08:25:43.979266882 (86h59m38.410347013s) [upload=90630]: Done starting upload Aug 12 08:25:43.979357245 (86h59m38.410437376s) [upload=90630]: Uploading segments... Aug 12 08:25:43.979439702 (86h59m38.410519833s) [upload=90630]: Got next segment. Inline: false Aug 12 08:25:43.979464390 (86h59m38.410544511s) [upload=90630]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:25:43.979468678 (86h59m38.410548799s) [upload=90630]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 08:25:44.191455513 (86h59m38.622535645s) [upload=90630]: Next segment err: metaclient: Too Many Requests Aug 12 08:25:44.191480320 (86h59m38.622560441s) [upload=90630]: Done uploading segments... Aug 12 08:25:44.191493666 (86h59m38.622573797s) [upload=90630]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.052821276s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X...........X...................X..............] duration:
1.93677097s
FAIL (2025-08-12 08:28:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:19:53.360416026 (86h53m47.791496157s) [upload=90531]: Starting upload Aug 12 08:19:53.360459740 (86h53m47.791539861s) [upload=90531]: Done starting upload Aug 12 08:19:53.360505187 (86h53m47.791585318s) [upload=90531]: Uploading segments... Aug 12 08:19:53.360542528 (86h53m47.791622659s) [upload=90531]: Got next segment. Inline: true Aug 12 08:19:53.360547267 (86h53m47.791627388s) [upload=90531]: Waiting for error group managing segments... Aug 12 08:19:53.360580851 (86h53m47.791660982s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:19:53.360585350 (86h53m47.791665481s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:19:53.360588046 (86h53m47.791668177s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:19:53.575072238 (86h53m48.006152369s) [upload=90531]: Done uploading segments... Aug 12 08:19:53.575094721 (86h53m48.006174852s) [upload=90531]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.936795076s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X...........X...................X.............] duration:
1.843245869s
FAIL (2025-08-12 08:28:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:19:53.360416026 (86h53m47.791496157s) [upload=90531]: Starting upload Aug 12 08:19:53.360459740 (86h53m47.791539861s) [upload=90531]: Done starting upload Aug 12 08:19:53.360505187 (86h53m47.791585318s) [upload=90531]: Uploading segments... Aug 12 08:19:53.360542528 (86h53m47.791622659s) [upload=90531]: Got next segment. Inline: true Aug 12 08:19:53.360547267 (86h53m47.791627388s) [upload=90531]: Waiting for error group managing segments... Aug 12 08:19:53.360580851 (86h53m47.791660982s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:19:53.360585350 (86h53m47.791665481s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:19:53.360588046 (86h53m47.791668177s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:19:53.575072238 (86h53m48.006152369s) [upload=90531]: Done uploading segments... Aug 12 08:19:53.575094721 (86h53m48.006174852s) [upload=90531]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.843268381s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.X...............XXX.....X..........X...................X...] duration:
5.751851433s
FAIL (2025-08-12 08:28:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:25:43.979203541 (86h59m38.410283672s) [upload=90630]: Starting upload Aug 12 08:25:43.979266882 (86h59m38.410347013s) [upload=90630]: Done starting upload Aug 12 08:25:43.979357245 (86h59m38.410437376s) [upload=90630]: Uploading segments... Aug 12 08:25:43.979439702 (86h59m38.410519833s) [upload=90630]: Got next segment. Inline: false Aug 12 08:25:43.979464390 (86h59m38.410544511s) [upload=90630]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:25:43.979468678 (86h59m38.410548799s) [upload=90630]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 08:25:44.191455513 (86h59m38.622535645s) [upload=90630]: Next segment err: metaclient: Too Many Requests Aug 12 08:25:44.191480320 (86h59m38.622560441s) [upload=90630]: Done uploading segments... Aug 12 08:25:44.191493666 (86h59m38.622573797s) [upload=90630]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.751883033s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X...........X...................X............] duration:
1.823613329s
FAIL (2025-08-12 08:27:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:19:53.360416026 (86h53m47.791496157s) [upload=90531]: Starting upload Aug 12 08:19:53.360459740 (86h53m47.791539861s) [upload=90531]: Done starting upload Aug 12 08:19:53.360505187 (86h53m47.791585318s) [upload=90531]: Uploading segments... Aug 12 08:19:53.360542528 (86h53m47.791622659s) [upload=90531]: Got next segment. Inline: true Aug 12 08:19:53.360547267 (86h53m47.791627388s) [upload=90531]: Waiting for error group managing segments... Aug 12 08:19:53.360580851 (86h53m47.791660982s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:19:53.360585350 (86h53m47.791665481s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:19:53.360588046 (86h53m47.791668177s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:19:53.575072238 (86h53m48.006152369s) [upload=90531]: Done uploading segments... Aug 12 08:19:53.575094721 (86h53m48.006174852s) [upload=90531]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.823639489s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [..X...............XXX.....X..........X...................X..] duration:
5.886489931s
FAIL (2025-08-12 08:27:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:25:43.979203541 (86h59m38.410283672s) [upload=90630]: Starting upload Aug 12 08:25:43.979266882 (86h59m38.410347013s) [upload=90630]: Done starting upload Aug 12 08:25:43.979357245 (86h59m38.410437376s) [upload=90630]: Uploading segments... Aug 12 08:25:43.979439702 (86h59m38.410519833s) [upload=90630]: Got next segment. Inline: false Aug 12 08:25:43.979464390 (86h59m38.410544511s) [upload=90630]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:25:43.979468678 (86h59m38.410548799s) [upload=90630]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 08:25:44.191455513 (86h59m38.622535645s) [upload=90630]: Next segment err: metaclient: Too Many Requests Aug 12 08:25:44.191480320 (86h59m38.622560441s) [upload=90630]: Done uploading segments... Aug 12 08:25:44.191493666 (86h59m38.622573797s) [upload=90630]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.88656751s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X...........X...................X...........] duration:
1.954860991s
FAIL (2025-08-12 08:27:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:19:53.360416026 (86h53m47.791496157s) [upload=90531]: Starting upload Aug 12 08:19:53.360459740 (86h53m47.791539861s) [upload=90531]: Done starting upload Aug 12 08:19:53.360505187 (86h53m47.791585318s) [upload=90531]: Uploading segments... Aug 12 08:19:53.360542528 (86h53m47.791622659s) [upload=90531]: Got next segment. Inline: true Aug 12 08:19:53.360547267 (86h53m47.791627388s) [upload=90531]: Waiting for error group managing segments... Aug 12 08:19:53.360580851 (86h53m47.791660982s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:19:53.360585350 (86h53m47.791665481s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:19:53.360588046 (86h53m47.791668177s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:19:53.575072238 (86h53m48.006152369s) [upload=90531]: Done uploading segments... Aug 12 08:19:53.575094721 (86h53m48.006174852s) [upload=90531]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.95488638s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X...........X...................X..........] duration:
2.042850379s
FAIL (2025-08-12 08:26:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:19:53.360416026 (86h53m47.791496157s) [upload=90531]: Starting upload Aug 12 08:19:53.360459740 (86h53m47.791539861s) [upload=90531]: Done starting upload Aug 12 08:19:53.360505187 (86h53m47.791585318s) [upload=90531]: Uploading segments... Aug 12 08:19:53.360542528 (86h53m47.791622659s) [upload=90531]: Got next segment. Inline: true Aug 12 08:19:53.360547267 (86h53m47.791627388s) [upload=90531]: Waiting for error group managing segments... Aug 12 08:19:53.360580851 (86h53m47.791660982s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:19:53.360585350 (86h53m47.791665481s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:19:53.360588046 (86h53m47.791668177s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:19:53.575072238 (86h53m48.006152369s) [upload=90531]: Done uploading segments... Aug 12 08:19:53.575094721 (86h53m48.006174852s) [upload=90531]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.04287734s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [X..X...............XXX.....X..........X...................X.] duration:
5.67166968s
FAIL (2025-08-12 08:26:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:25:43.979203541 (86h59m38.410283672s) [upload=90630]: Starting upload Aug 12 08:25:43.979266882 (86h59m38.410347013s) [upload=90630]: Done starting upload Aug 12 08:25:43.979357245 (86h59m38.410437376s) [upload=90630]: Uploading segments... Aug 12 08:25:43.979439702 (86h59m38.410519833s) [upload=90630]: Got next segment. Inline: false Aug 12 08:25:43.979464390 (86h59m38.410544511s) [upload=90630]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:25:43.979468678 (86h59m38.410548799s) [upload=90630]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 08:25:44.191455513 (86h59m38.622535645s) [upload=90630]: Next segment err: metaclient: Too Many Requests Aug 12 08:25:44.191480320 (86h59m38.622560441s) [upload=90630]: Done uploading segments... Aug 12 08:25:44.191493666 (86h59m38.622573797s) [upload=90630]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.671702754s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X...........X...................X.........] duration:
1.825294794s
FAIL (2025-08-12 08:25:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:19:53.360416026 (86h53m47.791496157s) [upload=90531]: Starting upload Aug 12 08:19:53.360459740 (86h53m47.791539861s) [upload=90531]: Done starting upload Aug 12 08:19:53.360505187 (86h53m47.791585318s) [upload=90531]: Uploading segments... Aug 12 08:19:53.360542528 (86h53m47.791622659s) [upload=90531]: Got next segment. Inline: true Aug 12 08:19:53.360547267 (86h53m47.791627388s) [upload=90531]: Waiting for error group managing segments... Aug 12 08:19:53.360580851 (86h53m47.791660982s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:19:53.360585350 (86h53m47.791665481s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:19:53.360588046 (86h53m47.791668177s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:19:53.575072238 (86h53m48.006152369s) [upload=90531]: Done uploading segments... Aug 12 08:19:53.575094721 (86h53m48.006174852s) [upload=90531]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.825334691s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [.X..X...............XXX.....X..........X...................X] duration:
854.37668ms
FAIL (2025-08-12 08:25:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:25:43.979203541 (86h59m38.410283672s) [upload=90630]: Starting upload Aug 12 08:25:43.979266882 (86h59m38.410347013s) [upload=90630]: Done starting upload Aug 12 08:25:43.979357245 (86h59m38.410437376s) [upload=90630]: Uploading segments... Aug 12 08:25:43.979439702 (86h59m38.410519833s) [upload=90630]: Got next segment. Inline: false Aug 12 08:25:43.979464390 (86h59m38.410544511s) [upload=90630]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:25:43.979468678 (86h59m38.410548799s) [upload=90630]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 08:25:44.191455513 (86h59m38.622535645s) [upload=90630]: Next segment err: metaclient: Too Many Requests Aug 12 08:25:44.191480320 (86h59m38.622560441s) [upload=90630]: Done uploading segments... Aug 12 08:25:44.191493666 (86h59m38.622573797s) [upload=90630]: Upload finished. err: metaclient: Too Many Requests
Duration: 854.396058ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X...........X...................X........] duration:
1.881881298s
FAIL (2025-08-12 08:25:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:19:53.360416026 (86h53m47.791496157s) [upload=90531]: Starting upload Aug 12 08:19:53.360459740 (86h53m47.791539861s) [upload=90531]: Done starting upload Aug 12 08:19:53.360505187 (86h53m47.791585318s) [upload=90531]: Uploading segments... Aug 12 08:19:53.360542528 (86h53m47.791622659s) [upload=90531]: Got next segment. Inline: true Aug 12 08:19:53.360547267 (86h53m47.791627388s) [upload=90531]: Waiting for error group managing segments... Aug 12 08:19:53.360580851 (86h53m47.791660982s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:19:53.360585350 (86h53m47.791665481s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:19:53.360588046 (86h53m47.791668177s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:19:53.575072238 (86h53m48.006152369s) [upload=90531]: Done uploading segments... Aug 12 08:19:53.575094721 (86h53m48.006174852s) [upload=90531]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.881920344s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [..X..X...............XXX.....X..........X...................] duration:
5.87919937s
FAIL (2025-08-12 08:25:12 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0541524414bf0ab1f0120df54344a6488221348d350cc5ba3083d90fcc59bff6 != before bca785758da141099ae40d74d5d98242818dbb2f97045270e27eff3867a75c15
======LOGS======
Aug 12 08:09:34.518392650 (86h43m28.949472781s) [upload=90348]: Starting upload
Aug 12 08:09:34.518438588 (86h43m28.949518719s) [upload=90348]: Done starting upload
Aug 12 08:09:34.518530284 (86h43m28.949610415s) [upload=90348]: Uploading segments...
Aug 12 08:09:34.518693356 (86h43m28.949773487s) [upload=90348]: Got next segment. Inline: false
Aug 12 08:09:34.518723123 (86h43m28.949803244s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:09:34.518727791 (86h43m28.949807922s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:09:34.994551934 (86h43m29.425649047s) [seg_pos={0 0}, upload=90348]: Begin upload segment...
Aug 12 08:09:34.994613311 (86h43m29.425693442s) [seg_pos={0 0}, upload=90348]: Done begin upload segment.
Aug 12 08:09:34.994639210 (86h43m29.425719342s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.994728832 (86h43m29.425808953s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995016151 (86h43m29.426096282s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995157472 (86h43m29.426237603s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995386059 (86h43m29.42646619s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995532319 (86h43m29.42661244s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995737302 (86h43m29.426817433s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995836070 (86h43m29.426916201s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996007398 (86h43m29.42708753s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996111497 (86h43m29.427191618s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996271764 (86h43m29.427351895s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996568872 (86h43m29.427649003s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996593449 (86h43m29.427673591s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996818540 (86h43m29.427898671s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997048910 (86h43m29.428129041s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997230117 (86h43m29.428310248s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997284461 (86h43m29.428364592s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997895721 (86h43m29.428975842s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:36.173165467 (86h43m30.604245598s) [upload=90348]: Next returned nil segment
Aug 12 08:09:36.173182580 (86h43m30.604262701s) [upload=90348]: Waiting for error group managing segments...
Aug 12 08:09:36.472128999 (86h43m30.903209131s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.501144544 (86h43m30.932224675s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.506666519 (86h43m30.93774665s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.975977670 (86h43m31.407057801s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.003408231 (86h43m31.434488372s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.004134902 (86h43m31.435215043s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.039682183 (86h43m31.470762304s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.052540554 (86h43m31.483620685s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.058179543 (86h43m31.489259674s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.071996118 (86h43m31.503076249s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.073423749 (86h43m31.504503881s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088308768 (86h43m31.519388899s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088912863 (86h43m31.519992995s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106290181 (86h43m31.537370312s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106315128 (86h43m31.537395249s) [seg_pos={0 0}, upload=90348]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:09:37.106421512 (86h43m31.537501643s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CspvuKb3CWXrAW8FtFEoCVUNhLzWsbpwpW5uUfgyWy71R3qYX): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106474003 (86h43m31.537554134s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106542022 (86h43m31.537622153s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r5RXjrbpRcyxvcYhpoqQdgv8MD8zLmpninS7D3cdNCid4Rc8j): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106648326 (86h43m31.537728457s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106700646 (86h43m31.537780777s) [seg_pos={0 0}, upload=90348]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:09:37.106784566 (86h43m31.537864697s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:09:37.106790037 (86h43m31.537870168s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:09:37.396978732 (86h43m31.828058863s) [upload=90348]: Done uploading segments...
Aug 12 08:09:37.397002888 (86h43m31.828083069s) [upload=90348]: Upload finished. err: <nil>
Duration: 5.879227464s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [...X..X...............XXX.....X..........X..................] duration:
5.652685663s
FAIL (2025-08-12 08:24:44 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0541524414bf0ab1f0120df54344a6488221348d350cc5ba3083d90fcc59bff6 != before bca785758da141099ae40d74d5d98242818dbb2f97045270e27eff3867a75c15
======LOGS======
Aug 12 08:09:34.518392650 (86h43m28.949472781s) [upload=90348]: Starting upload
Aug 12 08:09:34.518438588 (86h43m28.949518719s) [upload=90348]: Done starting upload
Aug 12 08:09:34.518530284 (86h43m28.949610415s) [upload=90348]: Uploading segments...
Aug 12 08:09:34.518693356 (86h43m28.949773487s) [upload=90348]: Got next segment. Inline: false
Aug 12 08:09:34.518723123 (86h43m28.949803244s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:09:34.518727791 (86h43m28.949807922s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:09:34.994551934 (86h43m29.425649047s) [seg_pos={0 0}, upload=90348]: Begin upload segment...
Aug 12 08:09:34.994613311 (86h43m29.425693442s) [seg_pos={0 0}, upload=90348]: Done begin upload segment.
Aug 12 08:09:34.994639210 (86h43m29.425719342s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.994728832 (86h43m29.425808953s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995016151 (86h43m29.426096282s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995157472 (86h43m29.426237603s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995386059 (86h43m29.42646619s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995532319 (86h43m29.42661244s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995737302 (86h43m29.426817433s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995836070 (86h43m29.426916201s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996007398 (86h43m29.42708753s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996111497 (86h43m29.427191618s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996271764 (86h43m29.427351895s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996568872 (86h43m29.427649003s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996593449 (86h43m29.427673591s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996818540 (86h43m29.427898671s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997048910 (86h43m29.428129041s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997230117 (86h43m29.428310248s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997284461 (86h43m29.428364592s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997895721 (86h43m29.428975842s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:36.173165467 (86h43m30.604245598s) [upload=90348]: Next returned nil segment
Aug 12 08:09:36.173182580 (86h43m30.604262701s) [upload=90348]: Waiting for error group managing segments...
Aug 12 08:09:36.472128999 (86h43m30.903209131s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.501144544 (86h43m30.932224675s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.506666519 (86h43m30.93774665s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.975977670 (86h43m31.407057801s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.003408231 (86h43m31.434488372s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.004134902 (86h43m31.435215043s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.039682183 (86h43m31.470762304s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.052540554 (86h43m31.483620685s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.058179543 (86h43m31.489259674s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.071996118 (86h43m31.503076249s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.073423749 (86h43m31.504503881s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088308768 (86h43m31.519388899s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088912863 (86h43m31.519992995s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106290181 (86h43m31.537370312s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106315128 (86h43m31.537395249s) [seg_pos={0 0}, upload=90348]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:09:37.106421512 (86h43m31.537501643s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CspvuKb3CWXrAW8FtFEoCVUNhLzWsbpwpW5uUfgyWy71R3qYX): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106474003 (86h43m31.537554134s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106542022 (86h43m31.537622153s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r5RXjrbpRcyxvcYhpoqQdgv8MD8zLmpninS7D3cdNCid4Rc8j): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106648326 (86h43m31.537728457s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106700646 (86h43m31.537780777s) [seg_pos={0 0}, upload=90348]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:09:37.106784566 (86h43m31.537864697s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:09:37.106790037 (86h43m31.537870168s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:09:37.396978732 (86h43m31.828058863s) [upload=90348]: Done uploading segments...
Aug 12 08:09:37.397002888 (86h43m31.828083069s) [upload=90348]: Upload finished. err: <nil>
Duration: 5.652706631s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X...........X...................X.......] duration:
1.862303822s
FAIL (2025-08-12 08:24:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:19:53.360416026 (86h53m47.791496157s) [upload=90531]: Starting upload Aug 12 08:19:53.360459740 (86h53m47.791539861s) [upload=90531]: Done starting upload Aug 12 08:19:53.360505187 (86h53m47.791585318s) [upload=90531]: Uploading segments... Aug 12 08:19:53.360542528 (86h53m47.791622659s) [upload=90531]: Got next segment. Inline: true Aug 12 08:19:53.360547267 (86h53m47.791627388s) [upload=90531]: Waiting for error group managing segments... Aug 12 08:19:53.360580851 (86h53m47.791660982s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:19:53.360585350 (86h53m47.791665481s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:19:53.360588046 (86h53m47.791668177s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:19:53.575072238 (86h53m48.006152369s) [upload=90531]: Done uploading segments... Aug 12 08:19:53.575094721 (86h53m48.006174852s) [upload=90531]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.862329951s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [....X..X...............XXX.....X..........X.................] duration:
5.713376291s
FAIL (2025-08-12 08:23:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0541524414bf0ab1f0120df54344a6488221348d350cc5ba3083d90fcc59bff6 != before bca785758da141099ae40d74d5d98242818dbb2f97045270e27eff3867a75c15
======LOGS======
Aug 12 08:09:34.518392650 (86h43m28.949472781s) [upload=90348]: Starting upload
Aug 12 08:09:34.518438588 (86h43m28.949518719s) [upload=90348]: Done starting upload
Aug 12 08:09:34.518530284 (86h43m28.949610415s) [upload=90348]: Uploading segments...
Aug 12 08:09:34.518693356 (86h43m28.949773487s) [upload=90348]: Got next segment. Inline: false
Aug 12 08:09:34.518723123 (86h43m28.949803244s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:09:34.518727791 (86h43m28.949807922s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:09:34.994551934 (86h43m29.425649047s) [seg_pos={0 0}, upload=90348]: Begin upload segment...
Aug 12 08:09:34.994613311 (86h43m29.425693442s) [seg_pos={0 0}, upload=90348]: Done begin upload segment.
Aug 12 08:09:34.994639210 (86h43m29.425719342s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.994728832 (86h43m29.425808953s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995016151 (86h43m29.426096282s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995157472 (86h43m29.426237603s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995386059 (86h43m29.42646619s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995532319 (86h43m29.42661244s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995737302 (86h43m29.426817433s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995836070 (86h43m29.426916201s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996007398 (86h43m29.42708753s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996111497 (86h43m29.427191618s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996271764 (86h43m29.427351895s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996568872 (86h43m29.427649003s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996593449 (86h43m29.427673591s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996818540 (86h43m29.427898671s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997048910 (86h43m29.428129041s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997230117 (86h43m29.428310248s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997284461 (86h43m29.428364592s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997895721 (86h43m29.428975842s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:36.173165467 (86h43m30.604245598s) [upload=90348]: Next returned nil segment
Aug 12 08:09:36.173182580 (86h43m30.604262701s) [upload=90348]: Waiting for error group managing segments...
Aug 12 08:09:36.472128999 (86h43m30.903209131s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.501144544 (86h43m30.932224675s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.506666519 (86h43m30.93774665s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.975977670 (86h43m31.407057801s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.003408231 (86h43m31.434488372s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.004134902 (86h43m31.435215043s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.039682183 (86h43m31.470762304s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.052540554 (86h43m31.483620685s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.058179543 (86h43m31.489259674s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.071996118 (86h43m31.503076249s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.073423749 (86h43m31.504503881s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088308768 (86h43m31.519388899s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088912863 (86h43m31.519992995s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106290181 (86h43m31.537370312s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106315128 (86h43m31.537395249s) [seg_pos={0 0}, upload=90348]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:09:37.106421512 (86h43m31.537501643s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CspvuKb3CWXrAW8FtFEoCVUNhLzWsbpwpW5uUfgyWy71R3qYX): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106474003 (86h43m31.537554134s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106542022 (86h43m31.537622153s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r5RXjrbpRcyxvcYhpoqQdgv8MD8zLmpninS7D3cdNCid4Rc8j): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106648326 (86h43m31.537728457s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106700646 (86h43m31.537780777s) [seg_pos={0 0}, upload=90348]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:09:37.106784566 (86h43m31.537864697s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:09:37.106790037 (86h43m31.537870168s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:09:37.396978732 (86h43m31.828058863s) [upload=90348]: Done uploading segments...
Aug 12 08:09:37.397002888 (86h43m31.828083069s) [upload=90348]: Upload finished. err: <nil>
Duration: 5.713403874s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X...........X...................X......] duration:
1.872572126s
FAIL (2025-08-12 08:23:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:19:53.360416026 (86h53m47.791496157s) [upload=90531]: Starting upload Aug 12 08:19:53.360459740 (86h53m47.791539861s) [upload=90531]: Done starting upload Aug 12 08:19:53.360505187 (86h53m47.791585318s) [upload=90531]: Uploading segments... Aug 12 08:19:53.360542528 (86h53m47.791622659s) [upload=90531]: Got next segment. Inline: true Aug 12 08:19:53.360547267 (86h53m47.791627388s) [upload=90531]: Waiting for error group managing segments... Aug 12 08:19:53.360580851 (86h53m47.791660982s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:19:53.360585350 (86h53m47.791665481s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:19:53.360588046 (86h53m47.791668177s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:19:53.575072238 (86h53m48.006152369s) [upload=90531]: Done uploading segments... Aug 12 08:19:53.575094721 (86h53m48.006174852s) [upload=90531]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.872598367s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X...........X...................X.....] duration:
1.880886743s
FAIL (2025-08-12 08:23:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:19:53.360416026 (86h53m47.791496157s) [upload=90531]: Starting upload Aug 12 08:19:53.360459740 (86h53m47.791539861s) [upload=90531]: Done starting upload Aug 12 08:19:53.360505187 (86h53m47.791585318s) [upload=90531]: Uploading segments... Aug 12 08:19:53.360542528 (86h53m47.791622659s) [upload=90531]: Got next segment. Inline: true Aug 12 08:19:53.360547267 (86h53m47.791627388s) [upload=90531]: Waiting for error group managing segments... Aug 12 08:19:53.360580851 (86h53m47.791660982s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:19:53.360585350 (86h53m47.791665481s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:19:53.360588046 (86h53m47.791668177s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:19:53.575072238 (86h53m48.006152369s) [upload=90531]: Done uploading segments... Aug 12 08:19:53.575094721 (86h53m48.006174852s) [upload=90531]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.880914576s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......................X...........X...................X....] duration:
1.850635555s
FAIL (2025-08-12 08:22:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:19:53.360416026 (86h53m47.791496157s) [upload=90531]: Starting upload Aug 12 08:19:53.360459740 (86h53m47.791539861s) [upload=90531]: Done starting upload Aug 12 08:19:53.360505187 (86h53m47.791585318s) [upload=90531]: Uploading segments... Aug 12 08:19:53.360542528 (86h53m47.791622659s) [upload=90531]: Got next segment. Inline: true Aug 12 08:19:53.360547267 (86h53m47.791627388s) [upload=90531]: Waiting for error group managing segments... Aug 12 08:19:53.360580851 (86h53m47.791660982s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:19:53.360585350 (86h53m47.791665481s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:19:53.360588046 (86h53m47.791668177s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:19:53.575072238 (86h53m48.006152369s) [upload=90531]: Done uploading segments... Aug 12 08:19:53.575094721 (86h53m48.006174852s) [upload=90531]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.850686353s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.....X..X...............XXX.....X..........X................] duration:
6.074120997s
FAIL (2025-08-12 08:22:44 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0541524414bf0ab1f0120df54344a6488221348d350cc5ba3083d90fcc59bff6 != before bca785758da141099ae40d74d5d98242818dbb2f97045270e27eff3867a75c15
======LOGS======
Aug 12 08:09:34.518392650 (86h43m28.949472781s) [upload=90348]: Starting upload
Aug 12 08:09:34.518438588 (86h43m28.949518719s) [upload=90348]: Done starting upload
Aug 12 08:09:34.518530284 (86h43m28.949610415s) [upload=90348]: Uploading segments...
Aug 12 08:09:34.518693356 (86h43m28.949773487s) [upload=90348]: Got next segment. Inline: false
Aug 12 08:09:34.518723123 (86h43m28.949803244s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:09:34.518727791 (86h43m28.949807922s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:09:34.994551934 (86h43m29.425649047s) [seg_pos={0 0}, upload=90348]: Begin upload segment...
Aug 12 08:09:34.994613311 (86h43m29.425693442s) [seg_pos={0 0}, upload=90348]: Done begin upload segment.
Aug 12 08:09:34.994639210 (86h43m29.425719342s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.994728832 (86h43m29.425808953s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995016151 (86h43m29.426096282s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995157472 (86h43m29.426237603s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995386059 (86h43m29.42646619s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995532319 (86h43m29.42661244s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995737302 (86h43m29.426817433s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995836070 (86h43m29.426916201s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996007398 (86h43m29.42708753s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996111497 (86h43m29.427191618s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996271764 (86h43m29.427351895s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996568872 (86h43m29.427649003s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996593449 (86h43m29.427673591s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996818540 (86h43m29.427898671s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997048910 (86h43m29.428129041s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997230117 (86h43m29.428310248s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997284461 (86h43m29.428364592s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997895721 (86h43m29.428975842s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:36.173165467 (86h43m30.604245598s) [upload=90348]: Next returned nil segment
Aug 12 08:09:36.173182580 (86h43m30.604262701s) [upload=90348]: Waiting for error group managing segments...
Aug 12 08:09:36.472128999 (86h43m30.903209131s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.501144544 (86h43m30.932224675s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.506666519 (86h43m30.93774665s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.975977670 (86h43m31.407057801s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.003408231 (86h43m31.434488372s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.004134902 (86h43m31.435215043s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.039682183 (86h43m31.470762304s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.052540554 (86h43m31.483620685s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.058179543 (86h43m31.489259674s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.071996118 (86h43m31.503076249s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.073423749 (86h43m31.504503881s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088308768 (86h43m31.519388899s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088912863 (86h43m31.519992995s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106290181 (86h43m31.537370312s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106315128 (86h43m31.537395249s) [seg_pos={0 0}, upload=90348]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:09:37.106421512 (86h43m31.537501643s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CspvuKb3CWXrAW8FtFEoCVUNhLzWsbpwpW5uUfgyWy71R3qYX): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106474003 (86h43m31.537554134s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106542022 (86h43m31.537622153s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r5RXjrbpRcyxvcYhpoqQdgv8MD8zLmpninS7D3cdNCid4Rc8j): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106648326 (86h43m31.537728457s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106700646 (86h43m31.537780777s) [seg_pos={0 0}, upload=90348]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:09:37.106784566 (86h43m31.537864697s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:09:37.106790037 (86h43m31.537870168s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:09:37.396978732 (86h43m31.828058863s) [upload=90348]: Done uploading segments...
Aug 12 08:09:37.397002888 (86h43m31.828083069s) [upload=90348]: Upload finished. err: <nil>
Duration: 6.074147397s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........................X...........X...................X...] duration:
1.920708835s
FAIL (2025-08-12 08:21:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:19:53.360416026 (86h53m47.791496157s) [upload=90531]: Starting upload Aug 12 08:19:53.360459740 (86h53m47.791539861s) [upload=90531]: Done starting upload Aug 12 08:19:53.360505187 (86h53m47.791585318s) [upload=90531]: Uploading segments... Aug 12 08:19:53.360542528 (86h53m47.791622659s) [upload=90531]: Got next segment. Inline: true Aug 12 08:19:53.360547267 (86h53m47.791627388s) [upload=90531]: Waiting for error group managing segments... Aug 12 08:19:53.360580851 (86h53m47.791660982s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:19:53.360585350 (86h53m47.791665481s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:19:53.360588046 (86h53m47.791668177s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:19:53.575072238 (86h53m48.006152369s) [upload=90531]: Done uploading segments... Aug 12 08:19:53.575094721 (86h53m48.006174852s) [upload=90531]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.920730476s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [......X..X...............XXX.....X..........X...............] duration:
5.872568702s
FAIL (2025-08-12 08:21:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0541524414bf0ab1f0120df54344a6488221348d350cc5ba3083d90fcc59bff6 != before bca785758da141099ae40d74d5d98242818dbb2f97045270e27eff3867a75c15
======LOGS======
Aug 12 08:09:34.518392650 (86h43m28.949472781s) [upload=90348]: Starting upload
Aug 12 08:09:34.518438588 (86h43m28.949518719s) [upload=90348]: Done starting upload
Aug 12 08:09:34.518530284 (86h43m28.949610415s) [upload=90348]: Uploading segments...
Aug 12 08:09:34.518693356 (86h43m28.949773487s) [upload=90348]: Got next segment. Inline: false
Aug 12 08:09:34.518723123 (86h43m28.949803244s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:09:34.518727791 (86h43m28.949807922s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:09:34.994551934 (86h43m29.425649047s) [seg_pos={0 0}, upload=90348]: Begin upload segment...
Aug 12 08:09:34.994613311 (86h43m29.425693442s) [seg_pos={0 0}, upload=90348]: Done begin upload segment.
Aug 12 08:09:34.994639210 (86h43m29.425719342s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.994728832 (86h43m29.425808953s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995016151 (86h43m29.426096282s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995157472 (86h43m29.426237603s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995386059 (86h43m29.42646619s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995532319 (86h43m29.42661244s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995737302 (86h43m29.426817433s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995836070 (86h43m29.426916201s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996007398 (86h43m29.42708753s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996111497 (86h43m29.427191618s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996271764 (86h43m29.427351895s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996568872 (86h43m29.427649003s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996593449 (86h43m29.427673591s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996818540 (86h43m29.427898671s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997048910 (86h43m29.428129041s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997230117 (86h43m29.428310248s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997284461 (86h43m29.428364592s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997895721 (86h43m29.428975842s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:36.173165467 (86h43m30.604245598s) [upload=90348]: Next returned nil segment
Aug 12 08:09:36.173182580 (86h43m30.604262701s) [upload=90348]: Waiting for error group managing segments...
Aug 12 08:09:36.472128999 (86h43m30.903209131s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.501144544 (86h43m30.932224675s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.506666519 (86h43m30.93774665s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.975977670 (86h43m31.407057801s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.003408231 (86h43m31.434488372s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.004134902 (86h43m31.435215043s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.039682183 (86h43m31.470762304s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.052540554 (86h43m31.483620685s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.058179543 (86h43m31.489259674s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.071996118 (86h43m31.503076249s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.073423749 (86h43m31.504503881s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088308768 (86h43m31.519388899s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088912863 (86h43m31.519992995s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106290181 (86h43m31.537370312s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106315128 (86h43m31.537395249s) [seg_pos={0 0}, upload=90348]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:09:37.106421512 (86h43m31.537501643s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CspvuKb3CWXrAW8FtFEoCVUNhLzWsbpwpW5uUfgyWy71R3qYX): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106474003 (86h43m31.537554134s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106542022 (86h43m31.537622153s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r5RXjrbpRcyxvcYhpoqQdgv8MD8zLmpninS7D3cdNCid4Rc8j): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106648326 (86h43m31.537728457s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106700646 (86h43m31.537780777s) [seg_pos={0 0}, upload=90348]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:09:37.106784566 (86h43m31.537864697s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:09:37.106790037 (86h43m31.537870168s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:09:37.396978732 (86h43m31.828058863s) [upload=90348]: Done uploading segments...
Aug 12 08:09:37.397002888 (86h43m31.828083069s) [upload=90348]: Upload finished. err: <nil>
Duration: 5.872628338s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........................X...........X...................X..] duration:
1.914329305s
FAIL (2025-08-12 08:20:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:19:53.360416026 (86h53m47.791496157s) [upload=90531]: Starting upload Aug 12 08:19:53.360459740 (86h53m47.791539861s) [upload=90531]: Done starting upload Aug 12 08:19:53.360505187 (86h53m47.791585318s) [upload=90531]: Uploading segments... Aug 12 08:19:53.360542528 (86h53m47.791622659s) [upload=90531]: Got next segment. Inline: true Aug 12 08:19:53.360547267 (86h53m47.791627388s) [upload=90531]: Waiting for error group managing segments... Aug 12 08:19:53.360580851 (86h53m47.791660982s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:19:53.360585350 (86h53m47.791665481s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:19:53.360588046 (86h53m47.791668177s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:19:53.575072238 (86h53m48.006152369s) [upload=90531]: Done uploading segments... Aug 12 08:19:53.575094721 (86h53m48.006174852s) [upload=90531]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.914358512s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.......X..X...............XXX.....X..........X..............] duration:
5.924052794s
FAIL (2025-08-12 08:20:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0541524414bf0ab1f0120df54344a6488221348d350cc5ba3083d90fcc59bff6 != before bca785758da141099ae40d74d5d98242818dbb2f97045270e27eff3867a75c15
======LOGS======
Aug 12 08:09:34.518392650 (86h43m28.949472781s) [upload=90348]: Starting upload
Aug 12 08:09:34.518438588 (86h43m28.949518719s) [upload=90348]: Done starting upload
Aug 12 08:09:34.518530284 (86h43m28.949610415s) [upload=90348]: Uploading segments...
Aug 12 08:09:34.518693356 (86h43m28.949773487s) [upload=90348]: Got next segment. Inline: false
Aug 12 08:09:34.518723123 (86h43m28.949803244s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:09:34.518727791 (86h43m28.949807922s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:09:34.994551934 (86h43m29.425649047s) [seg_pos={0 0}, upload=90348]: Begin upload segment...
Aug 12 08:09:34.994613311 (86h43m29.425693442s) [seg_pos={0 0}, upload=90348]: Done begin upload segment.
Aug 12 08:09:34.994639210 (86h43m29.425719342s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.994728832 (86h43m29.425808953s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995016151 (86h43m29.426096282s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995157472 (86h43m29.426237603s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995386059 (86h43m29.42646619s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995532319 (86h43m29.42661244s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995737302 (86h43m29.426817433s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995836070 (86h43m29.426916201s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996007398 (86h43m29.42708753s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996111497 (86h43m29.427191618s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996271764 (86h43m29.427351895s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996568872 (86h43m29.427649003s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996593449 (86h43m29.427673591s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996818540 (86h43m29.427898671s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997048910 (86h43m29.428129041s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997230117 (86h43m29.428310248s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997284461 (86h43m29.428364592s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997895721 (86h43m29.428975842s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:36.173165467 (86h43m30.604245598s) [upload=90348]: Next returned nil segment
Aug 12 08:09:36.173182580 (86h43m30.604262701s) [upload=90348]: Waiting for error group managing segments...
Aug 12 08:09:36.472128999 (86h43m30.903209131s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.501144544 (86h43m30.932224675s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.506666519 (86h43m30.93774665s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.975977670 (86h43m31.407057801s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.003408231 (86h43m31.434488372s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.004134902 (86h43m31.435215043s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.039682183 (86h43m31.470762304s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.052540554 (86h43m31.483620685s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.058179543 (86h43m31.489259674s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.071996118 (86h43m31.503076249s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.073423749 (86h43m31.504503881s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088308768 (86h43m31.519388899s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088912863 (86h43m31.519992995s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106290181 (86h43m31.537370312s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106315128 (86h43m31.537395249s) [seg_pos={0 0}, upload=90348]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:09:37.106421512 (86h43m31.537501643s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CspvuKb3CWXrAW8FtFEoCVUNhLzWsbpwpW5uUfgyWy71R3qYX): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106474003 (86h43m31.537554134s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106542022 (86h43m31.537622153s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r5RXjrbpRcyxvcYhpoqQdgv8MD8zLmpninS7D3cdNCid4Rc8j): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106648326 (86h43m31.537728457s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106700646 (86h43m31.537780777s) [seg_pos={0 0}, upload=90348]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:09:37.106784566 (86h43m31.537864697s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:09:37.106790037 (86h43m31.537870168s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:09:37.396978732 (86h43m31.828058863s) [upload=90348]: Done uploading segments...
Aug 12 08:09:37.397002888 (86h43m31.828083069s) [upload=90348]: Upload finished. err: <nil>
Duration: 5.924078493s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........................X...........X...................X.] duration:
1.859684217s
FAIL (2025-08-12 08:20:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:19:53.360416026 (86h53m47.791496157s) [upload=90531]: Starting upload Aug 12 08:19:53.360459740 (86h53m47.791539861s) [upload=90531]: Done starting upload Aug 12 08:19:53.360505187 (86h53m47.791585318s) [upload=90531]: Uploading segments... Aug 12 08:19:53.360542528 (86h53m47.791622659s) [upload=90531]: Got next segment. Inline: true Aug 12 08:19:53.360547267 (86h53m47.791627388s) [upload=90531]: Waiting for error group managing segments... Aug 12 08:19:53.360580851 (86h53m47.791660982s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:19:53.360585350 (86h53m47.791665481s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:19:53.360588046 (86h53m47.791668177s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:19:53.575072238 (86h53m48.006152369s) [upload=90531]: Done uploading segments... Aug 12 08:19:53.575094721 (86h53m48.006174852s) [upload=90531]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.859706468s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........................X...........X...................X] duration:
862.378118ms
FAIL (2025-08-12 08:19:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:19:53.360416026 (86h53m47.791496157s) [upload=90531]: Starting upload Aug 12 08:19:53.360459740 (86h53m47.791539861s) [upload=90531]: Done starting upload Aug 12 08:19:53.360505187 (86h53m47.791585318s) [upload=90531]: Uploading segments... Aug 12 08:19:53.360542528 (86h53m47.791622659s) [upload=90531]: Got next segment. Inline: true Aug 12 08:19:53.360547267 (86h53m47.791627388s) [upload=90531]: Waiting for error group managing segments... Aug 12 08:19:53.360580851 (86h53m47.791660982s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:19:53.360585350 (86h53m47.791665481s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:19:53.360588046 (86h53m47.791668177s) [upload=90531]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:19:53.575072238 (86h53m48.006152369s) [upload=90531]: Done uploading segments... Aug 12 08:19:53.575094721 (86h53m48.006174852s) [upload=90531]: Upload finished. err: metaclient: Too Many Requests
Duration: 862.397286ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [........X..X...............XXX.....X..........X.............] duration:
5.748608939s
FAIL (2025-08-12 08:19:29 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0541524414bf0ab1f0120df54344a6488221348d350cc5ba3083d90fcc59bff6 != before bca785758da141099ae40d74d5d98242818dbb2f97045270e27eff3867a75c15
======LOGS======
Aug 12 08:09:34.518392650 (86h43m28.949472781s) [upload=90348]: Starting upload
Aug 12 08:09:34.518438588 (86h43m28.949518719s) [upload=90348]: Done starting upload
Aug 12 08:09:34.518530284 (86h43m28.949610415s) [upload=90348]: Uploading segments...
Aug 12 08:09:34.518693356 (86h43m28.949773487s) [upload=90348]: Got next segment. Inline: false
Aug 12 08:09:34.518723123 (86h43m28.949803244s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:09:34.518727791 (86h43m28.949807922s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:09:34.994551934 (86h43m29.425649047s) [seg_pos={0 0}, upload=90348]: Begin upload segment...
Aug 12 08:09:34.994613311 (86h43m29.425693442s) [seg_pos={0 0}, upload=90348]: Done begin upload segment.
Aug 12 08:09:34.994639210 (86h43m29.425719342s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.994728832 (86h43m29.425808953s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995016151 (86h43m29.426096282s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995157472 (86h43m29.426237603s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995386059 (86h43m29.42646619s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995532319 (86h43m29.42661244s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995737302 (86h43m29.426817433s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995836070 (86h43m29.426916201s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996007398 (86h43m29.42708753s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996111497 (86h43m29.427191618s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996271764 (86h43m29.427351895s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996568872 (86h43m29.427649003s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996593449 (86h43m29.427673591s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996818540 (86h43m29.427898671s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997048910 (86h43m29.428129041s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997230117 (86h43m29.428310248s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997284461 (86h43m29.428364592s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997895721 (86h43m29.428975842s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:36.173165467 (86h43m30.604245598s) [upload=90348]: Next returned nil segment
Aug 12 08:09:36.173182580 (86h43m30.604262701s) [upload=90348]: Waiting for error group managing segments...
Aug 12 08:09:36.472128999 (86h43m30.903209131s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.501144544 (86h43m30.932224675s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.506666519 (86h43m30.93774665s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.975977670 (86h43m31.407057801s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.003408231 (86h43m31.434488372s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.004134902 (86h43m31.435215043s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.039682183 (86h43m31.470762304s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.052540554 (86h43m31.483620685s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.058179543 (86h43m31.489259674s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.071996118 (86h43m31.503076249s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.073423749 (86h43m31.504503881s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088308768 (86h43m31.519388899s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088912863 (86h43m31.519992995s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106290181 (86h43m31.537370312s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106315128 (86h43m31.537395249s) [seg_pos={0 0}, upload=90348]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:09:37.106421512 (86h43m31.537501643s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CspvuKb3CWXrAW8FtFEoCVUNhLzWsbpwpW5uUfgyWy71R3qYX): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106474003 (86h43m31.537554134s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106542022 (86h43m31.537622153s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r5RXjrbpRcyxvcYhpoqQdgv8MD8zLmpninS7D3cdNCid4Rc8j): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106648326 (86h43m31.537728457s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106700646 (86h43m31.537780777s) [seg_pos={0 0}, upload=90348]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:09:37.106784566 (86h43m31.537864697s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:09:37.106790037 (86h43m31.537870168s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:09:37.396978732 (86h43m31.828058863s) [upload=90348]: Done uploading segments...
Aug 12 08:09:37.397002888 (86h43m31.828083069s) [upload=90348]: Upload finished. err: <nil>
Duration: 5.74863574s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X...........X...................] duration:
1.852595186s
FAIL (2025-08-12 08:19:13 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 08:04:39.065758868 (86h38m33.496838999s) [upload=90272]: Starting upload Aug 12 08:04:39.065815496 (86h38m33.496895627s) [upload=90272]: Done starting upload Aug 12 08:04:39.065860663 (86h38m33.496940784s) [upload=90272]: Uploading segments... Aug 12 08:04:39.065894056 (86h38m33.496974178s) [upload=90272]: Got next segment. Inline: true Aug 12 08:04:39.065898956 (86h38m33.496979087s) [upload=90272]: Waiting for error group managing segments... Aug 12 08:04:39.065930075 (86h38m33.497010206s) [upload=90272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:04:39.065933943 (86h38m33.497014074s) [upload=90272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:04:39.065936268 (86h38m33.497016399s) [upload=90272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:04:39.355440795 (86h38m33.786520966s) [upload=90272]: Done uploading segments... Aug 12 08:04:39.355460783 (86h38m33.786540964s) [upload=90272]: Upload finished. err: <nil>
Duration: 1.852619372s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.........X..X...............XXX.....X..........X............] duration:
5.720859337s
FAIL (2025-08-12 08:18:32 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0541524414bf0ab1f0120df54344a6488221348d350cc5ba3083d90fcc59bff6 != before bca785758da141099ae40d74d5d98242818dbb2f97045270e27eff3867a75c15
======LOGS======
Aug 12 08:09:34.518392650 (86h43m28.949472781s) [upload=90348]: Starting upload
Aug 12 08:09:34.518438588 (86h43m28.949518719s) [upload=90348]: Done starting upload
Aug 12 08:09:34.518530284 (86h43m28.949610415s) [upload=90348]: Uploading segments...
Aug 12 08:09:34.518693356 (86h43m28.949773487s) [upload=90348]: Got next segment. Inline: false
Aug 12 08:09:34.518723123 (86h43m28.949803244s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:09:34.518727791 (86h43m28.949807922s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:09:34.994551934 (86h43m29.425649047s) [seg_pos={0 0}, upload=90348]: Begin upload segment...
Aug 12 08:09:34.994613311 (86h43m29.425693442s) [seg_pos={0 0}, upload=90348]: Done begin upload segment.
Aug 12 08:09:34.994639210 (86h43m29.425719342s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.994728832 (86h43m29.425808953s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995016151 (86h43m29.426096282s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995157472 (86h43m29.426237603s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995386059 (86h43m29.42646619s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995532319 (86h43m29.42661244s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995737302 (86h43m29.426817433s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995836070 (86h43m29.426916201s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996007398 (86h43m29.42708753s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996111497 (86h43m29.427191618s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996271764 (86h43m29.427351895s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996568872 (86h43m29.427649003s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996593449 (86h43m29.427673591s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996818540 (86h43m29.427898671s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997048910 (86h43m29.428129041s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997230117 (86h43m29.428310248s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997284461 (86h43m29.428364592s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997895721 (86h43m29.428975842s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:36.173165467 (86h43m30.604245598s) [upload=90348]: Next returned nil segment
Aug 12 08:09:36.173182580 (86h43m30.604262701s) [upload=90348]: Waiting for error group managing segments...
Aug 12 08:09:36.472128999 (86h43m30.903209131s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.501144544 (86h43m30.932224675s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.506666519 (86h43m30.93774665s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.975977670 (86h43m31.407057801s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.003408231 (86h43m31.434488372s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.004134902 (86h43m31.435215043s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.039682183 (86h43m31.470762304s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.052540554 (86h43m31.483620685s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.058179543 (86h43m31.489259674s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.071996118 (86h43m31.503076249s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.073423749 (86h43m31.504503881s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088308768 (86h43m31.519388899s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088912863 (86h43m31.519992995s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106290181 (86h43m31.537370312s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106315128 (86h43m31.537395249s) [seg_pos={0 0}, upload=90348]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:09:37.106421512 (86h43m31.537501643s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CspvuKb3CWXrAW8FtFEoCVUNhLzWsbpwpW5uUfgyWy71R3qYX): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106474003 (86h43m31.537554134s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106542022 (86h43m31.537622153s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r5RXjrbpRcyxvcYhpoqQdgv8MD8zLmpninS7D3cdNCid4Rc8j): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106648326 (86h43m31.537728457s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106700646 (86h43m31.537780777s) [seg_pos={0 0}, upload=90348]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:09:37.106784566 (86h43m31.537864697s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:09:37.106790037 (86h43m31.537870168s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:09:37.396978732 (86h43m31.828058863s) [upload=90348]: Done uploading segments...
Aug 12 08:09:37.397002888 (86h43m31.828083069s) [upload=90348]: Upload finished. err: <nil>
Duration: 5.720887522s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X...........X..................] duration:
1.990460026s
FAIL (2025-08-12 08:18:15 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 08:04:39.065758868 (86h38m33.496838999s) [upload=90272]: Starting upload Aug 12 08:04:39.065815496 (86h38m33.496895627s) [upload=90272]: Done starting upload Aug 12 08:04:39.065860663 (86h38m33.496940784s) [upload=90272]: Uploading segments... Aug 12 08:04:39.065894056 (86h38m33.496974178s) [upload=90272]: Got next segment. Inline: true Aug 12 08:04:39.065898956 (86h38m33.496979087s) [upload=90272]: Waiting for error group managing segments... Aug 12 08:04:39.065930075 (86h38m33.497010206s) [upload=90272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:04:39.065933943 (86h38m33.497014074s) [upload=90272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:04:39.065936268 (86h38m33.497016399s) [upload=90272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:04:39.355440795 (86h38m33.786520966s) [upload=90272]: Done uploading segments... Aug 12 08:04:39.355460783 (86h38m33.786540964s) [upload=90272]: Upload finished. err: <nil>
Duration: 1.990541002s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X...........X.................] duration:
1.818510893s
FAIL (2025-08-12 08:17:48 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 08:04:39.065758868 (86h38m33.496838999s) [upload=90272]: Starting upload Aug 12 08:04:39.065815496 (86h38m33.496895627s) [upload=90272]: Done starting upload Aug 12 08:04:39.065860663 (86h38m33.496940784s) [upload=90272]: Uploading segments... Aug 12 08:04:39.065894056 (86h38m33.496974178s) [upload=90272]: Got next segment. Inline: true Aug 12 08:04:39.065898956 (86h38m33.496979087s) [upload=90272]: Waiting for error group managing segments... Aug 12 08:04:39.065930075 (86h38m33.497010206s) [upload=90272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:04:39.065933943 (86h38m33.497014074s) [upload=90272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:04:39.065936268 (86h38m33.497016399s) [upload=90272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:04:39.355440795 (86h38m33.786520966s) [upload=90272]: Done uploading segments... Aug 12 08:04:39.355460783 (86h38m33.786540964s) [upload=90272]: Upload finished. err: <nil>
Duration: 1.818539317s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [..........X..X...............XXX.....X..........X...........] duration:
5.645662273s
FAIL (2025-08-12 08:17:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0541524414bf0ab1f0120df54344a6488221348d350cc5ba3083d90fcc59bff6 != before bca785758da141099ae40d74d5d98242818dbb2f97045270e27eff3867a75c15
======LOGS======
Aug 12 08:09:34.518392650 (86h43m28.949472781s) [upload=90348]: Starting upload
Aug 12 08:09:34.518438588 (86h43m28.949518719s) [upload=90348]: Done starting upload
Aug 12 08:09:34.518530284 (86h43m28.949610415s) [upload=90348]: Uploading segments...
Aug 12 08:09:34.518693356 (86h43m28.949773487s) [upload=90348]: Got next segment. Inline: false
Aug 12 08:09:34.518723123 (86h43m28.949803244s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:09:34.518727791 (86h43m28.949807922s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:09:34.994551934 (86h43m29.425649047s) [seg_pos={0 0}, upload=90348]: Begin upload segment...
Aug 12 08:09:34.994613311 (86h43m29.425693442s) [seg_pos={0 0}, upload=90348]: Done begin upload segment.
Aug 12 08:09:34.994639210 (86h43m29.425719342s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.994728832 (86h43m29.425808953s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995016151 (86h43m29.426096282s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995157472 (86h43m29.426237603s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995386059 (86h43m29.42646619s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995532319 (86h43m29.42661244s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995737302 (86h43m29.426817433s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995836070 (86h43m29.426916201s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996007398 (86h43m29.42708753s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996111497 (86h43m29.427191618s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996271764 (86h43m29.427351895s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996568872 (86h43m29.427649003s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996593449 (86h43m29.427673591s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996818540 (86h43m29.427898671s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997048910 (86h43m29.428129041s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997230117 (86h43m29.428310248s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997284461 (86h43m29.428364592s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997895721 (86h43m29.428975842s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:36.173165467 (86h43m30.604245598s) [upload=90348]: Next returned nil segment
Aug 12 08:09:36.173182580 (86h43m30.604262701s) [upload=90348]: Waiting for error group managing segments...
Aug 12 08:09:36.472128999 (86h43m30.903209131s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.501144544 (86h43m30.932224675s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.506666519 (86h43m30.93774665s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.975977670 (86h43m31.407057801s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.003408231 (86h43m31.434488372s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.004134902 (86h43m31.435215043s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.039682183 (86h43m31.470762304s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.052540554 (86h43m31.483620685s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.058179543 (86h43m31.489259674s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.071996118 (86h43m31.503076249s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.073423749 (86h43m31.504503881s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088308768 (86h43m31.519388899s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088912863 (86h43m31.519992995s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106290181 (86h43m31.537370312s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106315128 (86h43m31.537395249s) [seg_pos={0 0}, upload=90348]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:09:37.106421512 (86h43m31.537501643s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CspvuKb3CWXrAW8FtFEoCVUNhLzWsbpwpW5uUfgyWy71R3qYX): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106474003 (86h43m31.537554134s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106542022 (86h43m31.537622153s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r5RXjrbpRcyxvcYhpoqQdgv8MD8zLmpninS7D3cdNCid4Rc8j): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106648326 (86h43m31.537728457s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106700646 (86h43m31.537780777s) [seg_pos={0 0}, upload=90348]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:09:37.106784566 (86h43m31.537864697s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:09:37.106790037 (86h43m31.537870168s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:09:37.396978732 (86h43m31.828058863s) [upload=90348]: Done uploading segments...
Aug 12 08:09:37.397002888 (86h43m31.828083069s) [upload=90348]: Upload finished. err: <nil>
Duration: 5.645687583s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [...........X..X...............XXX.....X..........X..........] duration:
5.672319653s
FAIL (2025-08-12 08:16:59 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0541524414bf0ab1f0120df54344a6488221348d350cc5ba3083d90fcc59bff6 != before bca785758da141099ae40d74d5d98242818dbb2f97045270e27eff3867a75c15
======LOGS======
Aug 12 08:09:34.518392650 (86h43m28.949472781s) [upload=90348]: Starting upload
Aug 12 08:09:34.518438588 (86h43m28.949518719s) [upload=90348]: Done starting upload
Aug 12 08:09:34.518530284 (86h43m28.949610415s) [upload=90348]: Uploading segments...
Aug 12 08:09:34.518693356 (86h43m28.949773487s) [upload=90348]: Got next segment. Inline: false
Aug 12 08:09:34.518723123 (86h43m28.949803244s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:09:34.518727791 (86h43m28.949807922s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:09:34.994551934 (86h43m29.425649047s) [seg_pos={0 0}, upload=90348]: Begin upload segment...
Aug 12 08:09:34.994613311 (86h43m29.425693442s) [seg_pos={0 0}, upload=90348]: Done begin upload segment.
Aug 12 08:09:34.994639210 (86h43m29.425719342s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.994728832 (86h43m29.425808953s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995016151 (86h43m29.426096282s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995157472 (86h43m29.426237603s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995386059 (86h43m29.42646619s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995532319 (86h43m29.42661244s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995737302 (86h43m29.426817433s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995836070 (86h43m29.426916201s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996007398 (86h43m29.42708753s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996111497 (86h43m29.427191618s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996271764 (86h43m29.427351895s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996568872 (86h43m29.427649003s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996593449 (86h43m29.427673591s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996818540 (86h43m29.427898671s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997048910 (86h43m29.428129041s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997230117 (86h43m29.428310248s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997284461 (86h43m29.428364592s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997895721 (86h43m29.428975842s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:36.173165467 (86h43m30.604245598s) [upload=90348]: Next returned nil segment
Aug 12 08:09:36.173182580 (86h43m30.604262701s) [upload=90348]: Waiting for error group managing segments...
Aug 12 08:09:36.472128999 (86h43m30.903209131s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.501144544 (86h43m30.932224675s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.506666519 (86h43m30.93774665s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.975977670 (86h43m31.407057801s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.003408231 (86h43m31.434488372s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.004134902 (86h43m31.435215043s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.039682183 (86h43m31.470762304s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.052540554 (86h43m31.483620685s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.058179543 (86h43m31.489259674s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.071996118 (86h43m31.503076249s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.073423749 (86h43m31.504503881s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088308768 (86h43m31.519388899s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088912863 (86h43m31.519992995s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106290181 (86h43m31.537370312s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106315128 (86h43m31.537395249s) [seg_pos={0 0}, upload=90348]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:09:37.106421512 (86h43m31.537501643s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CspvuKb3CWXrAW8FtFEoCVUNhLzWsbpwpW5uUfgyWy71R3qYX): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106474003 (86h43m31.537554134s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106542022 (86h43m31.537622153s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r5RXjrbpRcyxvcYhpoqQdgv8MD8zLmpninS7D3cdNCid4Rc8j): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106648326 (86h43m31.537728457s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106700646 (86h43m31.537780777s) [seg_pos={0 0}, upload=90348]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:09:37.106784566 (86h43m31.537864697s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:09:37.106790037 (86h43m31.537870168s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:09:37.396978732 (86h43m31.828058863s) [upload=90348]: Done uploading segments...
Aug 12 08:09:37.397002888 (86h43m31.828083069s) [upload=90348]: Upload finished. err: <nil>
Duration: 5.672343639s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X...........X................] duration:
1.86277599s
FAIL (2025-08-12 08:16:59 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 08:04:39.065758868 (86h38m33.496838999s) [upload=90272]: Starting upload Aug 12 08:04:39.065815496 (86h38m33.496895627s) [upload=90272]: Done starting upload Aug 12 08:04:39.065860663 (86h38m33.496940784s) [upload=90272]: Uploading segments... Aug 12 08:04:39.065894056 (86h38m33.496974178s) [upload=90272]: Got next segment. Inline: true Aug 12 08:04:39.065898956 (86h38m33.496979087s) [upload=90272]: Waiting for error group managing segments... Aug 12 08:04:39.065930075 (86h38m33.497010206s) [upload=90272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:04:39.065933943 (86h38m33.497014074s) [upload=90272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:04:39.065936268 (86h38m33.497016399s) [upload=90272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:04:39.355440795 (86h38m33.786520966s) [upload=90272]: Done uploading segments... Aug 12 08:04:39.355460783 (86h38m33.786540964s) [upload=90272]: Upload finished. err: <nil>
Duration: 1.86280224s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [............X..X...............XXX.....X..........X.........] duration:
5.936116188s
FAIL (2025-08-12 08:16:44 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0541524414bf0ab1f0120df54344a6488221348d350cc5ba3083d90fcc59bff6 != before bca785758da141099ae40d74d5d98242818dbb2f97045270e27eff3867a75c15
======LOGS======
Aug 12 08:09:34.518392650 (86h43m28.949472781s) [upload=90348]: Starting upload
Aug 12 08:09:34.518438588 (86h43m28.949518719s) [upload=90348]: Done starting upload
Aug 12 08:09:34.518530284 (86h43m28.949610415s) [upload=90348]: Uploading segments...
Aug 12 08:09:34.518693356 (86h43m28.949773487s) [upload=90348]: Got next segment. Inline: false
Aug 12 08:09:34.518723123 (86h43m28.949803244s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:09:34.518727791 (86h43m28.949807922s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:09:34.994551934 (86h43m29.425649047s) [seg_pos={0 0}, upload=90348]: Begin upload segment...
Aug 12 08:09:34.994613311 (86h43m29.425693442s) [seg_pos={0 0}, upload=90348]: Done begin upload segment.
Aug 12 08:09:34.994639210 (86h43m29.425719342s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.994728832 (86h43m29.425808953s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995016151 (86h43m29.426096282s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995157472 (86h43m29.426237603s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995386059 (86h43m29.42646619s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995532319 (86h43m29.42661244s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995737302 (86h43m29.426817433s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995836070 (86h43m29.426916201s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996007398 (86h43m29.42708753s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996111497 (86h43m29.427191618s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996271764 (86h43m29.427351895s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996568872 (86h43m29.427649003s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996593449 (86h43m29.427673591s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996818540 (86h43m29.427898671s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997048910 (86h43m29.428129041s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997230117 (86h43m29.428310248s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997284461 (86h43m29.428364592s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997895721 (86h43m29.428975842s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:36.173165467 (86h43m30.604245598s) [upload=90348]: Next returned nil segment
Aug 12 08:09:36.173182580 (86h43m30.604262701s) [upload=90348]: Waiting for error group managing segments...
Aug 12 08:09:36.472128999 (86h43m30.903209131s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.501144544 (86h43m30.932224675s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.506666519 (86h43m30.93774665s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.975977670 (86h43m31.407057801s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.003408231 (86h43m31.434488372s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.004134902 (86h43m31.435215043s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.039682183 (86h43m31.470762304s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.052540554 (86h43m31.483620685s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.058179543 (86h43m31.489259674s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.071996118 (86h43m31.503076249s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.073423749 (86h43m31.504503881s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088308768 (86h43m31.519388899s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088912863 (86h43m31.519992995s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106290181 (86h43m31.537370312s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106315128 (86h43m31.537395249s) [seg_pos={0 0}, upload=90348]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:09:37.106421512 (86h43m31.537501643s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CspvuKb3CWXrAW8FtFEoCVUNhLzWsbpwpW5uUfgyWy71R3qYX): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106474003 (86h43m31.537554134s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106542022 (86h43m31.537622153s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r5RXjrbpRcyxvcYhpoqQdgv8MD8zLmpninS7D3cdNCid4Rc8j): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106648326 (86h43m31.537728457s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106700646 (86h43m31.537780777s) [seg_pos={0 0}, upload=90348]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:09:37.106784566 (86h43m31.537864697s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:09:37.106790037 (86h43m31.537870168s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:09:37.396978732 (86h43m31.828058863s) [upload=90348]: Done uploading segments...
Aug 12 08:09:37.397002888 (86h43m31.828083069s) [upload=90348]: Upload finished. err: <nil>
Duration: 5.936140635s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X...........X...............] duration:
1.830800806s
FAIL (2025-08-12 08:16:40 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 08:04:39.065758868 (86h38m33.496838999s) [upload=90272]: Starting upload Aug 12 08:04:39.065815496 (86h38m33.496895627s) [upload=90272]: Done starting upload Aug 12 08:04:39.065860663 (86h38m33.496940784s) [upload=90272]: Uploading segments... Aug 12 08:04:39.065894056 (86h38m33.496974178s) [upload=90272]: Got next segment. Inline: true Aug 12 08:04:39.065898956 (86h38m33.496979087s) [upload=90272]: Waiting for error group managing segments... Aug 12 08:04:39.065930075 (86h38m33.497010206s) [upload=90272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:04:39.065933943 (86h38m33.497014074s) [upload=90272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:04:39.065936268 (86h38m33.497016399s) [upload=90272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:04:39.355440795 (86h38m33.786520966s) [upload=90272]: Done uploading segments... Aug 12 08:04:39.355460783 (86h38m33.786540964s) [upload=90272]: Upload finished. err: <nil>
Duration: 1.830841074s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.............X..X...............XXX.....X..........X........] duration:
5.746443105s
FAIL (2025-08-12 08:15:45 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0541524414bf0ab1f0120df54344a6488221348d350cc5ba3083d90fcc59bff6 != before bca785758da141099ae40d74d5d98242818dbb2f97045270e27eff3867a75c15
======LOGS======
Aug 12 08:09:34.518392650 (86h43m28.949472781s) [upload=90348]: Starting upload
Aug 12 08:09:34.518438588 (86h43m28.949518719s) [upload=90348]: Done starting upload
Aug 12 08:09:34.518530284 (86h43m28.949610415s) [upload=90348]: Uploading segments...
Aug 12 08:09:34.518693356 (86h43m28.949773487s) [upload=90348]: Got next segment. Inline: false
Aug 12 08:09:34.518723123 (86h43m28.949803244s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:09:34.518727791 (86h43m28.949807922s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:09:34.994551934 (86h43m29.425649047s) [seg_pos={0 0}, upload=90348]: Begin upload segment...
Aug 12 08:09:34.994613311 (86h43m29.425693442s) [seg_pos={0 0}, upload=90348]: Done begin upload segment.
Aug 12 08:09:34.994639210 (86h43m29.425719342s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.994728832 (86h43m29.425808953s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995016151 (86h43m29.426096282s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995157472 (86h43m29.426237603s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995386059 (86h43m29.42646619s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995532319 (86h43m29.42661244s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995737302 (86h43m29.426817433s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995836070 (86h43m29.426916201s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996007398 (86h43m29.42708753s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996111497 (86h43m29.427191618s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996271764 (86h43m29.427351895s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996568872 (86h43m29.427649003s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996593449 (86h43m29.427673591s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996818540 (86h43m29.427898671s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997048910 (86h43m29.428129041s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997230117 (86h43m29.428310248s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997284461 (86h43m29.428364592s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997895721 (86h43m29.428975842s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:36.173165467 (86h43m30.604245598s) [upload=90348]: Next returned nil segment
Aug 12 08:09:36.173182580 (86h43m30.604262701s) [upload=90348]: Waiting for error group managing segments...
Aug 12 08:09:36.472128999 (86h43m30.903209131s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.501144544 (86h43m30.932224675s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.506666519 (86h43m30.93774665s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.975977670 (86h43m31.407057801s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.003408231 (86h43m31.434488372s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.004134902 (86h43m31.435215043s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.039682183 (86h43m31.470762304s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.052540554 (86h43m31.483620685s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.058179543 (86h43m31.489259674s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.071996118 (86h43m31.503076249s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.073423749 (86h43m31.504503881s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088308768 (86h43m31.519388899s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088912863 (86h43m31.519992995s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106290181 (86h43m31.537370312s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106315128 (86h43m31.537395249s) [seg_pos={0 0}, upload=90348]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:09:37.106421512 (86h43m31.537501643s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CspvuKb3CWXrAW8FtFEoCVUNhLzWsbpwpW5uUfgyWy71R3qYX): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106474003 (86h43m31.537554134s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106542022 (86h43m31.537622153s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r5RXjrbpRcyxvcYhpoqQdgv8MD8zLmpninS7D3cdNCid4Rc8j): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106648326 (86h43m31.537728457s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106700646 (86h43m31.537780777s) [seg_pos={0 0}, upload=90348]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:09:37.106784566 (86h43m31.537864697s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:09:37.106790037 (86h43m31.537870168s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:09:37.396978732 (86h43m31.828058863s) [upload=90348]: Done uploading segments...
Aug 12 08:09:37.397002888 (86h43m31.828083069s) [upload=90348]: Upload finished. err: <nil>
Duration: 5.746463784s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X...........X..............] duration:
1.82866391s
FAIL (2025-08-12 08:15:29 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 08:04:39.065758868 (86h38m33.496838999s) [upload=90272]: Starting upload Aug 12 08:04:39.065815496 (86h38m33.496895627s) [upload=90272]: Done starting upload Aug 12 08:04:39.065860663 (86h38m33.496940784s) [upload=90272]: Uploading segments... Aug 12 08:04:39.065894056 (86h38m33.496974178s) [upload=90272]: Got next segment. Inline: true Aug 12 08:04:39.065898956 (86h38m33.496979087s) [upload=90272]: Waiting for error group managing segments... Aug 12 08:04:39.065930075 (86h38m33.497010206s) [upload=90272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:04:39.065933943 (86h38m33.497014074s) [upload=90272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:04:39.065936268 (86h38m33.497016399s) [upload=90272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:04:39.355440795 (86h38m33.786520966s) [upload=90272]: Done uploading segments... Aug 12 08:04:39.355460783 (86h38m33.786540964s) [upload=90272]: Upload finished. err: <nil>
Duration: 1.828696931s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [..............X..X...............XXX.....X..........X.......] duration:
5.799304829s
FAIL (2025-08-12 08:15:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0541524414bf0ab1f0120df54344a6488221348d350cc5ba3083d90fcc59bff6 != before bca785758da141099ae40d74d5d98242818dbb2f97045270e27eff3867a75c15
======LOGS======
Aug 12 08:09:34.518392650 (86h43m28.949472781s) [upload=90348]: Starting upload
Aug 12 08:09:34.518438588 (86h43m28.949518719s) [upload=90348]: Done starting upload
Aug 12 08:09:34.518530284 (86h43m28.949610415s) [upload=90348]: Uploading segments...
Aug 12 08:09:34.518693356 (86h43m28.949773487s) [upload=90348]: Got next segment. Inline: false
Aug 12 08:09:34.518723123 (86h43m28.949803244s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:09:34.518727791 (86h43m28.949807922s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:09:34.994551934 (86h43m29.425649047s) [seg_pos={0 0}, upload=90348]: Begin upload segment...
Aug 12 08:09:34.994613311 (86h43m29.425693442s) [seg_pos={0 0}, upload=90348]: Done begin upload segment.
Aug 12 08:09:34.994639210 (86h43m29.425719342s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.994728832 (86h43m29.425808953s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995016151 (86h43m29.426096282s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995157472 (86h43m29.426237603s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995386059 (86h43m29.42646619s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995532319 (86h43m29.42661244s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995737302 (86h43m29.426817433s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995836070 (86h43m29.426916201s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996007398 (86h43m29.42708753s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996111497 (86h43m29.427191618s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996271764 (86h43m29.427351895s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996568872 (86h43m29.427649003s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996593449 (86h43m29.427673591s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996818540 (86h43m29.427898671s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997048910 (86h43m29.428129041s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997230117 (86h43m29.428310248s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997284461 (86h43m29.428364592s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997895721 (86h43m29.428975842s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:36.173165467 (86h43m30.604245598s) [upload=90348]: Next returned nil segment
Aug 12 08:09:36.173182580 (86h43m30.604262701s) [upload=90348]: Waiting for error group managing segments...
Aug 12 08:09:36.472128999 (86h43m30.903209131s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.501144544 (86h43m30.932224675s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.506666519 (86h43m30.93774665s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.975977670 (86h43m31.407057801s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.003408231 (86h43m31.434488372s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.004134902 (86h43m31.435215043s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.039682183 (86h43m31.470762304s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.052540554 (86h43m31.483620685s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.058179543 (86h43m31.489259674s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.071996118 (86h43m31.503076249s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.073423749 (86h43m31.504503881s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088308768 (86h43m31.519388899s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088912863 (86h43m31.519992995s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106290181 (86h43m31.537370312s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106315128 (86h43m31.537395249s) [seg_pos={0 0}, upload=90348]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:09:37.106421512 (86h43m31.537501643s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CspvuKb3CWXrAW8FtFEoCVUNhLzWsbpwpW5uUfgyWy71R3qYX): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106474003 (86h43m31.537554134s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106542022 (86h43m31.537622153s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r5RXjrbpRcyxvcYhpoqQdgv8MD8zLmpninS7D3cdNCid4Rc8j): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106648326 (86h43m31.537728457s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106700646 (86h43m31.537780777s) [seg_pos={0 0}, upload=90348]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:09:37.106784566 (86h43m31.537864697s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:09:37.106790037 (86h43m31.537870168s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:09:37.396978732 (86h43m31.828058863s) [upload=90348]: Done uploading segments...
Aug 12 08:09:37.397002888 (86h43m31.828083069s) [upload=90348]: Upload finished. err: <nil>
Duration: 5.799325528s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [...............X..X...............XXX.....X..........X......] duration:
5.982021076s
FAIL (2025-08-12 08:14:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0541524414bf0ab1f0120df54344a6488221348d350cc5ba3083d90fcc59bff6 != before bca785758da141099ae40d74d5d98242818dbb2f97045270e27eff3867a75c15
======LOGS======
Aug 12 08:09:34.518392650 (86h43m28.949472781s) [upload=90348]: Starting upload
Aug 12 08:09:34.518438588 (86h43m28.949518719s) [upload=90348]: Done starting upload
Aug 12 08:09:34.518530284 (86h43m28.949610415s) [upload=90348]: Uploading segments...
Aug 12 08:09:34.518693356 (86h43m28.949773487s) [upload=90348]: Got next segment. Inline: false
Aug 12 08:09:34.518723123 (86h43m28.949803244s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:09:34.518727791 (86h43m28.949807922s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:09:34.994551934 (86h43m29.425649047s) [seg_pos={0 0}, upload=90348]: Begin upload segment...
Aug 12 08:09:34.994613311 (86h43m29.425693442s) [seg_pos={0 0}, upload=90348]: Done begin upload segment.
Aug 12 08:09:34.994639210 (86h43m29.425719342s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.994728832 (86h43m29.425808953s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995016151 (86h43m29.426096282s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995157472 (86h43m29.426237603s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995386059 (86h43m29.42646619s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995532319 (86h43m29.42661244s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995737302 (86h43m29.426817433s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.995836070 (86h43m29.426916201s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996007398 (86h43m29.42708753s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996111497 (86h43m29.427191618s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996271764 (86h43m29.427351895s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996568872 (86h43m29.427649003s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996593449 (86h43m29.427673591s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.996818540 (86h43m29.427898671s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997048910 (86h43m29.428129041s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997230117 (86h43m29.428310248s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997284461 (86h43m29.428364592s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:34.997895721 (86h43m29.428975842s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Uploading piece...
Aug 12 08:09:36.173165467 (86h43m30.604245598s) [upload=90348]: Next returned nil segment
Aug 12 08:09:36.173182580 (86h43m30.604262701s) [upload=90348]: Waiting for error group managing segments...
Aug 12 08:09:36.472128999 (86h43m30.903209131s) [noise=true , address=66.23.193.175:4563 , piece_id=4OQZNZUGCS3PTE6ZOGNEAWGUTTWIJFUC7LTIWLBNIXIM7WJ4WAWA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.501144544 (86h43m30.932224675s) [noise=true , address=193.149.164.143:4693 , piece_id=6FY2JML6F7J36SC5GXAUEAMGGSSBJDITSSMSO66RQPT56EVGRZOA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.506666519 (86h43m30.93774665s) [noise=true , address=64.49.13.137:4497 , piece_id=ILDOX2W3MUIUGFMHLTYGSJBL2BJSO36I5PBVK2U4GXREE4UXVXQA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:36.975977670 (86h43m31.407057801s) [noise=true , address=104.36.82.61:4392 , piece_id=TOEYOBZM22AHIETKXW2DWE37AV6PVACXRP6O4ER7L77YBZLRP2ZQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.003408231 (86h43m31.434488372s) [noise=true , address=77.90.31.13:4645 , piece_id=RFNBDV2I5XKIRFJX6WBVPAX67PITXSQD5YELIUPXSDIHN6P54WOQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.004134902 (86h43m31.435215043s) [noise=true , address=104.36.82.62:4415 , piece_id=C5IAFZP6GLM7EEXT6QBP2JYVNJQJCYYFTXSG56FQRPAYMT5EVA4A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.039682183 (86h43m31.470762304s) [noise=true , address=104.36.82.43:4857 , piece_id=3ZOK22LNPHDCYHEICCK5YZOMLY4NIA56GHUFQQI6JDABMKFKMT4Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.052540554 (86h43m31.483620685s) [noise=true , address=104.36.82.5:4858 , piece_id=Y6MDMWUJPDDUY6IHQ23GDMNC76XFMSL7ANNBU3A3OQRJU5POGPJQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.058179543 (86h43m31.489259674s) [noise=true , address=104.36.82.19:4409 , piece_id=YGCP57OL6JX6PA7OYH3M5ZYC5HSAKKP6HLDNS4QPYPS7E7VWWUKQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.071996118 (86h43m31.503076249s) [noise=true , address=104.36.82.13:4196 , piece_id=M62GVHJJYJ64MANYQ7IBY7DBPJPC7RRYQEJ2X6IOHOX2SKHS2S3A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.073423749 (86h43m31.504503881s) [noise=true , address=156.146.43.225:4467 , piece_id=JSTN3X6CMF24KN6OYEZRTS3HNDBA6PUXLNQHZ4II6INWYBNYQQ2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088308768 (86h43m31.519388899s) [noise=true , address=104.36.82.37:4670 , piece_id=6YPRWJ3MFODALEVS67R26V2R2JVVYMUXS2JAQ7J3V7UP33TZGGLQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.088912863 (86h43m31.519992995s) [noise=true , address=104.36.82.16:4302 , piece_id=UISFGBHJOMSNP6AONNBNQYAGDA6VHAYVIMLKNOGYKTQIEZPR2C2A, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106290181 (86h43m31.537370312s) [noise=true , address=104.36.82.8:4001 , piece_id=TTOPNPAZEBZVUW2ZZ3MV7CGT5L4PKQYMDSYO7PTBCUUIKWDY6KEA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: <nil>
Aug 12 08:09:37.106315128 (86h43m31.537395249s) [seg_pos={0 0}, upload=90348]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:09:37.106421512 (86h43m31.537501643s) [noise=true , address=104.36.82.46:4491 , piece_id=ADI2DGIPE3UVQ6WUST4BEUERAAWSJF4ZLQ5VXCXE3BAA3LSSBG7Q, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CspvuKb3CWXrAW8FtFEoCVUNhLzWsbpwpW5uUfgyWy71R3qYX): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106474003 (86h43m31.537554134s) [noise=true , address=104.36.82.44:4899 , piece_id=EWXGMEVKSURZG6QMCCEGGTU5HWCHZQMOW3PK4HVXKNP7N2BM56SQ, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106542022 (86h43m31.537622153s) [noise=true , address=104.36.82.38:4719 , piece_id=OF3W6AGZKBLJNCUXUJQIE6XPRTC7Y4AUVHYLCBNK2Z5CWFMVNWFA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r5RXjrbpRcyxvcYhpoqQdgv8MD8zLmpninS7D3cdNCid4Rc8j): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106648326 (86h43m31.537728457s) [noise=true , address=104.36.82.23:4459 , piece_id=AY366BKPXWM4PHSWDWSNNBO2YRYEG3TBV4KS4IHU4PZVLUGSSUYA, seg_pos={0 0}, upload=90348]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF
Aug 12 08:09:37.106700646 (86h43m31.537780777s) [seg_pos={0 0}, upload=90348]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:09:37.106784566 (86h43m31.537864697s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:09:37.106790037 (86h43m31.537870168s) [upload=90348]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:09:37.396978732 (86h43m31.828058863s) [upload=90348]: Done uploading segments...
Aug 12 08:09:37.397002888 (86h43m31.828083069s) [upload=90348]: Upload finished. err: <nil>
Duration: 5.982051284s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X.................................X...........X.............] duration:
1.863287399s
FAIL (2025-08-12 08:14:41 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 08:04:39.065758868 (86h38m33.496838999s) [upload=90272]: Starting upload Aug 12 08:04:39.065815496 (86h38m33.496895627s) [upload=90272]: Done starting upload Aug 12 08:04:39.065860663 (86h38m33.496940784s) [upload=90272]: Uploading segments... Aug 12 08:04:39.065894056 (86h38m33.496974178s) [upload=90272]: Got next segment. Inline: true Aug 12 08:04:39.065898956 (86h38m33.496979087s) [upload=90272]: Waiting for error group managing segments... Aug 12 08:04:39.065930075 (86h38m33.497010206s) [upload=90272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:04:39.065933943 (86h38m33.497014074s) [upload=90272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:04:39.065936268 (86h38m33.497016399s) [upload=90272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:04:39.355440795 (86h38m33.786520966s) [upload=90272]: Done uploading segments... Aug 12 08:04:39.355460783 (86h38m33.786540964s) [upload=90272]: Upload finished. err: <nil>
Duration: 1.863312928s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|