Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X.X.......................................................] duration:
2.388198706s
FAIL (2025-08-19 08:56:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:12:21.770696128 (254h46m16.201776259s) [upload=264940]: Starting upload Aug 19 08:12:21.770757987 (254h46m16.201838108s) [upload=264940]: Done starting upload Aug 19 08:12:21.770820176 (254h46m16.201900307s) [upload=264940]: Uploading segments... Aug 19 08:12:21.770863408 (254h46m16.201943539s) [upload=264940]: Got next segment. Inline: true Aug 19 08:12:21.770866965 (254h46m16.201947086s) [upload=264940]: Waiting for error group managing segments... Aug 19 08:12:21.770897073 (254h46m16.201977194s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:12:21.770900720 (254h46m16.201980851s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 08:12:21.770903125 (254h46m16.201983246s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 08:12:21.983071451 (254h46m16.414151582s) [upload=264940]: Done uploading segments... Aug 19 08:12:21.983087682 (254h46m16.414167814s) [upload=264940]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.38823186s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
7.107482677s
FAIL (2025-08-19 08:56:15 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 7.107510108s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [..X...X.............X.........X............X......X......X..] duration:
6.412333295s
FAIL (2025-08-19 08:56:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:54:27.154617895 (255h28m21.585698026s) [upload=265665]: Starting upload Aug 19 08:54:27.154677290 (255h28m21.585757421s) [upload=265665]: Done starting upload Aug 19 08:54:27.154825543 (255h28m21.585905674s) [upload=265665]: Uploading segments... Aug 19 08:54:27.154969548 (255h28m21.586049679s) [upload=265665]: Got next segment. Inline: false Aug 19 08:54:27.155015116 (255h28m21.586095247s) [upload=265665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:54:27.155021257 (255h28m21.586101388s) [upload=265665]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 08:54:27.371785709 (255h28m21.80286584s) [upload=265665]: Next segment err: metaclient: Too Many Requests Aug 19 08:54:27.371806920 (255h28m21.802887051s) [upload=265665]: Done uploading segments... Aug 19 08:54:27.371822129 (255h28m21.80290226s) [upload=265665]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.41236221s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
6.316473074s
FAIL (2025-08-19 08:55:55 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 6.316527047s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
6.165163756s
FAIL (2025-08-19 08:55:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.165185526s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [...X...X.............X.........X............X......X......X.] duration:
5.755737283s
FAIL (2025-08-19 08:55:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:54:27.154617895 (255h28m21.585698026s) [upload=265665]: Starting upload Aug 19 08:54:27.154677290 (255h28m21.585757421s) [upload=265665]: Done starting upload Aug 19 08:54:27.154825543 (255h28m21.585905674s) [upload=265665]: Uploading segments... Aug 19 08:54:27.154969548 (255h28m21.586049679s) [upload=265665]: Got next segment. Inline: false Aug 19 08:54:27.155015116 (255h28m21.586095247s) [upload=265665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:54:27.155021257 (255h28m21.586101388s) [upload=265665]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 08:54:27.371785709 (255h28m21.80286584s) [upload=265665]: Next segment err: metaclient: Too Many Requests Aug 19 08:54:27.371806920 (255h28m21.802887051s) [upload=265665]: Done uploading segments... Aug 19 08:54:27.371822129 (255h28m21.80290226s) [upload=265665]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.755762801s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
6.322308731s
FAIL (2025-08-19 08:55:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.322326566s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X.X......................................................] duration:
2.423060041s
FAIL (2025-08-19 08:55:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:12:21.770696128 (254h46m16.201776259s) [upload=264940]: Starting upload Aug 19 08:12:21.770757987 (254h46m16.201838108s) [upload=264940]: Done starting upload Aug 19 08:12:21.770820176 (254h46m16.201900307s) [upload=264940]: Uploading segments... Aug 19 08:12:21.770863408 (254h46m16.201943539s) [upload=264940]: Got next segment. Inline: true Aug 19 08:12:21.770866965 (254h46m16.201947086s) [upload=264940]: Waiting for error group managing segments... Aug 19 08:12:21.770897073 (254h46m16.201977194s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:12:21.770900720 (254h46m16.201980851s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 08:12:21.770903125 (254h46m16.201983246s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 08:12:21.983071451 (254h46m16.414151582s) [upload=264940]: Done uploading segments... Aug 19 08:12:21.983087682 (254h46m16.414167814s) [upload=264940]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.423085883s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X.X.....................................................] duration:
1.896416653s
FAIL (2025-08-19 08:55:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:12:21.770696128 (254h46m16.201776259s) [upload=264940]: Starting upload Aug 19 08:12:21.770757987 (254h46m16.201838108s) [upload=264940]: Done starting upload Aug 19 08:12:21.770820176 (254h46m16.201900307s) [upload=264940]: Uploading segments... Aug 19 08:12:21.770863408 (254h46m16.201943539s) [upload=264940]: Got next segment. Inline: true Aug 19 08:12:21.770866965 (254h46m16.201947086s) [upload=264940]: Waiting for error group managing segments... Aug 19 08:12:21.770897073 (254h46m16.201977194s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:12:21.770900720 (254h46m16.201980851s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 08:12:21.770903125 (254h46m16.201983246s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 08:12:21.983071451 (254h46m16.414151582s) [upload=264940]: Done uploading segments... Aug 19 08:12:21.983087682 (254h46m16.414167814s) [upload=264940]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.896444085s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
5.531693242s
FAIL (2025-08-19 08:55:04 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.531717828s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
5.867258165s
FAIL (2025-08-19 08:54:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.867274636s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
5.881455832s
FAIL (2025-08-19 08:54:36 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.881485398s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
6.415542152s
FAIL (2025-08-19 08:54:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.415574224s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [....X...X.............X.........X............X......X......X] duration:
875.206187ms
FAIL (2025-08-19 08:54:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:54:27.154617895 (255h28m21.585698026s) [upload=265665]: Starting upload Aug 19 08:54:27.154677290 (255h28m21.585757421s) [upload=265665]: Done starting upload Aug 19 08:54:27.154825543 (255h28m21.585905674s) [upload=265665]: Uploading segments... Aug 19 08:54:27.154969548 (255h28m21.586049679s) [upload=265665]: Got next segment. Inline: false Aug 19 08:54:27.155015116 (255h28m21.586095247s) [upload=265665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:54:27.155021257 (255h28m21.586101388s) [upload=265665]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 08:54:27.371785709 (255h28m21.80286584s) [upload=265665]: Next segment err: metaclient: Too Many Requests Aug 19 08:54:27.371806920 (255h28m21.802887051s) [upload=265665]: Done uploading segments... Aug 19 08:54:27.371822129 (255h28m21.80290226s) [upload=265665]: Upload finished. err: metaclient: Too Many Requests
Duration: 875.229221ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X.X....................................................] duration:
1.806903124s
FAIL (2025-08-19 08:54:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:12:21.770696128 (254h46m16.201776259s) [upload=264940]: Starting upload Aug 19 08:12:21.770757987 (254h46m16.201838108s) [upload=264940]: Done starting upload Aug 19 08:12:21.770820176 (254h46m16.201900307s) [upload=264940]: Uploading segments... Aug 19 08:12:21.770863408 (254h46m16.201943539s) [upload=264940]: Got next segment. Inline: true Aug 19 08:12:21.770866965 (254h46m16.201947086s) [upload=264940]: Waiting for error group managing segments... Aug 19 08:12:21.770897073 (254h46m16.201977194s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:12:21.770900720 (254h46m16.201980851s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 08:12:21.770903125 (254h46m16.201983246s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 08:12:21.983071451 (254h46m16.414151582s) [upload=264940]: Done uploading segments... Aug 19 08:12:21.983087682 (254h46m16.414167814s) [upload=264940]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.806930917s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
6.113307985s
FAIL (2025-08-19 08:54:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.113327122s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X.X...................................................] duration:
1.820158709s
FAIL (2025-08-19 08:53:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:12:21.770696128 (254h46m16.201776259s) [upload=264940]: Starting upload Aug 19 08:12:21.770757987 (254h46m16.201838108s) [upload=264940]: Done starting upload Aug 19 08:12:21.770820176 (254h46m16.201900307s) [upload=264940]: Uploading segments... Aug 19 08:12:21.770863408 (254h46m16.201943539s) [upload=264940]: Got next segment. Inline: true Aug 19 08:12:21.770866965 (254h46m16.201947086s) [upload=264940]: Waiting for error group managing segments... Aug 19 08:12:21.770897073 (254h46m16.201977194s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:12:21.770900720 (254h46m16.201980851s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 08:12:21.770903125 (254h46m16.201983246s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 08:12:21.983071451 (254h46m16.414151582s) [upload=264940]: Done uploading segments... Aug 19 08:12:21.983087682 (254h46m16.414167814s) [upload=264940]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.82018616s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.891186013s
FAIL (2025-08-19 08:53:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.891209969s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.418388111s
FAIL (2025-08-19 08:53:29 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.418413959s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.....X...X.............X.........X............X......X......] duration:
5.736712202s
FAIL (2025-08-19 08:53:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 19 08:48:29.339556343 (255h22m23.770636474s) [upload=265569]: Starting upload
Aug 19 08:48:29.339611238 (255h22m23.770691369s) [upload=265569]: Done starting upload
Aug 19 08:48:29.339683346 (255h22m23.770763467s) [upload=265569]: Uploading segments...
Aug 19 08:48:29.339796262 (255h22m23.770876393s) [upload=265569]: Got next segment. Inline: false
Aug 19 08:48:29.339833354 (255h22m23.770913485s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 08:48:29.339837462 (255h22m23.770917593s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 08:48:29.782557410 (255h22m24.213637541s) [seg_pos={0 0}, upload=265569]: Begin upload segment...
Aug 19 08:48:29.782604140 (255h22m24.213684261s) [seg_pos={0 0}, upload=265569]: Done begin upload segment.
Aug 19 08:48:29.782625000 (255h22m24.213705131s) [noise=true , address=104.36.82.40:4971 , piece_id=CAL4HNJ5D3LD5NUPDFPQQ773BSCOXMN6STRWOSXTQQT33GMBRT5A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.782696957 (255h22m24.213777088s) [noise=true , address=79.127.201.215:4353 , piece_id=PIC5UU7O7ZRIUOOFWDJRPFKKP6Y2IJDVCG66VNQUB4HCARNEHSEA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783002893 (255h22m24.214083014s) [noise=true , address=79.127.219.51:4206 , piece_id=5E7AKMTWKSWMZP65KCS53UOZIMRY2QRNDW744LZDNNM6T46LOOVQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783215379 (255h22m24.21429551s) [noise=true , address=77.90.31.10:4547 , piece_id=LT62A6FAFE22V6J6L33DHGP4KO2TGOQIA7NNBNP54WGFD62KLMSQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783324508 (255h22m24.214404639s) [noise=true , address=45.91.116.7:4039 , piece_id=KXNPL2ITUQRMPOA6V2W5TVFKBBDDJMRG7TL3I6GFMWQJH4D3E57A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783554638 (255h22m24.214634769s) [noise=true , address=45.91.116.10:4109 , piece_id=5HXRNCDWGKACJPA7SFH5SMUHBQWZAJKGZNYWGJDLJ3MLPXDP22TQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783618100 (255h22m24.214698231s) [noise=true , address=77.90.31.16:4765 , piece_id=ZCO5VOGKUCX2YJK2W4XHD7HMXQMYXTYAMLHM66XZVHUEBRLPOG2Q, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783866475 (255h22m24.214946607s) [noise=true , address=104.36.82.23:4461 , piece_id=XR7GLWCM46VORSP3BYATYPPX7R7MUVFMWTSRHE35YRGC3IT5HFJA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783888438 (255h22m24.214968569s) [noise=true , address=104.36.82.44:4880 , piece_id=24XTB67GOOJFCT5UIZ4PJNAVBFODJIQZC3FHHDMCOJBG3CU6AAJA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784197359 (255h22m24.21527749s) [noise=true , address=77.90.31.12:4615 , piece_id=CLN3DSBAI5DIVAORK3IG73U6B3KL2AXO6ZU4QUU3S7PC5ZIT7PRA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784371602 (255h22m24.215451723s) [noise=true , address=79.127.219.38:4022 , piece_id=4DZTAXSPCXPQHM3EVH36A2FF6FOR5YM2P5QWYIDX77CYTMA3IY3A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784439893 (255h22m24.215520024s) [noise=true , address=77.90.31.21:4890 , piece_id=LY4VJTYJTJDYNEYPGW7DFUCUFARIBRAC64MLUQ4LDDQOR3557W6A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784690292 (255h22m24.215770413s) [noise=true , address=104.36.82.60:4348 , piece_id=FRYVR52VEFADAUPR3W4I6JLX5RKWHICLVMBYK6Z6LPNSU2V44JLQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784698156 (255h22m24.215778288s) [noise=true , address=77.90.31.15:4705 , piece_id=L3OWGKEMR4KMLT4QYXJXH3FZ2R5YVUFMAPZR4VZRCE3LRFGKYJTA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784933207 (255h22m24.216013328s) [noise=true , address=45.91.116.12:4259 , piece_id=UDQ7OUULHDQJXUMYRO5E3G7R6JMQK3DKP7454GR2NIB7XMBER3AA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784941673 (255h22m24.216021804s) [noise=true , address=77.90.31.17:4773 , piece_id=HSCFO6ZH5DG6KGG5LVDRT2F3H6MZBGM3EQXGJYL2DAILLSE74BSA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.785191310 (255h22m24.216271441s) [noise=true , address=104.36.82.23:4457 , piece_id=LGTWIQRASQ6DELFXQIPX3ZBWNKFUNZXPGFXPTQFUPWL55C6QO7OA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.785438974 (255h22m24.216519105s) [noise=true , address=66.23.193.175:4559 , piece_id=3JALCKC2Y7PIU3SZLDNAZQA6PHZUE4M4FG7P7O2FVTWN2WSOD5QA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:30.987247668 (255h22m25.418327799s) [upload=265569]: Next returned nil segment
Aug 19 08:48:30.987263478 (255h22m25.418343609s) [upload=265569]: Waiting for error group managing segments...
Aug 19 08:48:31.274737547 (255h22m25.705817678s) [noise=true , address=66.23.193.175:4559 , piece_id=3JALCKC2Y7PIU3SZLDNAZQA6PHZUE4M4FG7P7O2FVTWN2WSOD5QA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.645368700 (255h22m26.076448831s) [noise=true , address=79.127.219.51:4206 , piece_id=5E7AKMTWKSWMZP65KCS53UOZIMRY2QRNDW744LZDNNM6T46LOOVQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.675304860 (255h22m26.106384991s) [noise=true , address=45.91.116.12:4259 , piece_id=UDQ7OUULHDQJXUMYRO5E3G7R6JMQK3DKP7454GR2NIB7XMBER3AA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.702646396 (255h22m26.133726567s) [noise=true , address=79.127.219.38:4022 , piece_id=4DZTAXSPCXPQHM3EVH36A2FF6FOR5YM2P5QWYIDX77CYTMA3IY3A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.750009401 (255h22m26.181089532s) [noise=true , address=77.90.31.21:4890 , piece_id=LY4VJTYJTJDYNEYPGW7DFUCUFARIBRAC64MLUQ4LDDQOR3557W6A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.761841281 (255h22m26.192921412s) [noise=true , address=79.127.201.215:4353 , piece_id=PIC5UU7O7ZRIUOOFWDJRPFKKP6Y2IJDVCG66VNQUB4HCARNEHSEA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.772257822 (255h22m26.203337943s) [noise=true , address=77.90.31.17:4773 , piece_id=HSCFO6ZH5DG6KGG5LVDRT2F3H6MZBGM3EQXGJYL2DAILLSE74BSA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.779554113 (255h22m26.210634244s) [noise=true , address=77.90.31.15:4705 , piece_id=L3OWGKEMR4KMLT4QYXJXH3FZ2R5YVUFMAPZR4VZRCE3LRFGKYJTA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.781666905 (255h22m26.212747036s) [noise=true , address=104.36.82.44:4880 , piece_id=24XTB67GOOJFCT5UIZ4PJNAVBFODJIQZC3FHHDMCOJBG3CU6AAJA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.836555049 (255h22m26.267635181s) [noise=true , address=104.36.82.40:4971 , piece_id=CAL4HNJ5D3LD5NUPDFPQQ773BSCOXMN6STRWOSXTQQT33GMBRT5A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.836983669 (255h22m26.2680638s) [noise=true , address=104.36.82.60:4348 , piece_id=FRYVR52VEFADAUPR3W4I6JLX5RKWHICLVMBYK6Z6LPNSU2V44JLQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.865918594 (255h22m26.296998725s) [noise=true , address=77.90.31.16:4765 , piece_id=ZCO5VOGKUCX2YJK2W4XHD7HMXQMYXTYAMLHM66XZVHUEBRLPOG2Q, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.875581784 (255h22m26.306661915s) [noise=true , address=45.91.116.7:4039 , piece_id=KXNPL2ITUQRMPOA6V2W5TVFKBBDDJMRG7TL3I6GFMWQJH4D3E57A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.907809920 (255h22m26.338890051s) [noise=true , address=104.36.82.23:4457 , piece_id=LGTWIQRASQ6DELFXQIPX3ZBWNKFUNZXPGFXPTQFUPWL55C6QO7OA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.907836671 (255h22m26.338916802s) [seg_pos={0 0}, upload=265569]: Segment reached optimal threshold of 14 pieces.
Aug 19 08:48:31.907950799 (255h22m26.33903093s) [noise=true , address=77.90.31.10:4547 , piece_id=LT62A6FAFE22V6J6L33DHGP4KO2TGOQIA7NNBNP54WGFD62KLMSQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF
Aug 19 08:48:31.908095566 (255h22m26.339175697s) [noise=true , address=104.36.82.23:4461 , piece_id=XR7GLWCM46VORSP3BYATYPPX7R7MUVFMWTSRHE35YRGC3IT5HFJA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA): protocol: expected piece hash; context canceled; EOF
Aug 19 08:48:31.908134120 (255h22m26.339214242s) [noise=true , address=77.90.31.12:4615 , piece_id=CLN3DSBAI5DIVAORK3IG73U6B3KL2AXO6ZU4QUU3S7PC5ZIT7PRA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xaory9AHtW4ra15wmL2CagPKKJU2u9keFo1ntBMy8AzjpkmwR): protocol: expected piece hash; context canceled; EOF
Aug 19 08:48:31.908186751 (255h22m26.339266882s) [noise=true , address=45.91.116.10:4109 , piece_id=5HXRNCDWGKACJPA7SFH5SMUHBQWZAJKGZNYWGJDLJ3MLPXDP22TQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KxvKeR7QALkoH9b9ttiTwTunhNiW2ez95rsZ1xe2vmPG8BXCa): protocol: write tcp 188.166.225.170:54138->45.91.116.10:4109: use of closed network connection; write tcp 188.166.225.170:54138->45.91.116.10:4109: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54138->45.91.116.10:4109: use of closed network connection
Aug 19 08:48:31.908206508 (255h22m26.339286629s) [seg_pos={0 0}, upload=265569]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 08:48:31.908262075 (255h22m26.339342196s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 08:48:31.908269039 (255h22m26.33934917s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 08:48:32.188909672 (255h22m26.619989803s) [upload=265569]: Done uploading segments...
Aug 19 08:48:32.188931514 (255h22m26.620011645s) [upload=265569]: Upload finished. err: <nil>
Duration: 5.736740546s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.965255231s
FAIL (2025-08-19 08:53:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.965277603s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [......X...X.............X.........X............X......X.....] duration:
5.620883357s
FAIL (2025-08-19 08:53:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 19 08:48:29.339556343 (255h22m23.770636474s) [upload=265569]: Starting upload
Aug 19 08:48:29.339611238 (255h22m23.770691369s) [upload=265569]: Done starting upload
Aug 19 08:48:29.339683346 (255h22m23.770763467s) [upload=265569]: Uploading segments...
Aug 19 08:48:29.339796262 (255h22m23.770876393s) [upload=265569]: Got next segment. Inline: false
Aug 19 08:48:29.339833354 (255h22m23.770913485s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 08:48:29.339837462 (255h22m23.770917593s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 08:48:29.782557410 (255h22m24.213637541s) [seg_pos={0 0}, upload=265569]: Begin upload segment...
Aug 19 08:48:29.782604140 (255h22m24.213684261s) [seg_pos={0 0}, upload=265569]: Done begin upload segment.
Aug 19 08:48:29.782625000 (255h22m24.213705131s) [noise=true , address=104.36.82.40:4971 , piece_id=CAL4HNJ5D3LD5NUPDFPQQ773BSCOXMN6STRWOSXTQQT33GMBRT5A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.782696957 (255h22m24.213777088s) [noise=true , address=79.127.201.215:4353 , piece_id=PIC5UU7O7ZRIUOOFWDJRPFKKP6Y2IJDVCG66VNQUB4HCARNEHSEA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783002893 (255h22m24.214083014s) [noise=true , address=79.127.219.51:4206 , piece_id=5E7AKMTWKSWMZP65KCS53UOZIMRY2QRNDW744LZDNNM6T46LOOVQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783215379 (255h22m24.21429551s) [noise=true , address=77.90.31.10:4547 , piece_id=LT62A6FAFE22V6J6L33DHGP4KO2TGOQIA7NNBNP54WGFD62KLMSQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783324508 (255h22m24.214404639s) [noise=true , address=45.91.116.7:4039 , piece_id=KXNPL2ITUQRMPOA6V2W5TVFKBBDDJMRG7TL3I6GFMWQJH4D3E57A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783554638 (255h22m24.214634769s) [noise=true , address=45.91.116.10:4109 , piece_id=5HXRNCDWGKACJPA7SFH5SMUHBQWZAJKGZNYWGJDLJ3MLPXDP22TQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783618100 (255h22m24.214698231s) [noise=true , address=77.90.31.16:4765 , piece_id=ZCO5VOGKUCX2YJK2W4XHD7HMXQMYXTYAMLHM66XZVHUEBRLPOG2Q, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783866475 (255h22m24.214946607s) [noise=true , address=104.36.82.23:4461 , piece_id=XR7GLWCM46VORSP3BYATYPPX7R7MUVFMWTSRHE35YRGC3IT5HFJA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783888438 (255h22m24.214968569s) [noise=true , address=104.36.82.44:4880 , piece_id=24XTB67GOOJFCT5UIZ4PJNAVBFODJIQZC3FHHDMCOJBG3CU6AAJA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784197359 (255h22m24.21527749s) [noise=true , address=77.90.31.12:4615 , piece_id=CLN3DSBAI5DIVAORK3IG73U6B3KL2AXO6ZU4QUU3S7PC5ZIT7PRA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784371602 (255h22m24.215451723s) [noise=true , address=79.127.219.38:4022 , piece_id=4DZTAXSPCXPQHM3EVH36A2FF6FOR5YM2P5QWYIDX77CYTMA3IY3A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784439893 (255h22m24.215520024s) [noise=true , address=77.90.31.21:4890 , piece_id=LY4VJTYJTJDYNEYPGW7DFUCUFARIBRAC64MLUQ4LDDQOR3557W6A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784690292 (255h22m24.215770413s) [noise=true , address=104.36.82.60:4348 , piece_id=FRYVR52VEFADAUPR3W4I6JLX5RKWHICLVMBYK6Z6LPNSU2V44JLQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784698156 (255h22m24.215778288s) [noise=true , address=77.90.31.15:4705 , piece_id=L3OWGKEMR4KMLT4QYXJXH3FZ2R5YVUFMAPZR4VZRCE3LRFGKYJTA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784933207 (255h22m24.216013328s) [noise=true , address=45.91.116.12:4259 , piece_id=UDQ7OUULHDQJXUMYRO5E3G7R6JMQK3DKP7454GR2NIB7XMBER3AA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784941673 (255h22m24.216021804s) [noise=true , address=77.90.31.17:4773 , piece_id=HSCFO6ZH5DG6KGG5LVDRT2F3H6MZBGM3EQXGJYL2DAILLSE74BSA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.785191310 (255h22m24.216271441s) [noise=true , address=104.36.82.23:4457 , piece_id=LGTWIQRASQ6DELFXQIPX3ZBWNKFUNZXPGFXPTQFUPWL55C6QO7OA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.785438974 (255h22m24.216519105s) [noise=true , address=66.23.193.175:4559 , piece_id=3JALCKC2Y7PIU3SZLDNAZQA6PHZUE4M4FG7P7O2FVTWN2WSOD5QA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:30.987247668 (255h22m25.418327799s) [upload=265569]: Next returned nil segment
Aug 19 08:48:30.987263478 (255h22m25.418343609s) [upload=265569]: Waiting for error group managing segments...
Aug 19 08:48:31.274737547 (255h22m25.705817678s) [noise=true , address=66.23.193.175:4559 , piece_id=3JALCKC2Y7PIU3SZLDNAZQA6PHZUE4M4FG7P7O2FVTWN2WSOD5QA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.645368700 (255h22m26.076448831s) [noise=true , address=79.127.219.51:4206 , piece_id=5E7AKMTWKSWMZP65KCS53UOZIMRY2QRNDW744LZDNNM6T46LOOVQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.675304860 (255h22m26.106384991s) [noise=true , address=45.91.116.12:4259 , piece_id=UDQ7OUULHDQJXUMYRO5E3G7R6JMQK3DKP7454GR2NIB7XMBER3AA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.702646396 (255h22m26.133726567s) [noise=true , address=79.127.219.38:4022 , piece_id=4DZTAXSPCXPQHM3EVH36A2FF6FOR5YM2P5QWYIDX77CYTMA3IY3A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.750009401 (255h22m26.181089532s) [noise=true , address=77.90.31.21:4890 , piece_id=LY4VJTYJTJDYNEYPGW7DFUCUFARIBRAC64MLUQ4LDDQOR3557W6A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.761841281 (255h22m26.192921412s) [noise=true , address=79.127.201.215:4353 , piece_id=PIC5UU7O7ZRIUOOFWDJRPFKKP6Y2IJDVCG66VNQUB4HCARNEHSEA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.772257822 (255h22m26.203337943s) [noise=true , address=77.90.31.17:4773 , piece_id=HSCFO6ZH5DG6KGG5LVDRT2F3H6MZBGM3EQXGJYL2DAILLSE74BSA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.779554113 (255h22m26.210634244s) [noise=true , address=77.90.31.15:4705 , piece_id=L3OWGKEMR4KMLT4QYXJXH3FZ2R5YVUFMAPZR4VZRCE3LRFGKYJTA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.781666905 (255h22m26.212747036s) [noise=true , address=104.36.82.44:4880 , piece_id=24XTB67GOOJFCT5UIZ4PJNAVBFODJIQZC3FHHDMCOJBG3CU6AAJA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.836555049 (255h22m26.267635181s) [noise=true , address=104.36.82.40:4971 , piece_id=CAL4HNJ5D3LD5NUPDFPQQ773BSCOXMN6STRWOSXTQQT33GMBRT5A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.836983669 (255h22m26.2680638s) [noise=true , address=104.36.82.60:4348 , piece_id=FRYVR52VEFADAUPR3W4I6JLX5RKWHICLVMBYK6Z6LPNSU2V44JLQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.865918594 (255h22m26.296998725s) [noise=true , address=77.90.31.16:4765 , piece_id=ZCO5VOGKUCX2YJK2W4XHD7HMXQMYXTYAMLHM66XZVHUEBRLPOG2Q, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.875581784 (255h22m26.306661915s) [noise=true , address=45.91.116.7:4039 , piece_id=KXNPL2ITUQRMPOA6V2W5TVFKBBDDJMRG7TL3I6GFMWQJH4D3E57A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.907809920 (255h22m26.338890051s) [noise=true , address=104.36.82.23:4457 , piece_id=LGTWIQRASQ6DELFXQIPX3ZBWNKFUNZXPGFXPTQFUPWL55C6QO7OA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.907836671 (255h22m26.338916802s) [seg_pos={0 0}, upload=265569]: Segment reached optimal threshold of 14 pieces.
Aug 19 08:48:31.907950799 (255h22m26.33903093s) [noise=true , address=77.90.31.10:4547 , piece_id=LT62A6FAFE22V6J6L33DHGP4KO2TGOQIA7NNBNP54WGFD62KLMSQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF
Aug 19 08:48:31.908095566 (255h22m26.339175697s) [noise=true , address=104.36.82.23:4461 , piece_id=XR7GLWCM46VORSP3BYATYPPX7R7MUVFMWTSRHE35YRGC3IT5HFJA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA): protocol: expected piece hash; context canceled; EOF
Aug 19 08:48:31.908134120 (255h22m26.339214242s) [noise=true , address=77.90.31.12:4615 , piece_id=CLN3DSBAI5DIVAORK3IG73U6B3KL2AXO6ZU4QUU3S7PC5ZIT7PRA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xaory9AHtW4ra15wmL2CagPKKJU2u9keFo1ntBMy8AzjpkmwR): protocol: expected piece hash; context canceled; EOF
Aug 19 08:48:31.908186751 (255h22m26.339266882s) [noise=true , address=45.91.116.10:4109 , piece_id=5HXRNCDWGKACJPA7SFH5SMUHBQWZAJKGZNYWGJDLJ3MLPXDP22TQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KxvKeR7QALkoH9b9ttiTwTunhNiW2ez95rsZ1xe2vmPG8BXCa): protocol: write tcp 188.166.225.170:54138->45.91.116.10:4109: use of closed network connection; write tcp 188.166.225.170:54138->45.91.116.10:4109: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54138->45.91.116.10:4109: use of closed network connection
Aug 19 08:48:31.908206508 (255h22m26.339286629s) [seg_pos={0 0}, upload=265569]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 08:48:31.908262075 (255h22m26.339342196s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 08:48:31.908269039 (255h22m26.33934917s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 08:48:32.188909672 (255h22m26.619989803s) [upload=265569]: Done uploading segments...
Aug 19 08:48:32.188931514 (255h22m26.620011645s) [upload=265569]: Upload finished. err: <nil>
Duration: 5.62091172s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X.X..................................................] duration:
1.819542038s
FAIL (2025-08-19 08:52:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:12:21.770696128 (254h46m16.201776259s) [upload=264940]: Starting upload Aug 19 08:12:21.770757987 (254h46m16.201838108s) [upload=264940]: Done starting upload Aug 19 08:12:21.770820176 (254h46m16.201900307s) [upload=264940]: Uploading segments... Aug 19 08:12:21.770863408 (254h46m16.201943539s) [upload=264940]: Got next segment. Inline: true Aug 19 08:12:21.770866965 (254h46m16.201947086s) [upload=264940]: Waiting for error group managing segments... Aug 19 08:12:21.770897073 (254h46m16.201977194s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:12:21.770900720 (254h46m16.201980851s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 08:12:21.770903125 (254h46m16.201983246s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 08:12:21.983071451 (254h46m16.414151582s) [upload=264940]: Done uploading segments... Aug 19 08:12:21.983087682 (254h46m16.414167814s) [upload=264940]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.819568398s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
6.025482546s
FAIL (2025-08-19 08:52:24 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 6.025509508s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.826537551s
FAIL (2025-08-19 08:52:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.826557449s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X.X.................................................] duration:
1.826528217s
FAIL (2025-08-19 08:52:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:12:21.770696128 (254h46m16.201776259s) [upload=264940]: Starting upload Aug 19 08:12:21.770757987 (254h46m16.201838108s) [upload=264940]: Done starting upload Aug 19 08:12:21.770820176 (254h46m16.201900307s) [upload=264940]: Uploading segments... Aug 19 08:12:21.770863408 (254h46m16.201943539s) [upload=264940]: Got next segment. Inline: true Aug 19 08:12:21.770866965 (254h46m16.201947086s) [upload=264940]: Waiting for error group managing segments... Aug 19 08:12:21.770897073 (254h46m16.201977194s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:12:21.770900720 (254h46m16.201980851s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 08:12:21.770903125 (254h46m16.201983246s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 08:12:21.983071451 (254h46m16.414151582s) [upload=264940]: Done uploading segments... Aug 19 08:12:21.983087682 (254h46m16.414167814s) [upload=264940]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.826555387s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.......X...X.............X.........X............X......X....] duration:
5.582662266s
FAIL (2025-08-19 08:51:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 19 08:48:29.339556343 (255h22m23.770636474s) [upload=265569]: Starting upload
Aug 19 08:48:29.339611238 (255h22m23.770691369s) [upload=265569]: Done starting upload
Aug 19 08:48:29.339683346 (255h22m23.770763467s) [upload=265569]: Uploading segments...
Aug 19 08:48:29.339796262 (255h22m23.770876393s) [upload=265569]: Got next segment. Inline: false
Aug 19 08:48:29.339833354 (255h22m23.770913485s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 08:48:29.339837462 (255h22m23.770917593s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 08:48:29.782557410 (255h22m24.213637541s) [seg_pos={0 0}, upload=265569]: Begin upload segment...
Aug 19 08:48:29.782604140 (255h22m24.213684261s) [seg_pos={0 0}, upload=265569]: Done begin upload segment.
Aug 19 08:48:29.782625000 (255h22m24.213705131s) [noise=true , address=104.36.82.40:4971 , piece_id=CAL4HNJ5D3LD5NUPDFPQQ773BSCOXMN6STRWOSXTQQT33GMBRT5A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.782696957 (255h22m24.213777088s) [noise=true , address=79.127.201.215:4353 , piece_id=PIC5UU7O7ZRIUOOFWDJRPFKKP6Y2IJDVCG66VNQUB4HCARNEHSEA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783002893 (255h22m24.214083014s) [noise=true , address=79.127.219.51:4206 , piece_id=5E7AKMTWKSWMZP65KCS53UOZIMRY2QRNDW744LZDNNM6T46LOOVQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783215379 (255h22m24.21429551s) [noise=true , address=77.90.31.10:4547 , piece_id=LT62A6FAFE22V6J6L33DHGP4KO2TGOQIA7NNBNP54WGFD62KLMSQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783324508 (255h22m24.214404639s) [noise=true , address=45.91.116.7:4039 , piece_id=KXNPL2ITUQRMPOA6V2W5TVFKBBDDJMRG7TL3I6GFMWQJH4D3E57A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783554638 (255h22m24.214634769s) [noise=true , address=45.91.116.10:4109 , piece_id=5HXRNCDWGKACJPA7SFH5SMUHBQWZAJKGZNYWGJDLJ3MLPXDP22TQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783618100 (255h22m24.214698231s) [noise=true , address=77.90.31.16:4765 , piece_id=ZCO5VOGKUCX2YJK2W4XHD7HMXQMYXTYAMLHM66XZVHUEBRLPOG2Q, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783866475 (255h22m24.214946607s) [noise=true , address=104.36.82.23:4461 , piece_id=XR7GLWCM46VORSP3BYATYPPX7R7MUVFMWTSRHE35YRGC3IT5HFJA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783888438 (255h22m24.214968569s) [noise=true , address=104.36.82.44:4880 , piece_id=24XTB67GOOJFCT5UIZ4PJNAVBFODJIQZC3FHHDMCOJBG3CU6AAJA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784197359 (255h22m24.21527749s) [noise=true , address=77.90.31.12:4615 , piece_id=CLN3DSBAI5DIVAORK3IG73U6B3KL2AXO6ZU4QUU3S7PC5ZIT7PRA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784371602 (255h22m24.215451723s) [noise=true , address=79.127.219.38:4022 , piece_id=4DZTAXSPCXPQHM3EVH36A2FF6FOR5YM2P5QWYIDX77CYTMA3IY3A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784439893 (255h22m24.215520024s) [noise=true , address=77.90.31.21:4890 , piece_id=LY4VJTYJTJDYNEYPGW7DFUCUFARIBRAC64MLUQ4LDDQOR3557W6A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784690292 (255h22m24.215770413s) [noise=true , address=104.36.82.60:4348 , piece_id=FRYVR52VEFADAUPR3W4I6JLX5RKWHICLVMBYK6Z6LPNSU2V44JLQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784698156 (255h22m24.215778288s) [noise=true , address=77.90.31.15:4705 , piece_id=L3OWGKEMR4KMLT4QYXJXH3FZ2R5YVUFMAPZR4VZRCE3LRFGKYJTA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784933207 (255h22m24.216013328s) [noise=true , address=45.91.116.12:4259 , piece_id=UDQ7OUULHDQJXUMYRO5E3G7R6JMQK3DKP7454GR2NIB7XMBER3AA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784941673 (255h22m24.216021804s) [noise=true , address=77.90.31.17:4773 , piece_id=HSCFO6ZH5DG6KGG5LVDRT2F3H6MZBGM3EQXGJYL2DAILLSE74BSA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.785191310 (255h22m24.216271441s) [noise=true , address=104.36.82.23:4457 , piece_id=LGTWIQRASQ6DELFXQIPX3ZBWNKFUNZXPGFXPTQFUPWL55C6QO7OA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.785438974 (255h22m24.216519105s) [noise=true , address=66.23.193.175:4559 , piece_id=3JALCKC2Y7PIU3SZLDNAZQA6PHZUE4M4FG7P7O2FVTWN2WSOD5QA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:30.987247668 (255h22m25.418327799s) [upload=265569]: Next returned nil segment
Aug 19 08:48:30.987263478 (255h22m25.418343609s) [upload=265569]: Waiting for error group managing segments...
Aug 19 08:48:31.274737547 (255h22m25.705817678s) [noise=true , address=66.23.193.175:4559 , piece_id=3JALCKC2Y7PIU3SZLDNAZQA6PHZUE4M4FG7P7O2FVTWN2WSOD5QA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.645368700 (255h22m26.076448831s) [noise=true , address=79.127.219.51:4206 , piece_id=5E7AKMTWKSWMZP65KCS53UOZIMRY2QRNDW744LZDNNM6T46LOOVQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.675304860 (255h22m26.106384991s) [noise=true , address=45.91.116.12:4259 , piece_id=UDQ7OUULHDQJXUMYRO5E3G7R6JMQK3DKP7454GR2NIB7XMBER3AA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.702646396 (255h22m26.133726567s) [noise=true , address=79.127.219.38:4022 , piece_id=4DZTAXSPCXPQHM3EVH36A2FF6FOR5YM2P5QWYIDX77CYTMA3IY3A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.750009401 (255h22m26.181089532s) [noise=true , address=77.90.31.21:4890 , piece_id=LY4VJTYJTJDYNEYPGW7DFUCUFARIBRAC64MLUQ4LDDQOR3557W6A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.761841281 (255h22m26.192921412s) [noise=true , address=79.127.201.215:4353 , piece_id=PIC5UU7O7ZRIUOOFWDJRPFKKP6Y2IJDVCG66VNQUB4HCARNEHSEA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.772257822 (255h22m26.203337943s) [noise=true , address=77.90.31.17:4773 , piece_id=HSCFO6ZH5DG6KGG5LVDRT2F3H6MZBGM3EQXGJYL2DAILLSE74BSA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.779554113 (255h22m26.210634244s) [noise=true , address=77.90.31.15:4705 , piece_id=L3OWGKEMR4KMLT4QYXJXH3FZ2R5YVUFMAPZR4VZRCE3LRFGKYJTA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.781666905 (255h22m26.212747036s) [noise=true , address=104.36.82.44:4880 , piece_id=24XTB67GOOJFCT5UIZ4PJNAVBFODJIQZC3FHHDMCOJBG3CU6AAJA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.836555049 (255h22m26.267635181s) [noise=true , address=104.36.82.40:4971 , piece_id=CAL4HNJ5D3LD5NUPDFPQQ773BSCOXMN6STRWOSXTQQT33GMBRT5A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.836983669 (255h22m26.2680638s) [noise=true , address=104.36.82.60:4348 , piece_id=FRYVR52VEFADAUPR3W4I6JLX5RKWHICLVMBYK6Z6LPNSU2V44JLQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.865918594 (255h22m26.296998725s) [noise=true , address=77.90.31.16:4765 , piece_id=ZCO5VOGKUCX2YJK2W4XHD7HMXQMYXTYAMLHM66XZVHUEBRLPOG2Q, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.875581784 (255h22m26.306661915s) [noise=true , address=45.91.116.7:4039 , piece_id=KXNPL2ITUQRMPOA6V2W5TVFKBBDDJMRG7TL3I6GFMWQJH4D3E57A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.907809920 (255h22m26.338890051s) [noise=true , address=104.36.82.23:4457 , piece_id=LGTWIQRASQ6DELFXQIPX3ZBWNKFUNZXPGFXPTQFUPWL55C6QO7OA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.907836671 (255h22m26.338916802s) [seg_pos={0 0}, upload=265569]: Segment reached optimal threshold of 14 pieces.
Aug 19 08:48:31.907950799 (255h22m26.33903093s) [noise=true , address=77.90.31.10:4547 , piece_id=LT62A6FAFE22V6J6L33DHGP4KO2TGOQIA7NNBNP54WGFD62KLMSQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF
Aug 19 08:48:31.908095566 (255h22m26.339175697s) [noise=true , address=104.36.82.23:4461 , piece_id=XR7GLWCM46VORSP3BYATYPPX7R7MUVFMWTSRHE35YRGC3IT5HFJA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA): protocol: expected piece hash; context canceled; EOF
Aug 19 08:48:31.908134120 (255h22m26.339214242s) [noise=true , address=77.90.31.12:4615 , piece_id=CLN3DSBAI5DIVAORK3IG73U6B3KL2AXO6ZU4QUU3S7PC5ZIT7PRA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xaory9AHtW4ra15wmL2CagPKKJU2u9keFo1ntBMy8AzjpkmwR): protocol: expected piece hash; context canceled; EOF
Aug 19 08:48:31.908186751 (255h22m26.339266882s) [noise=true , address=45.91.116.10:4109 , piece_id=5HXRNCDWGKACJPA7SFH5SMUHBQWZAJKGZNYWGJDLJ3MLPXDP22TQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KxvKeR7QALkoH9b9ttiTwTunhNiW2ez95rsZ1xe2vmPG8BXCa): protocol: write tcp 188.166.225.170:54138->45.91.116.10:4109: use of closed network connection; write tcp 188.166.225.170:54138->45.91.116.10:4109: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54138->45.91.116.10:4109: use of closed network connection
Aug 19 08:48:31.908206508 (255h22m26.339286629s) [seg_pos={0 0}, upload=265569]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 08:48:31.908262075 (255h22m26.339342196s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 08:48:31.908269039 (255h22m26.33934917s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 08:48:32.188909672 (255h22m26.619989803s) [upload=265569]: Done uploading segments...
Aug 19 08:48:32.188931514 (255h22m26.620011645s) [upload=265569]: Upload finished. err: <nil>
Duration: 5.582679027s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.783733219s
FAIL (2025-08-19 08:51:46 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.783759638s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.889719355s
FAIL (2025-08-19 08:51:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.88973681s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
6.386849953s
FAIL (2025-08-19 08:51:05 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 6.386878627s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [........X...X.............X.........X............X......X...] duration:
5.668031322s
FAIL (2025-08-19 08:51:05 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 19 08:48:29.339556343 (255h22m23.770636474s) [upload=265569]: Starting upload
Aug 19 08:48:29.339611238 (255h22m23.770691369s) [upload=265569]: Done starting upload
Aug 19 08:48:29.339683346 (255h22m23.770763467s) [upload=265569]: Uploading segments...
Aug 19 08:48:29.339796262 (255h22m23.770876393s) [upload=265569]: Got next segment. Inline: false
Aug 19 08:48:29.339833354 (255h22m23.770913485s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 08:48:29.339837462 (255h22m23.770917593s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 08:48:29.782557410 (255h22m24.213637541s) [seg_pos={0 0}, upload=265569]: Begin upload segment...
Aug 19 08:48:29.782604140 (255h22m24.213684261s) [seg_pos={0 0}, upload=265569]: Done begin upload segment.
Aug 19 08:48:29.782625000 (255h22m24.213705131s) [noise=true , address=104.36.82.40:4971 , piece_id=CAL4HNJ5D3LD5NUPDFPQQ773BSCOXMN6STRWOSXTQQT33GMBRT5A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.782696957 (255h22m24.213777088s) [noise=true , address=79.127.201.215:4353 , piece_id=PIC5UU7O7ZRIUOOFWDJRPFKKP6Y2IJDVCG66VNQUB4HCARNEHSEA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783002893 (255h22m24.214083014s) [noise=true , address=79.127.219.51:4206 , piece_id=5E7AKMTWKSWMZP65KCS53UOZIMRY2QRNDW744LZDNNM6T46LOOVQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783215379 (255h22m24.21429551s) [noise=true , address=77.90.31.10:4547 , piece_id=LT62A6FAFE22V6J6L33DHGP4KO2TGOQIA7NNBNP54WGFD62KLMSQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783324508 (255h22m24.214404639s) [noise=true , address=45.91.116.7:4039 , piece_id=KXNPL2ITUQRMPOA6V2W5TVFKBBDDJMRG7TL3I6GFMWQJH4D3E57A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783554638 (255h22m24.214634769s) [noise=true , address=45.91.116.10:4109 , piece_id=5HXRNCDWGKACJPA7SFH5SMUHBQWZAJKGZNYWGJDLJ3MLPXDP22TQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783618100 (255h22m24.214698231s) [noise=true , address=77.90.31.16:4765 , piece_id=ZCO5VOGKUCX2YJK2W4XHD7HMXQMYXTYAMLHM66XZVHUEBRLPOG2Q, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783866475 (255h22m24.214946607s) [noise=true , address=104.36.82.23:4461 , piece_id=XR7GLWCM46VORSP3BYATYPPX7R7MUVFMWTSRHE35YRGC3IT5HFJA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783888438 (255h22m24.214968569s) [noise=true , address=104.36.82.44:4880 , piece_id=24XTB67GOOJFCT5UIZ4PJNAVBFODJIQZC3FHHDMCOJBG3CU6AAJA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784197359 (255h22m24.21527749s) [noise=true , address=77.90.31.12:4615 , piece_id=CLN3DSBAI5DIVAORK3IG73U6B3KL2AXO6ZU4QUU3S7PC5ZIT7PRA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784371602 (255h22m24.215451723s) [noise=true , address=79.127.219.38:4022 , piece_id=4DZTAXSPCXPQHM3EVH36A2FF6FOR5YM2P5QWYIDX77CYTMA3IY3A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784439893 (255h22m24.215520024s) [noise=true , address=77.90.31.21:4890 , piece_id=LY4VJTYJTJDYNEYPGW7DFUCUFARIBRAC64MLUQ4LDDQOR3557W6A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784690292 (255h22m24.215770413s) [noise=true , address=104.36.82.60:4348 , piece_id=FRYVR52VEFADAUPR3W4I6JLX5RKWHICLVMBYK6Z6LPNSU2V44JLQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784698156 (255h22m24.215778288s) [noise=true , address=77.90.31.15:4705 , piece_id=L3OWGKEMR4KMLT4QYXJXH3FZ2R5YVUFMAPZR4VZRCE3LRFGKYJTA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784933207 (255h22m24.216013328s) [noise=true , address=45.91.116.12:4259 , piece_id=UDQ7OUULHDQJXUMYRO5E3G7R6JMQK3DKP7454GR2NIB7XMBER3AA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784941673 (255h22m24.216021804s) [noise=true , address=77.90.31.17:4773 , piece_id=HSCFO6ZH5DG6KGG5LVDRT2F3H6MZBGM3EQXGJYL2DAILLSE74BSA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.785191310 (255h22m24.216271441s) [noise=true , address=104.36.82.23:4457 , piece_id=LGTWIQRASQ6DELFXQIPX3ZBWNKFUNZXPGFXPTQFUPWL55C6QO7OA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.785438974 (255h22m24.216519105s) [noise=true , address=66.23.193.175:4559 , piece_id=3JALCKC2Y7PIU3SZLDNAZQA6PHZUE4M4FG7P7O2FVTWN2WSOD5QA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:30.987247668 (255h22m25.418327799s) [upload=265569]: Next returned nil segment
Aug 19 08:48:30.987263478 (255h22m25.418343609s) [upload=265569]: Waiting for error group managing segments...
Aug 19 08:48:31.274737547 (255h22m25.705817678s) [noise=true , address=66.23.193.175:4559 , piece_id=3JALCKC2Y7PIU3SZLDNAZQA6PHZUE4M4FG7P7O2FVTWN2WSOD5QA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.645368700 (255h22m26.076448831s) [noise=true , address=79.127.219.51:4206 , piece_id=5E7AKMTWKSWMZP65KCS53UOZIMRY2QRNDW744LZDNNM6T46LOOVQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.675304860 (255h22m26.106384991s) [noise=true , address=45.91.116.12:4259 , piece_id=UDQ7OUULHDQJXUMYRO5E3G7R6JMQK3DKP7454GR2NIB7XMBER3AA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.702646396 (255h22m26.133726567s) [noise=true , address=79.127.219.38:4022 , piece_id=4DZTAXSPCXPQHM3EVH36A2FF6FOR5YM2P5QWYIDX77CYTMA3IY3A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.750009401 (255h22m26.181089532s) [noise=true , address=77.90.31.21:4890 , piece_id=LY4VJTYJTJDYNEYPGW7DFUCUFARIBRAC64MLUQ4LDDQOR3557W6A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.761841281 (255h22m26.192921412s) [noise=true , address=79.127.201.215:4353 , piece_id=PIC5UU7O7ZRIUOOFWDJRPFKKP6Y2IJDVCG66VNQUB4HCARNEHSEA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.772257822 (255h22m26.203337943s) [noise=true , address=77.90.31.17:4773 , piece_id=HSCFO6ZH5DG6KGG5LVDRT2F3H6MZBGM3EQXGJYL2DAILLSE74BSA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.779554113 (255h22m26.210634244s) [noise=true , address=77.90.31.15:4705 , piece_id=L3OWGKEMR4KMLT4QYXJXH3FZ2R5YVUFMAPZR4VZRCE3LRFGKYJTA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.781666905 (255h22m26.212747036s) [noise=true , address=104.36.82.44:4880 , piece_id=24XTB67GOOJFCT5UIZ4PJNAVBFODJIQZC3FHHDMCOJBG3CU6AAJA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.836555049 (255h22m26.267635181s) [noise=true , address=104.36.82.40:4971 , piece_id=CAL4HNJ5D3LD5NUPDFPQQ773BSCOXMN6STRWOSXTQQT33GMBRT5A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.836983669 (255h22m26.2680638s) [noise=true , address=104.36.82.60:4348 , piece_id=FRYVR52VEFADAUPR3W4I6JLX5RKWHICLVMBYK6Z6LPNSU2V44JLQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.865918594 (255h22m26.296998725s) [noise=true , address=77.90.31.16:4765 , piece_id=ZCO5VOGKUCX2YJK2W4XHD7HMXQMYXTYAMLHM66XZVHUEBRLPOG2Q, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.875581784 (255h22m26.306661915s) [noise=true , address=45.91.116.7:4039 , piece_id=KXNPL2ITUQRMPOA6V2W5TVFKBBDDJMRG7TL3I6GFMWQJH4D3E57A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.907809920 (255h22m26.338890051s) [noise=true , address=104.36.82.23:4457 , piece_id=LGTWIQRASQ6DELFXQIPX3ZBWNKFUNZXPGFXPTQFUPWL55C6QO7OA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.907836671 (255h22m26.338916802s) [seg_pos={0 0}, upload=265569]: Segment reached optimal threshold of 14 pieces.
Aug 19 08:48:31.907950799 (255h22m26.33903093s) [noise=true , address=77.90.31.10:4547 , piece_id=LT62A6FAFE22V6J6L33DHGP4KO2TGOQIA7NNBNP54WGFD62KLMSQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF
Aug 19 08:48:31.908095566 (255h22m26.339175697s) [noise=true , address=104.36.82.23:4461 , piece_id=XR7GLWCM46VORSP3BYATYPPX7R7MUVFMWTSRHE35YRGC3IT5HFJA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA): protocol: expected piece hash; context canceled; EOF
Aug 19 08:48:31.908134120 (255h22m26.339214242s) [noise=true , address=77.90.31.12:4615 , piece_id=CLN3DSBAI5DIVAORK3IG73U6B3KL2AXO6ZU4QUU3S7PC5ZIT7PRA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xaory9AHtW4ra15wmL2CagPKKJU2u9keFo1ntBMy8AzjpkmwR): protocol: expected piece hash; context canceled; EOF
Aug 19 08:48:31.908186751 (255h22m26.339266882s) [noise=true , address=45.91.116.10:4109 , piece_id=5HXRNCDWGKACJPA7SFH5SMUHBQWZAJKGZNYWGJDLJ3MLPXDP22TQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KxvKeR7QALkoH9b9ttiTwTunhNiW2ez95rsZ1xe2vmPG8BXCa): protocol: write tcp 188.166.225.170:54138->45.91.116.10:4109: use of closed network connection; write tcp 188.166.225.170:54138->45.91.116.10:4109: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54138->45.91.116.10:4109: use of closed network connection
Aug 19 08:48:31.908206508 (255h22m26.339286629s) [seg_pos={0 0}, upload=265569]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 08:48:31.908262075 (255h22m26.339342196s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 08:48:31.908269039 (255h22m26.33934917s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 08:48:32.188909672 (255h22m26.619989803s) [upload=265569]: Done uploading segments...
Aug 19 08:48:32.188931514 (255h22m26.620011645s) [upload=265569]: Upload finished. err: <nil>
Duration: 5.668053614s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.........X...X.............X.........X............X......X..] duration:
5.893320716s
FAIL (2025-08-19 08:50:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 19 08:48:29.339556343 (255h22m23.770636474s) [upload=265569]: Starting upload
Aug 19 08:48:29.339611238 (255h22m23.770691369s) [upload=265569]: Done starting upload
Aug 19 08:48:29.339683346 (255h22m23.770763467s) [upload=265569]: Uploading segments...
Aug 19 08:48:29.339796262 (255h22m23.770876393s) [upload=265569]: Got next segment. Inline: false
Aug 19 08:48:29.339833354 (255h22m23.770913485s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 08:48:29.339837462 (255h22m23.770917593s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 08:48:29.782557410 (255h22m24.213637541s) [seg_pos={0 0}, upload=265569]: Begin upload segment...
Aug 19 08:48:29.782604140 (255h22m24.213684261s) [seg_pos={0 0}, upload=265569]: Done begin upload segment.
Aug 19 08:48:29.782625000 (255h22m24.213705131s) [noise=true , address=104.36.82.40:4971 , piece_id=CAL4HNJ5D3LD5NUPDFPQQ773BSCOXMN6STRWOSXTQQT33GMBRT5A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.782696957 (255h22m24.213777088s) [noise=true , address=79.127.201.215:4353 , piece_id=PIC5UU7O7ZRIUOOFWDJRPFKKP6Y2IJDVCG66VNQUB4HCARNEHSEA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783002893 (255h22m24.214083014s) [noise=true , address=79.127.219.51:4206 , piece_id=5E7AKMTWKSWMZP65KCS53UOZIMRY2QRNDW744LZDNNM6T46LOOVQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783215379 (255h22m24.21429551s) [noise=true , address=77.90.31.10:4547 , piece_id=LT62A6FAFE22V6J6L33DHGP4KO2TGOQIA7NNBNP54WGFD62KLMSQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783324508 (255h22m24.214404639s) [noise=true , address=45.91.116.7:4039 , piece_id=KXNPL2ITUQRMPOA6V2W5TVFKBBDDJMRG7TL3I6GFMWQJH4D3E57A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783554638 (255h22m24.214634769s) [noise=true , address=45.91.116.10:4109 , piece_id=5HXRNCDWGKACJPA7SFH5SMUHBQWZAJKGZNYWGJDLJ3MLPXDP22TQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783618100 (255h22m24.214698231s) [noise=true , address=77.90.31.16:4765 , piece_id=ZCO5VOGKUCX2YJK2W4XHD7HMXQMYXTYAMLHM66XZVHUEBRLPOG2Q, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783866475 (255h22m24.214946607s) [noise=true , address=104.36.82.23:4461 , piece_id=XR7GLWCM46VORSP3BYATYPPX7R7MUVFMWTSRHE35YRGC3IT5HFJA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783888438 (255h22m24.214968569s) [noise=true , address=104.36.82.44:4880 , piece_id=24XTB67GOOJFCT5UIZ4PJNAVBFODJIQZC3FHHDMCOJBG3CU6AAJA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784197359 (255h22m24.21527749s) [noise=true , address=77.90.31.12:4615 , piece_id=CLN3DSBAI5DIVAORK3IG73U6B3KL2AXO6ZU4QUU3S7PC5ZIT7PRA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784371602 (255h22m24.215451723s) [noise=true , address=79.127.219.38:4022 , piece_id=4DZTAXSPCXPQHM3EVH36A2FF6FOR5YM2P5QWYIDX77CYTMA3IY3A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784439893 (255h22m24.215520024s) [noise=true , address=77.90.31.21:4890 , piece_id=LY4VJTYJTJDYNEYPGW7DFUCUFARIBRAC64MLUQ4LDDQOR3557W6A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784690292 (255h22m24.215770413s) [noise=true , address=104.36.82.60:4348 , piece_id=FRYVR52VEFADAUPR3W4I6JLX5RKWHICLVMBYK6Z6LPNSU2V44JLQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784698156 (255h22m24.215778288s) [noise=true , address=77.90.31.15:4705 , piece_id=L3OWGKEMR4KMLT4QYXJXH3FZ2R5YVUFMAPZR4VZRCE3LRFGKYJTA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784933207 (255h22m24.216013328s) [noise=true , address=45.91.116.12:4259 , piece_id=UDQ7OUULHDQJXUMYRO5E3G7R6JMQK3DKP7454GR2NIB7XMBER3AA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784941673 (255h22m24.216021804s) [noise=true , address=77.90.31.17:4773 , piece_id=HSCFO6ZH5DG6KGG5LVDRT2F3H6MZBGM3EQXGJYL2DAILLSE74BSA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.785191310 (255h22m24.216271441s) [noise=true , address=104.36.82.23:4457 , piece_id=LGTWIQRASQ6DELFXQIPX3ZBWNKFUNZXPGFXPTQFUPWL55C6QO7OA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.785438974 (255h22m24.216519105s) [noise=true , address=66.23.193.175:4559 , piece_id=3JALCKC2Y7PIU3SZLDNAZQA6PHZUE4M4FG7P7O2FVTWN2WSOD5QA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:30.987247668 (255h22m25.418327799s) [upload=265569]: Next returned nil segment
Aug 19 08:48:30.987263478 (255h22m25.418343609s) [upload=265569]: Waiting for error group managing segments...
Aug 19 08:48:31.274737547 (255h22m25.705817678s) [noise=true , address=66.23.193.175:4559 , piece_id=3JALCKC2Y7PIU3SZLDNAZQA6PHZUE4M4FG7P7O2FVTWN2WSOD5QA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.645368700 (255h22m26.076448831s) [noise=true , address=79.127.219.51:4206 , piece_id=5E7AKMTWKSWMZP65KCS53UOZIMRY2QRNDW744LZDNNM6T46LOOVQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.675304860 (255h22m26.106384991s) [noise=true , address=45.91.116.12:4259 , piece_id=UDQ7OUULHDQJXUMYRO5E3G7R6JMQK3DKP7454GR2NIB7XMBER3AA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.702646396 (255h22m26.133726567s) [noise=true , address=79.127.219.38:4022 , piece_id=4DZTAXSPCXPQHM3EVH36A2FF6FOR5YM2P5QWYIDX77CYTMA3IY3A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.750009401 (255h22m26.181089532s) [noise=true , address=77.90.31.21:4890 , piece_id=LY4VJTYJTJDYNEYPGW7DFUCUFARIBRAC64MLUQ4LDDQOR3557W6A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.761841281 (255h22m26.192921412s) [noise=true , address=79.127.201.215:4353 , piece_id=PIC5UU7O7ZRIUOOFWDJRPFKKP6Y2IJDVCG66VNQUB4HCARNEHSEA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.772257822 (255h22m26.203337943s) [noise=true , address=77.90.31.17:4773 , piece_id=HSCFO6ZH5DG6KGG5LVDRT2F3H6MZBGM3EQXGJYL2DAILLSE74BSA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.779554113 (255h22m26.210634244s) [noise=true , address=77.90.31.15:4705 , piece_id=L3OWGKEMR4KMLT4QYXJXH3FZ2R5YVUFMAPZR4VZRCE3LRFGKYJTA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.781666905 (255h22m26.212747036s) [noise=true , address=104.36.82.44:4880 , piece_id=24XTB67GOOJFCT5UIZ4PJNAVBFODJIQZC3FHHDMCOJBG3CU6AAJA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.836555049 (255h22m26.267635181s) [noise=true , address=104.36.82.40:4971 , piece_id=CAL4HNJ5D3LD5NUPDFPQQ773BSCOXMN6STRWOSXTQQT33GMBRT5A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.836983669 (255h22m26.2680638s) [noise=true , address=104.36.82.60:4348 , piece_id=FRYVR52VEFADAUPR3W4I6JLX5RKWHICLVMBYK6Z6LPNSU2V44JLQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.865918594 (255h22m26.296998725s) [noise=true , address=77.90.31.16:4765 , piece_id=ZCO5VOGKUCX2YJK2W4XHD7HMXQMYXTYAMLHM66XZVHUEBRLPOG2Q, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.875581784 (255h22m26.306661915s) [noise=true , address=45.91.116.7:4039 , piece_id=KXNPL2ITUQRMPOA6V2W5TVFKBBDDJMRG7TL3I6GFMWQJH4D3E57A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.907809920 (255h22m26.338890051s) [noise=true , address=104.36.82.23:4457 , piece_id=LGTWIQRASQ6DELFXQIPX3ZBWNKFUNZXPGFXPTQFUPWL55C6QO7OA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.907836671 (255h22m26.338916802s) [seg_pos={0 0}, upload=265569]: Segment reached optimal threshold of 14 pieces.
Aug 19 08:48:31.907950799 (255h22m26.33903093s) [noise=true , address=77.90.31.10:4547 , piece_id=LT62A6FAFE22V6J6L33DHGP4KO2TGOQIA7NNBNP54WGFD62KLMSQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF
Aug 19 08:48:31.908095566 (255h22m26.339175697s) [noise=true , address=104.36.82.23:4461 , piece_id=XR7GLWCM46VORSP3BYATYPPX7R7MUVFMWTSRHE35YRGC3IT5HFJA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA): protocol: expected piece hash; context canceled; EOF
Aug 19 08:48:31.908134120 (255h22m26.339214242s) [noise=true , address=77.90.31.12:4615 , piece_id=CLN3DSBAI5DIVAORK3IG73U6B3KL2AXO6ZU4QUU3S7PC5ZIT7PRA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xaory9AHtW4ra15wmL2CagPKKJU2u9keFo1ntBMy8AzjpkmwR): protocol: expected piece hash; context canceled; EOF
Aug 19 08:48:31.908186751 (255h22m26.339266882s) [noise=true , address=45.91.116.10:4109 , piece_id=5HXRNCDWGKACJPA7SFH5SMUHBQWZAJKGZNYWGJDLJ3MLPXDP22TQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KxvKeR7QALkoH9b9ttiTwTunhNiW2ez95rsZ1xe2vmPG8BXCa): protocol: write tcp 188.166.225.170:54138->45.91.116.10:4109: use of closed network connection; write tcp 188.166.225.170:54138->45.91.116.10:4109: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54138->45.91.116.10:4109: use of closed network connection
Aug 19 08:48:31.908206508 (255h22m26.339286629s) [seg_pos={0 0}, upload=265569]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 08:48:31.908262075 (255h22m26.339342196s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 08:48:31.908269039 (255h22m26.33934917s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 08:48:32.188909672 (255h22m26.619989803s) [upload=265569]: Done uploading segments...
Aug 19 08:48:32.188931514 (255h22m26.620011645s) [upload=265569]: Upload finished. err: <nil>
Duration: 5.89334913s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X.X................................................] duration:
2.084063547s
FAIL (2025-08-19 08:50:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:12:21.770696128 (254h46m16.201776259s) [upload=264940]: Starting upload Aug 19 08:12:21.770757987 (254h46m16.201838108s) [upload=264940]: Done starting upload Aug 19 08:12:21.770820176 (254h46m16.201900307s) [upload=264940]: Uploading segments... Aug 19 08:12:21.770863408 (254h46m16.201943539s) [upload=264940]: Got next segment. Inline: true Aug 19 08:12:21.770866965 (254h46m16.201947086s) [upload=264940]: Waiting for error group managing segments... Aug 19 08:12:21.770897073 (254h46m16.201977194s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:12:21.770900720 (254h46m16.201980851s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 08:12:21.770903125 (254h46m16.201983246s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 08:12:21.983071451 (254h46m16.414151582s) [upload=264940]: Done uploading segments... Aug 19 08:12:21.983087682 (254h46m16.414167814s) [upload=264940]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.08409052s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
5.874429578s
FAIL (2025-08-19 08:50:29 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.874452733s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
6.391072104s
FAIL (2025-08-19 08:50:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.391094829s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..........X...X.............X.........X............X......X.] duration:
5.626345433s
FAIL (2025-08-19 08:49:44 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 19 08:48:29.339556343 (255h22m23.770636474s) [upload=265569]: Starting upload
Aug 19 08:48:29.339611238 (255h22m23.770691369s) [upload=265569]: Done starting upload
Aug 19 08:48:29.339683346 (255h22m23.770763467s) [upload=265569]: Uploading segments...
Aug 19 08:48:29.339796262 (255h22m23.770876393s) [upload=265569]: Got next segment. Inline: false
Aug 19 08:48:29.339833354 (255h22m23.770913485s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 08:48:29.339837462 (255h22m23.770917593s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 08:48:29.782557410 (255h22m24.213637541s) [seg_pos={0 0}, upload=265569]: Begin upload segment...
Aug 19 08:48:29.782604140 (255h22m24.213684261s) [seg_pos={0 0}, upload=265569]: Done begin upload segment.
Aug 19 08:48:29.782625000 (255h22m24.213705131s) [noise=true , address=104.36.82.40:4971 , piece_id=CAL4HNJ5D3LD5NUPDFPQQ773BSCOXMN6STRWOSXTQQT33GMBRT5A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.782696957 (255h22m24.213777088s) [noise=true , address=79.127.201.215:4353 , piece_id=PIC5UU7O7ZRIUOOFWDJRPFKKP6Y2IJDVCG66VNQUB4HCARNEHSEA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783002893 (255h22m24.214083014s) [noise=true , address=79.127.219.51:4206 , piece_id=5E7AKMTWKSWMZP65KCS53UOZIMRY2QRNDW744LZDNNM6T46LOOVQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783215379 (255h22m24.21429551s) [noise=true , address=77.90.31.10:4547 , piece_id=LT62A6FAFE22V6J6L33DHGP4KO2TGOQIA7NNBNP54WGFD62KLMSQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783324508 (255h22m24.214404639s) [noise=true , address=45.91.116.7:4039 , piece_id=KXNPL2ITUQRMPOA6V2W5TVFKBBDDJMRG7TL3I6GFMWQJH4D3E57A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783554638 (255h22m24.214634769s) [noise=true , address=45.91.116.10:4109 , piece_id=5HXRNCDWGKACJPA7SFH5SMUHBQWZAJKGZNYWGJDLJ3MLPXDP22TQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783618100 (255h22m24.214698231s) [noise=true , address=77.90.31.16:4765 , piece_id=ZCO5VOGKUCX2YJK2W4XHD7HMXQMYXTYAMLHM66XZVHUEBRLPOG2Q, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783866475 (255h22m24.214946607s) [noise=true , address=104.36.82.23:4461 , piece_id=XR7GLWCM46VORSP3BYATYPPX7R7MUVFMWTSRHE35YRGC3IT5HFJA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783888438 (255h22m24.214968569s) [noise=true , address=104.36.82.44:4880 , piece_id=24XTB67GOOJFCT5UIZ4PJNAVBFODJIQZC3FHHDMCOJBG3CU6AAJA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784197359 (255h22m24.21527749s) [noise=true , address=77.90.31.12:4615 , piece_id=CLN3DSBAI5DIVAORK3IG73U6B3KL2AXO6ZU4QUU3S7PC5ZIT7PRA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784371602 (255h22m24.215451723s) [noise=true , address=79.127.219.38:4022 , piece_id=4DZTAXSPCXPQHM3EVH36A2FF6FOR5YM2P5QWYIDX77CYTMA3IY3A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784439893 (255h22m24.215520024s) [noise=true , address=77.90.31.21:4890 , piece_id=LY4VJTYJTJDYNEYPGW7DFUCUFARIBRAC64MLUQ4LDDQOR3557W6A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784690292 (255h22m24.215770413s) [noise=true , address=104.36.82.60:4348 , piece_id=FRYVR52VEFADAUPR3W4I6JLX5RKWHICLVMBYK6Z6LPNSU2V44JLQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784698156 (255h22m24.215778288s) [noise=true , address=77.90.31.15:4705 , piece_id=L3OWGKEMR4KMLT4QYXJXH3FZ2R5YVUFMAPZR4VZRCE3LRFGKYJTA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784933207 (255h22m24.216013328s) [noise=true , address=45.91.116.12:4259 , piece_id=UDQ7OUULHDQJXUMYRO5E3G7R6JMQK3DKP7454GR2NIB7XMBER3AA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784941673 (255h22m24.216021804s) [noise=true , address=77.90.31.17:4773 , piece_id=HSCFO6ZH5DG6KGG5LVDRT2F3H6MZBGM3EQXGJYL2DAILLSE74BSA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.785191310 (255h22m24.216271441s) [noise=true , address=104.36.82.23:4457 , piece_id=LGTWIQRASQ6DELFXQIPX3ZBWNKFUNZXPGFXPTQFUPWL55C6QO7OA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.785438974 (255h22m24.216519105s) [noise=true , address=66.23.193.175:4559 , piece_id=3JALCKC2Y7PIU3SZLDNAZQA6PHZUE4M4FG7P7O2FVTWN2WSOD5QA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:30.987247668 (255h22m25.418327799s) [upload=265569]: Next returned nil segment
Aug 19 08:48:30.987263478 (255h22m25.418343609s) [upload=265569]: Waiting for error group managing segments...
Aug 19 08:48:31.274737547 (255h22m25.705817678s) [noise=true , address=66.23.193.175:4559 , piece_id=3JALCKC2Y7PIU3SZLDNAZQA6PHZUE4M4FG7P7O2FVTWN2WSOD5QA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.645368700 (255h22m26.076448831s) [noise=true , address=79.127.219.51:4206 , piece_id=5E7AKMTWKSWMZP65KCS53UOZIMRY2QRNDW744LZDNNM6T46LOOVQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.675304860 (255h22m26.106384991s) [noise=true , address=45.91.116.12:4259 , piece_id=UDQ7OUULHDQJXUMYRO5E3G7R6JMQK3DKP7454GR2NIB7XMBER3AA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.702646396 (255h22m26.133726567s) [noise=true , address=79.127.219.38:4022 , piece_id=4DZTAXSPCXPQHM3EVH36A2FF6FOR5YM2P5QWYIDX77CYTMA3IY3A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.750009401 (255h22m26.181089532s) [noise=true , address=77.90.31.21:4890 , piece_id=LY4VJTYJTJDYNEYPGW7DFUCUFARIBRAC64MLUQ4LDDQOR3557W6A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.761841281 (255h22m26.192921412s) [noise=true , address=79.127.201.215:4353 , piece_id=PIC5UU7O7ZRIUOOFWDJRPFKKP6Y2IJDVCG66VNQUB4HCARNEHSEA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.772257822 (255h22m26.203337943s) [noise=true , address=77.90.31.17:4773 , piece_id=HSCFO6ZH5DG6KGG5LVDRT2F3H6MZBGM3EQXGJYL2DAILLSE74BSA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.779554113 (255h22m26.210634244s) [noise=true , address=77.90.31.15:4705 , piece_id=L3OWGKEMR4KMLT4QYXJXH3FZ2R5YVUFMAPZR4VZRCE3LRFGKYJTA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.781666905 (255h22m26.212747036s) [noise=true , address=104.36.82.44:4880 , piece_id=24XTB67GOOJFCT5UIZ4PJNAVBFODJIQZC3FHHDMCOJBG3CU6AAJA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.836555049 (255h22m26.267635181s) [noise=true , address=104.36.82.40:4971 , piece_id=CAL4HNJ5D3LD5NUPDFPQQ773BSCOXMN6STRWOSXTQQT33GMBRT5A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.836983669 (255h22m26.2680638s) [noise=true , address=104.36.82.60:4348 , piece_id=FRYVR52VEFADAUPR3W4I6JLX5RKWHICLVMBYK6Z6LPNSU2V44JLQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.865918594 (255h22m26.296998725s) [noise=true , address=77.90.31.16:4765 , piece_id=ZCO5VOGKUCX2YJK2W4XHD7HMXQMYXTYAMLHM66XZVHUEBRLPOG2Q, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.875581784 (255h22m26.306661915s) [noise=true , address=45.91.116.7:4039 , piece_id=KXNPL2ITUQRMPOA6V2W5TVFKBBDDJMRG7TL3I6GFMWQJH4D3E57A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.907809920 (255h22m26.338890051s) [noise=true , address=104.36.82.23:4457 , piece_id=LGTWIQRASQ6DELFXQIPX3ZBWNKFUNZXPGFXPTQFUPWL55C6QO7OA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.907836671 (255h22m26.338916802s) [seg_pos={0 0}, upload=265569]: Segment reached optimal threshold of 14 pieces.
Aug 19 08:48:31.907950799 (255h22m26.33903093s) [noise=true , address=77.90.31.10:4547 , piece_id=LT62A6FAFE22V6J6L33DHGP4KO2TGOQIA7NNBNP54WGFD62KLMSQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF
Aug 19 08:48:31.908095566 (255h22m26.339175697s) [noise=true , address=104.36.82.23:4461 , piece_id=XR7GLWCM46VORSP3BYATYPPX7R7MUVFMWTSRHE35YRGC3IT5HFJA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA): protocol: expected piece hash; context canceled; EOF
Aug 19 08:48:31.908134120 (255h22m26.339214242s) [noise=true , address=77.90.31.12:4615 , piece_id=CLN3DSBAI5DIVAORK3IG73U6B3KL2AXO6ZU4QUU3S7PC5ZIT7PRA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xaory9AHtW4ra15wmL2CagPKKJU2u9keFo1ntBMy8AzjpkmwR): protocol: expected piece hash; context canceled; EOF
Aug 19 08:48:31.908186751 (255h22m26.339266882s) [noise=true , address=45.91.116.10:4109 , piece_id=5HXRNCDWGKACJPA7SFH5SMUHBQWZAJKGZNYWGJDLJ3MLPXDP22TQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KxvKeR7QALkoH9b9ttiTwTunhNiW2ez95rsZ1xe2vmPG8BXCa): protocol: write tcp 188.166.225.170:54138->45.91.116.10:4109: use of closed network connection; write tcp 188.166.225.170:54138->45.91.116.10:4109: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54138->45.91.116.10:4109: use of closed network connection
Aug 19 08:48:31.908206508 (255h22m26.339286629s) [seg_pos={0 0}, upload=265569]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 08:48:31.908262075 (255h22m26.339342196s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 08:48:31.908269039 (255h22m26.33934917s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 08:48:32.188909672 (255h22m26.619989803s) [upload=265569]: Done uploading segments...
Aug 19 08:48:32.188931514 (255h22m26.620011645s) [upload=265569]: Upload finished. err: <nil>
Duration: 5.626367806s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X.X...............................................] duration:
1.84478518s
FAIL (2025-08-19 08:49:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:12:21.770696128 (254h46m16.201776259s) [upload=264940]: Starting upload Aug 19 08:12:21.770757987 (254h46m16.201838108s) [upload=264940]: Done starting upload Aug 19 08:12:21.770820176 (254h46m16.201900307s) [upload=264940]: Uploading segments... Aug 19 08:12:21.770863408 (254h46m16.201943539s) [upload=264940]: Got next segment. Inline: true Aug 19 08:12:21.770866965 (254h46m16.201947086s) [upload=264940]: Waiting for error group managing segments... Aug 19 08:12:21.770897073 (254h46m16.201977194s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:12:21.770900720 (254h46m16.201980851s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 08:12:21.770903125 (254h46m16.201983246s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 08:12:21.983071451 (254h46m16.414151582s) [upload=264940]: Done uploading segments... Aug 19 08:12:21.983087682 (254h46m16.414167814s) [upload=264940]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.844803875s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
6.347441273s
FAIL (2025-08-19 08:49:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.347465069s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
5.663739402s
FAIL (2025-08-19 08:49:28 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.663783887s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.871478982s
FAIL (2025-08-19 08:49:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.871519239s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X.X..............................................] duration:
1.824300593s
FAIL (2025-08-19 08:48:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:12:21.770696128 (254h46m16.201776259s) [upload=264940]: Starting upload Aug 19 08:12:21.770757987 (254h46m16.201838108s) [upload=264940]: Done starting upload Aug 19 08:12:21.770820176 (254h46m16.201900307s) [upload=264940]: Uploading segments... Aug 19 08:12:21.770863408 (254h46m16.201943539s) [upload=264940]: Got next segment. Inline: true Aug 19 08:12:21.770866965 (254h46m16.201947086s) [upload=264940]: Waiting for error group managing segments... Aug 19 08:12:21.770897073 (254h46m16.201977194s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:12:21.770900720 (254h46m16.201980851s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 08:12:21.770903125 (254h46m16.201983246s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 08:12:21.983071451 (254h46m16.414151582s) [upload=264940]: Done uploading segments... Aug 19 08:12:21.983087682 (254h46m16.414167814s) [upload=264940]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.824328696s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
6.163297895s
FAIL (2025-08-19 08:48:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.163321599s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...........X...X.............X.........X............X......X] duration:
4.160206341s
FAIL (2025-08-19 08:48:32 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 19 08:48:29.339556343 (255h22m23.770636474s) [upload=265569]: Starting upload
Aug 19 08:48:29.339611238 (255h22m23.770691369s) [upload=265569]: Done starting upload
Aug 19 08:48:29.339683346 (255h22m23.770763467s) [upload=265569]: Uploading segments...
Aug 19 08:48:29.339796262 (255h22m23.770876393s) [upload=265569]: Got next segment. Inline: false
Aug 19 08:48:29.339833354 (255h22m23.770913485s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 08:48:29.339837462 (255h22m23.770917593s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 08:48:29.782557410 (255h22m24.213637541s) [seg_pos={0 0}, upload=265569]: Begin upload segment...
Aug 19 08:48:29.782604140 (255h22m24.213684261s) [seg_pos={0 0}, upload=265569]: Done begin upload segment.
Aug 19 08:48:29.782625000 (255h22m24.213705131s) [noise=true , address=104.36.82.40:4971 , piece_id=CAL4HNJ5D3LD5NUPDFPQQ773BSCOXMN6STRWOSXTQQT33GMBRT5A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.782696957 (255h22m24.213777088s) [noise=true , address=79.127.201.215:4353 , piece_id=PIC5UU7O7ZRIUOOFWDJRPFKKP6Y2IJDVCG66VNQUB4HCARNEHSEA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783002893 (255h22m24.214083014s) [noise=true , address=79.127.219.51:4206 , piece_id=5E7AKMTWKSWMZP65KCS53UOZIMRY2QRNDW744LZDNNM6T46LOOVQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783215379 (255h22m24.21429551s) [noise=true , address=77.90.31.10:4547 , piece_id=LT62A6FAFE22V6J6L33DHGP4KO2TGOQIA7NNBNP54WGFD62KLMSQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783324508 (255h22m24.214404639s) [noise=true , address=45.91.116.7:4039 , piece_id=KXNPL2ITUQRMPOA6V2W5TVFKBBDDJMRG7TL3I6GFMWQJH4D3E57A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783554638 (255h22m24.214634769s) [noise=true , address=45.91.116.10:4109 , piece_id=5HXRNCDWGKACJPA7SFH5SMUHBQWZAJKGZNYWGJDLJ3MLPXDP22TQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783618100 (255h22m24.214698231s) [noise=true , address=77.90.31.16:4765 , piece_id=ZCO5VOGKUCX2YJK2W4XHD7HMXQMYXTYAMLHM66XZVHUEBRLPOG2Q, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783866475 (255h22m24.214946607s) [noise=true , address=104.36.82.23:4461 , piece_id=XR7GLWCM46VORSP3BYATYPPX7R7MUVFMWTSRHE35YRGC3IT5HFJA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.783888438 (255h22m24.214968569s) [noise=true , address=104.36.82.44:4880 , piece_id=24XTB67GOOJFCT5UIZ4PJNAVBFODJIQZC3FHHDMCOJBG3CU6AAJA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784197359 (255h22m24.21527749s) [noise=true , address=77.90.31.12:4615 , piece_id=CLN3DSBAI5DIVAORK3IG73U6B3KL2AXO6ZU4QUU3S7PC5ZIT7PRA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784371602 (255h22m24.215451723s) [noise=true , address=79.127.219.38:4022 , piece_id=4DZTAXSPCXPQHM3EVH36A2FF6FOR5YM2P5QWYIDX77CYTMA3IY3A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784439893 (255h22m24.215520024s) [noise=true , address=77.90.31.21:4890 , piece_id=LY4VJTYJTJDYNEYPGW7DFUCUFARIBRAC64MLUQ4LDDQOR3557W6A, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784690292 (255h22m24.215770413s) [noise=true , address=104.36.82.60:4348 , piece_id=FRYVR52VEFADAUPR3W4I6JLX5RKWHICLVMBYK6Z6LPNSU2V44JLQ, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784698156 (255h22m24.215778288s) [noise=true , address=77.90.31.15:4705 , piece_id=L3OWGKEMR4KMLT4QYXJXH3FZ2R5YVUFMAPZR4VZRCE3LRFGKYJTA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784933207 (255h22m24.216013328s) [noise=true , address=45.91.116.12:4259 , piece_id=UDQ7OUULHDQJXUMYRO5E3G7R6JMQK3DKP7454GR2NIB7XMBER3AA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.784941673 (255h22m24.216021804s) [noise=true , address=77.90.31.17:4773 , piece_id=HSCFO6ZH5DG6KGG5LVDRT2F3H6MZBGM3EQXGJYL2DAILLSE74BSA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.785191310 (255h22m24.216271441s) [noise=true , address=104.36.82.23:4457 , piece_id=LGTWIQRASQ6DELFXQIPX3ZBWNKFUNZXPGFXPTQFUPWL55C6QO7OA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:29.785438974 (255h22m24.216519105s) [noise=true , address=66.23.193.175:4559 , piece_id=3JALCKC2Y7PIU3SZLDNAZQA6PHZUE4M4FG7P7O2FVTWN2WSOD5QA, seg_pos={0 0}, upload=265569]: Uploading piece...
Aug 19 08:48:30.987247668 (255h22m25.418327799s) [upload=265569]: Next returned nil segment
Aug 19 08:48:30.987263478 (255h22m25.418343609s) [upload=265569]: Waiting for error group managing segments...
Aug 19 08:48:31.274737547 (255h22m25.705817678s) [noise=true , address=66.23.193.175:4559 , piece_id=3JALCKC2Y7PIU3SZLDNAZQA6PHZUE4M4FG7P7O2FVTWN2WSOD5QA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.645368700 (255h22m26.076448831s) [noise=true , address=79.127.219.51:4206 , piece_id=5E7AKMTWKSWMZP65KCS53UOZIMRY2QRNDW744LZDNNM6T46LOOVQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.675304860 (255h22m26.106384991s) [noise=true , address=45.91.116.12:4259 , piece_id=UDQ7OUULHDQJXUMYRO5E3G7R6JMQK3DKP7454GR2NIB7XMBER3AA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.702646396 (255h22m26.133726567s) [noise=true , address=79.127.219.38:4022 , piece_id=4DZTAXSPCXPQHM3EVH36A2FF6FOR5YM2P5QWYIDX77CYTMA3IY3A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.750009401 (255h22m26.181089532s) [noise=true , address=77.90.31.21:4890 , piece_id=LY4VJTYJTJDYNEYPGW7DFUCUFARIBRAC64MLUQ4LDDQOR3557W6A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.761841281 (255h22m26.192921412s) [noise=true , address=79.127.201.215:4353 , piece_id=PIC5UU7O7ZRIUOOFWDJRPFKKP6Y2IJDVCG66VNQUB4HCARNEHSEA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.772257822 (255h22m26.203337943s) [noise=true , address=77.90.31.17:4773 , piece_id=HSCFO6ZH5DG6KGG5LVDRT2F3H6MZBGM3EQXGJYL2DAILLSE74BSA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.779554113 (255h22m26.210634244s) [noise=true , address=77.90.31.15:4705 , piece_id=L3OWGKEMR4KMLT4QYXJXH3FZ2R5YVUFMAPZR4VZRCE3LRFGKYJTA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.781666905 (255h22m26.212747036s) [noise=true , address=104.36.82.44:4880 , piece_id=24XTB67GOOJFCT5UIZ4PJNAVBFODJIQZC3FHHDMCOJBG3CU6AAJA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.836555049 (255h22m26.267635181s) [noise=true , address=104.36.82.40:4971 , piece_id=CAL4HNJ5D3LD5NUPDFPQQ773BSCOXMN6STRWOSXTQQT33GMBRT5A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.836983669 (255h22m26.2680638s) [noise=true , address=104.36.82.60:4348 , piece_id=FRYVR52VEFADAUPR3W4I6JLX5RKWHICLVMBYK6Z6LPNSU2V44JLQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.865918594 (255h22m26.296998725s) [noise=true , address=77.90.31.16:4765 , piece_id=ZCO5VOGKUCX2YJK2W4XHD7HMXQMYXTYAMLHM66XZVHUEBRLPOG2Q, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.875581784 (255h22m26.306661915s) [noise=true , address=45.91.116.7:4039 , piece_id=KXNPL2ITUQRMPOA6V2W5TVFKBBDDJMRG7TL3I6GFMWQJH4D3E57A, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.907809920 (255h22m26.338890051s) [noise=true , address=104.36.82.23:4457 , piece_id=LGTWIQRASQ6DELFXQIPX3ZBWNKFUNZXPGFXPTQFUPWL55C6QO7OA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: <nil>
Aug 19 08:48:31.907836671 (255h22m26.338916802s) [seg_pos={0 0}, upload=265569]: Segment reached optimal threshold of 14 pieces.
Aug 19 08:48:31.907950799 (255h22m26.33903093s) [noise=true , address=77.90.31.10:4547 , piece_id=LT62A6FAFE22V6J6L33DHGP4KO2TGOQIA7NNBNP54WGFD62KLMSQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF
Aug 19 08:48:31.908095566 (255h22m26.339175697s) [noise=true , address=104.36.82.23:4461 , piece_id=XR7GLWCM46VORSP3BYATYPPX7R7MUVFMWTSRHE35YRGC3IT5HFJA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA): protocol: expected piece hash; context canceled; EOF
Aug 19 08:48:31.908134120 (255h22m26.339214242s) [noise=true , address=77.90.31.12:4615 , piece_id=CLN3DSBAI5DIVAORK3IG73U6B3KL2AXO6ZU4QUU3S7PC5ZIT7PRA, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xaory9AHtW4ra15wmL2CagPKKJU2u9keFo1ntBMy8AzjpkmwR): protocol: expected piece hash; context canceled; EOF
Aug 19 08:48:31.908186751 (255h22m26.339266882s) [noise=true , address=45.91.116.10:4109 , piece_id=5HXRNCDWGKACJPA7SFH5SMUHBQWZAJKGZNYWGJDLJ3MLPXDP22TQ, seg_pos={0 0}, upload=265569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KxvKeR7QALkoH9b9ttiTwTunhNiW2ez95rsZ1xe2vmPG8BXCa): protocol: write tcp 188.166.225.170:54138->45.91.116.10:4109: use of closed network connection; write tcp 188.166.225.170:54138->45.91.116.10:4109: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54138->45.91.116.10:4109: use of closed network connection
Aug 19 08:48:31.908206508 (255h22m26.339286629s) [seg_pos={0 0}, upload=265569]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 08:48:31.908262075 (255h22m26.339342196s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 08:48:31.908269039 (255h22m26.33934917s) [upload=265569]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 08:48:32.188909672 (255h22m26.619989803s) [upload=265569]: Done uploading segments...
Aug 19 08:48:32.188931514 (255h22m26.620011645s) [upload=265569]: Upload finished. err: <nil>
Duration: 4.160236087s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.640914457s
FAIL (2025-08-19 08:48:23 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.640943101s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [............X...X.............X.........X............X......] duration:
6.020826019s
FAIL (2025-08-19 08:48:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 08:42:20.500816156 (255h16m14.931896287s) [upload=265458]: Starting upload
Aug 19 08:42:20.500867244 (255h16m14.931947375s) [upload=265458]: Done starting upload
Aug 19 08:42:20.501001241 (255h16m14.932081372s) [upload=265458]: Uploading segments...
Aug 19 08:42:20.501060855 (255h16m14.932140996s) [upload=265458]: Got next segment. Inline: false
Aug 19 08:42:20.501088127 (255h16m14.932168258s) [upload=265458]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 08:42:20.501109177 (255h16m14.932189308s) [upload=265458]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 08:42:20.954652160 (255h16m15.385732291s) [seg_pos={0 0}, upload=265458]: Begin upload segment...
Aug 19 08:42:20.954700222 (255h16m15.385780353s) [seg_pos={0 0}, upload=265458]: Done begin upload segment.
Aug 19 08:42:20.954723277 (255h16m15.385803408s) [noise=true , address=66.23.193.175:4561 , piece_id=AAMFCQRFGMSYK3MRYT4IVC4KXNMDL4JXKAQBQVETLVGZ57K6E4OA, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.954789543 (255h16m15.385869684s) [noise=true , address=77.90.31.14:4685 , piece_id=PLKYYR6N7BGUHVUFAIY5TYUKNL3JUA2NJRNA2BJABEUBGQ2Q5FOQ, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.955158740 (255h16m15.386238861s) [noise=true , address=104.36.82.44:4869 , piece_id=EXPT6R466GC4XDES45SG4WXASTTX55YFQF2OCUWV5ZOYBJFTKW5Q, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.955438595 (255h16m15.386518726s) [noise=true , address=77.90.31.17:4791 , piece_id=OFY6UGGPXYL5C4GHZSVOEOBU2TMUQFBSQWLX2RDBKJSH2UKAHOVA, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.955456480 (255h16m15.386536611s) [noise=true , address=79.127.219.48:4103 , piece_id=N4QS2PMQH6IWYUUZ5QZ3FDUH6WWYROKXCKGOSKVORTPYZKPNPFBQ, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.955708041 (255h16m15.386788172s) [noise=true , address=45.91.116.6:4994 , piece_id=3DCV6TUR562S2GCWN6Y3IVTZN2FZM7CM6V26ZP4GEY5QN4YDJMYQ, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.955986774 (255h16m15.387066905s) [noise=true , address=45.91.116.12:4256 , piece_id=27YKUMX33TAUKMP533VJ7JPATXQ3FZWANCRTZBXY7GENCDUXCX5A, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.956101383 (255h16m15.387181514s) [noise=true , address=77.90.31.12:4619 , piece_id=26CDZBQ6ITQITKCSZIR3422EGVNTHN5KAQBTATM67QBHZ5YF5M3Q, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.956228116 (255h16m15.387308237s) [noise=true , address=45.91.116.11:4137 , piece_id=MUYYMG5WH5G44J35ON7WZ2GGYRCOJQTXO5JL33J7XYD7BWHPNJFA, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.956562386 (255h16m15.387642517s) [noise=true , address=77.90.31.21:4896 , piece_id=UKKWXESACHDMXOA7GDEIKG45ICKOCK27UQQPD4VL6LNI2KM757CA, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.956622110 (255h16m15.387702241s) [noise=true , address=77.90.31.15:4731 , piece_id=5FQSVLOWIPOPLWJMOB5R2J2A2NUSAQFCJOHDFLSP7PK7HB7LLFHQ, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.956815580 (255h16m15.387895711s) [noise=true , address=104.36.82.51:4079 , piece_id=FQZSETG5VBSFZB56DIH6VTJOYFY5ZVOKUHJ6RZNXSSM7FV6V7DQQ, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.957062553 (255h16m15.388142684s) [noise=true , address=104.36.82.23:4472 , piece_id=RC7JRGQZ544STVJBWTR2BZQC64HWTDZSTH432PHRZ22AYIIX55TQ, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.957069697 (255h16m15.388149868s) [noise=true , address=45.91.116.10:4107 , piece_id=G4H6POF62JEXWXCRR7IRL6FK7DJGDRDFVZDLQCQ3R2W4B642YQDA, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.957294036 (255h16m15.388374167s) [noise=true , address=79.127.201.215:4359 , piece_id=N3CFXJPA7C4EQY4NV3FXQF3Y2MYSRTLQD6OYWXPNXZQINAKMXSEA, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.957534135 (255h16m15.388614267s) [noise=true , address=104.36.82.60:4347 , piece_id=ZWKYK5RFNQV77F3KBMVWYU4Q7KPAGM3FHJRNS23GI7TJ6UF4555Q, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.958016909 (255h16m15.38909704s) [noise=true , address=79.127.219.38:4027 , piece_id=VCZG7UGZJ4GAJ3K62GJQ2MGQF4BKABUNTZCE77HWCMTCYZA2DWOQ, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.958436542 (255h16m15.389516673s) [noise=true , address=45.91.116.4:4952 , piece_id=XHID2XE5HOWVOPTPZQGMCZZIN7ZXWER5WOUNUTZUGRKBZIAU6OYA, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:22.101238548 (255h16m16.532318679s) [upload=265458]: Next returned nil segment
Aug 19 08:42:22.101257774 (255h16m16.532337905s) [upload=265458]: Waiting for error group managing segments...
Aug 19 08:42:22.388987371 (255h16m16.820067492s) [noise=true , address=66.23.193.175:4561 , piece_id=AAMFCQRFGMSYK3MRYT4IVC4KXNMDL4JXKAQBQVETLVGZ57K6E4OA, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.845139910 (255h16m17.276220032s) [noise=true , address=79.127.219.48:4103 , piece_id=N4QS2PMQH6IWYUUZ5QZ3FDUH6WWYROKXCKGOSKVORTPYZKPNPFBQ, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.850994894 (255h16m17.282075025s) [noise=true , address=45.91.116.12:4256 , piece_id=27YKUMX33TAUKMP533VJ7JPATXQ3FZWANCRTZBXY7GENCDUXCX5A, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.860437262 (255h16m17.291517393s) [noise=true , address=45.91.116.4:4952 , piece_id=XHID2XE5HOWVOPTPZQGMCZZIN7ZXWER5WOUNUTZUGRKBZIAU6OYA, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.869981273 (255h16m17.301061404s) [noise=true , address=45.91.116.11:4137 , piece_id=MUYYMG5WH5G44J35ON7WZ2GGYRCOJQTXO5JL33J7XYD7BWHPNJFA, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.882501889 (255h16m17.31358202s) [noise=true , address=77.90.31.12:4619 , piece_id=26CDZBQ6ITQITKCSZIR3422EGVNTHN5KAQBTATM67QBHZ5YF5M3Q, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.902789207 (255h16m17.333869338s) [noise=true , address=77.90.31.15:4731 , piece_id=5FQSVLOWIPOPLWJMOB5R2J2A2NUSAQFCJOHDFLSP7PK7HB7LLFHQ, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.919469244 (255h16m17.350549375s) [noise=true , address=79.127.201.215:4359 , piece_id=N3CFXJPA7C4EQY4NV3FXQF3Y2MYSRTLQD6OYWXPNXZQINAKMXSEA, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.930998033 (255h16m17.362078164s) [noise=true , address=104.36.82.44:4869 , piece_id=EXPT6R466GC4XDES45SG4WXASTTX55YFQF2OCUWV5ZOYBJFTKW5Q, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.936915446 (255h16m17.367995577s) [noise=true , address=77.90.31.21:4896 , piece_id=UKKWXESACHDMXOA7GDEIKG45ICKOCK27UQQPD4VL6LNI2KM757CA, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.939195007 (255h16m17.370275128s) [noise=true , address=45.91.116.10:4107 , piece_id=G4H6POF62JEXWXCRR7IRL6FK7DJGDRDFVZDLQCQ3R2W4B642YQDA, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.940566952 (255h16m17.371647084s) [noise=true , address=77.90.31.14:4685 , piece_id=PLKYYR6N7BGUHVUFAIY5TYUKNL3JUA2NJRNA2BJABEUBGQ2Q5FOQ, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.942442731 (255h16m17.373522862s) [noise=true , address=104.36.82.23:4472 , piece_id=RC7JRGQZ544STVJBWTR2BZQC64HWTDZSTH432PHRZ22AYIIX55TQ, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.942943280 (255h16m17.374023411s) [noise=true , address=104.36.82.51:4079 , piece_id=FQZSETG5VBSFZB56DIH6VTJOYFY5ZVOKUHJ6RZNXSSM7FV6V7DQQ, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.942954851 (255h16m17.374034982s) [seg_pos={0 0}, upload=265458]: Segment reached optimal threshold of 14 pieces.
Aug 19 08:42:22.943066295 (255h16m17.374146426s) [noise=true , address=45.91.116.6:4994 , piece_id=3DCV6TUR562S2GCWN6Y3IVTZN2FZM7CM6V26ZP4GEY5QN4YDJMYQ, seg_pos={0 0}, upload=265458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13bDFHbqDxbPr7n4PTQYCXE151sUUFPkidaY1KBZSPcPBBAnFo): protocol: expected piece hash; context canceled; EOF
Aug 19 08:42:22.943121701 (255h16m17.374201832s) [noise=true , address=77.90.31.17:4791 , piece_id=OFY6UGGPXYL5C4GHZSVOEOBU2TMUQFBSQWLX2RDBKJSH2UKAHOVA, seg_pos={0 0}, upload=265458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFEmP78qGhyHhXr3QNVptdiWQ4No4nrb31qj6DPgmJLcHYKiM): protocol: expected piece hash; context canceled; EOF
Aug 19 08:42:22.943158060 (255h16m17.374238191s) [noise=true , address=79.127.219.38:4027 , piece_id=VCZG7UGZJ4GAJ3K62GJQ2MGQF4BKABUNTZCE77HWCMTCYZA2DWOQ, seg_pos={0 0}, upload=265458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cxEy1QQznXLaZA7qt54iNubZUjHMMjZwJXu16uxEyCwmRk2HH): protocol: expected piece hash; context canceled; EOF
Aug 19 08:42:22.943196404 (255h16m17.374276535s) [noise=true , address=104.36.82.60:4347 , piece_id=ZWKYK5RFNQV77F3KBMVWYU4Q7KPAGM3FHJRNS23GI7TJ6UF4555Q, seg_pos={0 0}, upload=265458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbCAPrrYNvhv8129X18ftZmajktekzBFMu5rMLYpHriJbN5PM): protocol: expected piece hash; context canceled; EOF
Aug 19 08:42:22.943209879 (255h16m17.37429001s) [seg_pos={0 0}, upload=265458]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 08:42:22.943263171 (255h16m17.374343302s) [upload=265458]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 08:42:22.943267038 (255h16m17.374347169s) [upload=265458]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 08:42:23.296640432 (255h16m17.727720563s) [upload=265458]: Done uploading segments...
Aug 19 08:42:23.296660330 (255h16m17.727740451s) [upload=265458]: Upload finished. err: <nil>
Duration: 6.02085207s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
7.334130454s
FAIL (2025-08-19 08:47:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.334150083s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X.X.............................................] duration:
1.85381034s
FAIL (2025-08-19 08:47:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:12:21.770696128 (254h46m16.201776259s) [upload=264940]: Starting upload Aug 19 08:12:21.770757987 (254h46m16.201838108s) [upload=264940]: Done starting upload Aug 19 08:12:21.770820176 (254h46m16.201900307s) [upload=264940]: Uploading segments... Aug 19 08:12:21.770863408 (254h46m16.201943539s) [upload=264940]: Got next segment. Inline: true Aug 19 08:12:21.770866965 (254h46m16.201947086s) [upload=264940]: Waiting for error group managing segments... Aug 19 08:12:21.770897073 (254h46m16.201977194s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:12:21.770900720 (254h46m16.201980851s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 08:12:21.770903125 (254h46m16.201983246s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 08:12:21.983071451 (254h46m16.414151582s) [upload=264940]: Done uploading segments... Aug 19 08:12:21.983087682 (254h46m16.414167814s) [upload=264940]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.853844976s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
7.753442994s
FAIL (2025-08-19 08:47:26 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 7.75347299s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
6.107009402s
FAIL (2025-08-19 08:47:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.107033437s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.............X...X.............X.........X............X.....] duration:
5.664196215s
FAIL (2025-08-19 08:47:07 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 08:42:20.500816156 (255h16m14.931896287s) [upload=265458]: Starting upload
Aug 19 08:42:20.500867244 (255h16m14.931947375s) [upload=265458]: Done starting upload
Aug 19 08:42:20.501001241 (255h16m14.932081372s) [upload=265458]: Uploading segments...
Aug 19 08:42:20.501060855 (255h16m14.932140996s) [upload=265458]: Got next segment. Inline: false
Aug 19 08:42:20.501088127 (255h16m14.932168258s) [upload=265458]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 08:42:20.501109177 (255h16m14.932189308s) [upload=265458]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 08:42:20.954652160 (255h16m15.385732291s) [seg_pos={0 0}, upload=265458]: Begin upload segment...
Aug 19 08:42:20.954700222 (255h16m15.385780353s) [seg_pos={0 0}, upload=265458]: Done begin upload segment.
Aug 19 08:42:20.954723277 (255h16m15.385803408s) [noise=true , address=66.23.193.175:4561 , piece_id=AAMFCQRFGMSYK3MRYT4IVC4KXNMDL4JXKAQBQVETLVGZ57K6E4OA, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.954789543 (255h16m15.385869684s) [noise=true , address=77.90.31.14:4685 , piece_id=PLKYYR6N7BGUHVUFAIY5TYUKNL3JUA2NJRNA2BJABEUBGQ2Q5FOQ, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.955158740 (255h16m15.386238861s) [noise=true , address=104.36.82.44:4869 , piece_id=EXPT6R466GC4XDES45SG4WXASTTX55YFQF2OCUWV5ZOYBJFTKW5Q, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.955438595 (255h16m15.386518726s) [noise=true , address=77.90.31.17:4791 , piece_id=OFY6UGGPXYL5C4GHZSVOEOBU2TMUQFBSQWLX2RDBKJSH2UKAHOVA, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.955456480 (255h16m15.386536611s) [noise=true , address=79.127.219.48:4103 , piece_id=N4QS2PMQH6IWYUUZ5QZ3FDUH6WWYROKXCKGOSKVORTPYZKPNPFBQ, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.955708041 (255h16m15.386788172s) [noise=true , address=45.91.116.6:4994 , piece_id=3DCV6TUR562S2GCWN6Y3IVTZN2FZM7CM6V26ZP4GEY5QN4YDJMYQ, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.955986774 (255h16m15.387066905s) [noise=true , address=45.91.116.12:4256 , piece_id=27YKUMX33TAUKMP533VJ7JPATXQ3FZWANCRTZBXY7GENCDUXCX5A, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.956101383 (255h16m15.387181514s) [noise=true , address=77.90.31.12:4619 , piece_id=26CDZBQ6ITQITKCSZIR3422EGVNTHN5KAQBTATM67QBHZ5YF5M3Q, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.956228116 (255h16m15.387308237s) [noise=true , address=45.91.116.11:4137 , piece_id=MUYYMG5WH5G44J35ON7WZ2GGYRCOJQTXO5JL33J7XYD7BWHPNJFA, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.956562386 (255h16m15.387642517s) [noise=true , address=77.90.31.21:4896 , piece_id=UKKWXESACHDMXOA7GDEIKG45ICKOCK27UQQPD4VL6LNI2KM757CA, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.956622110 (255h16m15.387702241s) [noise=true , address=77.90.31.15:4731 , piece_id=5FQSVLOWIPOPLWJMOB5R2J2A2NUSAQFCJOHDFLSP7PK7HB7LLFHQ, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.956815580 (255h16m15.387895711s) [noise=true , address=104.36.82.51:4079 , piece_id=FQZSETG5VBSFZB56DIH6VTJOYFY5ZVOKUHJ6RZNXSSM7FV6V7DQQ, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.957062553 (255h16m15.388142684s) [noise=true , address=104.36.82.23:4472 , piece_id=RC7JRGQZ544STVJBWTR2BZQC64HWTDZSTH432PHRZ22AYIIX55TQ, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.957069697 (255h16m15.388149868s) [noise=true , address=45.91.116.10:4107 , piece_id=G4H6POF62JEXWXCRR7IRL6FK7DJGDRDFVZDLQCQ3R2W4B642YQDA, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.957294036 (255h16m15.388374167s) [noise=true , address=79.127.201.215:4359 , piece_id=N3CFXJPA7C4EQY4NV3FXQF3Y2MYSRTLQD6OYWXPNXZQINAKMXSEA, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.957534135 (255h16m15.388614267s) [noise=true , address=104.36.82.60:4347 , piece_id=ZWKYK5RFNQV77F3KBMVWYU4Q7KPAGM3FHJRNS23GI7TJ6UF4555Q, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.958016909 (255h16m15.38909704s) [noise=true , address=79.127.219.38:4027 , piece_id=VCZG7UGZJ4GAJ3K62GJQ2MGQF4BKABUNTZCE77HWCMTCYZA2DWOQ, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:20.958436542 (255h16m15.389516673s) [noise=true , address=45.91.116.4:4952 , piece_id=XHID2XE5HOWVOPTPZQGMCZZIN7ZXWER5WOUNUTZUGRKBZIAU6OYA, seg_pos={0 0}, upload=265458]: Uploading piece...
Aug 19 08:42:22.101238548 (255h16m16.532318679s) [upload=265458]: Next returned nil segment
Aug 19 08:42:22.101257774 (255h16m16.532337905s) [upload=265458]: Waiting for error group managing segments...
Aug 19 08:42:22.388987371 (255h16m16.820067492s) [noise=true , address=66.23.193.175:4561 , piece_id=AAMFCQRFGMSYK3MRYT4IVC4KXNMDL4JXKAQBQVETLVGZ57K6E4OA, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.845139910 (255h16m17.276220032s) [noise=true , address=79.127.219.48:4103 , piece_id=N4QS2PMQH6IWYUUZ5QZ3FDUH6WWYROKXCKGOSKVORTPYZKPNPFBQ, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.850994894 (255h16m17.282075025s) [noise=true , address=45.91.116.12:4256 , piece_id=27YKUMX33TAUKMP533VJ7JPATXQ3FZWANCRTZBXY7GENCDUXCX5A, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.860437262 (255h16m17.291517393s) [noise=true , address=45.91.116.4:4952 , piece_id=XHID2XE5HOWVOPTPZQGMCZZIN7ZXWER5WOUNUTZUGRKBZIAU6OYA, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.869981273 (255h16m17.301061404s) [noise=true , address=45.91.116.11:4137 , piece_id=MUYYMG5WH5G44J35ON7WZ2GGYRCOJQTXO5JL33J7XYD7BWHPNJFA, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.882501889 (255h16m17.31358202s) [noise=true , address=77.90.31.12:4619 , piece_id=26CDZBQ6ITQITKCSZIR3422EGVNTHN5KAQBTATM67QBHZ5YF5M3Q, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.902789207 (255h16m17.333869338s) [noise=true , address=77.90.31.15:4731 , piece_id=5FQSVLOWIPOPLWJMOB5R2J2A2NUSAQFCJOHDFLSP7PK7HB7LLFHQ, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.919469244 (255h16m17.350549375s) [noise=true , address=79.127.201.215:4359 , piece_id=N3CFXJPA7C4EQY4NV3FXQF3Y2MYSRTLQD6OYWXPNXZQINAKMXSEA, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.930998033 (255h16m17.362078164s) [noise=true , address=104.36.82.44:4869 , piece_id=EXPT6R466GC4XDES45SG4WXASTTX55YFQF2OCUWV5ZOYBJFTKW5Q, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.936915446 (255h16m17.367995577s) [noise=true , address=77.90.31.21:4896 , piece_id=UKKWXESACHDMXOA7GDEIKG45ICKOCK27UQQPD4VL6LNI2KM757CA, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.939195007 (255h16m17.370275128s) [noise=true , address=45.91.116.10:4107 , piece_id=G4H6POF62JEXWXCRR7IRL6FK7DJGDRDFVZDLQCQ3R2W4B642YQDA, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.940566952 (255h16m17.371647084s) [noise=true , address=77.90.31.14:4685 , piece_id=PLKYYR6N7BGUHVUFAIY5TYUKNL3JUA2NJRNA2BJABEUBGQ2Q5FOQ, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.942442731 (255h16m17.373522862s) [noise=true , address=104.36.82.23:4472 , piece_id=RC7JRGQZ544STVJBWTR2BZQC64HWTDZSTH432PHRZ22AYIIX55TQ, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.942943280 (255h16m17.374023411s) [noise=true , address=104.36.82.51:4079 , piece_id=FQZSETG5VBSFZB56DIH6VTJOYFY5ZVOKUHJ6RZNXSSM7FV6V7DQQ, seg_pos={0 0}, upload=265458]: Done uploading piece. err: <nil>
Aug 19 08:42:22.942954851 (255h16m17.374034982s) [seg_pos={0 0}, upload=265458]: Segment reached optimal threshold of 14 pieces.
Aug 19 08:42:22.943066295 (255h16m17.374146426s) [noise=true , address=45.91.116.6:4994 , piece_id=3DCV6TUR562S2GCWN6Y3IVTZN2FZM7CM6V26ZP4GEY5QN4YDJMYQ, seg_pos={0 0}, upload=265458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13bDFHbqDxbPr7n4PTQYCXE151sUUFPkidaY1KBZSPcPBBAnFo): protocol: expected piece hash; context canceled; EOF
Aug 19 08:42:22.943121701 (255h16m17.374201832s) [noise=true , address=77.90.31.17:4791 , piece_id=OFY6UGGPXYL5C4GHZSVOEOBU2TMUQFBSQWLX2RDBKJSH2UKAHOVA, seg_pos={0 0}, upload=265458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFEmP78qGhyHhXr3QNVptdiWQ4No4nrb31qj6DPgmJLcHYKiM): protocol: expected piece hash; context canceled; EOF
Aug 19 08:42:22.943158060 (255h16m17.374238191s) [noise=true , address=79.127.219.38:4027 , piece_id=VCZG7UGZJ4GAJ3K62GJQ2MGQF4BKABUNTZCE77HWCMTCYZA2DWOQ, seg_pos={0 0}, upload=265458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cxEy1QQznXLaZA7qt54iNubZUjHMMjZwJXu16uxEyCwmRk2HH): protocol: expected piece hash; context canceled; EOF
Aug 19 08:42:22.943196404 (255h16m17.374276535s) [noise=true , address=104.36.82.60:4347 , piece_id=ZWKYK5RFNQV77F3KBMVWYU4Q7KPAGM3FHJRNS23GI7TJ6UF4555Q, seg_pos={0 0}, upload=265458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbCAPrrYNvhv8129X18ftZmajktekzBFMu5rMLYpHriJbN5PM): protocol: expected piece hash; context canceled; EOF
Aug 19 08:42:22.943209879 (255h16m17.37429001s) [seg_pos={0 0}, upload=265458]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 08:42:22.943263171 (255h16m17.374343302s) [upload=265458]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 08:42:22.943267038 (255h16m17.374347169s) [upload=265458]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 08:42:23.296640432 (255h16m17.727720563s) [upload=265458]: Done uploading segments...
Aug 19 08:42:23.296660330 (255h16m17.727740451s) [upload=265458]: Upload finished. err: <nil>
Duration: 5.664226794s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|