Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...............X........X...............X......X..X...X.....] duration:
7.864396871s
FAIL (2025-08-11 03:44:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:39:30.119006289 (58h13m24.55008641s) [upload=60686]: Starting upload Aug 11 03:39:30.119057457 (58h13m24.550137578s) [upload=60686]: Done starting upload Aug 11 03:39:30.119224998 (58h13m24.550305129s) [upload=60686]: Uploading segments... Aug 11 03:39:30.119335248 (58h13m24.55041538s) [upload=60686]: Got next segment. Inline: false Aug 11 03:39:30.119382719 (58h13m24.55046285s) [upload=60686]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:39:30.119387358 (58h13m24.550467489s) [upload=60686]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 03:39:30.358540629 (58h13m24.78962076s) [upload=60686]: Next segment err: metaclient: Too Many Requests Aug 11 03:39:30.358572319 (58h13m24.78965249s) [upload=60686]: Done uploading segments... Aug 11 03:39:30.358598930 (58h13m24.789679081s) [upload=60686]: Upload finished. err: metaclient: Too Many Requests
Duration: 7.864422088s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X....X.............X.....................X..........] duration:
1.811552098s
FAIL (2025-08-11 03:43:53 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 03:35:59.697389440 (58h9m54.128469571s) [upload=60624]: Starting upload
Aug 11 03:35:59.697433665 (58h9m54.128513796s) [upload=60624]: Done starting upload
Aug 11 03:35:59.697484944 (58h9m54.128565075s) [upload=60624]: Uploading segments...
Aug 11 03:35:59.697523367 (58h9m54.128603488s) [upload=60624]: Got next segment. Inline: true
Aug 11 03:35:59.697527264 (58h9m54.128607395s) [upload=60624]: Waiting for error group managing segments...
Aug 11 03:35:59.697564615 (58h9m54.128644736s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 03:35:59.697568724 (58h9m54.128648855s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 03:35:59.697571459 (58h9m54.12865159s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 03:35:59.988045132 (58h9m54.419125263s) [upload=60624]: Done uploading segments...
Aug 11 03:35:59.988063237 (58h9m54.419143358s) [upload=60624]: Upload finished. err: <nil>
Duration: 1.8115792s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X....X......................................] duration:
6.265691906s
FAIL (2025-08-11 03:43:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.265711945s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X....X.....................................] duration:
6.911033612s
FAIL (2025-08-11 03:43:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.911053218s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [................X........X...............X......X..X...X....] duration:
7.707557516s
FAIL (2025-08-11 03:43:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:39:30.119006289 (58h13m24.55008641s) [upload=60686]: Starting upload Aug 11 03:39:30.119057457 (58h13m24.550137578s) [upload=60686]: Done starting upload Aug 11 03:39:30.119224998 (58h13m24.550305129s) [upload=60686]: Uploading segments... Aug 11 03:39:30.119335248 (58h13m24.55041538s) [upload=60686]: Got next segment. Inline: false Aug 11 03:39:30.119382719 (58h13m24.55046285s) [upload=60686]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:39:30.119387358 (58h13m24.550467489s) [upload=60686]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 03:39:30.358540629 (58h13m24.78962076s) [upload=60686]: Next segment err: metaclient: Too Many Requests Aug 11 03:39:30.358572319 (58h13m24.78965249s) [upload=60686]: Done uploading segments... Aug 11 03:39:30.358598930 (58h13m24.789679081s) [upload=60686]: Upload finished. err: metaclient: Too Many Requests
Duration: 7.707582102s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X....X.............X.....................X.........] duration:
1.825380758s
FAIL (2025-08-11 03:42:51 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 03:35:59.697389440 (58h9m54.128469571s) [upload=60624]: Starting upload
Aug 11 03:35:59.697433665 (58h9m54.128513796s) [upload=60624]: Done starting upload
Aug 11 03:35:59.697484944 (58h9m54.128565075s) [upload=60624]: Uploading segments...
Aug 11 03:35:59.697523367 (58h9m54.128603488s) [upload=60624]: Got next segment. Inline: true
Aug 11 03:35:59.697527264 (58h9m54.128607395s) [upload=60624]: Waiting for error group managing segments...
Aug 11 03:35:59.697564615 (58h9m54.128644736s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 03:35:59.697568724 (58h9m54.128648855s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 03:35:59.697571459 (58h9m54.12865159s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 03:35:59.988045132 (58h9m54.419125263s) [upload=60624]: Done uploading segments...
Aug 11 03:35:59.988063237 (58h9m54.419143358s) [upload=60624]: Upload finished. err: <nil>
Duration: 1.825418079s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.................X........X...............X......X..X...X...] duration:
8.335432851s
FAIL (2025-08-11 03:42:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:39:30.119006289 (58h13m24.55008641s) [upload=60686]: Starting upload Aug 11 03:39:30.119057457 (58h13m24.550137578s) [upload=60686]: Done starting upload Aug 11 03:39:30.119224998 (58h13m24.550305129s) [upload=60686]: Uploading segments... Aug 11 03:39:30.119335248 (58h13m24.55041538s) [upload=60686]: Got next segment. Inline: false Aug 11 03:39:30.119382719 (58h13m24.55046285s) [upload=60686]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:39:30.119387358 (58h13m24.550467489s) [upload=60686]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 03:39:30.358540629 (58h13m24.78962076s) [upload=60686]: Next segment err: metaclient: Too Many Requests Aug 11 03:39:30.358572319 (58h13m24.78965249s) [upload=60686]: Done uploading segments... Aug 11 03:39:30.358598930 (58h13m24.789679081s) [upload=60686]: Upload finished. err: metaclient: Too Many Requests
Duration: 8.335463982s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X....X....................................] duration:
5.881418148s
FAIL (2025-08-11 03:42:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.88143972s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..................X........X...............X......X..X...X..] duration:
7.62781683s
FAIL (2025-08-11 03:41:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:39:30.119006289 (58h13m24.55008641s) [upload=60686]: Starting upload Aug 11 03:39:30.119057457 (58h13m24.550137578s) [upload=60686]: Done starting upload Aug 11 03:39:30.119224998 (58h13m24.550305129s) [upload=60686]: Uploading segments... Aug 11 03:39:30.119335248 (58h13m24.55041538s) [upload=60686]: Got next segment. Inline: false Aug 11 03:39:30.119382719 (58h13m24.55046285s) [upload=60686]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:39:30.119387358 (58h13m24.550467489s) [upload=60686]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 03:39:30.358540629 (58h13m24.78962076s) [upload=60686]: Next segment err: metaclient: Too Many Requests Aug 11 03:39:30.358572319 (58h13m24.78965249s) [upload=60686]: Done uploading segments... Aug 11 03:39:30.358598930 (58h13m24.789679081s) [upload=60686]: Upload finished. err: metaclient: Too Many Requests
Duration: 7.627842538s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X....X.............X.....................X........] duration:
1.830484321s
FAIL (2025-08-11 03:41:36 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 03:35:59.697389440 (58h9m54.128469571s) [upload=60624]: Starting upload
Aug 11 03:35:59.697433665 (58h9m54.128513796s) [upload=60624]: Done starting upload
Aug 11 03:35:59.697484944 (58h9m54.128565075s) [upload=60624]: Uploading segments...
Aug 11 03:35:59.697523367 (58h9m54.128603488s) [upload=60624]: Got next segment. Inline: true
Aug 11 03:35:59.697527264 (58h9m54.128607395s) [upload=60624]: Waiting for error group managing segments...
Aug 11 03:35:59.697564615 (58h9m54.128644736s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 03:35:59.697568724 (58h9m54.128648855s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 03:35:59.697571459 (58h9m54.12865159s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 03:35:59.988045132 (58h9m54.419125263s) [upload=60624]: Done uploading segments...
Aug 11 03:35:59.988063237 (58h9m54.419143358s) [upload=60624]: Upload finished. err: <nil>
Duration: 1.830503458s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X....X...................................] duration:
5.922248013s
FAIL (2025-08-11 03:41:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.922270285s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X....X..................................] duration:
6.551778722s
FAIL (2025-08-11 03:41:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.551820092s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X....X.............X.....................X.......] duration:
1.835205024s
FAIL (2025-08-11 03:41:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 03:35:59.697389440 (58h9m54.128469571s) [upload=60624]: Starting upload
Aug 11 03:35:59.697433665 (58h9m54.128513796s) [upload=60624]: Done starting upload
Aug 11 03:35:59.697484944 (58h9m54.128565075s) [upload=60624]: Uploading segments...
Aug 11 03:35:59.697523367 (58h9m54.128603488s) [upload=60624]: Got next segment. Inline: true
Aug 11 03:35:59.697527264 (58h9m54.128607395s) [upload=60624]: Waiting for error group managing segments...
Aug 11 03:35:59.697564615 (58h9m54.128644736s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 03:35:59.697568724 (58h9m54.128648855s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 03:35:59.697571459 (58h9m54.12865159s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 03:35:59.988045132 (58h9m54.419125263s) [upload=60624]: Done uploading segments...
Aug 11 03:35:59.988063237 (58h9m54.419143358s) [upload=60624]: Upload finished. err: <nil>
Duration: 1.835223762s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X....X.................................] duration:
6.23018912s
FAIL (2025-08-11 03:40:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.230212304s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...................X........X...............X......X..X...X.] duration:
7.771313031s
FAIL (2025-08-11 03:40:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:39:30.119006289 (58h13m24.55008641s) [upload=60686]: Starting upload Aug 11 03:39:30.119057457 (58h13m24.550137578s) [upload=60686]: Done starting upload Aug 11 03:39:30.119224998 (58h13m24.550305129s) [upload=60686]: Uploading segments... Aug 11 03:39:30.119335248 (58h13m24.55041538s) [upload=60686]: Got next segment. Inline: false Aug 11 03:39:30.119382719 (58h13m24.55046285s) [upload=60686]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:39:30.119387358 (58h13m24.550467489s) [upload=60686]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 03:39:30.358540629 (58h13m24.78962076s) [upload=60686]: Next segment err: metaclient: Too Many Requests Aug 11 03:39:30.358572319 (58h13m24.78965249s) [upload=60686]: Done uploading segments... Aug 11 03:39:30.358598930 (58h13m24.789679081s) [upload=60686]: Upload finished. err: metaclient: Too Many Requests
Duration: 7.771461454s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X....X................................] duration:
5.913959842s
FAIL (2025-08-11 03:40:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.913983096s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X....X.............X.....................X......] duration:
1.937513304s
FAIL (2025-08-11 03:40:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 03:35:59.697389440 (58h9m54.128469571s) [upload=60624]: Starting upload
Aug 11 03:35:59.697433665 (58h9m54.128513796s) [upload=60624]: Done starting upload
Aug 11 03:35:59.697484944 (58h9m54.128565075s) [upload=60624]: Uploading segments...
Aug 11 03:35:59.697523367 (58h9m54.128603488s) [upload=60624]: Got next segment. Inline: true
Aug 11 03:35:59.697527264 (58h9m54.128607395s) [upload=60624]: Waiting for error group managing segments...
Aug 11 03:35:59.697564615 (58h9m54.128644736s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 03:35:59.697568724 (58h9m54.128648855s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 03:35:59.697571459 (58h9m54.12865159s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 03:35:59.988045132 (58h9m54.419125263s) [upload=60624]: Done uploading segments...
Aug 11 03:35:59.988063237 (58h9m54.419143358s) [upload=60624]: Upload finished. err: <nil>
Duration: 1.937540245s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X....X...............................] duration:
7.808801692s
FAIL (2025-08-11 03:40:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.808842431s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X....X..............................] duration:
6.195538495s
FAIL (2025-08-11 03:39:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.195573993s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............X....X.............X.....................X.....] duration:
1.857865089s
FAIL (2025-08-11 03:39:45 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 03:35:59.697389440 (58h9m54.128469571s) [upload=60624]: Starting upload
Aug 11 03:35:59.697433665 (58h9m54.128513796s) [upload=60624]: Done starting upload
Aug 11 03:35:59.697484944 (58h9m54.128565075s) [upload=60624]: Uploading segments...
Aug 11 03:35:59.697523367 (58h9m54.128603488s) [upload=60624]: Got next segment. Inline: true
Aug 11 03:35:59.697527264 (58h9m54.128607395s) [upload=60624]: Waiting for error group managing segments...
Aug 11 03:35:59.697564615 (58h9m54.128644736s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 03:35:59.697568724 (58h9m54.128648855s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 03:35:59.697571459 (58h9m54.12865159s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 03:35:59.988045132 (58h9m54.419125263s) [upload=60624]: Done uploading segments...
Aug 11 03:35:59.988063237 (58h9m54.419143358s) [upload=60624]: Upload finished. err: <nil>
Duration: 1.857889775s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [....................X........X...............X......X..X...X] duration:
885.642152ms
FAIL (2025-08-11 03:39:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:39:30.119006289 (58h13m24.55008641s) [upload=60686]: Starting upload Aug 11 03:39:30.119057457 (58h13m24.550137578s) [upload=60686]: Done starting upload Aug 11 03:39:30.119224998 (58h13m24.550305129s) [upload=60686]: Uploading segments... Aug 11 03:39:30.119335248 (58h13m24.55041538s) [upload=60686]: Got next segment. Inline: false Aug 11 03:39:30.119382719 (58h13m24.55046285s) [upload=60686]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:39:30.119387358 (58h13m24.550467489s) [upload=60686]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 03:39:30.358540629 (58h13m24.78962076s) [upload=60686]: Next segment err: metaclient: Too Many Requests Aug 11 03:39:30.358572319 (58h13m24.78965249s) [upload=60686]: Done uploading segments... Aug 11 03:39:30.358598930 (58h13m24.789679081s) [upload=60686]: Upload finished. err: metaclient: Too Many Requests
Duration: 885.663312ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X....X.............................] duration:
6.297193793s
FAIL (2025-08-11 03:39:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.297220113s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....................X........X...............X......X..X...] duration:
7.670647209s
FAIL (2025-08-11 03:39:09 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 03:36:11.293271998 (58h10m5.724352149s) [upload=60629]: Starting upload
Aug 11 03:36:11.293353684 (58h10m5.724433835s) [upload=60629]: Done starting upload
Aug 11 03:36:11.293450319 (58h10m5.72453047s) [upload=60629]: Uploading segments...
Aug 11 03:36:11.293638780 (58h10m5.724718921s) [upload=60629]: Got next segment. Inline: false
Aug 11 03:36:11.293690899 (58h10m5.72477105s) [upload=60629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 03:36:11.293696250 (58h10m5.724776391s) [upload=60629]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 03:36:11.736650551 (58h10m6.167730682s) [seg_pos={0 0}, upload=60629]: Begin upload segment...
Aug 11 03:36:11.736692981 (58h10m6.167773112s) [seg_pos={0 0}, upload=60629]: Done begin upload segment.
Aug 11 03:36:11.736719582 (58h10m6.167799713s) [noise=true , address=104.36.82.38:4713 , piece_id=A3HM5JAMY56234EID2U3KB6KU2OEOQD4SG7QJJO74UIZRS5CU2FA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.736760631 (58h10m6.167840762s) [noise=true , address=104.36.82.60:4340 , piece_id=NDQHYROL5EAZCH3SKZSSA4QRBFHK5FQXOYMQGY2CLPFFMEEGIY6A, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.737160706 (58h10m6.168240837s) [noise=true , address=104.36.82.8:4000 , piece_id=TSV3UEAMFKS2GMKGGKYWDVGZJ6S7XEPKIKUGWUKBXH6PWZ5CYYKQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.737249887 (58h10m6.168330018s) [noise=true , address=104.36.82.23:4460 , piece_id=FBMSWNXYPU5VLOYQKVZVTBE2VPP5AZUJV7OP72YCWY2US3YST7RQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.737473185 (58h10m6.168553316s) [noise=true , address=104.36.82.35:4584 , piece_id=YGU5SK4MFYVWBZPYURBSPF3SLZCYB6EDZFIIEZCPOUZBT3BFSHGA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.737546344 (58h10m6.168626465s) [noise=true , address=104.36.82.5:4852 , piece_id=BF3EPWI7433FZQRHOLWVLRMKCWKXOTZV5RZSU4FCJA23ZRKDPLLQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.737763890 (58h10m6.168844011s) [noise=true , address=104.36.82.45:4914 , piece_id=AHUXQAWKOI4UW4467OIHIYAXNINQAMIAQPQ3G5XPUGUVF4GCMHTQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.738099252 (58h10m6.169179373s) [noise=true , address=64.49.13.27:4958 , piece_id=XO6WUEN3VFQAGCLKVDPLVPFALDUBGZQF6VCR7U4YSEHLB2AFSFBQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.738385350 (58h10m6.169465481s) [noise=true , address=104.36.82.61:4407 , piece_id=OOBLCBVIXFUN2432GRXVFDWZEO5FLDJ2EJUW2T7OQIYB5FRN7PQA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.738665666 (58h10m6.169745797s) [noise=true , address=104.36.82.62:4422 , piece_id=VT6NHEQJYPYF4X44GDSEWHUMKX34A6YK2XNXNQSAYUTCW35Y7CHQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.738916115 (58h10m6.169996236s) [noise=true , address=104.36.82.44:4886 , piece_id=ZWRLPZQ73S5JYHBYQ3NOQX6663AZ3AEH4GPZ5FDVKYV4XJYJMTUQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.739140855 (58h10m6.170220986s) [noise=true , address=104.36.82.18:4379 , piece_id=YINW4XPUQ3IXIVPU63WVGQFGMWN6UYAUZLJ5AVAD6LIMGU6FGC5A, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.739378941 (58h10m6.170459072s) [noise=true , address=104.36.82.35:4583 , piece_id=EGEQI2D7C7AHAW6OESRMNO3LMRQKSBE44MQP6KLLOBIUCVUZ7TXQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.739579123 (58h10m6.170659254s) [noise=true , address=104.36.82.17:4346 , piece_id=VIXIJNQKSMUZA27U7EO37XZJEME22NWTL43K4IL5T5YDZZGFVPCA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.739795638 (58h10m6.170875769s) [noise=true , address=77.90.31.15:4724 , piece_id=U4HOU6WCG5LBVXYS46ZHEPF6FZ4NC6J6AO2WBPWRJSWWTOEGTLDA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.739999539 (58h10m6.17107967s) [noise=true , address=104.36.82.36:4632 , piece_id=NIFUBGMPSJGKXTBHLIGF3C4PP5XZCQIGGVSYZQZLXSW55A2ANWJA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.740340500 (58h10m6.171420632s) [noise=true , address=104.36.82.55:4224 , piece_id=Y2XMRPJMTPV6LMVUSJA4RKZVL2UR4K7EYT26GNWJB6DF2HWXQBIQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.740614555 (58h10m6.171694686s) [noise=true , address=104.36.82.45:4938 , piece_id=MVQWOUMSGYLMJUPDXPLVAEZVYGDNUSXLPXDHIYIM3TCO6PPD2G7A, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:12.876917864 (58h10m7.307997995s) [upload=60629]: Next returned nil segment
Aug 11 03:36:12.876935037 (58h10m7.308015168s) [upload=60629]: Waiting for error group managing segments...
Aug 11 03:36:13.164461271 (58h10m7.595541402s) [noise=true , address=64.49.13.27:4958 , piece_id=XO6WUEN3VFQAGCLKVDPLVPFALDUBGZQF6VCR7U4YSEHLB2AFSFBQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.501463266 (58h10m8.932543387s) [noise=true , address=104.36.82.45:4914 , piece_id=AHUXQAWKOI4UW4467OIHIYAXNINQAMIAQPQ3G5XPUGUVF4GCMHTQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.628662400 (58h10m9.059742531s) [noise=true , address=77.90.31.15:4724 , piece_id=U4HOU6WCG5LBVXYS46ZHEPF6FZ4NC6J6AO2WBPWRJSWWTOEGTLDA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.689466359 (58h10m9.12054649s) [noise=true , address=104.36.82.62:4422 , piece_id=VT6NHEQJYPYF4X44GDSEWHUMKX34A6YK2XNXNQSAYUTCW35Y7CHQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.790799273 (58h10m9.221879404s) [noise=true , address=104.36.82.55:4224 , piece_id=Y2XMRPJMTPV6LMVUSJA4RKZVL2UR4K7EYT26GNWJB6DF2HWXQBIQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.898250664 (58h10m9.329330795s) [noise=true , address=104.36.82.17:4346 , piece_id=VIXIJNQKSMUZA27U7EO37XZJEME22NWTL43K4IL5T5YDZZGFVPCA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.900882138 (58h10m9.331962259s) [noise=true , address=104.36.82.44:4886 , piece_id=ZWRLPZQ73S5JYHBYQ3NOQX6663AZ3AEH4GPZ5FDVKYV4XJYJMTUQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.951745036 (58h10m9.382825157s) [noise=true , address=104.36.82.36:4632 , piece_id=NIFUBGMPSJGKXTBHLIGF3C4PP5XZCQIGGVSYZQZLXSW55A2ANWJA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.975320705 (58h10m9.406400836s) [noise=true , address=104.36.82.23:4460 , piece_id=FBMSWNXYPU5VLOYQKVZVTBE2VPP5AZUJV7OP72YCWY2US3YST7RQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.042248690 (58h10m9.473328821s) [noise=true , address=104.36.82.18:4379 , piece_id=YINW4XPUQ3IXIVPU63WVGQFGMWN6UYAUZLJ5AVAD6LIMGU6FGC5A, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.083239740 (58h10m9.514319901s) [noise=true , address=104.36.82.35:4583 , piece_id=EGEQI2D7C7AHAW6OESRMNO3LMRQKSBE44MQP6KLLOBIUCVUZ7TXQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.181940126 (58h10m9.613020257s) [noise=true , address=104.36.82.45:4938 , piece_id=MVQWOUMSGYLMJUPDXPLVAEZVYGDNUSXLPXDHIYIM3TCO6PPD2G7A, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.351448262 (58h10m9.782528394s) [noise=true , address=104.36.82.8:4000 , piece_id=TSV3UEAMFKS2GMKGGKYWDVGZJ6S7XEPKIKUGWUKBXH6PWZ5CYYKQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.354552001 (58h10m9.785632122s) [noise=true , address=104.36.82.5:4852 , piece_id=BF3EPWI7433FZQRHOLWVLRMKCWKXOTZV5RZSU4FCJA23ZRKDPLLQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.354574785 (58h10m9.785654906s) [seg_pos={0 0}, upload=60629]: Segment reached optimal threshold of 14 pieces.
Aug 11 03:36:15.354696428 (58h10m9.785776559s) [noise=true , address=104.36.82.60:4340 , piece_id=NDQHYROL5EAZCH3SKZSSA4QRBFHK5FQXOYMQGY2CLPFFMEEGIY6A, seg_pos={0 0}, upload=60629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 03:36:15.354760340 (58h10m9.785840471s) [noise=true , address=104.36.82.61:4407 , piece_id=OOBLCBVIXFUN2432GRXVFDWZEO5FLDJ2EJUW2T7OQIYB5FRN7PQA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122k7b6wa2JhSXMVAhF4qPKA48cWkh3DZRyWuwPEt7Vp3ciofPF): protocol: expected piece hash; context canceled; EOF
Aug 11 03:36:15.354791500 (58h10m9.785871631s) [noise=true , address=104.36.82.35:4584 , piece_id=YGU5SK4MFYVWBZPYURBSPF3SLZCYB6EDZFIIEZCPOUZBT3BFSHGA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TMMXMjWNxBgccLQMbuExNxgwvzQpNH4cizjaPZDufcjvTqdeh): protocol: expected piece hash; context canceled; EOF
Aug 11 03:36:15.354810246 (58h10m9.785890377s) [noise=true , address=104.36.82.38:4713 , piece_id=A3HM5JAMY56234EID2U3KB6KU2OEOQD4SG7QJJO74UIZRS5CU2FA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6e9GSH9aUj8t9T79uLE6p5jPZSnX3cNDLEBHVL88hLqLq2qF): protocol: expected piece hash; context canceled; EOF
Aug 11 03:36:15.354821196 (58h10m9.785901327s) [seg_pos={0 0}, upload=60629]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 03:36:15.354902251 (58h10m9.785982372s) [upload=60629]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 03:36:15.354920777 (58h10m9.786000908s) [upload=60629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 03:36:15.656182984 (58h10m10.087263155s) [upload=60629]: Done uploading segments...
Aug 11 03:36:15.656216277 (58h10m10.087296438s) [upload=60629]: Upload finished. err: <nil>
Duration: 7.670673239s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X....X.............X.....................X....] duration:
1.93516964s
FAIL (2025-08-11 03:38:45 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 03:35:59.697389440 (58h9m54.128469571s) [upload=60624]: Starting upload
Aug 11 03:35:59.697433665 (58h9m54.128513796s) [upload=60624]: Done starting upload
Aug 11 03:35:59.697484944 (58h9m54.128565075s) [upload=60624]: Uploading segments...
Aug 11 03:35:59.697523367 (58h9m54.128603488s) [upload=60624]: Got next segment. Inline: true
Aug 11 03:35:59.697527264 (58h9m54.128607395s) [upload=60624]: Waiting for error group managing segments...
Aug 11 03:35:59.697564615 (58h9m54.128644736s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 03:35:59.697568724 (58h9m54.128648855s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 03:35:59.697571459 (58h9m54.12865159s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 03:35:59.988045132 (58h9m54.419125263s) [upload=60624]: Done uploading segments...
Aug 11 03:35:59.988063237 (58h9m54.419143358s) [upload=60624]: Upload finished. err: <nil>
Duration: 1.935213475s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [......................X........X...............X......X..X..] duration:
7.264278915s
FAIL (2025-08-11 03:38:44 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 03:36:11.293271998 (58h10m5.724352149s) [upload=60629]: Starting upload
Aug 11 03:36:11.293353684 (58h10m5.724433835s) [upload=60629]: Done starting upload
Aug 11 03:36:11.293450319 (58h10m5.72453047s) [upload=60629]: Uploading segments...
Aug 11 03:36:11.293638780 (58h10m5.724718921s) [upload=60629]: Got next segment. Inline: false
Aug 11 03:36:11.293690899 (58h10m5.72477105s) [upload=60629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 03:36:11.293696250 (58h10m5.724776391s) [upload=60629]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 03:36:11.736650551 (58h10m6.167730682s) [seg_pos={0 0}, upload=60629]: Begin upload segment...
Aug 11 03:36:11.736692981 (58h10m6.167773112s) [seg_pos={0 0}, upload=60629]: Done begin upload segment.
Aug 11 03:36:11.736719582 (58h10m6.167799713s) [noise=true , address=104.36.82.38:4713 , piece_id=A3HM5JAMY56234EID2U3KB6KU2OEOQD4SG7QJJO74UIZRS5CU2FA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.736760631 (58h10m6.167840762s) [noise=true , address=104.36.82.60:4340 , piece_id=NDQHYROL5EAZCH3SKZSSA4QRBFHK5FQXOYMQGY2CLPFFMEEGIY6A, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.737160706 (58h10m6.168240837s) [noise=true , address=104.36.82.8:4000 , piece_id=TSV3UEAMFKS2GMKGGKYWDVGZJ6S7XEPKIKUGWUKBXH6PWZ5CYYKQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.737249887 (58h10m6.168330018s) [noise=true , address=104.36.82.23:4460 , piece_id=FBMSWNXYPU5VLOYQKVZVTBE2VPP5AZUJV7OP72YCWY2US3YST7RQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.737473185 (58h10m6.168553316s) [noise=true , address=104.36.82.35:4584 , piece_id=YGU5SK4MFYVWBZPYURBSPF3SLZCYB6EDZFIIEZCPOUZBT3BFSHGA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.737546344 (58h10m6.168626465s) [noise=true , address=104.36.82.5:4852 , piece_id=BF3EPWI7433FZQRHOLWVLRMKCWKXOTZV5RZSU4FCJA23ZRKDPLLQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.737763890 (58h10m6.168844011s) [noise=true , address=104.36.82.45:4914 , piece_id=AHUXQAWKOI4UW4467OIHIYAXNINQAMIAQPQ3G5XPUGUVF4GCMHTQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.738099252 (58h10m6.169179373s) [noise=true , address=64.49.13.27:4958 , piece_id=XO6WUEN3VFQAGCLKVDPLVPFALDUBGZQF6VCR7U4YSEHLB2AFSFBQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.738385350 (58h10m6.169465481s) [noise=true , address=104.36.82.61:4407 , piece_id=OOBLCBVIXFUN2432GRXVFDWZEO5FLDJ2EJUW2T7OQIYB5FRN7PQA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.738665666 (58h10m6.169745797s) [noise=true , address=104.36.82.62:4422 , piece_id=VT6NHEQJYPYF4X44GDSEWHUMKX34A6YK2XNXNQSAYUTCW35Y7CHQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.738916115 (58h10m6.169996236s) [noise=true , address=104.36.82.44:4886 , piece_id=ZWRLPZQ73S5JYHBYQ3NOQX6663AZ3AEH4GPZ5FDVKYV4XJYJMTUQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.739140855 (58h10m6.170220986s) [noise=true , address=104.36.82.18:4379 , piece_id=YINW4XPUQ3IXIVPU63WVGQFGMWN6UYAUZLJ5AVAD6LIMGU6FGC5A, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.739378941 (58h10m6.170459072s) [noise=true , address=104.36.82.35:4583 , piece_id=EGEQI2D7C7AHAW6OESRMNO3LMRQKSBE44MQP6KLLOBIUCVUZ7TXQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.739579123 (58h10m6.170659254s) [noise=true , address=104.36.82.17:4346 , piece_id=VIXIJNQKSMUZA27U7EO37XZJEME22NWTL43K4IL5T5YDZZGFVPCA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.739795638 (58h10m6.170875769s) [noise=true , address=77.90.31.15:4724 , piece_id=U4HOU6WCG5LBVXYS46ZHEPF6FZ4NC6J6AO2WBPWRJSWWTOEGTLDA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.739999539 (58h10m6.17107967s) [noise=true , address=104.36.82.36:4632 , piece_id=NIFUBGMPSJGKXTBHLIGF3C4PP5XZCQIGGVSYZQZLXSW55A2ANWJA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.740340500 (58h10m6.171420632s) [noise=true , address=104.36.82.55:4224 , piece_id=Y2XMRPJMTPV6LMVUSJA4RKZVL2UR4K7EYT26GNWJB6DF2HWXQBIQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.740614555 (58h10m6.171694686s) [noise=true , address=104.36.82.45:4938 , piece_id=MVQWOUMSGYLMJUPDXPLVAEZVYGDNUSXLPXDHIYIM3TCO6PPD2G7A, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:12.876917864 (58h10m7.307997995s) [upload=60629]: Next returned nil segment
Aug 11 03:36:12.876935037 (58h10m7.308015168s) [upload=60629]: Waiting for error group managing segments...
Aug 11 03:36:13.164461271 (58h10m7.595541402s) [noise=true , address=64.49.13.27:4958 , piece_id=XO6WUEN3VFQAGCLKVDPLVPFALDUBGZQF6VCR7U4YSEHLB2AFSFBQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.501463266 (58h10m8.932543387s) [noise=true , address=104.36.82.45:4914 , piece_id=AHUXQAWKOI4UW4467OIHIYAXNINQAMIAQPQ3G5XPUGUVF4GCMHTQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.628662400 (58h10m9.059742531s) [noise=true , address=77.90.31.15:4724 , piece_id=U4HOU6WCG5LBVXYS46ZHEPF6FZ4NC6J6AO2WBPWRJSWWTOEGTLDA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.689466359 (58h10m9.12054649s) [noise=true , address=104.36.82.62:4422 , piece_id=VT6NHEQJYPYF4X44GDSEWHUMKX34A6YK2XNXNQSAYUTCW35Y7CHQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.790799273 (58h10m9.221879404s) [noise=true , address=104.36.82.55:4224 , piece_id=Y2XMRPJMTPV6LMVUSJA4RKZVL2UR4K7EYT26GNWJB6DF2HWXQBIQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.898250664 (58h10m9.329330795s) [noise=true , address=104.36.82.17:4346 , piece_id=VIXIJNQKSMUZA27U7EO37XZJEME22NWTL43K4IL5T5YDZZGFVPCA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.900882138 (58h10m9.331962259s) [noise=true , address=104.36.82.44:4886 , piece_id=ZWRLPZQ73S5JYHBYQ3NOQX6663AZ3AEH4GPZ5FDVKYV4XJYJMTUQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.951745036 (58h10m9.382825157s) [noise=true , address=104.36.82.36:4632 , piece_id=NIFUBGMPSJGKXTBHLIGF3C4PP5XZCQIGGVSYZQZLXSW55A2ANWJA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.975320705 (58h10m9.406400836s) [noise=true , address=104.36.82.23:4460 , piece_id=FBMSWNXYPU5VLOYQKVZVTBE2VPP5AZUJV7OP72YCWY2US3YST7RQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.042248690 (58h10m9.473328821s) [noise=true , address=104.36.82.18:4379 , piece_id=YINW4XPUQ3IXIVPU63WVGQFGMWN6UYAUZLJ5AVAD6LIMGU6FGC5A, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.083239740 (58h10m9.514319901s) [noise=true , address=104.36.82.35:4583 , piece_id=EGEQI2D7C7AHAW6OESRMNO3LMRQKSBE44MQP6KLLOBIUCVUZ7TXQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.181940126 (58h10m9.613020257s) [noise=true , address=104.36.82.45:4938 , piece_id=MVQWOUMSGYLMJUPDXPLVAEZVYGDNUSXLPXDHIYIM3TCO6PPD2G7A, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.351448262 (58h10m9.782528394s) [noise=true , address=104.36.82.8:4000 , piece_id=TSV3UEAMFKS2GMKGGKYWDVGZJ6S7XEPKIKUGWUKBXH6PWZ5CYYKQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.354552001 (58h10m9.785632122s) [noise=true , address=104.36.82.5:4852 , piece_id=BF3EPWI7433FZQRHOLWVLRMKCWKXOTZV5RZSU4FCJA23ZRKDPLLQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.354574785 (58h10m9.785654906s) [seg_pos={0 0}, upload=60629]: Segment reached optimal threshold of 14 pieces.
Aug 11 03:36:15.354696428 (58h10m9.785776559s) [noise=true , address=104.36.82.60:4340 , piece_id=NDQHYROL5EAZCH3SKZSSA4QRBFHK5FQXOYMQGY2CLPFFMEEGIY6A, seg_pos={0 0}, upload=60629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 03:36:15.354760340 (58h10m9.785840471s) [noise=true , address=104.36.82.61:4407 , piece_id=OOBLCBVIXFUN2432GRXVFDWZEO5FLDJ2EJUW2T7OQIYB5FRN7PQA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122k7b6wa2JhSXMVAhF4qPKA48cWkh3DZRyWuwPEt7Vp3ciofPF): protocol: expected piece hash; context canceled; EOF
Aug 11 03:36:15.354791500 (58h10m9.785871631s) [noise=true , address=104.36.82.35:4584 , piece_id=YGU5SK4MFYVWBZPYURBSPF3SLZCYB6EDZFIIEZCPOUZBT3BFSHGA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TMMXMjWNxBgccLQMbuExNxgwvzQpNH4cizjaPZDufcjvTqdeh): protocol: expected piece hash; context canceled; EOF
Aug 11 03:36:15.354810246 (58h10m9.785890377s) [noise=true , address=104.36.82.38:4713 , piece_id=A3HM5JAMY56234EID2U3KB6KU2OEOQD4SG7QJJO74UIZRS5CU2FA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6e9GSH9aUj8t9T79uLE6p5jPZSnX3cNDLEBHVL88hLqLq2qF): protocol: expected piece hash; context canceled; EOF
Aug 11 03:36:15.354821196 (58h10m9.785901327s) [seg_pos={0 0}, upload=60629]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 03:36:15.354902251 (58h10m9.785982372s) [upload=60629]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 03:36:15.354920777 (58h10m9.786000908s) [upload=60629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 03:36:15.656182984 (58h10m10.087263155s) [upload=60629]: Done uploading segments...
Aug 11 03:36:15.656216277 (58h10m10.087296438s) [upload=60629]: Upload finished. err: <nil>
Duration: 7.264305688s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X....X............................] duration:
6.481130778s
FAIL (2025-08-11 03:38:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.481156868s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............X....X.............X.....................X...] duration:
1.835471432s
FAIL (2025-08-11 03:38:07 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 03:35:59.697389440 (58h9m54.128469571s) [upload=60624]: Starting upload
Aug 11 03:35:59.697433665 (58h9m54.128513796s) [upload=60624]: Done starting upload
Aug 11 03:35:59.697484944 (58h9m54.128565075s) [upload=60624]: Uploading segments...
Aug 11 03:35:59.697523367 (58h9m54.128603488s) [upload=60624]: Got next segment. Inline: true
Aug 11 03:35:59.697527264 (58h9m54.128607395s) [upload=60624]: Waiting for error group managing segments...
Aug 11 03:35:59.697564615 (58h9m54.128644736s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 03:35:59.697568724 (58h9m54.128648855s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 03:35:59.697571459 (58h9m54.12865159s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 03:35:59.988045132 (58h9m54.419125263s) [upload=60624]: Done uploading segments...
Aug 11 03:35:59.988063237 (58h9m54.419143358s) [upload=60624]: Upload finished. err: <nil>
Duration: 1.835514695s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X....X...........................] duration:
6.359283616s
FAIL (2025-08-11 03:38:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.359299587s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.......................X........X...............X......X..X.] duration:
7.174253557s
FAIL (2025-08-11 03:37:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 03:36:11.293271998 (58h10m5.724352149s) [upload=60629]: Starting upload
Aug 11 03:36:11.293353684 (58h10m5.724433835s) [upload=60629]: Done starting upload
Aug 11 03:36:11.293450319 (58h10m5.72453047s) [upload=60629]: Uploading segments...
Aug 11 03:36:11.293638780 (58h10m5.724718921s) [upload=60629]: Got next segment. Inline: false
Aug 11 03:36:11.293690899 (58h10m5.72477105s) [upload=60629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 03:36:11.293696250 (58h10m5.724776391s) [upload=60629]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 03:36:11.736650551 (58h10m6.167730682s) [seg_pos={0 0}, upload=60629]: Begin upload segment...
Aug 11 03:36:11.736692981 (58h10m6.167773112s) [seg_pos={0 0}, upload=60629]: Done begin upload segment.
Aug 11 03:36:11.736719582 (58h10m6.167799713s) [noise=true , address=104.36.82.38:4713 , piece_id=A3HM5JAMY56234EID2U3KB6KU2OEOQD4SG7QJJO74UIZRS5CU2FA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.736760631 (58h10m6.167840762s) [noise=true , address=104.36.82.60:4340 , piece_id=NDQHYROL5EAZCH3SKZSSA4QRBFHK5FQXOYMQGY2CLPFFMEEGIY6A, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.737160706 (58h10m6.168240837s) [noise=true , address=104.36.82.8:4000 , piece_id=TSV3UEAMFKS2GMKGGKYWDVGZJ6S7XEPKIKUGWUKBXH6PWZ5CYYKQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.737249887 (58h10m6.168330018s) [noise=true , address=104.36.82.23:4460 , piece_id=FBMSWNXYPU5VLOYQKVZVTBE2VPP5AZUJV7OP72YCWY2US3YST7RQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.737473185 (58h10m6.168553316s) [noise=true , address=104.36.82.35:4584 , piece_id=YGU5SK4MFYVWBZPYURBSPF3SLZCYB6EDZFIIEZCPOUZBT3BFSHGA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.737546344 (58h10m6.168626465s) [noise=true , address=104.36.82.5:4852 , piece_id=BF3EPWI7433FZQRHOLWVLRMKCWKXOTZV5RZSU4FCJA23ZRKDPLLQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.737763890 (58h10m6.168844011s) [noise=true , address=104.36.82.45:4914 , piece_id=AHUXQAWKOI4UW4467OIHIYAXNINQAMIAQPQ3G5XPUGUVF4GCMHTQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.738099252 (58h10m6.169179373s) [noise=true , address=64.49.13.27:4958 , piece_id=XO6WUEN3VFQAGCLKVDPLVPFALDUBGZQF6VCR7U4YSEHLB2AFSFBQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.738385350 (58h10m6.169465481s) [noise=true , address=104.36.82.61:4407 , piece_id=OOBLCBVIXFUN2432GRXVFDWZEO5FLDJ2EJUW2T7OQIYB5FRN7PQA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.738665666 (58h10m6.169745797s) [noise=true , address=104.36.82.62:4422 , piece_id=VT6NHEQJYPYF4X44GDSEWHUMKX34A6YK2XNXNQSAYUTCW35Y7CHQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.738916115 (58h10m6.169996236s) [noise=true , address=104.36.82.44:4886 , piece_id=ZWRLPZQ73S5JYHBYQ3NOQX6663AZ3AEH4GPZ5FDVKYV4XJYJMTUQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.739140855 (58h10m6.170220986s) [noise=true , address=104.36.82.18:4379 , piece_id=YINW4XPUQ3IXIVPU63WVGQFGMWN6UYAUZLJ5AVAD6LIMGU6FGC5A, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.739378941 (58h10m6.170459072s) [noise=true , address=104.36.82.35:4583 , piece_id=EGEQI2D7C7AHAW6OESRMNO3LMRQKSBE44MQP6KLLOBIUCVUZ7TXQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.739579123 (58h10m6.170659254s) [noise=true , address=104.36.82.17:4346 , piece_id=VIXIJNQKSMUZA27U7EO37XZJEME22NWTL43K4IL5T5YDZZGFVPCA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.739795638 (58h10m6.170875769s) [noise=true , address=77.90.31.15:4724 , piece_id=U4HOU6WCG5LBVXYS46ZHEPF6FZ4NC6J6AO2WBPWRJSWWTOEGTLDA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.739999539 (58h10m6.17107967s) [noise=true , address=104.36.82.36:4632 , piece_id=NIFUBGMPSJGKXTBHLIGF3C4PP5XZCQIGGVSYZQZLXSW55A2ANWJA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.740340500 (58h10m6.171420632s) [noise=true , address=104.36.82.55:4224 , piece_id=Y2XMRPJMTPV6LMVUSJA4RKZVL2UR4K7EYT26GNWJB6DF2HWXQBIQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.740614555 (58h10m6.171694686s) [noise=true , address=104.36.82.45:4938 , piece_id=MVQWOUMSGYLMJUPDXPLVAEZVYGDNUSXLPXDHIYIM3TCO6PPD2G7A, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:12.876917864 (58h10m7.307997995s) [upload=60629]: Next returned nil segment
Aug 11 03:36:12.876935037 (58h10m7.308015168s) [upload=60629]: Waiting for error group managing segments...
Aug 11 03:36:13.164461271 (58h10m7.595541402s) [noise=true , address=64.49.13.27:4958 , piece_id=XO6WUEN3VFQAGCLKVDPLVPFALDUBGZQF6VCR7U4YSEHLB2AFSFBQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.501463266 (58h10m8.932543387s) [noise=true , address=104.36.82.45:4914 , piece_id=AHUXQAWKOI4UW4467OIHIYAXNINQAMIAQPQ3G5XPUGUVF4GCMHTQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.628662400 (58h10m9.059742531s) [noise=true , address=77.90.31.15:4724 , piece_id=U4HOU6WCG5LBVXYS46ZHEPF6FZ4NC6J6AO2WBPWRJSWWTOEGTLDA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.689466359 (58h10m9.12054649s) [noise=true , address=104.36.82.62:4422 , piece_id=VT6NHEQJYPYF4X44GDSEWHUMKX34A6YK2XNXNQSAYUTCW35Y7CHQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.790799273 (58h10m9.221879404s) [noise=true , address=104.36.82.55:4224 , piece_id=Y2XMRPJMTPV6LMVUSJA4RKZVL2UR4K7EYT26GNWJB6DF2HWXQBIQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.898250664 (58h10m9.329330795s) [noise=true , address=104.36.82.17:4346 , piece_id=VIXIJNQKSMUZA27U7EO37XZJEME22NWTL43K4IL5T5YDZZGFVPCA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.900882138 (58h10m9.331962259s) [noise=true , address=104.36.82.44:4886 , piece_id=ZWRLPZQ73S5JYHBYQ3NOQX6663AZ3AEH4GPZ5FDVKYV4XJYJMTUQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.951745036 (58h10m9.382825157s) [noise=true , address=104.36.82.36:4632 , piece_id=NIFUBGMPSJGKXTBHLIGF3C4PP5XZCQIGGVSYZQZLXSW55A2ANWJA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.975320705 (58h10m9.406400836s) [noise=true , address=104.36.82.23:4460 , piece_id=FBMSWNXYPU5VLOYQKVZVTBE2VPP5AZUJV7OP72YCWY2US3YST7RQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.042248690 (58h10m9.473328821s) [noise=true , address=104.36.82.18:4379 , piece_id=YINW4XPUQ3IXIVPU63WVGQFGMWN6UYAUZLJ5AVAD6LIMGU6FGC5A, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.083239740 (58h10m9.514319901s) [noise=true , address=104.36.82.35:4583 , piece_id=EGEQI2D7C7AHAW6OESRMNO3LMRQKSBE44MQP6KLLOBIUCVUZ7TXQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.181940126 (58h10m9.613020257s) [noise=true , address=104.36.82.45:4938 , piece_id=MVQWOUMSGYLMJUPDXPLVAEZVYGDNUSXLPXDHIYIM3TCO6PPD2G7A, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.351448262 (58h10m9.782528394s) [noise=true , address=104.36.82.8:4000 , piece_id=TSV3UEAMFKS2GMKGGKYWDVGZJ6S7XEPKIKUGWUKBXH6PWZ5CYYKQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.354552001 (58h10m9.785632122s) [noise=true , address=104.36.82.5:4852 , piece_id=BF3EPWI7433FZQRHOLWVLRMKCWKXOTZV5RZSU4FCJA23ZRKDPLLQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.354574785 (58h10m9.785654906s) [seg_pos={0 0}, upload=60629]: Segment reached optimal threshold of 14 pieces.
Aug 11 03:36:15.354696428 (58h10m9.785776559s) [noise=true , address=104.36.82.60:4340 , piece_id=NDQHYROL5EAZCH3SKZSSA4QRBFHK5FQXOYMQGY2CLPFFMEEGIY6A, seg_pos={0 0}, upload=60629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 03:36:15.354760340 (58h10m9.785840471s) [noise=true , address=104.36.82.61:4407 , piece_id=OOBLCBVIXFUN2432GRXVFDWZEO5FLDJ2EJUW2T7OQIYB5FRN7PQA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122k7b6wa2JhSXMVAhF4qPKA48cWkh3DZRyWuwPEt7Vp3ciofPF): protocol: expected piece hash; context canceled; EOF
Aug 11 03:36:15.354791500 (58h10m9.785871631s) [noise=true , address=104.36.82.35:4584 , piece_id=YGU5SK4MFYVWBZPYURBSPF3SLZCYB6EDZFIIEZCPOUZBT3BFSHGA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TMMXMjWNxBgccLQMbuExNxgwvzQpNH4cizjaPZDufcjvTqdeh): protocol: expected piece hash; context canceled; EOF
Aug 11 03:36:15.354810246 (58h10m9.785890377s) [noise=true , address=104.36.82.38:4713 , piece_id=A3HM5JAMY56234EID2U3KB6KU2OEOQD4SG7QJJO74UIZRS5CU2FA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6e9GSH9aUj8t9T79uLE6p5jPZSnX3cNDLEBHVL88hLqLq2qF): protocol: expected piece hash; context canceled; EOF
Aug 11 03:36:15.354821196 (58h10m9.785901327s) [seg_pos={0 0}, upload=60629]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 03:36:15.354902251 (58h10m9.785982372s) [upload=60629]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 03:36:15.354920777 (58h10m9.786000908s) [upload=60629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 03:36:15.656182984 (58h10m10.087263155s) [upload=60629]: Done uploading segments...
Aug 11 03:36:15.656216277 (58h10m10.087296438s) [upload=60629]: Upload finished. err: <nil>
Duration: 7.174287052s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X....X..........................] duration:
5.718702753s
FAIL (2025-08-11 03:37:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.718719324s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................X....X.............X.....................X..] duration:
1.882895852s
FAIL (2025-08-11 03:37:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 03:35:59.697389440 (58h9m54.128469571s) [upload=60624]: Starting upload
Aug 11 03:35:59.697433665 (58h9m54.128513796s) [upload=60624]: Done starting upload
Aug 11 03:35:59.697484944 (58h9m54.128565075s) [upload=60624]: Uploading segments...
Aug 11 03:35:59.697523367 (58h9m54.128603488s) [upload=60624]: Got next segment. Inline: true
Aug 11 03:35:59.697527264 (58h9m54.128607395s) [upload=60624]: Waiting for error group managing segments...
Aug 11 03:35:59.697564615 (58h9m54.128644736s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 03:35:59.697568724 (58h9m54.128648855s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 03:35:59.697571459 (58h9m54.12865159s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 03:35:59.988045132 (58h9m54.419125263s) [upload=60624]: Done uploading segments...
Aug 11 03:35:59.988063237 (58h9m54.419143358s) [upload=60624]: Upload finished. err: <nil>
Duration: 1.882932622s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.................X....X.............X.....................X.] duration:
1.809536812s
FAIL (2025-08-11 03:36:35 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 03:35:59.697389440 (58h9m54.128469571s) [upload=60624]: Starting upload
Aug 11 03:35:59.697433665 (58h9m54.128513796s) [upload=60624]: Done starting upload
Aug 11 03:35:59.697484944 (58h9m54.128565075s) [upload=60624]: Uploading segments...
Aug 11 03:35:59.697523367 (58h9m54.128603488s) [upload=60624]: Got next segment. Inline: true
Aug 11 03:35:59.697527264 (58h9m54.128607395s) [upload=60624]: Waiting for error group managing segments...
Aug 11 03:35:59.697564615 (58h9m54.128644736s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 03:35:59.697568724 (58h9m54.128648855s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 03:35:59.697571459 (58h9m54.12865159s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 03:35:59.988045132 (58h9m54.419125263s) [upload=60624]: Done uploading segments...
Aug 11 03:35:59.988063237 (58h9m54.419143358s) [upload=60624]: Upload finished. err: <nil>
Duration: 1.809560437s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X....X.........................] duration:
7.725444171s
FAIL (2025-08-11 03:36:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.725462728s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [........................X........X...............X......X..X] duration:
5.67957254s
FAIL (2025-08-11 03:36:16 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 03:36:11.293271998 (58h10m5.724352149s) [upload=60629]: Starting upload
Aug 11 03:36:11.293353684 (58h10m5.724433835s) [upload=60629]: Done starting upload
Aug 11 03:36:11.293450319 (58h10m5.72453047s) [upload=60629]: Uploading segments...
Aug 11 03:36:11.293638780 (58h10m5.724718921s) [upload=60629]: Got next segment. Inline: false
Aug 11 03:36:11.293690899 (58h10m5.72477105s) [upload=60629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 03:36:11.293696250 (58h10m5.724776391s) [upload=60629]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 03:36:11.736650551 (58h10m6.167730682s) [seg_pos={0 0}, upload=60629]: Begin upload segment...
Aug 11 03:36:11.736692981 (58h10m6.167773112s) [seg_pos={0 0}, upload=60629]: Done begin upload segment.
Aug 11 03:36:11.736719582 (58h10m6.167799713s) [noise=true , address=104.36.82.38:4713 , piece_id=A3HM5JAMY56234EID2U3KB6KU2OEOQD4SG7QJJO74UIZRS5CU2FA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.736760631 (58h10m6.167840762s) [noise=true , address=104.36.82.60:4340 , piece_id=NDQHYROL5EAZCH3SKZSSA4QRBFHK5FQXOYMQGY2CLPFFMEEGIY6A, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.737160706 (58h10m6.168240837s) [noise=true , address=104.36.82.8:4000 , piece_id=TSV3UEAMFKS2GMKGGKYWDVGZJ6S7XEPKIKUGWUKBXH6PWZ5CYYKQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.737249887 (58h10m6.168330018s) [noise=true , address=104.36.82.23:4460 , piece_id=FBMSWNXYPU5VLOYQKVZVTBE2VPP5AZUJV7OP72YCWY2US3YST7RQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.737473185 (58h10m6.168553316s) [noise=true , address=104.36.82.35:4584 , piece_id=YGU5SK4MFYVWBZPYURBSPF3SLZCYB6EDZFIIEZCPOUZBT3BFSHGA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.737546344 (58h10m6.168626465s) [noise=true , address=104.36.82.5:4852 , piece_id=BF3EPWI7433FZQRHOLWVLRMKCWKXOTZV5RZSU4FCJA23ZRKDPLLQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.737763890 (58h10m6.168844011s) [noise=true , address=104.36.82.45:4914 , piece_id=AHUXQAWKOI4UW4467OIHIYAXNINQAMIAQPQ3G5XPUGUVF4GCMHTQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.738099252 (58h10m6.169179373s) [noise=true , address=64.49.13.27:4958 , piece_id=XO6WUEN3VFQAGCLKVDPLVPFALDUBGZQF6VCR7U4YSEHLB2AFSFBQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.738385350 (58h10m6.169465481s) [noise=true , address=104.36.82.61:4407 , piece_id=OOBLCBVIXFUN2432GRXVFDWZEO5FLDJ2EJUW2T7OQIYB5FRN7PQA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.738665666 (58h10m6.169745797s) [noise=true , address=104.36.82.62:4422 , piece_id=VT6NHEQJYPYF4X44GDSEWHUMKX34A6YK2XNXNQSAYUTCW35Y7CHQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.738916115 (58h10m6.169996236s) [noise=true , address=104.36.82.44:4886 , piece_id=ZWRLPZQ73S5JYHBYQ3NOQX6663AZ3AEH4GPZ5FDVKYV4XJYJMTUQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.739140855 (58h10m6.170220986s) [noise=true , address=104.36.82.18:4379 , piece_id=YINW4XPUQ3IXIVPU63WVGQFGMWN6UYAUZLJ5AVAD6LIMGU6FGC5A, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.739378941 (58h10m6.170459072s) [noise=true , address=104.36.82.35:4583 , piece_id=EGEQI2D7C7AHAW6OESRMNO3LMRQKSBE44MQP6KLLOBIUCVUZ7TXQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.739579123 (58h10m6.170659254s) [noise=true , address=104.36.82.17:4346 , piece_id=VIXIJNQKSMUZA27U7EO37XZJEME22NWTL43K4IL5T5YDZZGFVPCA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.739795638 (58h10m6.170875769s) [noise=true , address=77.90.31.15:4724 , piece_id=U4HOU6WCG5LBVXYS46ZHEPF6FZ4NC6J6AO2WBPWRJSWWTOEGTLDA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.739999539 (58h10m6.17107967s) [noise=true , address=104.36.82.36:4632 , piece_id=NIFUBGMPSJGKXTBHLIGF3C4PP5XZCQIGGVSYZQZLXSW55A2ANWJA, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.740340500 (58h10m6.171420632s) [noise=true , address=104.36.82.55:4224 , piece_id=Y2XMRPJMTPV6LMVUSJA4RKZVL2UR4K7EYT26GNWJB6DF2HWXQBIQ, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:11.740614555 (58h10m6.171694686s) [noise=true , address=104.36.82.45:4938 , piece_id=MVQWOUMSGYLMJUPDXPLVAEZVYGDNUSXLPXDHIYIM3TCO6PPD2G7A, seg_pos={0 0}, upload=60629]: Uploading piece...
Aug 11 03:36:12.876917864 (58h10m7.307997995s) [upload=60629]: Next returned nil segment
Aug 11 03:36:12.876935037 (58h10m7.308015168s) [upload=60629]: Waiting for error group managing segments...
Aug 11 03:36:13.164461271 (58h10m7.595541402s) [noise=true , address=64.49.13.27:4958 , piece_id=XO6WUEN3VFQAGCLKVDPLVPFALDUBGZQF6VCR7U4YSEHLB2AFSFBQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.501463266 (58h10m8.932543387s) [noise=true , address=104.36.82.45:4914 , piece_id=AHUXQAWKOI4UW4467OIHIYAXNINQAMIAQPQ3G5XPUGUVF4GCMHTQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.628662400 (58h10m9.059742531s) [noise=true , address=77.90.31.15:4724 , piece_id=U4HOU6WCG5LBVXYS46ZHEPF6FZ4NC6J6AO2WBPWRJSWWTOEGTLDA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.689466359 (58h10m9.12054649s) [noise=true , address=104.36.82.62:4422 , piece_id=VT6NHEQJYPYF4X44GDSEWHUMKX34A6YK2XNXNQSAYUTCW35Y7CHQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.790799273 (58h10m9.221879404s) [noise=true , address=104.36.82.55:4224 , piece_id=Y2XMRPJMTPV6LMVUSJA4RKZVL2UR4K7EYT26GNWJB6DF2HWXQBIQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.898250664 (58h10m9.329330795s) [noise=true , address=104.36.82.17:4346 , piece_id=VIXIJNQKSMUZA27U7EO37XZJEME22NWTL43K4IL5T5YDZZGFVPCA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.900882138 (58h10m9.331962259s) [noise=true , address=104.36.82.44:4886 , piece_id=ZWRLPZQ73S5JYHBYQ3NOQX6663AZ3AEH4GPZ5FDVKYV4XJYJMTUQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.951745036 (58h10m9.382825157s) [noise=true , address=104.36.82.36:4632 , piece_id=NIFUBGMPSJGKXTBHLIGF3C4PP5XZCQIGGVSYZQZLXSW55A2ANWJA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:14.975320705 (58h10m9.406400836s) [noise=true , address=104.36.82.23:4460 , piece_id=FBMSWNXYPU5VLOYQKVZVTBE2VPP5AZUJV7OP72YCWY2US3YST7RQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.042248690 (58h10m9.473328821s) [noise=true , address=104.36.82.18:4379 , piece_id=YINW4XPUQ3IXIVPU63WVGQFGMWN6UYAUZLJ5AVAD6LIMGU6FGC5A, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.083239740 (58h10m9.514319901s) [noise=true , address=104.36.82.35:4583 , piece_id=EGEQI2D7C7AHAW6OESRMNO3LMRQKSBE44MQP6KLLOBIUCVUZ7TXQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.181940126 (58h10m9.613020257s) [noise=true , address=104.36.82.45:4938 , piece_id=MVQWOUMSGYLMJUPDXPLVAEZVYGDNUSXLPXDHIYIM3TCO6PPD2G7A, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.351448262 (58h10m9.782528394s) [noise=true , address=104.36.82.8:4000 , piece_id=TSV3UEAMFKS2GMKGGKYWDVGZJ6S7XEPKIKUGWUKBXH6PWZ5CYYKQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.354552001 (58h10m9.785632122s) [noise=true , address=104.36.82.5:4852 , piece_id=BF3EPWI7433FZQRHOLWVLRMKCWKXOTZV5RZSU4FCJA23ZRKDPLLQ, seg_pos={0 0}, upload=60629]: Done uploading piece. err: <nil>
Aug 11 03:36:15.354574785 (58h10m9.785654906s) [seg_pos={0 0}, upload=60629]: Segment reached optimal threshold of 14 pieces.
Aug 11 03:36:15.354696428 (58h10m9.785776559s) [noise=true , address=104.36.82.60:4340 , piece_id=NDQHYROL5EAZCH3SKZSSA4QRBFHK5FQXOYMQGY2CLPFFMEEGIY6A, seg_pos={0 0}, upload=60629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
Aug 11 03:36:15.354760340 (58h10m9.785840471s) [noise=true , address=104.36.82.61:4407 , piece_id=OOBLCBVIXFUN2432GRXVFDWZEO5FLDJ2EJUW2T7OQIYB5FRN7PQA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122k7b6wa2JhSXMVAhF4qPKA48cWkh3DZRyWuwPEt7Vp3ciofPF): protocol: expected piece hash; context canceled; EOF
Aug 11 03:36:15.354791500 (58h10m9.785871631s) [noise=true , address=104.36.82.35:4584 , piece_id=YGU5SK4MFYVWBZPYURBSPF3SLZCYB6EDZFIIEZCPOUZBT3BFSHGA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TMMXMjWNxBgccLQMbuExNxgwvzQpNH4cizjaPZDufcjvTqdeh): protocol: expected piece hash; context canceled; EOF
Aug 11 03:36:15.354810246 (58h10m9.785890377s) [noise=true , address=104.36.82.38:4713 , piece_id=A3HM5JAMY56234EID2U3KB6KU2OEOQD4SG7QJJO74UIZRS5CU2FA, seg_pos={0 0}, upload=60629]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6e9GSH9aUj8t9T79uLE6p5jPZSnX3cNDLEBHVL88hLqLq2qF): protocol: expected piece hash; context canceled; EOF
Aug 11 03:36:15.354821196 (58h10m9.785901327s) [seg_pos={0 0}, upload=60629]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 03:36:15.354902251 (58h10m9.785982372s) [upload=60629]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 03:36:15.354920777 (58h10m9.786000908s) [upload=60629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 03:36:15.656182984 (58h10m10.087263155s) [upload=60629]: Done uploading segments...
Aug 11 03:36:15.656216277 (58h10m10.087296438s) [upload=60629]: Upload finished. err: <nil>
Duration: 5.679598951s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X.................X....X.............X.....................X] duration:
1.608702756s
FAIL (2025-08-11 03:36:00 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 03:35:59.697389440 (58h9m54.128469571s) [upload=60624]: Starting upload
Aug 11 03:35:59.697433665 (58h9m54.128513796s) [upload=60624]: Done starting upload
Aug 11 03:35:59.697484944 (58h9m54.128565075s) [upload=60624]: Uploading segments...
Aug 11 03:35:59.697523367 (58h9m54.128603488s) [upload=60624]: Got next segment. Inline: true
Aug 11 03:35:59.697527264 (58h9m54.128607395s) [upload=60624]: Waiting for error group managing segments...
Aug 11 03:35:59.697564615 (58h9m54.128644736s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 03:35:59.697568724 (58h9m54.128648855s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 03:35:59.697571459 (58h9m54.12865159s) [upload=60624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 03:35:59.988045132 (58h9m54.419125263s) [upload=60624]: Done uploading segments...
Aug 11 03:35:59.988063237 (58h9m54.419143358s) [upload=60624]: Upload finished. err: <nil>
Duration: 1.608728196s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........................X........X...............X......X..] duration:
9.656869145s
FAIL (2025-08-11 03:35:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ebc04368416eb69cb9000beed409b90b5a5fd9d3314b60e0645111b5c47c9729 != before 3c3a86e768e739a21e9f66c297f51eae0cc04639fd69ecefc379968875e56331
======LOGS======
Aug 11 03:33:44.086099310 (58h7m38.517179621s) [upload=60588]: Starting upload
Aug 11 03:33:44.086157070 (58h7m38.517237201s) [upload=60588]: Done starting upload
Aug 11 03:33:44.086240269 (58h7m38.51732039s) [upload=60588]: Uploading segments...
Aug 11 03:33:44.086344940 (58h7m38.517425071s) [upload=60588]: Got next segment. Inline: false
Aug 11 03:33:44.086395096 (58h7m38.517475217s) [upload=60588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 03:33:44.086399614 (58h7m38.517479745s) [upload=60588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 03:33:44.532569336 (58h7m38.963649457s) [seg_pos={0 0}, upload=60588]: Begin upload segment...
Aug 11 03:33:44.532611367 (58h7m38.963691488s) [seg_pos={0 0}, upload=60588]: Done begin upload segment.
Aug 11 03:33:44.532632076 (58h7m38.963712207s) [noise=true , address=104.36.82.8:4995 , piece_id=66PZLQLFIUZIWGF6337GOCYYBYRSF4WCOJWMG2F52PGMWIWR5KQQ, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.532683384 (58h7m38.963763515s) [noise=true , address=104.36.82.4:4810 , piece_id=TQ7UZJHH7FUGY2DB7QSZYIUTY6HDD4AKHZ7UANBC4ECO5ZKS55AA, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.532995823 (58h7m38.964075954s) [noise=true , address=104.36.82.45:4911 , piece_id=RUJ2JBTM67OWQ26RZM2MX2WHLLNWORQRSFN3QSOO4YUYY4IEB4LQ, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.533251031 (58h7m38.964331162s) [noise=true , address=104.36.82.37:4674 , piece_id=SX2YLOYSRNJWIJAFHJX6R6DVDEGP6DMHLQOMVKUNDBRYRZ67BT6A, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.533313901 (58h7m38.964394032s) [noise=true , address=104.36.82.5:4857 , piece_id=J4TGECVA4B5DOLZ6SRICUCNYJJS52ACIIEVKFVINB2Z6DRGX3ULA, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.533629595 (58h7m38.964709726s) [noise=true , address=104.36.82.61:4383 , piece_id=UXRBJSBBEP43GBUPP7OLQDA3VPUDAXXBE75OJ2COVEMSXPUCJX2Q, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.533677877 (58h7m38.964758008s) [noise=true , address=79.127.220.98:4413 , piece_id=YGSUG7IVQNH6BIUVJ452HUZVYGF6WK5HAME7QGXDHKN6JD6KQBNQ, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.533984544 (58h7m38.965064665s) [noise=true , address=104.36.82.44:4871 , piece_id=LGA4FFPO6HII6PXURDO2S65EUVBF56QEVBKFEM3AR7HJED6T56WQ, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.534029229 (58h7m38.96510936s) [noise=true , address=104.36.82.14:4248 , piece_id=Y7CMDI67KTVIBZ4MTIQ3LNPOB43SJ6XC6GWEDYYUQEHQCXNOLUIA, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.534224292 (58h7m38.965304423s) [noise=true , address=79.127.201.215:4357 , piece_id=TGDAJIG7N4SC4FVRUE5K5QBHN2E6NIUSVXST77DHGCODRRUNF64Q, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.534366094 (58h7m38.965446225s) [noise=true , address=104.36.82.47:4533 , piece_id=EOHRJ2ZGSW4ZQVQXKZ5KW5TZULXX4BFP5WMV76GSQF43MSGEKJYA, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.534433062 (58h7m38.965513193s) [noise=true , address=104.36.82.59:4314 , piece_id=ZYOGQW66G3MGVJ3YH6IXN7J37OHLCDC2H4PCQZWPD3XK5QZMZZWQ, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.534646371 (58h7m38.965726502s) [noise=true , address=104.36.82.34:4574 , piece_id=CVWW2FNULWXHPUQDMUNPET54U63T44TEE7RCBYQDMSMSXMFMLX6Q, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.534691206 (58h7m38.965771337s) [noise=true , address=104.36.82.38:4696 , piece_id=WEBZK5A7C5YLIMARGLVVICCVMASOHEMQIILSWRDAU2GSEKWKDV3Q, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.534855380 (58h7m38.965935511s) [noise=true , address=104.36.82.13:4210 , piece_id=G3P6STIZAZAKM5AV3FV4MBEQRSF62JGPUUFIXYZ7PKFWO24OVC3Q, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.535011920 (58h7m38.966092041s) [noise=true , address=79.127.219.51:4182 , piece_id=5OLEWM5RXSGV5G7CCUE35TS5DKL2C6EIQON7EDMYZC3HHQYRDL6Q, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.535069871 (58h7m38.966150002s) [noise=true , address=104.36.82.36:4637 , piece_id=32DUVUE3CXRPZDQLT3YT4SNDTCSNM7OLNR6PXHPQ62HMGSBJ62YA, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.535324487 (58h7m38.966404618s) [noise=true , address=104.36.82.19:4418 , piece_id=3GNFTD4KZYK47U55DKFLEW5NZS72HEQXTA7UMDFGE5WQZVE72RCQ, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:46.005634485 (58h7m40.436714616s) [upload=60588]: Next returned nil segment
Aug 11 03:33:46.005651317 (58h7m40.436731458s) [upload=60588]: Waiting for error group managing segments...
Aug 11 03:33:46.405921528 (58h7m40.83700166s) [noise=true , address=79.127.219.51:4182 , piece_id=5OLEWM5RXSGV5G7CCUE35TS5DKL2C6EIQON7EDMYZC3HHQYRDL6Q, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:46.406070724 (58h7m40.837150855s) [noise=true , address=79.127.220.98:4413 , piece_id=YGSUG7IVQNH6BIUVJ452HUZVYGF6WK5HAME7QGXDHKN6JD6KQBNQ, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:46.488043174 (58h7m40.919123305s) [noise=true , address=79.127.201.215:4357 , piece_id=TGDAJIG7N4SC4FVRUE5K5QBHN2E6NIUSVXST77DHGCODRRUNF64Q, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:46.694181877 (58h7m41.125262008s) [noise=true , address=104.36.82.37:4674 , piece_id=SX2YLOYSRNJWIJAFHJX6R6DVDEGP6DMHLQOMVKUNDBRYRZ67BT6A, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:46.722998623 (58h7m41.154078754s) [noise=true , address=104.36.82.36:4637 , piece_id=32DUVUE3CXRPZDQLT3YT4SNDTCSNM7OLNR6PXHPQ62HMGSBJ62YA, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:46.807792793 (58h7m41.238872914s) [noise=true , address=104.36.82.44:4871 , piece_id=LGA4FFPO6HII6PXURDO2S65EUVBF56QEVBKFEM3AR7HJED6T56WQ, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.381778051 (58h7m41.812858182s) [noise=true , address=104.36.82.19:4418 , piece_id=3GNFTD4KZYK47U55DKFLEW5NZS72HEQXTA7UMDFGE5WQZVE72RCQ, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.397081552 (58h7m41.828161673s) [noise=true , address=104.36.82.14:4248 , piece_id=Y7CMDI67KTVIBZ4MTIQ3LNPOB43SJ6XC6GWEDYYUQEHQCXNOLUIA, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.448601637 (58h7m41.879681758s) [noise=true , address=104.36.82.13:4210 , piece_id=G3P6STIZAZAKM5AV3FV4MBEQRSF62JGPUUFIXYZ7PKFWO24OVC3Q, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.479168171 (58h7m41.910248302s) [noise=true , address=104.36.82.8:4995 , piece_id=66PZLQLFIUZIWGF6337GOCYYBYRSF4WCOJWMG2F52PGMWIWR5KQQ, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.493696027 (58h7m41.924776158s) [noise=true , address=104.36.82.5:4857 , piece_id=J4TGECVA4B5DOLZ6SRICUCNYJJS52ACIIEVKFVINB2Z6DRGX3ULA, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.536652247 (58h7m41.967732378s) [noise=true , address=104.36.82.38:4696 , piece_id=WEBZK5A7C5YLIMARGLVVICCVMASOHEMQIILSWRDAU2GSEKWKDV3Q, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.620565632 (58h7m42.051645763s) [noise=true , address=104.36.82.4:4810 , piece_id=TQ7UZJHH7FUGY2DB7QSZYIUTY6HDD4AKHZ7UANBC4ECO5ZKS55AA, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.767239639 (58h7m42.19831982s) [noise=true , address=104.36.82.34:4574 , piece_id=CVWW2FNULWXHPUQDMUNPET54U63T44TEE7RCBYQDMSMSXMFMLX6Q, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.767273584 (58h7m42.198353745s) [seg_pos={0 0}, upload=60588]: Segment reached optimal threshold of 14 pieces.
Aug 11 03:33:47.767418140 (58h7m42.198498271s) [noise=true , address=104.36.82.47:4533 , piece_id=EOHRJ2ZGSW4ZQVQXKZ5KW5TZULXX4BFP5WMV76GSQF43MSGEKJYA, seg_pos={0 0}, upload=60588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JUUdAnaUPAE8tkzPvVCokFbZMwmhqZvwKHXReK9VU2QeDqavR): protocol: expected piece hash; context canceled; EOF
Aug 11 03:33:47.767467835 (58h7m42.198547966s) [noise=true , address=104.36.82.45:4911 , piece_id=RUJ2JBTM67OWQ26RZM2MX2WHLLNWORQRSFN3QSOO4YUYY4IEB4LQ, seg_pos={0 0}, upload=60588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mzM4hseStJYeWqqm29qGjdaKkxydqFsKaKwNFrywGpDWSwFDQ): protocol: expected piece hash; context canceled; EOF
Aug 11 03:33:47.767509976 (58h7m42.198590107s) [noise=true , address=104.36.82.61:4383 , piece_id=UXRBJSBBEP43GBUPP7OLQDA3VPUDAXXBE75OJ2COVEMSXPUCJX2Q, seg_pos={0 0}, upload=60588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N24q6Li2xavkE61KntNxDPwQzTVHaG4LxyEqFUT1hhGYNQ9mp): protocol: expected piece hash; context canceled; EOF
Aug 11 03:33:47.767638962 (58h7m42.198719114s) [noise=true , address=104.36.82.59:4314 , piece_id=ZYOGQW66G3MGVJ3YH6IXN7J37OHLCDC2H4PCQZWPD3XK5QZMZZWQ, seg_pos={0 0}, upload=60588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: write tcp 188.166.225.170:60900->104.36.82.59:4314: use of closed network connection; write tcp 188.166.225.170:60900->104.36.82.59:4314: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->104.36.82.59:4314: use of closed network connection
Aug 11 03:33:47.767662858 (58h7m42.198742989s) [seg_pos={0 0}, upload=60588]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 03:33:47.767754965 (58h7m42.198835096s) [upload=60588]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 03:33:47.767761558 (58h7m42.198841689s) [upload=60588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 03:33:48.069415192 (58h7m42.500495323s) [upload=60588]: Done uploading segments...
Aug 11 03:33:48.069433637 (58h7m42.500513768s) [upload=60588]: Upload finished. err: <nil>
Duration: 9.656900155s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X....X........................] duration:
6.02691954s
FAIL (2025-08-11 03:35:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.026948384s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X....X.......................] duration:
8.385854015s
FAIL (2025-08-11 03:35:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 8.385889874s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X.................X....X.............X.....................] duration:
2.004600335s
FAIL (2025-08-11 03:35:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 509b491301fe4a2414703b6765da796dd548f9d2c6b24ad3529ce3351b142193 != before 91135a8730ae486bfd4199b43ecc728ba6e645e71181b3c44236f1d881e4575b ======LOGS====== Aug 11 03:18:11.216659207 (57h52m5.647739338s) [upload=60319]: Starting upload Aug 11 03:18:11.216716727 (57h52m5.647796858s) [upload=60319]: Done starting upload Aug 11 03:18:11.216782834 (57h52m5.647862965s) [upload=60319]: Uploading segments... Aug 11 03:18:11.216821648 (57h52m5.647901769s) [upload=60319]: Got next segment. Inline: true Aug 11 03:18:11.216825275 (57h52m5.647905396s) [upload=60319]: Waiting for error group managing segments... Aug 11 03:18:11.216857146 (57h52m5.647937277s) [upload=60319]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:18:11.216861033 (57h52m5.647941164s) [upload=60319]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:18:11.216863869 (57h52m5.647944001s) [upload=60319]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:18:11.492059343 (57h52m5.923139485s) [upload=60319]: Done uploading segments... Aug 11 03:18:11.492080735 (57h52m5.923160856s) [upload=60319]: Upload finished. err: <nil>
Duration: 2.004631054s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........................X........X...............X......X.] duration:
6.948919003s
FAIL (2025-08-11 03:35:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ebc04368416eb69cb9000beed409b90b5a5fd9d3314b60e0645111b5c47c9729 != before 3c3a86e768e739a21e9f66c297f51eae0cc04639fd69ecefc379968875e56331
======LOGS======
Aug 11 03:33:44.086099310 (58h7m38.517179621s) [upload=60588]: Starting upload
Aug 11 03:33:44.086157070 (58h7m38.517237201s) [upload=60588]: Done starting upload
Aug 11 03:33:44.086240269 (58h7m38.51732039s) [upload=60588]: Uploading segments...
Aug 11 03:33:44.086344940 (58h7m38.517425071s) [upload=60588]: Got next segment. Inline: false
Aug 11 03:33:44.086395096 (58h7m38.517475217s) [upload=60588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 03:33:44.086399614 (58h7m38.517479745s) [upload=60588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 03:33:44.532569336 (58h7m38.963649457s) [seg_pos={0 0}, upload=60588]: Begin upload segment...
Aug 11 03:33:44.532611367 (58h7m38.963691488s) [seg_pos={0 0}, upload=60588]: Done begin upload segment.
Aug 11 03:33:44.532632076 (58h7m38.963712207s) [noise=true , address=104.36.82.8:4995 , piece_id=66PZLQLFIUZIWGF6337GOCYYBYRSF4WCOJWMG2F52PGMWIWR5KQQ, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.532683384 (58h7m38.963763515s) [noise=true , address=104.36.82.4:4810 , piece_id=TQ7UZJHH7FUGY2DB7QSZYIUTY6HDD4AKHZ7UANBC4ECO5ZKS55AA, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.532995823 (58h7m38.964075954s) [noise=true , address=104.36.82.45:4911 , piece_id=RUJ2JBTM67OWQ26RZM2MX2WHLLNWORQRSFN3QSOO4YUYY4IEB4LQ, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.533251031 (58h7m38.964331162s) [noise=true , address=104.36.82.37:4674 , piece_id=SX2YLOYSRNJWIJAFHJX6R6DVDEGP6DMHLQOMVKUNDBRYRZ67BT6A, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.533313901 (58h7m38.964394032s) [noise=true , address=104.36.82.5:4857 , piece_id=J4TGECVA4B5DOLZ6SRICUCNYJJS52ACIIEVKFVINB2Z6DRGX3ULA, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.533629595 (58h7m38.964709726s) [noise=true , address=104.36.82.61:4383 , piece_id=UXRBJSBBEP43GBUPP7OLQDA3VPUDAXXBE75OJ2COVEMSXPUCJX2Q, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.533677877 (58h7m38.964758008s) [noise=true , address=79.127.220.98:4413 , piece_id=YGSUG7IVQNH6BIUVJ452HUZVYGF6WK5HAME7QGXDHKN6JD6KQBNQ, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.533984544 (58h7m38.965064665s) [noise=true , address=104.36.82.44:4871 , piece_id=LGA4FFPO6HII6PXURDO2S65EUVBF56QEVBKFEM3AR7HJED6T56WQ, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.534029229 (58h7m38.96510936s) [noise=true , address=104.36.82.14:4248 , piece_id=Y7CMDI67KTVIBZ4MTIQ3LNPOB43SJ6XC6GWEDYYUQEHQCXNOLUIA, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.534224292 (58h7m38.965304423s) [noise=true , address=79.127.201.215:4357 , piece_id=TGDAJIG7N4SC4FVRUE5K5QBHN2E6NIUSVXST77DHGCODRRUNF64Q, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.534366094 (58h7m38.965446225s) [noise=true , address=104.36.82.47:4533 , piece_id=EOHRJ2ZGSW4ZQVQXKZ5KW5TZULXX4BFP5WMV76GSQF43MSGEKJYA, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.534433062 (58h7m38.965513193s) [noise=true , address=104.36.82.59:4314 , piece_id=ZYOGQW66G3MGVJ3YH6IXN7J37OHLCDC2H4PCQZWPD3XK5QZMZZWQ, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.534646371 (58h7m38.965726502s) [noise=true , address=104.36.82.34:4574 , piece_id=CVWW2FNULWXHPUQDMUNPET54U63T44TEE7RCBYQDMSMSXMFMLX6Q, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.534691206 (58h7m38.965771337s) [noise=true , address=104.36.82.38:4696 , piece_id=WEBZK5A7C5YLIMARGLVVICCVMASOHEMQIILSWRDAU2GSEKWKDV3Q, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.534855380 (58h7m38.965935511s) [noise=true , address=104.36.82.13:4210 , piece_id=G3P6STIZAZAKM5AV3FV4MBEQRSF62JGPUUFIXYZ7PKFWO24OVC3Q, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.535011920 (58h7m38.966092041s) [noise=true , address=79.127.219.51:4182 , piece_id=5OLEWM5RXSGV5G7CCUE35TS5DKL2C6EIQON7EDMYZC3HHQYRDL6Q, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.535069871 (58h7m38.966150002s) [noise=true , address=104.36.82.36:4637 , piece_id=32DUVUE3CXRPZDQLT3YT4SNDTCSNM7OLNR6PXHPQ62HMGSBJ62YA, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.535324487 (58h7m38.966404618s) [noise=true , address=104.36.82.19:4418 , piece_id=3GNFTD4KZYK47U55DKFLEW5NZS72HEQXTA7UMDFGE5WQZVE72RCQ, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:46.005634485 (58h7m40.436714616s) [upload=60588]: Next returned nil segment
Aug 11 03:33:46.005651317 (58h7m40.436731458s) [upload=60588]: Waiting for error group managing segments...
Aug 11 03:33:46.405921528 (58h7m40.83700166s) [noise=true , address=79.127.219.51:4182 , piece_id=5OLEWM5RXSGV5G7CCUE35TS5DKL2C6EIQON7EDMYZC3HHQYRDL6Q, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:46.406070724 (58h7m40.837150855s) [noise=true , address=79.127.220.98:4413 , piece_id=YGSUG7IVQNH6BIUVJ452HUZVYGF6WK5HAME7QGXDHKN6JD6KQBNQ, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:46.488043174 (58h7m40.919123305s) [noise=true , address=79.127.201.215:4357 , piece_id=TGDAJIG7N4SC4FVRUE5K5QBHN2E6NIUSVXST77DHGCODRRUNF64Q, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:46.694181877 (58h7m41.125262008s) [noise=true , address=104.36.82.37:4674 , piece_id=SX2YLOYSRNJWIJAFHJX6R6DVDEGP6DMHLQOMVKUNDBRYRZ67BT6A, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:46.722998623 (58h7m41.154078754s) [noise=true , address=104.36.82.36:4637 , piece_id=32DUVUE3CXRPZDQLT3YT4SNDTCSNM7OLNR6PXHPQ62HMGSBJ62YA, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:46.807792793 (58h7m41.238872914s) [noise=true , address=104.36.82.44:4871 , piece_id=LGA4FFPO6HII6PXURDO2S65EUVBF56QEVBKFEM3AR7HJED6T56WQ, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.381778051 (58h7m41.812858182s) [noise=true , address=104.36.82.19:4418 , piece_id=3GNFTD4KZYK47U55DKFLEW5NZS72HEQXTA7UMDFGE5WQZVE72RCQ, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.397081552 (58h7m41.828161673s) [noise=true , address=104.36.82.14:4248 , piece_id=Y7CMDI67KTVIBZ4MTIQ3LNPOB43SJ6XC6GWEDYYUQEHQCXNOLUIA, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.448601637 (58h7m41.879681758s) [noise=true , address=104.36.82.13:4210 , piece_id=G3P6STIZAZAKM5AV3FV4MBEQRSF62JGPUUFIXYZ7PKFWO24OVC3Q, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.479168171 (58h7m41.910248302s) [noise=true , address=104.36.82.8:4995 , piece_id=66PZLQLFIUZIWGF6337GOCYYBYRSF4WCOJWMG2F52PGMWIWR5KQQ, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.493696027 (58h7m41.924776158s) [noise=true , address=104.36.82.5:4857 , piece_id=J4TGECVA4B5DOLZ6SRICUCNYJJS52ACIIEVKFVINB2Z6DRGX3ULA, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.536652247 (58h7m41.967732378s) [noise=true , address=104.36.82.38:4696 , piece_id=WEBZK5A7C5YLIMARGLVVICCVMASOHEMQIILSWRDAU2GSEKWKDV3Q, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.620565632 (58h7m42.051645763s) [noise=true , address=104.36.82.4:4810 , piece_id=TQ7UZJHH7FUGY2DB7QSZYIUTY6HDD4AKHZ7UANBC4ECO5ZKS55AA, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.767239639 (58h7m42.19831982s) [noise=true , address=104.36.82.34:4574 , piece_id=CVWW2FNULWXHPUQDMUNPET54U63T44TEE7RCBYQDMSMSXMFMLX6Q, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.767273584 (58h7m42.198353745s) [seg_pos={0 0}, upload=60588]: Segment reached optimal threshold of 14 pieces.
Aug 11 03:33:47.767418140 (58h7m42.198498271s) [noise=true , address=104.36.82.47:4533 , piece_id=EOHRJ2ZGSW4ZQVQXKZ5KW5TZULXX4BFP5WMV76GSQF43MSGEKJYA, seg_pos={0 0}, upload=60588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JUUdAnaUPAE8tkzPvVCokFbZMwmhqZvwKHXReK9VU2QeDqavR): protocol: expected piece hash; context canceled; EOF
Aug 11 03:33:47.767467835 (58h7m42.198547966s) [noise=true , address=104.36.82.45:4911 , piece_id=RUJ2JBTM67OWQ26RZM2MX2WHLLNWORQRSFN3QSOO4YUYY4IEB4LQ, seg_pos={0 0}, upload=60588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mzM4hseStJYeWqqm29qGjdaKkxydqFsKaKwNFrywGpDWSwFDQ): protocol: expected piece hash; context canceled; EOF
Aug 11 03:33:47.767509976 (58h7m42.198590107s) [noise=true , address=104.36.82.61:4383 , piece_id=UXRBJSBBEP43GBUPP7OLQDA3VPUDAXXBE75OJ2COVEMSXPUCJX2Q, seg_pos={0 0}, upload=60588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N24q6Li2xavkE61KntNxDPwQzTVHaG4LxyEqFUT1hhGYNQ9mp): protocol: expected piece hash; context canceled; EOF
Aug 11 03:33:47.767638962 (58h7m42.198719114s) [noise=true , address=104.36.82.59:4314 , piece_id=ZYOGQW66G3MGVJ3YH6IXN7J37OHLCDC2H4PCQZWPD3XK5QZMZZWQ, seg_pos={0 0}, upload=60588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: write tcp 188.166.225.170:60900->104.36.82.59:4314: use of closed network connection; write tcp 188.166.225.170:60900->104.36.82.59:4314: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->104.36.82.59:4314: use of closed network connection
Aug 11 03:33:47.767662858 (58h7m42.198742989s) [seg_pos={0 0}, upload=60588]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 03:33:47.767754965 (58h7m42.198835096s) [upload=60588]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 03:33:47.767761558 (58h7m42.198841689s) [upload=60588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 03:33:48.069415192 (58h7m42.500495323s) [upload=60588]: Done uploading segments...
Aug 11 03:33:48.069433637 (58h7m42.500513768s) [upload=60588]: Upload finished. err: <nil>
Duration: 6.948945163s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X.................X....X.............X....................] duration:
1.834873157s
FAIL (2025-08-11 03:34:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 509b491301fe4a2414703b6765da796dd548f9d2c6b24ad3529ce3351b142193 != before 91135a8730ae486bfd4199b43ecc728ba6e645e71181b3c44236f1d881e4575b ======LOGS====== Aug 11 03:18:11.216659207 (57h52m5.647739338s) [upload=60319]: Starting upload Aug 11 03:18:11.216716727 (57h52m5.647796858s) [upload=60319]: Done starting upload Aug 11 03:18:11.216782834 (57h52m5.647862965s) [upload=60319]: Uploading segments... Aug 11 03:18:11.216821648 (57h52m5.647901769s) [upload=60319]: Got next segment. Inline: true Aug 11 03:18:11.216825275 (57h52m5.647905396s) [upload=60319]: Waiting for error group managing segments... Aug 11 03:18:11.216857146 (57h52m5.647937277s) [upload=60319]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:18:11.216861033 (57h52m5.647941164s) [upload=60319]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:18:11.216863869 (57h52m5.647944001s) [upload=60319]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:18:11.492059343 (57h52m5.923139485s) [upload=60319]: Done uploading segments... Aug 11 03:18:11.492080735 (57h52m5.923160856s) [upload=60319]: Upload finished. err: <nil>
Duration: 1.834894237s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................X....X......................] duration:
5.914345639s
FAIL (2025-08-11 03:34:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.914364947s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X.................X....X.............X...................] duration:
1.831802836s
FAIL (2025-08-11 03:34:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 509b491301fe4a2414703b6765da796dd548f9d2c6b24ad3529ce3351b142193 != before 91135a8730ae486bfd4199b43ecc728ba6e645e71181b3c44236f1d881e4575b ======LOGS====== Aug 11 03:18:11.216659207 (57h52m5.647739338s) [upload=60319]: Starting upload Aug 11 03:18:11.216716727 (57h52m5.647796858s) [upload=60319]: Done starting upload Aug 11 03:18:11.216782834 (57h52m5.647862965s) [upload=60319]: Uploading segments... Aug 11 03:18:11.216821648 (57h52m5.647901769s) [upload=60319]: Got next segment. Inline: true Aug 11 03:18:11.216825275 (57h52m5.647905396s) [upload=60319]: Waiting for error group managing segments... Aug 11 03:18:11.216857146 (57h52m5.647937277s) [upload=60319]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:18:11.216861033 (57h52m5.647941164s) [upload=60319]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:18:11.216863869 (57h52m5.647944001s) [upload=60319]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:18:11.492059343 (57h52m5.923139485s) [upload=60319]: Done uploading segments... Aug 11 03:18:11.492080735 (57h52m5.923160856s) [upload=60319]: Upload finished. err: <nil>
Duration: 1.831829936s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........................X........X...............X......X] duration:
6.943465644s
FAIL (2025-08-11 03:33:50 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ebc04368416eb69cb9000beed409b90b5a5fd9d3314b60e0645111b5c47c9729 != before 3c3a86e768e739a21e9f66c297f51eae0cc04639fd69ecefc379968875e56331
======LOGS======
Aug 11 03:33:44.086099310 (58h7m38.517179621s) [upload=60588]: Starting upload
Aug 11 03:33:44.086157070 (58h7m38.517237201s) [upload=60588]: Done starting upload
Aug 11 03:33:44.086240269 (58h7m38.51732039s) [upload=60588]: Uploading segments...
Aug 11 03:33:44.086344940 (58h7m38.517425071s) [upload=60588]: Got next segment. Inline: false
Aug 11 03:33:44.086395096 (58h7m38.517475217s) [upload=60588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 03:33:44.086399614 (58h7m38.517479745s) [upload=60588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 03:33:44.532569336 (58h7m38.963649457s) [seg_pos={0 0}, upload=60588]: Begin upload segment...
Aug 11 03:33:44.532611367 (58h7m38.963691488s) [seg_pos={0 0}, upload=60588]: Done begin upload segment.
Aug 11 03:33:44.532632076 (58h7m38.963712207s) [noise=true , address=104.36.82.8:4995 , piece_id=66PZLQLFIUZIWGF6337GOCYYBYRSF4WCOJWMG2F52PGMWIWR5KQQ, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.532683384 (58h7m38.963763515s) [noise=true , address=104.36.82.4:4810 , piece_id=TQ7UZJHH7FUGY2DB7QSZYIUTY6HDD4AKHZ7UANBC4ECO5ZKS55AA, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.532995823 (58h7m38.964075954s) [noise=true , address=104.36.82.45:4911 , piece_id=RUJ2JBTM67OWQ26RZM2MX2WHLLNWORQRSFN3QSOO4YUYY4IEB4LQ, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.533251031 (58h7m38.964331162s) [noise=true , address=104.36.82.37:4674 , piece_id=SX2YLOYSRNJWIJAFHJX6R6DVDEGP6DMHLQOMVKUNDBRYRZ67BT6A, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.533313901 (58h7m38.964394032s) [noise=true , address=104.36.82.5:4857 , piece_id=J4TGECVA4B5DOLZ6SRICUCNYJJS52ACIIEVKFVINB2Z6DRGX3ULA, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.533629595 (58h7m38.964709726s) [noise=true , address=104.36.82.61:4383 , piece_id=UXRBJSBBEP43GBUPP7OLQDA3VPUDAXXBE75OJ2COVEMSXPUCJX2Q, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.533677877 (58h7m38.964758008s) [noise=true , address=79.127.220.98:4413 , piece_id=YGSUG7IVQNH6BIUVJ452HUZVYGF6WK5HAME7QGXDHKN6JD6KQBNQ, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.533984544 (58h7m38.965064665s) [noise=true , address=104.36.82.44:4871 , piece_id=LGA4FFPO6HII6PXURDO2S65EUVBF56QEVBKFEM3AR7HJED6T56WQ, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.534029229 (58h7m38.96510936s) [noise=true , address=104.36.82.14:4248 , piece_id=Y7CMDI67KTVIBZ4MTIQ3LNPOB43SJ6XC6GWEDYYUQEHQCXNOLUIA, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.534224292 (58h7m38.965304423s) [noise=true , address=79.127.201.215:4357 , piece_id=TGDAJIG7N4SC4FVRUE5K5QBHN2E6NIUSVXST77DHGCODRRUNF64Q, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.534366094 (58h7m38.965446225s) [noise=true , address=104.36.82.47:4533 , piece_id=EOHRJ2ZGSW4ZQVQXKZ5KW5TZULXX4BFP5WMV76GSQF43MSGEKJYA, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.534433062 (58h7m38.965513193s) [noise=true , address=104.36.82.59:4314 , piece_id=ZYOGQW66G3MGVJ3YH6IXN7J37OHLCDC2H4PCQZWPD3XK5QZMZZWQ, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.534646371 (58h7m38.965726502s) [noise=true , address=104.36.82.34:4574 , piece_id=CVWW2FNULWXHPUQDMUNPET54U63T44TEE7RCBYQDMSMSXMFMLX6Q, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.534691206 (58h7m38.965771337s) [noise=true , address=104.36.82.38:4696 , piece_id=WEBZK5A7C5YLIMARGLVVICCVMASOHEMQIILSWRDAU2GSEKWKDV3Q, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.534855380 (58h7m38.965935511s) [noise=true , address=104.36.82.13:4210 , piece_id=G3P6STIZAZAKM5AV3FV4MBEQRSF62JGPUUFIXYZ7PKFWO24OVC3Q, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.535011920 (58h7m38.966092041s) [noise=true , address=79.127.219.51:4182 , piece_id=5OLEWM5RXSGV5G7CCUE35TS5DKL2C6EIQON7EDMYZC3HHQYRDL6Q, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.535069871 (58h7m38.966150002s) [noise=true , address=104.36.82.36:4637 , piece_id=32DUVUE3CXRPZDQLT3YT4SNDTCSNM7OLNR6PXHPQ62HMGSBJ62YA, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:44.535324487 (58h7m38.966404618s) [noise=true , address=104.36.82.19:4418 , piece_id=3GNFTD4KZYK47U55DKFLEW5NZS72HEQXTA7UMDFGE5WQZVE72RCQ, seg_pos={0 0}, upload=60588]: Uploading piece...
Aug 11 03:33:46.005634485 (58h7m40.436714616s) [upload=60588]: Next returned nil segment
Aug 11 03:33:46.005651317 (58h7m40.436731458s) [upload=60588]: Waiting for error group managing segments...
Aug 11 03:33:46.405921528 (58h7m40.83700166s) [noise=true , address=79.127.219.51:4182 , piece_id=5OLEWM5RXSGV5G7CCUE35TS5DKL2C6EIQON7EDMYZC3HHQYRDL6Q, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:46.406070724 (58h7m40.837150855s) [noise=true , address=79.127.220.98:4413 , piece_id=YGSUG7IVQNH6BIUVJ452HUZVYGF6WK5HAME7QGXDHKN6JD6KQBNQ, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:46.488043174 (58h7m40.919123305s) [noise=true , address=79.127.201.215:4357 , piece_id=TGDAJIG7N4SC4FVRUE5K5QBHN2E6NIUSVXST77DHGCODRRUNF64Q, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:46.694181877 (58h7m41.125262008s) [noise=true , address=104.36.82.37:4674 , piece_id=SX2YLOYSRNJWIJAFHJX6R6DVDEGP6DMHLQOMVKUNDBRYRZ67BT6A, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:46.722998623 (58h7m41.154078754s) [noise=true , address=104.36.82.36:4637 , piece_id=32DUVUE3CXRPZDQLT3YT4SNDTCSNM7OLNR6PXHPQ62HMGSBJ62YA, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:46.807792793 (58h7m41.238872914s) [noise=true , address=104.36.82.44:4871 , piece_id=LGA4FFPO6HII6PXURDO2S65EUVBF56QEVBKFEM3AR7HJED6T56WQ, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.381778051 (58h7m41.812858182s) [noise=true , address=104.36.82.19:4418 , piece_id=3GNFTD4KZYK47U55DKFLEW5NZS72HEQXTA7UMDFGE5WQZVE72RCQ, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.397081552 (58h7m41.828161673s) [noise=true , address=104.36.82.14:4248 , piece_id=Y7CMDI67KTVIBZ4MTIQ3LNPOB43SJ6XC6GWEDYYUQEHQCXNOLUIA, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.448601637 (58h7m41.879681758s) [noise=true , address=104.36.82.13:4210 , piece_id=G3P6STIZAZAKM5AV3FV4MBEQRSF62JGPUUFIXYZ7PKFWO24OVC3Q, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.479168171 (58h7m41.910248302s) [noise=true , address=104.36.82.8:4995 , piece_id=66PZLQLFIUZIWGF6337GOCYYBYRSF4WCOJWMG2F52PGMWIWR5KQQ, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.493696027 (58h7m41.924776158s) [noise=true , address=104.36.82.5:4857 , piece_id=J4TGECVA4B5DOLZ6SRICUCNYJJS52ACIIEVKFVINB2Z6DRGX3ULA, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.536652247 (58h7m41.967732378s) [noise=true , address=104.36.82.38:4696 , piece_id=WEBZK5A7C5YLIMARGLVVICCVMASOHEMQIILSWRDAU2GSEKWKDV3Q, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.620565632 (58h7m42.051645763s) [noise=true , address=104.36.82.4:4810 , piece_id=TQ7UZJHH7FUGY2DB7QSZYIUTY6HDD4AKHZ7UANBC4ECO5ZKS55AA, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.767239639 (58h7m42.19831982s) [noise=true , address=104.36.82.34:4574 , piece_id=CVWW2FNULWXHPUQDMUNPET54U63T44TEE7RCBYQDMSMSXMFMLX6Q, seg_pos={0 0}, upload=60588]: Done uploading piece. err: <nil>
Aug 11 03:33:47.767273584 (58h7m42.198353745s) [seg_pos={0 0}, upload=60588]: Segment reached optimal threshold of 14 pieces.
Aug 11 03:33:47.767418140 (58h7m42.198498271s) [noise=true , address=104.36.82.47:4533 , piece_id=EOHRJ2ZGSW4ZQVQXKZ5KW5TZULXX4BFP5WMV76GSQF43MSGEKJYA, seg_pos={0 0}, upload=60588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JUUdAnaUPAE8tkzPvVCokFbZMwmhqZvwKHXReK9VU2QeDqavR): protocol: expected piece hash; context canceled; EOF
Aug 11 03:33:47.767467835 (58h7m42.198547966s) [noise=true , address=104.36.82.45:4911 , piece_id=RUJ2JBTM67OWQ26RZM2MX2WHLLNWORQRSFN3QSOO4YUYY4IEB4LQ, seg_pos={0 0}, upload=60588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mzM4hseStJYeWqqm29qGjdaKkxydqFsKaKwNFrywGpDWSwFDQ): protocol: expected piece hash; context canceled; EOF
Aug 11 03:33:47.767509976 (58h7m42.198590107s) [noise=true , address=104.36.82.61:4383 , piece_id=UXRBJSBBEP43GBUPP7OLQDA3VPUDAXXBE75OJ2COVEMSXPUCJX2Q, seg_pos={0 0}, upload=60588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N24q6Li2xavkE61KntNxDPwQzTVHaG4LxyEqFUT1hhGYNQ9mp): protocol: expected piece hash; context canceled; EOF
Aug 11 03:33:47.767638962 (58h7m42.198719114s) [noise=true , address=104.36.82.59:4314 , piece_id=ZYOGQW66G3MGVJ3YH6IXN7J37OHLCDC2H4PCQZWPD3XK5QZMZZWQ, seg_pos={0 0}, upload=60588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: write tcp 188.166.225.170:60900->104.36.82.59:4314: use of closed network connection; write tcp 188.166.225.170:60900->104.36.82.59:4314: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->104.36.82.59:4314: use of closed network connection
Aug 11 03:33:47.767662858 (58h7m42.198742989s) [seg_pos={0 0}, upload=60588]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 03:33:47.767754965 (58h7m42.198835096s) [upload=60588]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 03:33:47.767761558 (58h7m42.198841689s) [upload=60588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 03:33:48.069415192 (58h7m42.500495323s) [upload=60588]: Done uploading segments...
Aug 11 03:33:48.069433637 (58h7m42.500513768s) [upload=60588]: Upload finished. err: <nil>
Duration: 6.94348973s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X...X.................X....X.............X..................] duration:
1.815099244s
FAIL (2025-08-11 03:33:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 509b491301fe4a2414703b6765da796dd548f9d2c6b24ad3529ce3351b142193 != before 91135a8730ae486bfd4199b43ecc728ba6e645e71181b3c44236f1d881e4575b ======LOGS====== Aug 11 03:18:11.216659207 (57h52m5.647739338s) [upload=60319]: Starting upload Aug 11 03:18:11.216716727 (57h52m5.647796858s) [upload=60319]: Done starting upload Aug 11 03:18:11.216782834 (57h52m5.647862965s) [upload=60319]: Uploading segments... Aug 11 03:18:11.216821648 (57h52m5.647901769s) [upload=60319]: Got next segment. Inline: true Aug 11 03:18:11.216825275 (57h52m5.647905396s) [upload=60319]: Waiting for error group managing segments... Aug 11 03:18:11.216857146 (57h52m5.647937277s) [upload=60319]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:18:11.216861033 (57h52m5.647941164s) [upload=60319]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:18:11.216863869 (57h52m5.647944001s) [upload=60319]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:18:11.492059343 (57h52m5.923139485s) [upload=60319]: Done uploading segments... Aug 11 03:18:11.492080735 (57h52m5.923160856s) [upload=60319]: Upload finished. err: <nil>
Duration: 1.815148148s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................X........X...............X......] duration:
7.283181698s
FAIL (2025-08-11 03:33:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 03:28:45.940590727 (58h2m40.371670848s) [upload=60506]: Starting upload
Aug 11 03:28:45.940661994 (58h2m40.371742115s) [upload=60506]: Done starting upload
Aug 11 03:28:45.940747237 (58h2m40.371827368s) [upload=60506]: Uploading segments...
Aug 11 03:28:45.940842238 (58h2m40.371922369s) [upload=60506]: Got next segment. Inline: false
Aug 11 03:28:45.940867386 (58h2m40.371947517s) [upload=60506]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 03:28:45.940871274 (58h2m40.371951405s) [upload=60506]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 03:28:46.386421262 (58h2m40.817501393s) [seg_pos={0 0}, upload=60506]: Begin upload segment...
Aug 11 03:28:46.386462240 (58h2m40.817542361s) [seg_pos={0 0}, upload=60506]: Done begin upload segment.
Aug 11 03:28:46.386483331 (58h2m40.817563462s) [noise=true , address=104.36.82.43:4859 , piece_id=FE7T3SNBFEJT3P763MTAGATBYO7QNWV67J3I3Q24O7MCYPNJP2NQ, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.386566189 (58h2m40.81764632s) [noise=true , address=104.36.82.36:4646 , piece_id=MMJYJULKREEQ2NKZQSNUASMH7G4LECAT3NJHP5Y4SCZWLCNCJONQ, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.386832249 (58h2m40.81791238s) [noise=true , address=104.36.82.35:4613 , piece_id=CAH3YTS5O27DKAASH37TNSXAIK72GGR7TLKP4YXDKBBI3XCAEG7A, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.387095041 (58h2m40.818175172s) [noise=true , address=79.127.201.215:4341 , piece_id=MG4ARXQCOSRUU6ZW5Q37BHETNS5IHFX752GS46QYI4SQ3AEGFIZA, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.387239477 (58h2m40.818319608s) [noise=true , address=156.146.43.225:4442 , piece_id=BSEL3MS3BPL6EXPXKVZDIRJEVEY3F5LVM2Q7NJFQBDMYZMDPEXBA, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.387357203 (58h2m40.818437334s) [noise=true , address=104.36.82.62:4417 , piece_id=OENCOR2CZNPHFM5774IHU6GMYA4HPUZF7TL3WGJICAWOR37VLWEA, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.387625747 (58h2m40.818705868s) [noise=true , address=104.36.82.46:4511 , piece_id=ZMURBCUDR74DDHNRFCU4X5I7QUCVFKM2TV4TQGLVKSOWVDUUFZPA, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.387763531 (58h2m40.818843652s) [noise=true , address=104.36.82.8:4978 , piece_id=H2ONVG5KEIGO36Y5SEU2HOB55WBJJC36LC63UC2C7LLB467UDRQA, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.387847481 (58h2m40.818927612s) [noise=true , address=104.36.82.2:4750 , piece_id=54LPIX4UOXPPPZKUTTKOZIGNFKUCUO7M2J2RZ5NYUHFAW3USSBYA, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.388072391 (58h2m40.819152512s) [noise=true , address=104.36.82.44:4872 , piece_id=GGP72S2TFAPA6X446AEGLLD6OA27EQ4ZGLRRJAFGNV2G3EHG5OIQ, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.388108961 (58h2m40.819189092s) [noise=true , address=104.36.82.61:4373 , piece_id=N2NY3W5NPQPLBCM7EZYXXNCYTIHQI2M4VOOKZPAEZWLDOL5T64GA, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.388384759 (58h2m40.81946488s) [noise=true , address=64.49.13.169:4716 , piece_id=3EVL5CEWHMKZQTGGRDY65EQDF4VCOTBG436YFARS7SGVDTCS5NYA, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.388518224 (58h2m40.819598355s) [noise=true , address=104.36.82.41:4770 , piece_id=7YQYROKTIDZ4XCY4EV5UWW5VQVGYSIZBO23RH7TOQSUB3PGXN2WQ, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.388634607 (58h2m40.819714728s) [noise=true , address=104.36.82.18:4379 , piece_id=RYUUWYK2U4GG3NE3MRD6Q2FDSN3M4RF2JQGDNDMD7YFHFKIX26UQ, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.388845460 (58h2m40.819925591s) [noise=true , address=79.127.205.246:4257 , piece_id=3OEXD75LHOX3GKNCFJSTRFALZBZMY25Q7BK5QVXBY2BSX6TGORBQ, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.388859998 (58h2m40.819940129s) [noise=true , address=104.36.82.23:4468 , piece_id=HEYMQ3V3RWCC5YJAJSTVBNENS5PQYZP23PQVQOIXA722MXDJCSUA, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.389197424 (58h2m40.820277555s) [noise=true , address=104.36.82.60:4351 , piece_id=MRGZJP3B2OVM6XIFFXCOTRCVPSOS4UQPFXQVPZ3AEO5AKONN6DMQ, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.389508348 (58h2m40.82058848s) [noise=true , address=104.36.82.19:4404 , piece_id=SPU4KJ2YD4NWUOQNYZ6M42GFS6AIOOJHB6PYQLHTV5ZXCXC2QUKA, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:47.572715210 (58h2m42.003795341s) [upload=60506]: Next returned nil segment
Aug 11 03:28:47.572729709 (58h2m42.00380984s) [upload=60506]: Waiting for error group managing segments...
Aug 11 03:28:47.872595432 (58h2m42.303675563s) [noise=true , address=79.127.205.246:4257 , piece_id=3OEXD75LHOX3GKNCFJSTRFALZBZMY25Q7BK5QVXBY2BSX6TGORBQ, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:48.068847247 (58h2m42.499927368s) [noise=true , address=64.49.13.169:4716 , piece_id=3EVL5CEWHMKZQTGGRDY65EQDF4VCOTBG436YFARS7SGVDTCS5NYA, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:48.328455536 (58h2m42.759535667s) [noise=true , address=156.146.43.225:4442 , piece_id=BSEL3MS3BPL6EXPXKVZDIRJEVEY3F5LVM2Q7NJFQBDMYZMDPEXBA, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:48.337222981 (58h2m42.768303112s) [noise=true , address=79.127.201.215:4341 , piece_id=MG4ARXQCOSRUU6ZW5Q37BHETNS5IHFX752GS46QYI4SQ3AEGFIZA, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:48.674099429 (58h2m43.10517956s) [noise=true , address=104.36.82.41:4770 , piece_id=7YQYROKTIDZ4XCY4EV5UWW5VQVGYSIZBO23RH7TOQSUB3PGXN2WQ, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:48.757106369 (58h2m43.1881865s) [noise=true , address=104.36.82.61:4373 , piece_id=N2NY3W5NPQPLBCM7EZYXXNCYTIHQI2M4VOOKZPAEZWLDOL5T64GA, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:48.769217631 (58h2m43.200297762s) [noise=true , address=104.36.82.43:4859 , piece_id=FE7T3SNBFEJT3P763MTAGATBYO7QNWV67J3I3Q24O7MCYPNJP2NQ, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:49.214957131 (58h2m43.646037262s) [noise=true , address=104.36.82.18:4379 , piece_id=RYUUWYK2U4GG3NE3MRD6Q2FDSN3M4RF2JQGDNDMD7YFHFKIX26UQ, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:49.356739478 (58h2m43.787819609s) [noise=true , address=104.36.82.62:4417 , piece_id=OENCOR2CZNPHFM5774IHU6GMYA4HPUZF7TL3WGJICAWOR37VLWEA, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:49.437004232 (58h2m43.868084363s) [noise=true , address=104.36.82.2:4750 , piece_id=54LPIX4UOXPPPZKUTTKOZIGNFKUCUO7M2J2RZ5NYUHFAW3USSBYA, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:49.504046316 (58h2m43.935126437s) [noise=true , address=104.36.82.44:4872 , piece_id=GGP72S2TFAPA6X446AEGLLD6OA27EQ4ZGLRRJAFGNV2G3EHG5OIQ, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:49.610960097 (58h2m44.042040228s) [noise=true , address=104.36.82.19:4404 , piece_id=SPU4KJ2YD4NWUOQNYZ6M42GFS6AIOOJHB6PYQLHTV5ZXCXC2QUKA, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:49.630928513 (58h2m44.062008644s) [noise=true , address=104.36.82.8:4978 , piece_id=H2ONVG5KEIGO36Y5SEU2HOB55WBJJC36LC63UC2C7LLB467UDRQA, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:49.698423233 (58h2m44.129503354s) [noise=true , address=104.36.82.23:4468 , piece_id=HEYMQ3V3RWCC5YJAJSTVBNENS5PQYZP23PQVQOIXA722MXDJCSUA, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:49.698447790 (58h2m44.129527911s) [seg_pos={0 0}, upload=60506]: Segment reached optimal threshold of 14 pieces.
Aug 11 03:28:49.698552932 (58h2m44.129633063s) [noise=true , address=104.36.82.36:4646 , piece_id=MMJYJULKREEQ2NKZQSNUASMH7G4LECAT3NJHP5Y4SCZWLCNCJONQ, seg_pos={0 0}, upload=60506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zA8TqySnmGc9bVQnNNMSZEPbv9Gf1Wa1BwYrKjc2ZGgtyEmrh): protocol: expected piece hash; context canceled; EOF
Aug 11 03:28:49.698610211 (58h2m44.129690342s) [noise=true , address=104.36.82.46:4511 , piece_id=ZMURBCUDR74DDHNRFCU4X5I7QUCVFKM2TV4TQGLVKSOWVDUUFZPA, seg_pos={0 0}, upload=60506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Hbb5bsmU7eU4ejMtupHJByLcPHgEAUNiTbgh3rqmgVRVCfdh6): protocol: expected piece hash; context canceled; EOF
Aug 11 03:28:49.698623507 (58h2m44.129703638s) [noise=true , address=104.36.82.35:4613 , piece_id=CAH3YTS5O27DKAASH37TNSXAIK72GGR7TLKP4YXDKBBI3XCAEG7A, seg_pos={0 0}, upload=60506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xjm7XPPwM9nXBP3SS36HeLNxBVJdEpcQyD9BAp79xbGCze4vL): protocol: expected piece hash; context canceled; EOF
Aug 11 03:28:49.698688511 (58h2m44.129768642s) [noise=true , address=104.36.82.60:4351 , piece_id=MRGZJP3B2OVM6XIFFXCOTRCVPSOS4UQPFXQVPZ3AEO5AKONN6DMQ, seg_pos={0 0}, upload=60506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; write tcp 188.166.225.170:35254->104.36.82.60:4351: use of closed network connection; write tcp 188.166.225.170:35254->104.36.82.60:4351: use of closed network connection; EOF
Aug 11 03:28:49.698701597 (58h2m44.129781728s) [seg_pos={0 0}, upload=60506]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 03:28:49.698756101 (58h2m44.129836222s) [upload=60506]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 03:28:49.698759928 (58h2m44.129840059s) [upload=60506]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 03:28:50.084800474 (58h2m44.515880605s) [upload=60506]: Done uploading segments...
Aug 11 03:28:50.084819189 (58h2m44.51589932s) [upload=60506]: Upload finished. err: <nil>
Duration: 7.283203689s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................X....X.....................] duration:
6.160685752s
FAIL (2025-08-11 03:33:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.160708474s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X...X.................X....X.............X.................] duration:
1.838889933s
FAIL (2025-08-11 03:32:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 509b491301fe4a2414703b6765da796dd548f9d2c6b24ad3529ce3351b142193 != before 91135a8730ae486bfd4199b43ecc728ba6e645e71181b3c44236f1d881e4575b ======LOGS====== Aug 11 03:18:11.216659207 (57h52m5.647739338s) [upload=60319]: Starting upload Aug 11 03:18:11.216716727 (57h52m5.647796858s) [upload=60319]: Done starting upload Aug 11 03:18:11.216782834 (57h52m5.647862965s) [upload=60319]: Uploading segments... Aug 11 03:18:11.216821648 (57h52m5.647901769s) [upload=60319]: Got next segment. Inline: true Aug 11 03:18:11.216825275 (57h52m5.647905396s) [upload=60319]: Waiting for error group managing segments... Aug 11 03:18:11.216857146 (57h52m5.647937277s) [upload=60319]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:18:11.216861033 (57h52m5.647941164s) [upload=60319]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:18:11.216863869 (57h52m5.647944001s) [upload=60319]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:18:11.492059343 (57h52m5.923139485s) [upload=60319]: Done uploading segments... Aug 11 03:18:11.492080735 (57h52m5.923160856s) [upload=60319]: Upload finished. err: <nil>
Duration: 1.838919099s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X....X....................] duration:
6.016445711s
FAIL (2025-08-11 03:32:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.016465007s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............................X........X...............X.....] duration:
8.144028683s
FAIL (2025-08-11 03:32:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 03:28:45.940590727 (58h2m40.371670848s) [upload=60506]: Starting upload
Aug 11 03:28:45.940661994 (58h2m40.371742115s) [upload=60506]: Done starting upload
Aug 11 03:28:45.940747237 (58h2m40.371827368s) [upload=60506]: Uploading segments...
Aug 11 03:28:45.940842238 (58h2m40.371922369s) [upload=60506]: Got next segment. Inline: false
Aug 11 03:28:45.940867386 (58h2m40.371947517s) [upload=60506]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 03:28:45.940871274 (58h2m40.371951405s) [upload=60506]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 03:28:46.386421262 (58h2m40.817501393s) [seg_pos={0 0}, upload=60506]: Begin upload segment...
Aug 11 03:28:46.386462240 (58h2m40.817542361s) [seg_pos={0 0}, upload=60506]: Done begin upload segment.
Aug 11 03:28:46.386483331 (58h2m40.817563462s) [noise=true , address=104.36.82.43:4859 , piece_id=FE7T3SNBFEJT3P763MTAGATBYO7QNWV67J3I3Q24O7MCYPNJP2NQ, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.386566189 (58h2m40.81764632s) [noise=true , address=104.36.82.36:4646 , piece_id=MMJYJULKREEQ2NKZQSNUASMH7G4LECAT3NJHP5Y4SCZWLCNCJONQ, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.386832249 (58h2m40.81791238s) [noise=true , address=104.36.82.35:4613 , piece_id=CAH3YTS5O27DKAASH37TNSXAIK72GGR7TLKP4YXDKBBI3XCAEG7A, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.387095041 (58h2m40.818175172s) [noise=true , address=79.127.201.215:4341 , piece_id=MG4ARXQCOSRUU6ZW5Q37BHETNS5IHFX752GS46QYI4SQ3AEGFIZA, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.387239477 (58h2m40.818319608s) [noise=true , address=156.146.43.225:4442 , piece_id=BSEL3MS3BPL6EXPXKVZDIRJEVEY3F5LVM2Q7NJFQBDMYZMDPEXBA, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.387357203 (58h2m40.818437334s) [noise=true , address=104.36.82.62:4417 , piece_id=OENCOR2CZNPHFM5774IHU6GMYA4HPUZF7TL3WGJICAWOR37VLWEA, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.387625747 (58h2m40.818705868s) [noise=true , address=104.36.82.46:4511 , piece_id=ZMURBCUDR74DDHNRFCU4X5I7QUCVFKM2TV4TQGLVKSOWVDUUFZPA, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.387763531 (58h2m40.818843652s) [noise=true , address=104.36.82.8:4978 , piece_id=H2ONVG5KEIGO36Y5SEU2HOB55WBJJC36LC63UC2C7LLB467UDRQA, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.387847481 (58h2m40.818927612s) [noise=true , address=104.36.82.2:4750 , piece_id=54LPIX4UOXPPPZKUTTKOZIGNFKUCUO7M2J2RZ5NYUHFAW3USSBYA, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.388072391 (58h2m40.819152512s) [noise=true , address=104.36.82.44:4872 , piece_id=GGP72S2TFAPA6X446AEGLLD6OA27EQ4ZGLRRJAFGNV2G3EHG5OIQ, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.388108961 (58h2m40.819189092s) [noise=true , address=104.36.82.61:4373 , piece_id=N2NY3W5NPQPLBCM7EZYXXNCYTIHQI2M4VOOKZPAEZWLDOL5T64GA, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.388384759 (58h2m40.81946488s) [noise=true , address=64.49.13.169:4716 , piece_id=3EVL5CEWHMKZQTGGRDY65EQDF4VCOTBG436YFARS7SGVDTCS5NYA, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.388518224 (58h2m40.819598355s) [noise=true , address=104.36.82.41:4770 , piece_id=7YQYROKTIDZ4XCY4EV5UWW5VQVGYSIZBO23RH7TOQSUB3PGXN2WQ, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.388634607 (58h2m40.819714728s) [noise=true , address=104.36.82.18:4379 , piece_id=RYUUWYK2U4GG3NE3MRD6Q2FDSN3M4RF2JQGDNDMD7YFHFKIX26UQ, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.388845460 (58h2m40.819925591s) [noise=true , address=79.127.205.246:4257 , piece_id=3OEXD75LHOX3GKNCFJSTRFALZBZMY25Q7BK5QVXBY2BSX6TGORBQ, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.388859998 (58h2m40.819940129s) [noise=true , address=104.36.82.23:4468 , piece_id=HEYMQ3V3RWCC5YJAJSTVBNENS5PQYZP23PQVQOIXA722MXDJCSUA, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.389197424 (58h2m40.820277555s) [noise=true , address=104.36.82.60:4351 , piece_id=MRGZJP3B2OVM6XIFFXCOTRCVPSOS4UQPFXQVPZ3AEO5AKONN6DMQ, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:46.389508348 (58h2m40.82058848s) [noise=true , address=104.36.82.19:4404 , piece_id=SPU4KJ2YD4NWUOQNYZ6M42GFS6AIOOJHB6PYQLHTV5ZXCXC2QUKA, seg_pos={0 0}, upload=60506]: Uploading piece...
Aug 11 03:28:47.572715210 (58h2m42.003795341s) [upload=60506]: Next returned nil segment
Aug 11 03:28:47.572729709 (58h2m42.00380984s) [upload=60506]: Waiting for error group managing segments...
Aug 11 03:28:47.872595432 (58h2m42.303675563s) [noise=true , address=79.127.205.246:4257 , piece_id=3OEXD75LHOX3GKNCFJSTRFALZBZMY25Q7BK5QVXBY2BSX6TGORBQ, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:48.068847247 (58h2m42.499927368s) [noise=true , address=64.49.13.169:4716 , piece_id=3EVL5CEWHMKZQTGGRDY65EQDF4VCOTBG436YFARS7SGVDTCS5NYA, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:48.328455536 (58h2m42.759535667s) [noise=true , address=156.146.43.225:4442 , piece_id=BSEL3MS3BPL6EXPXKVZDIRJEVEY3F5LVM2Q7NJFQBDMYZMDPEXBA, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:48.337222981 (58h2m42.768303112s) [noise=true , address=79.127.201.215:4341 , piece_id=MG4ARXQCOSRUU6ZW5Q37BHETNS5IHFX752GS46QYI4SQ3AEGFIZA, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:48.674099429 (58h2m43.10517956s) [noise=true , address=104.36.82.41:4770 , piece_id=7YQYROKTIDZ4XCY4EV5UWW5VQVGYSIZBO23RH7TOQSUB3PGXN2WQ, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:48.757106369 (58h2m43.1881865s) [noise=true , address=104.36.82.61:4373 , piece_id=N2NY3W5NPQPLBCM7EZYXXNCYTIHQI2M4VOOKZPAEZWLDOL5T64GA, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:48.769217631 (58h2m43.200297762s) [noise=true , address=104.36.82.43:4859 , piece_id=FE7T3SNBFEJT3P763MTAGATBYO7QNWV67J3I3Q24O7MCYPNJP2NQ, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:49.214957131 (58h2m43.646037262s) [noise=true , address=104.36.82.18:4379 , piece_id=RYUUWYK2U4GG3NE3MRD6Q2FDSN3M4RF2JQGDNDMD7YFHFKIX26UQ, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:49.356739478 (58h2m43.787819609s) [noise=true , address=104.36.82.62:4417 , piece_id=OENCOR2CZNPHFM5774IHU6GMYA4HPUZF7TL3WGJICAWOR37VLWEA, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:49.437004232 (58h2m43.868084363s) [noise=true , address=104.36.82.2:4750 , piece_id=54LPIX4UOXPPPZKUTTKOZIGNFKUCUO7M2J2RZ5NYUHFAW3USSBYA, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:49.504046316 (58h2m43.935126437s) [noise=true , address=104.36.82.44:4872 , piece_id=GGP72S2TFAPA6X446AEGLLD6OA27EQ4ZGLRRJAFGNV2G3EHG5OIQ, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:49.610960097 (58h2m44.042040228s) [noise=true , address=104.36.82.19:4404 , piece_id=SPU4KJ2YD4NWUOQNYZ6M42GFS6AIOOJHB6PYQLHTV5ZXCXC2QUKA, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:49.630928513 (58h2m44.062008644s) [noise=true , address=104.36.82.8:4978 , piece_id=H2ONVG5KEIGO36Y5SEU2HOB55WBJJC36LC63UC2C7LLB467UDRQA, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:49.698423233 (58h2m44.129503354s) [noise=true , address=104.36.82.23:4468 , piece_id=HEYMQ3V3RWCC5YJAJSTVBNENS5PQYZP23PQVQOIXA722MXDJCSUA, seg_pos={0 0}, upload=60506]: Done uploading piece. err: <nil>
Aug 11 03:28:49.698447790 (58h2m44.129527911s) [seg_pos={0 0}, upload=60506]: Segment reached optimal threshold of 14 pieces.
Aug 11 03:28:49.698552932 (58h2m44.129633063s) [noise=true , address=104.36.82.36:4646 , piece_id=MMJYJULKREEQ2NKZQSNUASMH7G4LECAT3NJHP5Y4SCZWLCNCJONQ, seg_pos={0 0}, upload=60506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zA8TqySnmGc9bVQnNNMSZEPbv9Gf1Wa1BwYrKjc2ZGgtyEmrh): protocol: expected piece hash; context canceled; EOF
Aug 11 03:28:49.698610211 (58h2m44.129690342s) [noise=true , address=104.36.82.46:4511 , piece_id=ZMURBCUDR74DDHNRFCU4X5I7QUCVFKM2TV4TQGLVKSOWVDUUFZPA, seg_pos={0 0}, upload=60506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Hbb5bsmU7eU4ejMtupHJByLcPHgEAUNiTbgh3rqmgVRVCfdh6): protocol: expected piece hash; context canceled; EOF
Aug 11 03:28:49.698623507 (58h2m44.129703638s) [noise=true , address=104.36.82.35:4613 , piece_id=CAH3YTS5O27DKAASH37TNSXAIK72GGR7TLKP4YXDKBBI3XCAEG7A, seg_pos={0 0}, upload=60506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xjm7XPPwM9nXBP3SS36HeLNxBVJdEpcQyD9BAp79xbGCze4vL): protocol: expected piece hash; context canceled; EOF
Aug 11 03:28:49.698688511 (58h2m44.129768642s) [noise=true , address=104.36.82.60:4351 , piece_id=MRGZJP3B2OVM6XIFFXCOTRCVPSOS4UQPFXQVPZ3AEO5AKONN6DMQ, seg_pos={0 0}, upload=60506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; write tcp 188.166.225.170:35254->104.36.82.60:4351: use of closed network connection; write tcp 188.166.225.170:35254->104.36.82.60:4351: use of closed network connection; EOF
Aug 11 03:28:49.698701597 (58h2m44.129781728s) [seg_pos={0 0}, upload=60506]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 03:28:49.698756101 (58h2m44.129836222s) [upload=60506]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 03:28:49.698759928 (58h2m44.129840059s) [upload=60506]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 03:28:50.084800474 (58h2m44.515880605s) [upload=60506]: Done uploading segments...
Aug 11 03:28:50.084819189 (58h2m44.51589932s) [upload=60506]: Upload finished. err: <nil>
Duration: 8.144055456s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|