Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [......X.......................X...X.................X..X....] duration: 6.650528746s FAIL (2025-08-09 01:09:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 01:06:19.490141384 (7h40m13.921221515s) [upload=8022]: Starting upload Aug 9 01:06:19.490194696 (7h40m13.921274827s) [upload=8022]: Done starting upload Aug 9 01:06:19.490272484 (7h40m13.921352615s) [upload=8022]: Uploading segments... Aug 9 01:06:19.490419826 (7h40m13.921499967s) [upload=8022]: Got next segment. Inline: false Aug 9 01:06:19.490477807 (7h40m13.921557938s) [upload=8022]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:06:19.490483398 (7h40m13.921563539s) [upload=8022]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:06:19.703176702 (7h40m14.134256833s) [upload=8022]: Next segment err: metaclient: Too Many Requests Aug 9 01:06:19.703194126 (7h40m14.134274257s) [upload=8022]: Done uploading segments... Aug 9 01:06:19.703215657 (7h40m14.134295778s) [upload=8022]: Upload finished. err: metaclient: Too Many Requests Duration: 6.650553254s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [..........X.X.....X................X.........X............X.] duration: 1.970049513s FAIL (2025-08-09 01:09:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 01:08:15.407550863 (7h42m9.838630995s) [upload=8054]: Starting upload Aug 9 01:08:15.407585941 (7h42m9.838666072s) [upload=8054]: Done starting upload Aug 9 01:08:15.407625697 (7h42m9.838705828s) [upload=8054]: Uploading segments... Aug 9 01:08:15.407657608 (7h42m9.838737739s) [upload=8054]: Got next segment. Inline: true Aug 9 01:08:15.407661165 (7h42m9.838741296s) [upload=8054]: Waiting for error group managing segments... Aug 9 01:08:15.407691152 (7h42m9.838771283s) [upload=8054]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:08:15.407695501 (7h42m9.838775632s) [upload=8054]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:08:15.407698166 (7h42m9.838778297s) [upload=8054]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:08:15.690642090 (7h42m10.121722221s) [upload=8054]: Done uploading segments... Aug 9 01:08:15.690660516 (7h42m10.121740647s) [upload=8054]: Upload finished. err: <nil> Duration:* 1.970076474s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......X.......................X...X.................X..X...] duration: 6.418938077s FAIL (2025-08-09 01:08:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 01:06:19.490141384 (7h40m13.921221515s) [upload=8022]: Starting upload Aug 9 01:06:19.490194696 (7h40m13.921274827s) [upload=8022]: Done starting upload Aug 9 01:06:19.490272484 (7h40m13.921352615s) [upload=8022]: Uploading segments... Aug 9 01:06:19.490419826 (7h40m13.921499967s) [upload=8022]: Got next segment. Inline: false Aug 9 01:06:19.490477807 (7h40m13.921557938s) [upload=8022]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:06:19.490483398 (7h40m13.921563539s) [upload=8022]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:06:19.703176702 (7h40m14.134256833s) [upload=8022]: Next segment err: metaclient: Too Many Requests Aug 9 01:06:19.703194126 (7h40m14.134274257s) [upload=8022]: Done uploading segments... Aug 9 01:06:19.703215657 (7h40m14.134295778s) [upload=8022]: Upload finished. err: metaclient: Too Many Requests Duration: 6.418968455s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [...........X.X.....X................X.........X............X] duration: 1.59701027s FAIL (2025-08-09 01:08:16 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 01:08:15.407550863 (7h42m9.838630995s) [upload=8054]: Starting upload Aug 9 01:08:15.407585941 (7h42m9.838666072s) [upload=8054]: Done starting upload Aug 9 01:08:15.407625697 (7h42m9.838705828s) [upload=8054]: Uploading segments... Aug 9 01:08:15.407657608 (7h42m9.838737739s) [upload=8054]: Got next segment. Inline: true Aug 9 01:08:15.407661165 (7h42m9.838741296s) [upload=8054]: Waiting for error group managing segments... Aug 9 01:08:15.407691152 (7h42m9.838771283s) [upload=8054]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:08:15.407695501 (7h42m9.838775632s) [upload=8054]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:08:15.407698166 (7h42m9.838778297s) [upload=8054]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:08:15.690642090 (7h42m10.121722221s) [upload=8054]: Done uploading segments... Aug 9 01:08:15.690660516 (7h42m10.121740647s) [upload=8054]: Upload finished. err: <nil> Duration:* 1.597031621s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [........X.......................X...X.................X..X..] duration: 6.211735314s FAIL (2025-08-09 01:08:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 01:06:19.490141384 (7h40m13.921221515s) [upload=8022]: Starting upload Aug 9 01:06:19.490194696 (7h40m13.921274827s) [upload=8022]: Done starting upload Aug 9 01:06:19.490272484 (7h40m13.921352615s) [upload=8022]: Uploading segments... Aug 9 01:06:19.490419826 (7h40m13.921499967s) [upload=8022]: Got next segment. Inline: false Aug 9 01:06:19.490477807 (7h40m13.921557938s) [upload=8022]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:06:19.490483398 (7h40m13.921563539s) [upload=8022]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:06:19.703176702 (7h40m14.134256833s) [upload=8022]: Next segment err: metaclient: Too Many Requests Aug 9 01:06:19.703194126 (7h40m14.134274257s) [upload=8022]: Done uploading segments... Aug 9 01:06:19.703215657 (7h40m14.134295778s) [upload=8022]: Upload finished. err: metaclient: Too Many Requests Duration: 6.211762898s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [............X.X.....X................X.........X............] duration: 1.832516721s FAIL (2025-08-09 01:07:44 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 00:58:59.084188727 (7h32m53.515268878s) [upload=7898]: Starting upload Aug 9 00:58:59.084275873 (7h32m53.515356004s) [upload=7898]: Done starting upload Aug 9 00:58:59.084337591 (7h32m53.515417712s) [upload=7898]: Uploading segments... Aug 9 00:58:59.084378901 (7h32m53.515459032s) [upload=7898]: Got next segment. Inline: true Aug 9 00:58:59.084384140 (7h32m53.515464302s) [upload=7898]: Waiting for error group managing segments... Aug 9 00:58:59.084461699 (7h32m53.51554182s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:58:59.084466568 (7h32m53.515546699s) [upload=7898]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:58:59.084469013 (7h32m53.515549144s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:58:59.375040151 (7h32m53.806120282s) [upload=7898]: Done uploading segments... Aug 9 00:58:59.375058565 (7h32m53.806138686s) [upload=7898]: Upload finished. err: <nil> Duration:* 1.832802559s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.........X.......................X...X.................X..X.] duration: 6.6108299s FAIL (2025-08-09 01:07:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 01:06:19.490141384 (7h40m13.921221515s) [upload=8022]: Starting upload Aug 9 01:06:19.490194696 (7h40m13.921274827s) [upload=8022]: Done starting upload Aug 9 01:06:19.490272484 (7h40m13.921352615s) [upload=8022]: Uploading segments... Aug 9 01:06:19.490419826 (7h40m13.921499967s) [upload=8022]: Got next segment. Inline: false Aug 9 01:06:19.490477807 (7h40m13.921557938s) [upload=8022]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:06:19.490483398 (7h40m13.921563539s) [upload=8022]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:06:19.703176702 (7h40m14.134256833s) [upload=8022]: Next segment err: metaclient: Too Many Requests Aug 9 01:06:19.703194126 (7h40m14.134274257s) [upload=8022]: Done uploading segments... Aug 9 01:06:19.703215657 (7h40m14.134295778s) [upload=8022]: Upload finished. err: metaclient: Too Many Requests Duration: 6.610880106s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.............X.X.....X................X.........X...........] duration: 1.824374026s FAIL (2025-08-09 01:06:49 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 00:58:59.084188727 (7h32m53.515268878s) [upload=7898]: Starting upload Aug 9 00:58:59.084275873 (7h32m53.515356004s) [upload=7898]: Done starting upload Aug 9 00:58:59.084337591 (7h32m53.515417712s) [upload=7898]: Uploading segments... Aug 9 00:58:59.084378901 (7h32m53.515459032s) [upload=7898]: Got next segment. Inline: true Aug 9 00:58:59.084384140 (7h32m53.515464302s) [upload=7898]: Waiting for error group managing segments... Aug 9 00:58:59.084461699 (7h32m53.51554182s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:58:59.084466568 (7h32m53.515546699s) [upload=7898]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:58:59.084469013 (7h32m53.515549144s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:58:59.375040151 (7h32m53.806120282s) [upload=7898]: Done uploading segments... Aug 9 00:58:59.375058565 (7h32m53.806138686s) [upload=7898]: Upload finished. err: <nil> Duration:* 1.824400878s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..........X.......................X...X.................X..X] duration: 858.529941ms FAIL (2025-08-09 01:06:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 01:06:19.490141384 (7h40m13.921221515s) [upload=8022]: Starting upload Aug 9 01:06:19.490194696 (7h40m13.921274827s) [upload=8022]: Done starting upload Aug 9 01:06:19.490272484 (7h40m13.921352615s) [upload=8022]: Uploading segments... Aug 9 01:06:19.490419826 (7h40m13.921499967s) [upload=8022]: Got next segment. Inline: false Aug 9 01:06:19.490477807 (7h40m13.921557938s) [upload=8022]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:06:19.490483398 (7h40m13.921563539s) [upload=8022]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:06:19.703176702 (7h40m14.134256833s) [upload=8022]: Next segment err: metaclient: Too Many Requests Aug 9 01:06:19.703194126 (7h40m14.134274257s) [upload=8022]: Done uploading segments... Aug 9 01:06:19.703215657 (7h40m14.134295778s) [upload=8022]: Upload finished. err: metaclient: Too Many Requests Duration: 858.550089ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..............X.X.....X................X.........X..........] duration: 2.146204872s FAIL (2025-08-09 01:06:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 00:58:59.084188727 (7h32m53.515268878s) [upload=7898]: Starting upload Aug 9 00:58:59.084275873 (7h32m53.515356004s) [upload=7898]: Done starting upload Aug 9 00:58:59.084337591 (7h32m53.515417712s) [upload=7898]: Uploading segments... Aug 9 00:58:59.084378901 (7h32m53.515459032s) [upload=7898]: Got next segment. Inline: true Aug 9 00:58:59.084384140 (7h32m53.515464302s) [upload=7898]: Waiting for error group managing segments... Aug 9 00:58:59.084461699 (7h32m53.51554182s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:58:59.084466568 (7h32m53.515546699s) [upload=7898]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:58:59.084469013 (7h32m53.515549144s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:58:59.375040151 (7h32m53.806120282s) [upload=7898]: Done uploading segments... Aug 9 00:58:59.375058565 (7h32m53.806138686s) [upload=7898]: Upload finished. err: <nil> Duration:* 2.146230501s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...............X.X.....X................X.........X.........] duration: 1.88861702s FAIL (2025-08-09 01:05:48 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 00:58:59.084188727 (7h32m53.515268878s) [upload=7898]: Starting upload Aug 9 00:58:59.084275873 (7h32m53.515356004s) [upload=7898]: Done starting upload Aug 9 00:58:59.084337591 (7h32m53.515417712s) [upload=7898]: Uploading segments... Aug 9 00:58:59.084378901 (7h32m53.515459032s) [upload=7898]: Got next segment. Inline: true Aug 9 00:58:59.084384140 (7h32m53.515464302s) [upload=7898]: Waiting for error group managing segments... Aug 9 00:58:59.084461699 (7h32m53.51554182s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:58:59.084466568 (7h32m53.515546699s) [upload=7898]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:58:59.084469013 (7h32m53.515549144s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:58:59.375040151 (7h32m53.806120282s) [upload=7898]: Done uploading segments... Aug 9 00:58:59.375058565 (7h32m53.806138686s) [upload=7898]: Upload finished. err: <nil> Duration:* 1.88867s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [................X.X.....X................X.........X........] duration: 1.806817272s FAIL (2025-08-09 01:05:32 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 00:58:59.084188727 (7h32m53.515268878s) [upload=7898]: Starting upload Aug 9 00:58:59.084275873 (7h32m53.515356004s) [upload=7898]: Done starting upload Aug 9 00:58:59.084337591 (7h32m53.515417712s) [upload=7898]: Uploading segments... Aug 9 00:58:59.084378901 (7h32m53.515459032s) [upload=7898]: Got next segment. Inline: true Aug 9 00:58:59.084384140 (7h32m53.515464302s) [upload=7898]: Waiting for error group managing segments... Aug 9 00:58:59.084461699 (7h32m53.51554182s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:58:59.084466568 (7h32m53.515546699s) [upload=7898]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:58:59.084469013 (7h32m53.515549144s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:58:59.375040151 (7h32m53.806120282s) [upload=7898]: Done uploading segments... Aug 9 00:58:59.375058565 (7h32m53.806138686s) [upload=7898]: Upload finished. err: <nil> Duration:* 1.8068688s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X.......................X...X.................X..] duration: 6.338977847s FAIL (2025-08-09 01:05:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 01:03:47.960443281 (7h37m42.391523422s) [upload=7978]: Starting upload Aug 9 01:03:47.960491403 (7h37m42.391571524s) [upload=7978]: Done starting upload Aug 9 01:03:47.960601013 (7h37m42.391681144s) [upload=7978]: Uploading segments... Aug 9 01:03:47.960670405 (7h37m42.391750536s) [upload=7978]: Got next segment. Inline: false Aug 9 01:03:47.960715532 (7h37m42.391795663s) [upload=7978]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:47.960720050 (7h37m42.391800181s) [upload=7978]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:48.420438676 (7h37m42.851518807s) [seg_pos={0 0}, upload=7978]: Begin upload segment... Aug 9 01:03:48.420484313 (7h37m42.851564434s) [seg_pos={0 0}, upload=7978]: Done begin upload segment. Aug 9 01:03:48.420520011 (7h37m42.851600142s) [noise=true , address=104.36.82.43:4834 , piece_id=64H36DVR66VFJZ43E6CD2LEXF2IVGNYARWBVXD6NSZTCX6FULVRQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.420969732 (7h37m42.852049863s) [noise=true , address=104.36.82.13:4216 , piece_id=Q6RBO5M7P6FAEHTOTDLX2VQPU2OF6ADUCG4CVJATEFNX4OUALEWA, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.421263734 (7h37m42.852343855s) [noise=true , address=104.36.82.47:4523 , piece_id=KORZZQ6GOIPH6XBEUT5Y5GFJ7Z3EW324KPIV4JVJ7VV57LJTILHQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.421586332 (7h37m42.852666453s) [noise=true , address=104.36.82.37:4655 , piece_id=CEZ5B5RHOVNGP5EEMLQOPQVJJJ2GILQY442AYOSMBVP72CGONMFQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.421868641 (7h37m42.852948773s) [noise=true , address=104.36.82.9:4026 , piece_id=UDBZSKHUQYRDYEU6IT7ITN5GGUY6JJ373WG6ZZABBSYHE6R2VTBQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.421909330 (7h37m42.852989461s) [noise=true , address=64.49.13.27:4965 , piece_id=GDQ3HAFRAL3A5TZQ34DXMC2CQZMCDBEQDOIWJRINB5X3EJVNJP2Q, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.422171862 (7h37m42.853251993s) [noise=true , address=104.36.82.36:4648 , piece_id=5KIOQCLSN74KHMSNMU3C5CKATFQG5BWF3YMRFXY6KZOENXEYVG4Q, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.422223440 (7h37m42.853303561s) [noise=true , address=104.36.82.5:4859 , piece_id=2PD7LATDTEM4KGPNSXLK2Z7GALI7DTNTZSAPXOVW3IHHZJR5NI3Q, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.422436879 (7h37m42.85351701s) [noise=true , address=104.36.82.35:4615 , piece_id=TY5O4DNEVA7NWUYCMPOXTEPOZY7TJLGQ7MHQFMDDQNC4NY64HBEA, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.422772711 (7h37m42.853852882s) [noise=true , address=104.36.82.60:4363 , piece_id=YIRPGIXXGQTIBA7LTEOBQPWJZCRJ3WFPPTNAAJG2KTTYDGAH3NLQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.423183517 (7h37m42.854263638s) [noise=true , address=104.36.82.8:4004 , piece_id=SYDWOUBHGX24OOHKIXFNQPSJN2LF3BW5VSDW45B5UNYMI6KEA76Q, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.423282828 (7h37m42.854362949s) [noise=true , address=104.36.82.23:4463 , piece_id=P3RRZIPZUDFIRD7RLUUFRKRPLIUJINVGI3CZPAD2ZY3SFCO3KCUQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.423435860 (7h37m42.854515991s) [noise=true , address=104.36.82.21:4486 , piece_id=SUHXLN3OL4SPXMBTXVZDPNHX7TR57ADM533LOZ36C3ZVQKIHYLYA, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.423530091 (7h37m42.854610222s) [noise=true , address=104.36.82.62:4434 , piece_id=JMKCIK7AFX2YHI2UBFBN3BCV5RUY2EWTLT4OCQAVTIHWFZNIFB6A, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.423654398 (7h37m42.854734529s) [noise=true , address=104.36.82.39:4727 , piece_id=SSQAYPJOKYHMR52BFUFVVV2LS5LM3RVJ3P7E4FEW5SNHE54GHLQQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.423776953 (7h37m42.854857084s) [noise=true , address=104.36.82.59:4322 , piece_id=HFTQRSMVPYFJE2SIY5ADFDK4F524MPZI6QPD5KUT7ZYACQQPMCAQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.423863388 (7h37m42.85494352s) [noise=true , address=104.36.82.4:4818 , piece_id=FQQFSU6PZ4WNWLN5AZUNGNKQZZOQ6TDJFW3B5XJ3LFRN55HDY5MA, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.424289814 (7h37m42.855369935s) [noise=true , address=64.49.13.138:4490 , piece_id=WNOHL2GB7SLHBTOQFLG373YG522MJ3NUPRXAM25BWNMD56QAEQFQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:49.574519642 (7h37m44.005599783s) [upload=7978]: Next returned nil segment Aug 9 01:03:49.574539751 (7h37m44.005619882s) [upload=7978]: Waiting for error group managing segments... Aug 9 01:03:49.879858896 (7h37m44.310939017s) [noise=true , address=64.49.13.138:4490 , piece_id=WNOHL2GB7SLHBTOQFLG373YG522MJ3NUPRXAM25BWNMD56QAEQFQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:49.890940919 (7h37m44.32202105s) [noise=true , address=64.49.13.27:4965 , piece_id=GDQ3HAFRAL3A5TZQ34DXMC2CQZMCDBEQDOIWJRINB5X3EJVNJP2Q, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.318933265 (7h37m44.750013386s) [noise=true , address=104.36.82.47:4523 , piece_id=KORZZQ6GOIPH6XBEUT5Y5GFJ7Z3EW324KPIV4JVJ7VV57LJTILHQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.395589009 (7h37m44.82666913s) [noise=true , address=104.36.82.59:4322 , piece_id=HFTQRSMVPYFJE2SIY5ADFDK4F524MPZI6QPD5KUT7ZYACQQPMCAQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.447596845 (7h37m44.878676976s) [noise=true , address=104.36.82.39:4727 , piece_id=SSQAYPJOKYHMR52BFUFVVV2LS5LM3RVJ3P7E4FEW5SNHE54GHLQQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.447709581 (7h37m44.878789712s) [noise=true , address=104.36.82.21:4486 , piece_id=SUHXLN3OL4SPXMBTXVZDPNHX7TR57ADM533LOZ36C3ZVQKIHYLYA, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.482050135 (7h37m44.913130266s) [noise=true , address=104.36.82.23:4463 , piece_id=P3RRZIPZUDFIRD7RLUUFRKRPLIUJINVGI3CZPAD2ZY3SFCO3KCUQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.493607628 (7h37m44.924687759s) [noise=true , address=104.36.82.9:4026 , piece_id=UDBZSKHUQYRDYEU6IT7ITN5GGUY6JJ373WG6ZZABBSYHE6R2VTBQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.502119894 (7h37m44.933200025s) [noise=true , address=104.36.82.8:4004 , piece_id=SYDWOUBHGX24OOHKIXFNQPSJN2LF3BW5VSDW45B5UNYMI6KEA76Q, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.504465953 (7h37m44.935546084s) [noise=true , address=104.36.82.5:4859 , piece_id=2PD7LATDTEM4KGPNSXLK2Z7GALI7DTNTZSAPXOVW3IHHZJR5NI3Q, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.519084803 (7h37m44.950164934s) [noise=true , address=104.36.82.36:4648 , piece_id=5KIOQCLSN74KHMSNMU3C5CKATFQG5BWF3YMRFXY6KZOENXEYVG4Q, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.523620892 (7h37m44.954701023s) [noise=true , address=104.36.82.43:4834 , piece_id=64H36DVR66VFJZ43E6CD2LEXF2IVGNYARWBVXD6NSZTCX6FULVRQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.526711355 (7h37m44.957791486s) [noise=true , address=104.36.82.4:4818 , piece_id=FQQFSU6PZ4WNWLN5AZUNGNKQZZOQ6TDJFW3B5XJ3LFRN55HDY5MA, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.665048154 (7h37m45.096128285s) [noise=true , address=104.36.82.62:4434 , piece_id=JMKCIK7AFX2YHI2UBFBN3BCV5RUY2EWTLT4OCQAVTIHWFZNIFB6A, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.665071448 (7h37m45.096151579s) [seg_pos={0 0}, upload=7978]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.665180347 (7h37m45.096260478s) [noise=true , address=104.36.82.37:4655 , piece_id=CEZ5B5RHOVNGP5EEMLQOPQVJJJ2GILQY442AYOSMBVP72CGONMFQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.665304915 (7h37m45.096385046s) [noise=true , address=104.36.82.13:4216 , piece_id=Q6RBO5M7P6FAEHTOTDLX2VQPU2OF6ADUCG4CVJATEFNX4OUALEWA, seg_pos={0 0}, upload=7978]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AgazvjebAo7K4NdQ7zsKkETiNQNfiykHcBDcmXej6eipwWpFu): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.665451796 (7h37m45.096531927s) [noise=true , address=104.36.82.35:4615 , piece_id=TY5O4DNEVA7NWUYCMPOXTEPOZY7TJLGQ7MHQFMDDQNC4NY64HBEA, seg_pos={0 0}, upload=7978]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: write tcp 188.166.225.170:57786->104.36.82.35:4615: use of closed network connection; write tcp 188.166.225.170:57786->104.36.82.35:4615: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57786->104.36.82.35:4615: use of closed network connection Aug 9 01:03:50.665544183 (7h37m45.096624355s) [noise=true , address=104.36.82.60:4363 , piece_id=YIRPGIXXGQTIBA7LTEOBQPWJZCRJ3WFPPTNAAJG2KTTYDGAH3NLQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1endke3P5J92vFytHPiVczH5VcuHDSXyvd4qK9kFNhkQh8MhL7): protocol: write tcp 188.166.225.170:35210->104.36.82.60:4363: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.665580022 (7h37m45.096660153s) [seg_pos={0 0}, upload=7978]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.665649725 (7h37m45.096729857s) [upload=7978]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.665653943 (7h37m45.096734074s) [upload=7978]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:51.036009261 (7h37m45.467089392s) [upload=7978]: Done uploading segments... Aug 9 01:03:51.036022928 (7h37m45.467103059s) [upload=7978]: Upload finished. err: <nil> Duration: 6.339009909s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.................X.X.....X................X.........X.......] duration: 1.932723398s FAIL (2025-08-09 01:04:56 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 00:58:59.084188727 (7h32m53.515268878s) [upload=7898]: Starting upload Aug 9 00:58:59.084275873 (7h32m53.515356004s) [upload=7898]: Done starting upload Aug 9 00:58:59.084337591 (7h32m53.515417712s) [upload=7898]: Uploading segments... Aug 9 00:58:59.084378901 (7h32m53.515459032s) [upload=7898]: Got next segment. Inline: true Aug 9 00:58:59.084384140 (7h32m53.515464302s) [upload=7898]: Waiting for error group managing segments... Aug 9 00:58:59.084461699 (7h32m53.51554182s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:58:59.084466568 (7h32m53.515546699s) [upload=7898]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:58:59.084469013 (7h32m53.515549144s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:58:59.375040151 (7h32m53.806120282s) [upload=7898]: Done uploading segments... Aug 9 00:58:59.375058565 (7h32m53.806138686s) [upload=7898]: Upload finished. err: <nil> Duration:* 1.93275099s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..................X.X.....X................X.........X......] duration: 1.86330956s FAIL (2025-08-09 01:04:35 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 00:58:59.084188727 (7h32m53.515268878s) [upload=7898]: Starting upload Aug 9 00:58:59.084275873 (7h32m53.515356004s) [upload=7898]: Done starting upload Aug 9 00:58:59.084337591 (7h32m53.515417712s) [upload=7898]: Uploading segments... Aug 9 00:58:59.084378901 (7h32m53.515459032s) [upload=7898]: Got next segment. Inline: true Aug 9 00:58:59.084384140 (7h32m53.515464302s) [upload=7898]: Waiting for error group managing segments... Aug 9 00:58:59.084461699 (7h32m53.51554182s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:58:59.084466568 (7h32m53.515546699s) [upload=7898]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:58:59.084469013 (7h32m53.515549144s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:58:59.375040151 (7h32m53.806120282s) [upload=7898]: Done uploading segments... Aug 9 00:58:59.375058565 (7h32m53.806138686s) [upload=7898]: Upload finished. err: <nil> Duration:* 1.86333678s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X.......................X...X.................X.] duration: 5.855097511s FAIL (2025-08-09 01:04:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 01:03:47.960443281 (7h37m42.391523422s) [upload=7978]: Starting upload Aug 9 01:03:47.960491403 (7h37m42.391571524s) [upload=7978]: Done starting upload Aug 9 01:03:47.960601013 (7h37m42.391681144s) [upload=7978]: Uploading segments... Aug 9 01:03:47.960670405 (7h37m42.391750536s) [upload=7978]: Got next segment. Inline: false Aug 9 01:03:47.960715532 (7h37m42.391795663s) [upload=7978]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:47.960720050 (7h37m42.391800181s) [upload=7978]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:48.420438676 (7h37m42.851518807s) [seg_pos={0 0}, upload=7978]: Begin upload segment... Aug 9 01:03:48.420484313 (7h37m42.851564434s) [seg_pos={0 0}, upload=7978]: Done begin upload segment. Aug 9 01:03:48.420520011 (7h37m42.851600142s) [noise=true , address=104.36.82.43:4834 , piece_id=64H36DVR66VFJZ43E6CD2LEXF2IVGNYARWBVXD6NSZTCX6FULVRQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.420969732 (7h37m42.852049863s) [noise=true , address=104.36.82.13:4216 , piece_id=Q6RBO5M7P6FAEHTOTDLX2VQPU2OF6ADUCG4CVJATEFNX4OUALEWA, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.421263734 (7h37m42.852343855s) [noise=true , address=104.36.82.47:4523 , piece_id=KORZZQ6GOIPH6XBEUT5Y5GFJ7Z3EW324KPIV4JVJ7VV57LJTILHQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.421586332 (7h37m42.852666453s) [noise=true , address=104.36.82.37:4655 , piece_id=CEZ5B5RHOVNGP5EEMLQOPQVJJJ2GILQY442AYOSMBVP72CGONMFQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.421868641 (7h37m42.852948773s) [noise=true , address=104.36.82.9:4026 , piece_id=UDBZSKHUQYRDYEU6IT7ITN5GGUY6JJ373WG6ZZABBSYHE6R2VTBQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.421909330 (7h37m42.852989461s) [noise=true , address=64.49.13.27:4965 , piece_id=GDQ3HAFRAL3A5TZQ34DXMC2CQZMCDBEQDOIWJRINB5X3EJVNJP2Q, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.422171862 (7h37m42.853251993s) [noise=true , address=104.36.82.36:4648 , piece_id=5KIOQCLSN74KHMSNMU3C5CKATFQG5BWF3YMRFXY6KZOENXEYVG4Q, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.422223440 (7h37m42.853303561s) [noise=true , address=104.36.82.5:4859 , piece_id=2PD7LATDTEM4KGPNSXLK2Z7GALI7DTNTZSAPXOVW3IHHZJR5NI3Q, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.422436879 (7h37m42.85351701s) [noise=true , address=104.36.82.35:4615 , piece_id=TY5O4DNEVA7NWUYCMPOXTEPOZY7TJLGQ7MHQFMDDQNC4NY64HBEA, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.422772711 (7h37m42.853852882s) [noise=true , address=104.36.82.60:4363 , piece_id=YIRPGIXXGQTIBA7LTEOBQPWJZCRJ3WFPPTNAAJG2KTTYDGAH3NLQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.423183517 (7h37m42.854263638s) [noise=true , address=104.36.82.8:4004 , piece_id=SYDWOUBHGX24OOHKIXFNQPSJN2LF3BW5VSDW45B5UNYMI6KEA76Q, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.423282828 (7h37m42.854362949s) [noise=true , address=104.36.82.23:4463 , piece_id=P3RRZIPZUDFIRD7RLUUFRKRPLIUJINVGI3CZPAD2ZY3SFCO3KCUQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.423435860 (7h37m42.854515991s) [noise=true , address=104.36.82.21:4486 , piece_id=SUHXLN3OL4SPXMBTXVZDPNHX7TR57ADM533LOZ36C3ZVQKIHYLYA, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.423530091 (7h37m42.854610222s) [noise=true , address=104.36.82.62:4434 , piece_id=JMKCIK7AFX2YHI2UBFBN3BCV5RUY2EWTLT4OCQAVTIHWFZNIFB6A, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.423654398 (7h37m42.854734529s) [noise=true , address=104.36.82.39:4727 , piece_id=SSQAYPJOKYHMR52BFUFVVV2LS5LM3RVJ3P7E4FEW5SNHE54GHLQQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.423776953 (7h37m42.854857084s) [noise=true , address=104.36.82.59:4322 , piece_id=HFTQRSMVPYFJE2SIY5ADFDK4F524MPZI6QPD5KUT7ZYACQQPMCAQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.423863388 (7h37m42.85494352s) [noise=true , address=104.36.82.4:4818 , piece_id=FQQFSU6PZ4WNWLN5AZUNGNKQZZOQ6TDJFW3B5XJ3LFRN55HDY5MA, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.424289814 (7h37m42.855369935s) [noise=true , address=64.49.13.138:4490 , piece_id=WNOHL2GB7SLHBTOQFLG373YG522MJ3NUPRXAM25BWNMD56QAEQFQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:49.574519642 (7h37m44.005599783s) [upload=7978]: Next returned nil segment Aug 9 01:03:49.574539751 (7h37m44.005619882s) [upload=7978]: Waiting for error group managing segments... Aug 9 01:03:49.879858896 (7h37m44.310939017s) [noise=true , address=64.49.13.138:4490 , piece_id=WNOHL2GB7SLHBTOQFLG373YG522MJ3NUPRXAM25BWNMD56QAEQFQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:49.890940919 (7h37m44.32202105s) [noise=true , address=64.49.13.27:4965 , piece_id=GDQ3HAFRAL3A5TZQ34DXMC2CQZMCDBEQDOIWJRINB5X3EJVNJP2Q, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.318933265 (7h37m44.750013386s) [noise=true , address=104.36.82.47:4523 , piece_id=KORZZQ6GOIPH6XBEUT5Y5GFJ7Z3EW324KPIV4JVJ7VV57LJTILHQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.395589009 (7h37m44.82666913s) [noise=true , address=104.36.82.59:4322 , piece_id=HFTQRSMVPYFJE2SIY5ADFDK4F524MPZI6QPD5KUT7ZYACQQPMCAQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.447596845 (7h37m44.878676976s) [noise=true , address=104.36.82.39:4727 , piece_id=SSQAYPJOKYHMR52BFUFVVV2LS5LM3RVJ3P7E4FEW5SNHE54GHLQQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.447709581 (7h37m44.878789712s) [noise=true , address=104.36.82.21:4486 , piece_id=SUHXLN3OL4SPXMBTXVZDPNHX7TR57ADM533LOZ36C3ZVQKIHYLYA, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.482050135 (7h37m44.913130266s) [noise=true , address=104.36.82.23:4463 , piece_id=P3RRZIPZUDFIRD7RLUUFRKRPLIUJINVGI3CZPAD2ZY3SFCO3KCUQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.493607628 (7h37m44.924687759s) [noise=true , address=104.36.82.9:4026 , piece_id=UDBZSKHUQYRDYEU6IT7ITN5GGUY6JJ373WG6ZZABBSYHE6R2VTBQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.502119894 (7h37m44.933200025s) [noise=true , address=104.36.82.8:4004 , piece_id=SYDWOUBHGX24OOHKIXFNQPSJN2LF3BW5VSDW45B5UNYMI6KEA76Q, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.504465953 (7h37m44.935546084s) [noise=true , address=104.36.82.5:4859 , piece_id=2PD7LATDTEM4KGPNSXLK2Z7GALI7DTNTZSAPXOVW3IHHZJR5NI3Q, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.519084803 (7h37m44.950164934s) [noise=true , address=104.36.82.36:4648 , piece_id=5KIOQCLSN74KHMSNMU3C5CKATFQG5BWF3YMRFXY6KZOENXEYVG4Q, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.523620892 (7h37m44.954701023s) [noise=true , address=104.36.82.43:4834 , piece_id=64H36DVR66VFJZ43E6CD2LEXF2IVGNYARWBVXD6NSZTCX6FULVRQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.526711355 (7h37m44.957791486s) [noise=true , address=104.36.82.4:4818 , piece_id=FQQFSU6PZ4WNWLN5AZUNGNKQZZOQ6TDJFW3B5XJ3LFRN55HDY5MA, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.665048154 (7h37m45.096128285s) [noise=true , address=104.36.82.62:4434 , piece_id=JMKCIK7AFX2YHI2UBFBN3BCV5RUY2EWTLT4OCQAVTIHWFZNIFB6A, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.665071448 (7h37m45.096151579s) [seg_pos={0 0}, upload=7978]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.665180347 (7h37m45.096260478s) [noise=true , address=104.36.82.37:4655 , piece_id=CEZ5B5RHOVNGP5EEMLQOPQVJJJ2GILQY442AYOSMBVP72CGONMFQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.665304915 (7h37m45.096385046s) [noise=true , address=104.36.82.13:4216 , piece_id=Q6RBO5M7P6FAEHTOTDLX2VQPU2OF6ADUCG4CVJATEFNX4OUALEWA, seg_pos={0 0}, upload=7978]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AgazvjebAo7K4NdQ7zsKkETiNQNfiykHcBDcmXej6eipwWpFu): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.665451796 (7h37m45.096531927s) [noise=true , address=104.36.82.35:4615 , piece_id=TY5O4DNEVA7NWUYCMPOXTEPOZY7TJLGQ7MHQFMDDQNC4NY64HBEA, seg_pos={0 0}, upload=7978]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: write tcp 188.166.225.170:57786->104.36.82.35:4615: use of closed network connection; write tcp 188.166.225.170:57786->104.36.82.35:4615: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57786->104.36.82.35:4615: use of closed network connection Aug 9 01:03:50.665544183 (7h37m45.096624355s) [noise=true , address=104.36.82.60:4363 , piece_id=YIRPGIXXGQTIBA7LTEOBQPWJZCRJ3WFPPTNAAJG2KTTYDGAH3NLQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1endke3P5J92vFytHPiVczH5VcuHDSXyvd4qK9kFNhkQh8MhL7): protocol: write tcp 188.166.225.170:35210->104.36.82.60:4363: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.665580022 (7h37m45.096660153s) [seg_pos={0 0}, upload=7978]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.665649725 (7h37m45.096729857s) [upload=7978]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.665653943 (7h37m45.096734074s) [upload=7978]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:51.036009261 (7h37m45.467089392s) [upload=7978]: Done uploading segments... Aug 9 01:03:51.036022928 (7h37m45.467103059s) [upload=7978]: Upload finished. err: <nil> Duration: 5.855125255s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............X.......................X...X.................X] duration: 4.218941935s FAIL (2025-08-09 01:03:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 01:03:47.960443281 (7h37m42.391523422s) [upload=7978]: Starting upload Aug 9 01:03:47.960491403 (7h37m42.391571524s) [upload=7978]: Done starting upload Aug 9 01:03:47.960601013 (7h37m42.391681144s) [upload=7978]: Uploading segments... Aug 9 01:03:47.960670405 (7h37m42.391750536s) [upload=7978]: Got next segment. Inline: false Aug 9 01:03:47.960715532 (7h37m42.391795663s) [upload=7978]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:47.960720050 (7h37m42.391800181s) [upload=7978]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:48.420438676 (7h37m42.851518807s) [seg_pos={0 0}, upload=7978]: Begin upload segment... Aug 9 01:03:48.420484313 (7h37m42.851564434s) [seg_pos={0 0}, upload=7978]: Done begin upload segment. Aug 9 01:03:48.420520011 (7h37m42.851600142s) [noise=true , address=104.36.82.43:4834 , piece_id=64H36DVR66VFJZ43E6CD2LEXF2IVGNYARWBVXD6NSZTCX6FULVRQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.420969732 (7h37m42.852049863s) [noise=true , address=104.36.82.13:4216 , piece_id=Q6RBO5M7P6FAEHTOTDLX2VQPU2OF6ADUCG4CVJATEFNX4OUALEWA, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.421263734 (7h37m42.852343855s) [noise=true , address=104.36.82.47:4523 , piece_id=KORZZQ6GOIPH6XBEUT5Y5GFJ7Z3EW324KPIV4JVJ7VV57LJTILHQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.421586332 (7h37m42.852666453s) [noise=true , address=104.36.82.37:4655 , piece_id=CEZ5B5RHOVNGP5EEMLQOPQVJJJ2GILQY442AYOSMBVP72CGONMFQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.421868641 (7h37m42.852948773s) [noise=true , address=104.36.82.9:4026 , piece_id=UDBZSKHUQYRDYEU6IT7ITN5GGUY6JJ373WG6ZZABBSYHE6R2VTBQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.421909330 (7h37m42.852989461s) [noise=true , address=64.49.13.27:4965 , piece_id=GDQ3HAFRAL3A5TZQ34DXMC2CQZMCDBEQDOIWJRINB5X3EJVNJP2Q, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.422171862 (7h37m42.853251993s) [noise=true , address=104.36.82.36:4648 , piece_id=5KIOQCLSN74KHMSNMU3C5CKATFQG5BWF3YMRFXY6KZOENXEYVG4Q, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.422223440 (7h37m42.853303561s) [noise=true , address=104.36.82.5:4859 , piece_id=2PD7LATDTEM4KGPNSXLK2Z7GALI7DTNTZSAPXOVW3IHHZJR5NI3Q, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.422436879 (7h37m42.85351701s) [noise=true , address=104.36.82.35:4615 , piece_id=TY5O4DNEVA7NWUYCMPOXTEPOZY7TJLGQ7MHQFMDDQNC4NY64HBEA, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.422772711 (7h37m42.853852882s) [noise=true , address=104.36.82.60:4363 , piece_id=YIRPGIXXGQTIBA7LTEOBQPWJZCRJ3WFPPTNAAJG2KTTYDGAH3NLQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.423183517 (7h37m42.854263638s) [noise=true , address=104.36.82.8:4004 , piece_id=SYDWOUBHGX24OOHKIXFNQPSJN2LF3BW5VSDW45B5UNYMI6KEA76Q, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.423282828 (7h37m42.854362949s) [noise=true , address=104.36.82.23:4463 , piece_id=P3RRZIPZUDFIRD7RLUUFRKRPLIUJINVGI3CZPAD2ZY3SFCO3KCUQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.423435860 (7h37m42.854515991s) [noise=true , address=104.36.82.21:4486 , piece_id=SUHXLN3OL4SPXMBTXVZDPNHX7TR57ADM533LOZ36C3ZVQKIHYLYA, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.423530091 (7h37m42.854610222s) [noise=true , address=104.36.82.62:4434 , piece_id=JMKCIK7AFX2YHI2UBFBN3BCV5RUY2EWTLT4OCQAVTIHWFZNIFB6A, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.423654398 (7h37m42.854734529s) [noise=true , address=104.36.82.39:4727 , piece_id=SSQAYPJOKYHMR52BFUFVVV2LS5LM3RVJ3P7E4FEW5SNHE54GHLQQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.423776953 (7h37m42.854857084s) [noise=true , address=104.36.82.59:4322 , piece_id=HFTQRSMVPYFJE2SIY5ADFDK4F524MPZI6QPD5KUT7ZYACQQPMCAQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.423863388 (7h37m42.85494352s) [noise=true , address=104.36.82.4:4818 , piece_id=FQQFSU6PZ4WNWLN5AZUNGNKQZZOQ6TDJFW3B5XJ3LFRN55HDY5MA, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:48.424289814 (7h37m42.855369935s) [noise=true , address=64.49.13.138:4490 , piece_id=WNOHL2GB7SLHBTOQFLG373YG522MJ3NUPRXAM25BWNMD56QAEQFQ, seg_pos={0 0}, upload=7978]: Uploading piece... Aug 9 01:03:49.574519642 (7h37m44.005599783s) [upload=7978]: Next returned nil segment Aug 9 01:03:49.574539751 (7h37m44.005619882s) [upload=7978]: Waiting for error group managing segments... Aug 9 01:03:49.879858896 (7h37m44.310939017s) [noise=true , address=64.49.13.138:4490 , piece_id=WNOHL2GB7SLHBTOQFLG373YG522MJ3NUPRXAM25BWNMD56QAEQFQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:49.890940919 (7h37m44.32202105s) [noise=true , address=64.49.13.27:4965 , piece_id=GDQ3HAFRAL3A5TZQ34DXMC2CQZMCDBEQDOIWJRINB5X3EJVNJP2Q, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.318933265 (7h37m44.750013386s) [noise=true , address=104.36.82.47:4523 , piece_id=KORZZQ6GOIPH6XBEUT5Y5GFJ7Z3EW324KPIV4JVJ7VV57LJTILHQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.395589009 (7h37m44.82666913s) [noise=true , address=104.36.82.59:4322 , piece_id=HFTQRSMVPYFJE2SIY5ADFDK4F524MPZI6QPD5KUT7ZYACQQPMCAQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.447596845 (7h37m44.878676976s) [noise=true , address=104.36.82.39:4727 , piece_id=SSQAYPJOKYHMR52BFUFVVV2LS5LM3RVJ3P7E4FEW5SNHE54GHLQQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.447709581 (7h37m44.878789712s) [noise=true , address=104.36.82.21:4486 , piece_id=SUHXLN3OL4SPXMBTXVZDPNHX7TR57ADM533LOZ36C3ZVQKIHYLYA, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.482050135 (7h37m44.913130266s) [noise=true , address=104.36.82.23:4463 , piece_id=P3RRZIPZUDFIRD7RLUUFRKRPLIUJINVGI3CZPAD2ZY3SFCO3KCUQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.493607628 (7h37m44.924687759s) [noise=true , address=104.36.82.9:4026 , piece_id=UDBZSKHUQYRDYEU6IT7ITN5GGUY6JJ373WG6ZZABBSYHE6R2VTBQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.502119894 (7h37m44.933200025s) [noise=true , address=104.36.82.8:4004 , piece_id=SYDWOUBHGX24OOHKIXFNQPSJN2LF3BW5VSDW45B5UNYMI6KEA76Q, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.504465953 (7h37m44.935546084s) [noise=true , address=104.36.82.5:4859 , piece_id=2PD7LATDTEM4KGPNSXLK2Z7GALI7DTNTZSAPXOVW3IHHZJR5NI3Q, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.519084803 (7h37m44.950164934s) [noise=true , address=104.36.82.36:4648 , piece_id=5KIOQCLSN74KHMSNMU3C5CKATFQG5BWF3YMRFXY6KZOENXEYVG4Q, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.523620892 (7h37m44.954701023s) [noise=true , address=104.36.82.43:4834 , piece_id=64H36DVR66VFJZ43E6CD2LEXF2IVGNYARWBVXD6NSZTCX6FULVRQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.526711355 (7h37m44.957791486s) [noise=true , address=104.36.82.4:4818 , piece_id=FQQFSU6PZ4WNWLN5AZUNGNKQZZOQ6TDJFW3B5XJ3LFRN55HDY5MA, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.665048154 (7h37m45.096128285s) [noise=true , address=104.36.82.62:4434 , piece_id=JMKCIK7AFX2YHI2UBFBN3BCV5RUY2EWTLT4OCQAVTIHWFZNIFB6A, seg_pos={0 0}, upload=7978]: Done uploading piece. err: <nil> Aug 9 01:03:50.665071448 (7h37m45.096151579s) [seg_pos={0 0}, upload=7978]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.665180347 (7h37m45.096260478s) [noise=true , address=104.36.82.37:4655 , piece_id=CEZ5B5RHOVNGP5EEMLQOPQVJJJ2GILQY442AYOSMBVP72CGONMFQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.665304915 (7h37m45.096385046s) [noise=true , address=104.36.82.13:4216 , piece_id=Q6RBO5M7P6FAEHTOTDLX2VQPU2OF6ADUCG4CVJATEFNX4OUALEWA, seg_pos={0 0}, upload=7978]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AgazvjebAo7K4NdQ7zsKkETiNQNfiykHcBDcmXej6eipwWpFu): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.665451796 (7h37m45.096531927s) [noise=true , address=104.36.82.35:4615 , piece_id=TY5O4DNEVA7NWUYCMPOXTEPOZY7TJLGQ7MHQFMDDQNC4NY64HBEA, seg_pos={0 0}, upload=7978]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: write tcp 188.166.225.170:57786->104.36.82.35:4615: use of closed network connection; write tcp 188.166.225.170:57786->104.36.82.35:4615: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57786->104.36.82.35:4615: use of closed network connection Aug 9 01:03:50.665544183 (7h37m45.096624355s) [noise=true , address=104.36.82.60:4363 , piece_id=YIRPGIXXGQTIBA7LTEOBQPWJZCRJ3WFPPTNAAJG2KTTYDGAH3NLQ, seg_pos={0 0}, upload=7978]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1endke3P5J92vFytHPiVczH5VcuHDSXyvd4qK9kFNhkQh8MhL7): protocol: write tcp 188.166.225.170:35210->104.36.82.60:4363: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.665580022 (7h37m45.096660153s) [seg_pos={0 0}, upload=7978]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.665649725 (7h37m45.096729857s) [upload=7978]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.665653943 (7h37m45.096734074s) [upload=7978]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:51.036009261 (7h37m45.467089392s) [upload=7978]: Done uploading segments... Aug 9 01:03:51.036022928 (7h37m45.467103059s) [upload=7978]: Upload finished. err: <nil> Duration: 4.218968096s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.417513463s FAIL (2025-08-09 01:03:50 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.41753293s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X.......................X...X.................] duration: 6.496156461s FAIL (2025-08-09 01:03:36 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 9 00:48:46.017517689 (7h22m40.44859781s) [upload=7718]: Starting upload Aug 9 00:48:46.017561742 (7h22m40.448641863s) [upload=7718]: Done starting upload Aug 9 00:48:46.017629412 (7h22m40.448709543s) [upload=7718]: Uploading segments... Aug 9 00:48:46.017700498 (7h22m40.448780629s) [upload=7718]: Got next segment. Inline: false Aug 9 00:48:46.017739152 (7h22m40.448819273s) [upload=7718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:48:46.017743611 (7h22m40.448823742s) [upload=7718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 00:48:46.487633950 (7h22m40.918714081s) [seg_pos={0 0}, upload=7718]: Begin upload segment... Aug 9 00:48:46.487687452 (7h22m40.918767583s) [seg_pos={0 0}, upload=7718]: Done begin upload segment. Aug 9 00:48:46.487711057 (7h22m40.918791188s) [noise=true , address=45.91.116.11:4138 , piece_id=UWX4NN52D37ZJXXA5CKNE4N6ZYEWEYPMPPDZ37QM3B5CMQ2MLGMA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.487756925 (7h22m40.918837056s) [noise=true , address=45.91.116.11:4141 , piece_id=UBHP6JVK2FUFYLRVOULFRBMSOTUJCE56E76BU4EI23FHGF6SXPWQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488097557 (7h22m40.919177688s) [noise=true , address=104.36.82.19:4404 , piece_id=5VYJZAMM3H22UKBZWAA2SERPBXBOHUXC7HCIO2UNCJEDIXG3XQYA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488233727 (7h22m40.919313858s) [noise=true , address=104.36.82.15:4292 , piece_id=ZG53SGOH4M4OECCYW5KQKS6XL5PK3H322GP6LX5WFY7O454RAUTA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488374266 (7h22m40.919454397s) [noise=true , address=104.36.82.60:4370 , piece_id=72LHFQLVXCW5X2EYKC7TUUQICLE7R4KXXOE3UVEBC6K24KUON3LA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488628011 (7h22m40.919708142s) [noise=true , address=64.49.13.137:4500 , piece_id=74XIQN5DD2QOUR5D7DRT5CUCENQR74UKK45UEPH6LOHJ3HBURHYQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488856018 (7h22m40.919936139s) [noise=true , address=104.36.82.45:4918 , piece_id=TE7ASCIZM6CWQGUNON6L2WETJPGVRAGISW6LAXHPXHTBZPBEXPCA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489126416 (7h22m40.920206537s) [noise=true , address=104.36.82.4:4812 , piece_id=JX6L3CMRDWCGHMIQI2PIP4LHVXNNHLSKS2RNLAYBMXFJOZU2QCNA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489348511 (7h22m40.920428642s) [noise=true , address=104.36.82.44:4894 , piece_id=YEAPGAAV4XQQTGBJ7AIA4KJPZFPSQ44JDDCCZ2Q4OOBZWDOATFWA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489581706 (7h22m40.920661837s) [noise=true , address=104.36.82.14:4236 , piece_id=IVEBYXCNOQ3AQ4TOBTJEJIJKKB7MB4CHNZFQF2I2DWADEIMFTT2A, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489787100 (7h22m40.920867231s) [noise=true , address=104.36.82.22:4512 , piece_id=ERJOH5YWZ3BAKEMSSWW26EYQBP3ZEDTYMACULERDJ5MBVHGUJP6Q, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489998043 (7h22m40.921078174s) [noise=true , address=104.36.82.35:4588 , piece_id=S2JRBW2BJDMVTOWAN66SAIEOFWDW2ZMV6PCC4JSTUAMZWT566YVA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490181434 (7h22m40.921261565s) [noise=true , address=104.36.82.9:4017 , piece_id=A737253TXYKIQFEZ2CDOR5AQGKFBMONN3MCLIALGZBAQ3IVPENNQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490363022 (7h22m40.921443153s) [noise=true , address=64.49.13.138:4484 , piece_id=XJCMFVWHATEUVJLLD5VQFYG4ZXDH7TNBDOEFH7KV2JL4HM4X4IHQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490552123 (7h22m40.921632254s) [noise=true , address=64.49.13.169:4710 , piece_id=ZEKXCRSD434VSC2ORGR4QPLHOHMJCBQYGVTWIJLWR2XFM5DG5AWA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490745964 (7h22m40.921826085s) [noise=true , address=104.36.82.45:4909 , piece_id=DRFHX4YPP5SMIBBBUQBGDBSVPPLP3LOJKEU5D3VAP6ZFK5YSGU5Q, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490924466 (7h22m40.922004597s) [noise=true , address=104.36.82.37:4663 , piece_id=6PS327IZB4Y26F3W7B6PR5SAVZXJE6OIH5ZFHNOLZJXDI4LICQZA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.491108248 (7h22m40.922188379s) [noise=true , address=104.36.82.62:4435 , piece_id=QTZA2CCHRZK474D4T7MK5DDY2ZUB25XAOWDYYICFWYXHHN4U4GSA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:47.595108697 (7h22m42.026188828s) [upload=7718]: Next returned nil segment Aug 9 00:48:47.595125159 (7h22m42.02620529s) [upload=7718]: Waiting for error group managing segments... Aug 9 00:48:47.877294483 (7h22m42.308374614s) [noise=true , address=64.49.13.138:4484 , piece_id=XJCMFVWHATEUVJLLD5VQFYG4ZXDH7TNBDOEFH7KV2JL4HM4X4IHQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:47.948937908 (7h22m42.380018039s) [noise=true , address=64.49.13.137:4500 , piece_id=74XIQN5DD2QOUR5D7DRT5CUCENQR74UKK45UEPH6LOHJ3HBURHYQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:47.968047280 (7h22m42.399127411s) [noise=true , address=64.49.13.169:4710 , piece_id=ZEKXCRSD434VSC2ORGR4QPLHOHMJCBQYGVTWIJLWR2XFM5DG5AWA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.520661895 (7h22m42.951742026s) [noise=true , address=104.36.82.22:4512 , piece_id=ERJOH5YWZ3BAKEMSSWW26EYQBP3ZEDTYMACULERDJ5MBVHGUJP6Q, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.523938645 (7h22m42.955018776s) [noise=true , address=45.91.116.11:4138 , piece_id=UWX4NN52D37ZJXXA5CKNE4N6ZYEWEYPMPPDZ37QM3B5CMQ2MLGMA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.544420141 (7h22m42.975500272s) [noise=true , address=104.36.82.35:4588 , piece_id=S2JRBW2BJDMVTOWAN66SAIEOFWDW2ZMV6PCC4JSTUAMZWT566YVA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.566672848 (7h22m42.997752979s) [noise=true , address=45.91.116.11:4141 , piece_id=UBHP6JVK2FUFYLRVOULFRBMSOTUJCE56E76BU4EI23FHGF6SXPWQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.582416790 (7h22m43.013496921s) [noise=true , address=104.36.82.60:4370 , piece_id=72LHFQLVXCW5X2EYKC7TUUQICLE7R4KXXOE3UVEBC6K24KUON3LA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.585069256 (7h22m43.016149387s) [noise=true , address=104.36.82.62:4435 , piece_id=QTZA2CCHRZK474D4T7MK5DDY2ZUB25XAOWDYYICFWYXHHN4U4GSA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.658756792 (7h22m43.089836923s) [noise=true , address=104.36.82.37:4663 , piece_id=6PS327IZB4Y26F3W7B6PR5SAVZXJE6OIH5ZFHNOLZJXDI4LICQZA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.659623009 (7h22m43.09070314s) [noise=true , address=104.36.82.14:4236 , piece_id=IVEBYXCNOQ3AQ4TOBTJEJIJKKB7MB4CHNZFQF2I2DWADEIMFTT2A, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.873462627 (7h22m43.304542758s) [noise=true , address=104.36.82.4:4812 , piece_id=JX6L3CMRDWCGHMIQI2PIP4LHVXNNHLSKS2RNLAYBMXFJOZU2QCNA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.259262096 (7h22m43.690342227s) [noise=true , address=104.36.82.9:4017 , piece_id=A737253TXYKIQFEZ2CDOR5AQGKFBMONN3MCLIALGZBAQ3IVPENNQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.319042805 (7h22m43.750122936s) [noise=true , address=104.36.82.45:4909 , piece_id=DRFHX4YPP5SMIBBBUQBGDBSVPPLP3LOJKEU5D3VAP6ZFK5YSGU5Q, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.319066630 (7h22m43.750146761s) [seg_pos={0 0}, upload=7718]: Segment reached optimal threshold of 14 pieces. Aug 9 00:48:49.319407803 (7h22m43.750487934s) [noise=true , address=104.36.82.44:4894 , piece_id=YEAPGAAV4XQQTGBJ7AIA4KJPZFPSQ44JDDCCZ2Q4OOBZWDOATFWA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: rpc: dial tcp 104.36.82.44:4894: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319452639 (7h22m43.75053277s) [noise=true , address=104.36.82.15:4292 , piece_id=ZG53SGOH4M4OECCYW5KQKS6XL5PK3H322GP6LX5WFY7O454RAUTA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UpWmMhEmk5veKZvzsQ3MCxCMnfEKtFgCugBTsYfy9Ejm7G4xD): protocol: read tcp 188.166.225.170:35022->104.36.82.15:4292: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319470654 (7h22m43.750550785s) [noise=true , address=104.36.82.45:4918 , piece_id=TE7ASCIZM6CWQGUNON6L2WETJPGVRAGISW6LAXHPXHTBZPBEXPCA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Nw78dd9WPnmCwv5bFQR3VpV39776Pye2QVGSNMTs3zq2BtaGJ): protocol: expected piece hash; context canceled; EOF Aug 9 00:48:49.319573690 (7h22m43.750653821s) [noise=true , address=104.36.82.19:4404 , piece_id=5VYJZAMM3H22UKBZWAA2SERPBXBOHUXC7HCIO2UNCJEDIXG3XQYA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b): protocol: write tcp 188.166.225.170:41310->104.36.82.19:4404: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319629567 (7h22m43.750709698s) [seg_pos={0 0}, upload=7718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 00:48:49.319709189 (7h22m43.75078932s) [upload=7718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 00:48:49.319714160 (7h22m43.750794291s) [upload=7718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:48:49.635176021 (7h22m44.066256152s) [upload=7718]: Done uploading segments... Aug 9 00:48:49.635194487 (7h22m44.066274618s) [upload=7718]: Upload finished. err: <nil> Duration: 6.49618271s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...................X.X.....X................X.........X.....] duration: 2.053565213s FAIL (2025-08-09 01:03:22 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 00:58:59.084188727 (7h32m53.515268878s) [upload=7898]: Starting upload Aug 9 00:58:59.084275873 (7h32m53.515356004s) [upload=7898]: Done starting upload Aug 9 00:58:59.084337591 (7h32m53.515417712s) [upload=7898]: Uploading segments... Aug 9 00:58:59.084378901 (7h32m53.515459032s) [upload=7898]: Got next segment. Inline: true Aug 9 00:58:59.084384140 (7h32m53.515464302s) [upload=7898]: Waiting for error group managing segments... Aug 9 00:58:59.084461699 (7h32m53.51554182s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:58:59.084466568 (7h32m53.515546699s) [upload=7898]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:58:59.084469013 (7h32m53.515549144s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:58:59.375040151 (7h32m53.806120282s) [upload=7898]: Done uploading segments... Aug 9 00:58:59.375058565 (7h32m53.806138686s) [upload=7898]: Upload finished. err: <nil> Duration:* 2.053592094s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............X.......................X...X................] duration: 5.624847686s FAIL (2025-08-09 01:03:19 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 9 00:48:46.017517689 (7h22m40.44859781s) [upload=7718]: Starting upload Aug 9 00:48:46.017561742 (7h22m40.448641863s) [upload=7718]: Done starting upload Aug 9 00:48:46.017629412 (7h22m40.448709543s) [upload=7718]: Uploading segments... Aug 9 00:48:46.017700498 (7h22m40.448780629s) [upload=7718]: Got next segment. Inline: false Aug 9 00:48:46.017739152 (7h22m40.448819273s) [upload=7718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:48:46.017743611 (7h22m40.448823742s) [upload=7718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 00:48:46.487633950 (7h22m40.918714081s) [seg_pos={0 0}, upload=7718]: Begin upload segment... Aug 9 00:48:46.487687452 (7h22m40.918767583s) [seg_pos={0 0}, upload=7718]: Done begin upload segment. Aug 9 00:48:46.487711057 (7h22m40.918791188s) [noise=true , address=45.91.116.11:4138 , piece_id=UWX4NN52D37ZJXXA5CKNE4N6ZYEWEYPMPPDZ37QM3B5CMQ2MLGMA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.487756925 (7h22m40.918837056s) [noise=true , address=45.91.116.11:4141 , piece_id=UBHP6JVK2FUFYLRVOULFRBMSOTUJCE56E76BU4EI23FHGF6SXPWQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488097557 (7h22m40.919177688s) [noise=true , address=104.36.82.19:4404 , piece_id=5VYJZAMM3H22UKBZWAA2SERPBXBOHUXC7HCIO2UNCJEDIXG3XQYA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488233727 (7h22m40.919313858s) [noise=true , address=104.36.82.15:4292 , piece_id=ZG53SGOH4M4OECCYW5KQKS6XL5PK3H322GP6LX5WFY7O454RAUTA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488374266 (7h22m40.919454397s) [noise=true , address=104.36.82.60:4370 , piece_id=72LHFQLVXCW5X2EYKC7TUUQICLE7R4KXXOE3UVEBC6K24KUON3LA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488628011 (7h22m40.919708142s) [noise=true , address=64.49.13.137:4500 , piece_id=74XIQN5DD2QOUR5D7DRT5CUCENQR74UKK45UEPH6LOHJ3HBURHYQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488856018 (7h22m40.919936139s) [noise=true , address=104.36.82.45:4918 , piece_id=TE7ASCIZM6CWQGUNON6L2WETJPGVRAGISW6LAXHPXHTBZPBEXPCA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489126416 (7h22m40.920206537s) [noise=true , address=104.36.82.4:4812 , piece_id=JX6L3CMRDWCGHMIQI2PIP4LHVXNNHLSKS2RNLAYBMXFJOZU2QCNA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489348511 (7h22m40.920428642s) [noise=true , address=104.36.82.44:4894 , piece_id=YEAPGAAV4XQQTGBJ7AIA4KJPZFPSQ44JDDCCZ2Q4OOBZWDOATFWA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489581706 (7h22m40.920661837s) [noise=true , address=104.36.82.14:4236 , piece_id=IVEBYXCNOQ3AQ4TOBTJEJIJKKB7MB4CHNZFQF2I2DWADEIMFTT2A, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489787100 (7h22m40.920867231s) [noise=true , address=104.36.82.22:4512 , piece_id=ERJOH5YWZ3BAKEMSSWW26EYQBP3ZEDTYMACULERDJ5MBVHGUJP6Q, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489998043 (7h22m40.921078174s) [noise=true , address=104.36.82.35:4588 , piece_id=S2JRBW2BJDMVTOWAN66SAIEOFWDW2ZMV6PCC4JSTUAMZWT566YVA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490181434 (7h22m40.921261565s) [noise=true , address=104.36.82.9:4017 , piece_id=A737253TXYKIQFEZ2CDOR5AQGKFBMONN3MCLIALGZBAQ3IVPENNQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490363022 (7h22m40.921443153s) [noise=true , address=64.49.13.138:4484 , piece_id=XJCMFVWHATEUVJLLD5VQFYG4ZXDH7TNBDOEFH7KV2JL4HM4X4IHQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490552123 (7h22m40.921632254s) [noise=true , address=64.49.13.169:4710 , piece_id=ZEKXCRSD434VSC2ORGR4QPLHOHMJCBQYGVTWIJLWR2XFM5DG5AWA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490745964 (7h22m40.921826085s) [noise=true , address=104.36.82.45:4909 , piece_id=DRFHX4YPP5SMIBBBUQBGDBSVPPLP3LOJKEU5D3VAP6ZFK5YSGU5Q, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490924466 (7h22m40.922004597s) [noise=true , address=104.36.82.37:4663 , piece_id=6PS327IZB4Y26F3W7B6PR5SAVZXJE6OIH5ZFHNOLZJXDI4LICQZA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.491108248 (7h22m40.922188379s) [noise=true , address=104.36.82.62:4435 , piece_id=QTZA2CCHRZK474D4T7MK5DDY2ZUB25XAOWDYYICFWYXHHN4U4GSA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:47.595108697 (7h22m42.026188828s) [upload=7718]: Next returned nil segment Aug 9 00:48:47.595125159 (7h22m42.02620529s) [upload=7718]: Waiting for error group managing segments... Aug 9 00:48:47.877294483 (7h22m42.308374614s) [noise=true , address=64.49.13.138:4484 , piece_id=XJCMFVWHATEUVJLLD5VQFYG4ZXDH7TNBDOEFH7KV2JL4HM4X4IHQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:47.948937908 (7h22m42.380018039s) [noise=true , address=64.49.13.137:4500 , piece_id=74XIQN5DD2QOUR5D7DRT5CUCENQR74UKK45UEPH6LOHJ3HBURHYQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:47.968047280 (7h22m42.399127411s) [noise=true , address=64.49.13.169:4710 , piece_id=ZEKXCRSD434VSC2ORGR4QPLHOHMJCBQYGVTWIJLWR2XFM5DG5AWA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.520661895 (7h22m42.951742026s) [noise=true , address=104.36.82.22:4512 , piece_id=ERJOH5YWZ3BAKEMSSWW26EYQBP3ZEDTYMACULERDJ5MBVHGUJP6Q, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.523938645 (7h22m42.955018776s) [noise=true , address=45.91.116.11:4138 , piece_id=UWX4NN52D37ZJXXA5CKNE4N6ZYEWEYPMPPDZ37QM3B5CMQ2MLGMA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.544420141 (7h22m42.975500272s) [noise=true , address=104.36.82.35:4588 , piece_id=S2JRBW2BJDMVTOWAN66SAIEOFWDW2ZMV6PCC4JSTUAMZWT566YVA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.566672848 (7h22m42.997752979s) [noise=true , address=45.91.116.11:4141 , piece_id=UBHP6JVK2FUFYLRVOULFRBMSOTUJCE56E76BU4EI23FHGF6SXPWQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.582416790 (7h22m43.013496921s) [noise=true , address=104.36.82.60:4370 , piece_id=72LHFQLVXCW5X2EYKC7TUUQICLE7R4KXXOE3UVEBC6K24KUON3LA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.585069256 (7h22m43.016149387s) [noise=true , address=104.36.82.62:4435 , piece_id=QTZA2CCHRZK474D4T7MK5DDY2ZUB25XAOWDYYICFWYXHHN4U4GSA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.658756792 (7h22m43.089836923s) [noise=true , address=104.36.82.37:4663 , piece_id=6PS327IZB4Y26F3W7B6PR5SAVZXJE6OIH5ZFHNOLZJXDI4LICQZA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.659623009 (7h22m43.09070314s) [noise=true , address=104.36.82.14:4236 , piece_id=IVEBYXCNOQ3AQ4TOBTJEJIJKKB7MB4CHNZFQF2I2DWADEIMFTT2A, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.873462627 (7h22m43.304542758s) [noise=true , address=104.36.82.4:4812 , piece_id=JX6L3CMRDWCGHMIQI2PIP4LHVXNNHLSKS2RNLAYBMXFJOZU2QCNA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.259262096 (7h22m43.690342227s) [noise=true , address=104.36.82.9:4017 , piece_id=A737253TXYKIQFEZ2CDOR5AQGKFBMONN3MCLIALGZBAQ3IVPENNQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.319042805 (7h22m43.750122936s) [noise=true , address=104.36.82.45:4909 , piece_id=DRFHX4YPP5SMIBBBUQBGDBSVPPLP3LOJKEU5D3VAP6ZFK5YSGU5Q, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.319066630 (7h22m43.750146761s) [seg_pos={0 0}, upload=7718]: Segment reached optimal threshold of 14 pieces. Aug 9 00:48:49.319407803 (7h22m43.750487934s) [noise=true , address=104.36.82.44:4894 , piece_id=YEAPGAAV4XQQTGBJ7AIA4KJPZFPSQ44JDDCCZ2Q4OOBZWDOATFWA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: rpc: dial tcp 104.36.82.44:4894: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319452639 (7h22m43.75053277s) [noise=true , address=104.36.82.15:4292 , piece_id=ZG53SGOH4M4OECCYW5KQKS6XL5PK3H322GP6LX5WFY7O454RAUTA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UpWmMhEmk5veKZvzsQ3MCxCMnfEKtFgCugBTsYfy9Ejm7G4xD): protocol: read tcp 188.166.225.170:35022->104.36.82.15:4292: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319470654 (7h22m43.750550785s) [noise=true , address=104.36.82.45:4918 , piece_id=TE7ASCIZM6CWQGUNON6L2WETJPGVRAGISW6LAXHPXHTBZPBEXPCA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Nw78dd9WPnmCwv5bFQR3VpV39776Pye2QVGSNMTs3zq2BtaGJ): protocol: expected piece hash; context canceled; EOF Aug 9 00:48:49.319573690 (7h22m43.750653821s) [noise=true , address=104.36.82.19:4404 , piece_id=5VYJZAMM3H22UKBZWAA2SERPBXBOHUXC7HCIO2UNCJEDIXG3XQYA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b): protocol: write tcp 188.166.225.170:41310->104.36.82.19:4404: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319629567 (7h22m43.750709698s) [seg_pos={0 0}, upload=7718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 00:48:49.319709189 (7h22m43.75078932s) [upload=7718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 00:48:49.319714160 (7h22m43.750794291s) [upload=7718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:48:49.635176021 (7h22m44.066256152s) [upload=7718]: Done uploading segments... Aug 9 00:48:49.635194487 (7h22m44.066274618s) [upload=7718]: Upload finished. err: <nil> Duration: 5.624891199s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.376829264s FAIL (2025-08-09 01:02:40 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.376844071s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................X.......................X...X...............] duration: 5.969141468s FAIL (2025-08-09 01:02:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 9 00:48:46.017517689 (7h22m40.44859781s) [upload=7718]: Starting upload Aug 9 00:48:46.017561742 (7h22m40.448641863s) [upload=7718]: Done starting upload Aug 9 00:48:46.017629412 (7h22m40.448709543s) [upload=7718]: Uploading segments... Aug 9 00:48:46.017700498 (7h22m40.448780629s) [upload=7718]: Got next segment. Inline: false Aug 9 00:48:46.017739152 (7h22m40.448819273s) [upload=7718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:48:46.017743611 (7h22m40.448823742s) [upload=7718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 00:48:46.487633950 (7h22m40.918714081s) [seg_pos={0 0}, upload=7718]: Begin upload segment... Aug 9 00:48:46.487687452 (7h22m40.918767583s) [seg_pos={0 0}, upload=7718]: Done begin upload segment. Aug 9 00:48:46.487711057 (7h22m40.918791188s) [noise=true , address=45.91.116.11:4138 , piece_id=UWX4NN52D37ZJXXA5CKNE4N6ZYEWEYPMPPDZ37QM3B5CMQ2MLGMA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.487756925 (7h22m40.918837056s) [noise=true , address=45.91.116.11:4141 , piece_id=UBHP6JVK2FUFYLRVOULFRBMSOTUJCE56E76BU4EI23FHGF6SXPWQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488097557 (7h22m40.919177688s) [noise=true , address=104.36.82.19:4404 , piece_id=5VYJZAMM3H22UKBZWAA2SERPBXBOHUXC7HCIO2UNCJEDIXG3XQYA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488233727 (7h22m40.919313858s) [noise=true , address=104.36.82.15:4292 , piece_id=ZG53SGOH4M4OECCYW5KQKS6XL5PK3H322GP6LX5WFY7O454RAUTA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488374266 (7h22m40.919454397s) [noise=true , address=104.36.82.60:4370 , piece_id=72LHFQLVXCW5X2EYKC7TUUQICLE7R4KXXOE3UVEBC6K24KUON3LA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488628011 (7h22m40.919708142s) [noise=true , address=64.49.13.137:4500 , piece_id=74XIQN5DD2QOUR5D7DRT5CUCENQR74UKK45UEPH6LOHJ3HBURHYQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488856018 (7h22m40.919936139s) [noise=true , address=104.36.82.45:4918 , piece_id=TE7ASCIZM6CWQGUNON6L2WETJPGVRAGISW6LAXHPXHTBZPBEXPCA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489126416 (7h22m40.920206537s) [noise=true , address=104.36.82.4:4812 , piece_id=JX6L3CMRDWCGHMIQI2PIP4LHVXNNHLSKS2RNLAYBMXFJOZU2QCNA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489348511 (7h22m40.920428642s) [noise=true , address=104.36.82.44:4894 , piece_id=YEAPGAAV4XQQTGBJ7AIA4KJPZFPSQ44JDDCCZ2Q4OOBZWDOATFWA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489581706 (7h22m40.920661837s) [noise=true , address=104.36.82.14:4236 , piece_id=IVEBYXCNOQ3AQ4TOBTJEJIJKKB7MB4CHNZFQF2I2DWADEIMFTT2A, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489787100 (7h22m40.920867231s) [noise=true , address=104.36.82.22:4512 , piece_id=ERJOH5YWZ3BAKEMSSWW26EYQBP3ZEDTYMACULERDJ5MBVHGUJP6Q, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489998043 (7h22m40.921078174s) [noise=true , address=104.36.82.35:4588 , piece_id=S2JRBW2BJDMVTOWAN66SAIEOFWDW2ZMV6PCC4JSTUAMZWT566YVA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490181434 (7h22m40.921261565s) [noise=true , address=104.36.82.9:4017 , piece_id=A737253TXYKIQFEZ2CDOR5AQGKFBMONN3MCLIALGZBAQ3IVPENNQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490363022 (7h22m40.921443153s) [noise=true , address=64.49.13.138:4484 , piece_id=XJCMFVWHATEUVJLLD5VQFYG4ZXDH7TNBDOEFH7KV2JL4HM4X4IHQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490552123 (7h22m40.921632254s) [noise=true , address=64.49.13.169:4710 , piece_id=ZEKXCRSD434VSC2ORGR4QPLHOHMJCBQYGVTWIJLWR2XFM5DG5AWA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490745964 (7h22m40.921826085s) [noise=true , address=104.36.82.45:4909 , piece_id=DRFHX4YPP5SMIBBBUQBGDBSVPPLP3LOJKEU5D3VAP6ZFK5YSGU5Q, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490924466 (7h22m40.922004597s) [noise=true , address=104.36.82.37:4663 , piece_id=6PS327IZB4Y26F3W7B6PR5SAVZXJE6OIH5ZFHNOLZJXDI4LICQZA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.491108248 (7h22m40.922188379s) [noise=true , address=104.36.82.62:4435 , piece_id=QTZA2CCHRZK474D4T7MK5DDY2ZUB25XAOWDYYICFWYXHHN4U4GSA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:47.595108697 (7h22m42.026188828s) [upload=7718]: Next returned nil segment Aug 9 00:48:47.595125159 (7h22m42.02620529s) [upload=7718]: Waiting for error group managing segments... Aug 9 00:48:47.877294483 (7h22m42.308374614s) [noise=true , address=64.49.13.138:4484 , piece_id=XJCMFVWHATEUVJLLD5VQFYG4ZXDH7TNBDOEFH7KV2JL4HM4X4IHQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:47.948937908 (7h22m42.380018039s) [noise=true , address=64.49.13.137:4500 , piece_id=74XIQN5DD2QOUR5D7DRT5CUCENQR74UKK45UEPH6LOHJ3HBURHYQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:47.968047280 (7h22m42.399127411s) [noise=true , address=64.49.13.169:4710 , piece_id=ZEKXCRSD434VSC2ORGR4QPLHOHMJCBQYGVTWIJLWR2XFM5DG5AWA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.520661895 (7h22m42.951742026s) [noise=true , address=104.36.82.22:4512 , piece_id=ERJOH5YWZ3BAKEMSSWW26EYQBP3ZEDTYMACULERDJ5MBVHGUJP6Q, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.523938645 (7h22m42.955018776s) [noise=true , address=45.91.116.11:4138 , piece_id=UWX4NN52D37ZJXXA5CKNE4N6ZYEWEYPMPPDZ37QM3B5CMQ2MLGMA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.544420141 (7h22m42.975500272s) [noise=true , address=104.36.82.35:4588 , piece_id=S2JRBW2BJDMVTOWAN66SAIEOFWDW2ZMV6PCC4JSTUAMZWT566YVA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.566672848 (7h22m42.997752979s) [noise=true , address=45.91.116.11:4141 , piece_id=UBHP6JVK2FUFYLRVOULFRBMSOTUJCE56E76BU4EI23FHGF6SXPWQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.582416790 (7h22m43.013496921s) [noise=true , address=104.36.82.60:4370 , piece_id=72LHFQLVXCW5X2EYKC7TUUQICLE7R4KXXOE3UVEBC6K24KUON3LA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.585069256 (7h22m43.016149387s) [noise=true , address=104.36.82.62:4435 , piece_id=QTZA2CCHRZK474D4T7MK5DDY2ZUB25XAOWDYYICFWYXHHN4U4GSA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.658756792 (7h22m43.089836923s) [noise=true , address=104.36.82.37:4663 , piece_id=6PS327IZB4Y26F3W7B6PR5SAVZXJE6OIH5ZFHNOLZJXDI4LICQZA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.659623009 (7h22m43.09070314s) [noise=true , address=104.36.82.14:4236 , piece_id=IVEBYXCNOQ3AQ4TOBTJEJIJKKB7MB4CHNZFQF2I2DWADEIMFTT2A, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.873462627 (7h22m43.304542758s) [noise=true , address=104.36.82.4:4812 , piece_id=JX6L3CMRDWCGHMIQI2PIP4LHVXNNHLSKS2RNLAYBMXFJOZU2QCNA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.259262096 (7h22m43.690342227s) [noise=true , address=104.36.82.9:4017 , piece_id=A737253TXYKIQFEZ2CDOR5AQGKFBMONN3MCLIALGZBAQ3IVPENNQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.319042805 (7h22m43.750122936s) [noise=true , address=104.36.82.45:4909 , piece_id=DRFHX4YPP5SMIBBBUQBGDBSVPPLP3LOJKEU5D3VAP6ZFK5YSGU5Q, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.319066630 (7h22m43.750146761s) [seg_pos={0 0}, upload=7718]: Segment reached optimal threshold of 14 pieces. Aug 9 00:48:49.319407803 (7h22m43.750487934s) [noise=true , address=104.36.82.44:4894 , piece_id=YEAPGAAV4XQQTGBJ7AIA4KJPZFPSQ44JDDCCZ2Q4OOBZWDOATFWA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: rpc: dial tcp 104.36.82.44:4894: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319452639 (7h22m43.75053277s) [noise=true , address=104.36.82.15:4292 , piece_id=ZG53SGOH4M4OECCYW5KQKS6XL5PK3H322GP6LX5WFY7O454RAUTA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UpWmMhEmk5veKZvzsQ3MCxCMnfEKtFgCugBTsYfy9Ejm7G4xD): protocol: read tcp 188.166.225.170:35022->104.36.82.15:4292: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319470654 (7h22m43.750550785s) [noise=true , address=104.36.82.45:4918 , piece_id=TE7ASCIZM6CWQGUNON6L2WETJPGVRAGISW6LAXHPXHTBZPBEXPCA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Nw78dd9WPnmCwv5bFQR3VpV39776Pye2QVGSNMTs3zq2BtaGJ): protocol: expected piece hash; context canceled; EOF Aug 9 00:48:49.319573690 (7h22m43.750653821s) [noise=true , address=104.36.82.19:4404 , piece_id=5VYJZAMM3H22UKBZWAA2SERPBXBOHUXC7HCIO2UNCJEDIXG3XQYA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b): protocol: write tcp 188.166.225.170:41310->104.36.82.19:4404: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319629567 (7h22m43.750709698s) [seg_pos={0 0}, upload=7718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 00:48:49.319709189 (7h22m43.75078932s) [upload=7718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 00:48:49.319714160 (7h22m43.750794291s) [upload=7718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:48:49.635176021 (7h22m44.066256152s) [upload=7718]: Done uploading segments... Aug 9 00:48:49.635194487 (7h22m44.066274618s) [upload=7718]: Upload finished. err: <nil> Duration: 5.96916933s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [....................X.X.....X................X.........X....] duration: 1.85360449s FAIL (2025-08-09 01:02:24 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 00:58:59.084188727 (7h32m53.515268878s) [upload=7898]: Starting upload Aug 9 00:58:59.084275873 (7h32m53.515356004s) [upload=7898]: Done starting upload Aug 9 00:58:59.084337591 (7h32m53.515417712s) [upload=7898]: Uploading segments... Aug 9 00:58:59.084378901 (7h32m53.515459032s) [upload=7898]: Got next segment. Inline: true Aug 9 00:58:59.084384140 (7h32m53.515464302s) [upload=7898]: Waiting for error group managing segments... Aug 9 00:58:59.084461699 (7h32m53.51554182s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:58:59.084466568 (7h32m53.515546699s) [upload=7898]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:58:59.084469013 (7h32m53.515549144s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:58:59.375040151 (7h32m53.806120282s) [upload=7898]: Done uploading segments... Aug 9 00:58:59.375058565 (7h32m53.806138686s) [upload=7898]: Upload finished. err: <nil> Duration:* 1.853629747s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.372625901s FAIL (2025-08-09 01:01:37 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.3726466s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.....................X.X.....X................X.........X...] duration: 1.875911559s FAIL (2025-08-09 01:01:28 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 00:58:59.084188727 (7h32m53.515268878s) [upload=7898]: Starting upload Aug 9 00:58:59.084275873 (7h32m53.515356004s) [upload=7898]: Done starting upload Aug 9 00:58:59.084337591 (7h32m53.515417712s) [upload=7898]: Uploading segments... Aug 9 00:58:59.084378901 (7h32m53.515459032s) [upload=7898]: Got next segment. Inline: true Aug 9 00:58:59.084384140 (7h32m53.515464302s) [upload=7898]: Waiting for error group managing segments... Aug 9 00:58:59.084461699 (7h32m53.51554182s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:58:59.084466568 (7h32m53.515546699s) [upload=7898]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:58:59.084469013 (7h32m53.515549144s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:58:59.375040151 (7h32m53.806120282s) [upload=7898]: Done uploading segments... Aug 9 00:58:59.375058565 (7h32m53.806138686s) [upload=7898]: Upload finished. err: <nil> Duration:* 1.875942388s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................X.......................X...X..............] duration: 6.11506124s FAIL (2025-08-09 01:01:23 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 9 00:48:46.017517689 (7h22m40.44859781s) [upload=7718]: Starting upload Aug 9 00:48:46.017561742 (7h22m40.448641863s) [upload=7718]: Done starting upload Aug 9 00:48:46.017629412 (7h22m40.448709543s) [upload=7718]: Uploading segments... Aug 9 00:48:46.017700498 (7h22m40.448780629s) [upload=7718]: Got next segment. Inline: false Aug 9 00:48:46.017739152 (7h22m40.448819273s) [upload=7718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:48:46.017743611 (7h22m40.448823742s) [upload=7718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 00:48:46.487633950 (7h22m40.918714081s) [seg_pos={0 0}, upload=7718]: Begin upload segment... Aug 9 00:48:46.487687452 (7h22m40.918767583s) [seg_pos={0 0}, upload=7718]: Done begin upload segment. Aug 9 00:48:46.487711057 (7h22m40.918791188s) [noise=true , address=45.91.116.11:4138 , piece_id=UWX4NN52D37ZJXXA5CKNE4N6ZYEWEYPMPPDZ37QM3B5CMQ2MLGMA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.487756925 (7h22m40.918837056s) [noise=true , address=45.91.116.11:4141 , piece_id=UBHP6JVK2FUFYLRVOULFRBMSOTUJCE56E76BU4EI23FHGF6SXPWQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488097557 (7h22m40.919177688s) [noise=true , address=104.36.82.19:4404 , piece_id=5VYJZAMM3H22UKBZWAA2SERPBXBOHUXC7HCIO2UNCJEDIXG3XQYA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488233727 (7h22m40.919313858s) [noise=true , address=104.36.82.15:4292 , piece_id=ZG53SGOH4M4OECCYW5KQKS6XL5PK3H322GP6LX5WFY7O454RAUTA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488374266 (7h22m40.919454397s) [noise=true , address=104.36.82.60:4370 , piece_id=72LHFQLVXCW5X2EYKC7TUUQICLE7R4KXXOE3UVEBC6K24KUON3LA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488628011 (7h22m40.919708142s) [noise=true , address=64.49.13.137:4500 , piece_id=74XIQN5DD2QOUR5D7DRT5CUCENQR74UKK45UEPH6LOHJ3HBURHYQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488856018 (7h22m40.919936139s) [noise=true , address=104.36.82.45:4918 , piece_id=TE7ASCIZM6CWQGUNON6L2WETJPGVRAGISW6LAXHPXHTBZPBEXPCA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489126416 (7h22m40.920206537s) [noise=true , address=104.36.82.4:4812 , piece_id=JX6L3CMRDWCGHMIQI2PIP4LHVXNNHLSKS2RNLAYBMXFJOZU2QCNA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489348511 (7h22m40.920428642s) [noise=true , address=104.36.82.44:4894 , piece_id=YEAPGAAV4XQQTGBJ7AIA4KJPZFPSQ44JDDCCZ2Q4OOBZWDOATFWA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489581706 (7h22m40.920661837s) [noise=true , address=104.36.82.14:4236 , piece_id=IVEBYXCNOQ3AQ4TOBTJEJIJKKB7MB4CHNZFQF2I2DWADEIMFTT2A, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489787100 (7h22m40.920867231s) [noise=true , address=104.36.82.22:4512 , piece_id=ERJOH5YWZ3BAKEMSSWW26EYQBP3ZEDTYMACULERDJ5MBVHGUJP6Q, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489998043 (7h22m40.921078174s) [noise=true , address=104.36.82.35:4588 , piece_id=S2JRBW2BJDMVTOWAN66SAIEOFWDW2ZMV6PCC4JSTUAMZWT566YVA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490181434 (7h22m40.921261565s) [noise=true , address=104.36.82.9:4017 , piece_id=A737253TXYKIQFEZ2CDOR5AQGKFBMONN3MCLIALGZBAQ3IVPENNQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490363022 (7h22m40.921443153s) [noise=true , address=64.49.13.138:4484 , piece_id=XJCMFVWHATEUVJLLD5VQFYG4ZXDH7TNBDOEFH7KV2JL4HM4X4IHQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490552123 (7h22m40.921632254s) [noise=true , address=64.49.13.169:4710 , piece_id=ZEKXCRSD434VSC2ORGR4QPLHOHMJCBQYGVTWIJLWR2XFM5DG5AWA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490745964 (7h22m40.921826085s) [noise=true , address=104.36.82.45:4909 , piece_id=DRFHX4YPP5SMIBBBUQBGDBSVPPLP3LOJKEU5D3VAP6ZFK5YSGU5Q, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490924466 (7h22m40.922004597s) [noise=true , address=104.36.82.37:4663 , piece_id=6PS327IZB4Y26F3W7B6PR5SAVZXJE6OIH5ZFHNOLZJXDI4LICQZA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.491108248 (7h22m40.922188379s) [noise=true , address=104.36.82.62:4435 , piece_id=QTZA2CCHRZK474D4T7MK5DDY2ZUB25XAOWDYYICFWYXHHN4U4GSA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:47.595108697 (7h22m42.026188828s) [upload=7718]: Next returned nil segment Aug 9 00:48:47.595125159 (7h22m42.02620529s) [upload=7718]: Waiting for error group managing segments... Aug 9 00:48:47.877294483 (7h22m42.308374614s) [noise=true , address=64.49.13.138:4484 , piece_id=XJCMFVWHATEUVJLLD5VQFYG4ZXDH7TNBDOEFH7KV2JL4HM4X4IHQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:47.948937908 (7h22m42.380018039s) [noise=true , address=64.49.13.137:4500 , piece_id=74XIQN5DD2QOUR5D7DRT5CUCENQR74UKK45UEPH6LOHJ3HBURHYQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:47.968047280 (7h22m42.399127411s) [noise=true , address=64.49.13.169:4710 , piece_id=ZEKXCRSD434VSC2ORGR4QPLHOHMJCBQYGVTWIJLWR2XFM5DG5AWA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.520661895 (7h22m42.951742026s) [noise=true , address=104.36.82.22:4512 , piece_id=ERJOH5YWZ3BAKEMSSWW26EYQBP3ZEDTYMACULERDJ5MBVHGUJP6Q, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.523938645 (7h22m42.955018776s) [noise=true , address=45.91.116.11:4138 , piece_id=UWX4NN52D37ZJXXA5CKNE4N6ZYEWEYPMPPDZ37QM3B5CMQ2MLGMA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.544420141 (7h22m42.975500272s) [noise=true , address=104.36.82.35:4588 , piece_id=S2JRBW2BJDMVTOWAN66SAIEOFWDW2ZMV6PCC4JSTUAMZWT566YVA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.566672848 (7h22m42.997752979s) [noise=true , address=45.91.116.11:4141 , piece_id=UBHP6JVK2FUFYLRVOULFRBMSOTUJCE56E76BU4EI23FHGF6SXPWQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.582416790 (7h22m43.013496921s) [noise=true , address=104.36.82.60:4370 , piece_id=72LHFQLVXCW5X2EYKC7TUUQICLE7R4KXXOE3UVEBC6K24KUON3LA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.585069256 (7h22m43.016149387s) [noise=true , address=104.36.82.62:4435 , piece_id=QTZA2CCHRZK474D4T7MK5DDY2ZUB25XAOWDYYICFWYXHHN4U4GSA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.658756792 (7h22m43.089836923s) [noise=true , address=104.36.82.37:4663 , piece_id=6PS327IZB4Y26F3W7B6PR5SAVZXJE6OIH5ZFHNOLZJXDI4LICQZA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.659623009 (7h22m43.09070314s) [noise=true , address=104.36.82.14:4236 , piece_id=IVEBYXCNOQ3AQ4TOBTJEJIJKKB7MB4CHNZFQF2I2DWADEIMFTT2A, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.873462627 (7h22m43.304542758s) [noise=true , address=104.36.82.4:4812 , piece_id=JX6L3CMRDWCGHMIQI2PIP4LHVXNNHLSKS2RNLAYBMXFJOZU2QCNA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.259262096 (7h22m43.690342227s) [noise=true , address=104.36.82.9:4017 , piece_id=A737253TXYKIQFEZ2CDOR5AQGKFBMONN3MCLIALGZBAQ3IVPENNQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.319042805 (7h22m43.750122936s) [noise=true , address=104.36.82.45:4909 , piece_id=DRFHX4YPP5SMIBBBUQBGDBSVPPLP3LOJKEU5D3VAP6ZFK5YSGU5Q, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.319066630 (7h22m43.750146761s) [seg_pos={0 0}, upload=7718]: Segment reached optimal threshold of 14 pieces. Aug 9 00:48:49.319407803 (7h22m43.750487934s) [noise=true , address=104.36.82.44:4894 , piece_id=YEAPGAAV4XQQTGBJ7AIA4KJPZFPSQ44JDDCCZ2Q4OOBZWDOATFWA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: rpc: dial tcp 104.36.82.44:4894: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319452639 (7h22m43.75053277s) [noise=true , address=104.36.82.15:4292 , piece_id=ZG53SGOH4M4OECCYW5KQKS6XL5PK3H322GP6LX5WFY7O454RAUTA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UpWmMhEmk5veKZvzsQ3MCxCMnfEKtFgCugBTsYfy9Ejm7G4xD): protocol: read tcp 188.166.225.170:35022->104.36.82.15:4292: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319470654 (7h22m43.750550785s) [noise=true , address=104.36.82.45:4918 , piece_id=TE7ASCIZM6CWQGUNON6L2WETJPGVRAGISW6LAXHPXHTBZPBEXPCA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Nw78dd9WPnmCwv5bFQR3VpV39776Pye2QVGSNMTs3zq2BtaGJ): protocol: expected piece hash; context canceled; EOF Aug 9 00:48:49.319573690 (7h22m43.750653821s) [noise=true , address=104.36.82.19:4404 , piece_id=5VYJZAMM3H22UKBZWAA2SERPBXBOHUXC7HCIO2UNCJEDIXG3XQYA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b): protocol: write tcp 188.166.225.170:41310->104.36.82.19:4404: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319629567 (7h22m43.750709698s) [seg_pos={0 0}, upload=7718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 00:48:49.319709189 (7h22m43.75078932s) [upload=7718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 00:48:49.319714160 (7h22m43.750794291s) [upload=7718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:48:49.635176021 (7h22m44.066256152s) [upload=7718]: Done uploading segments... Aug 9 00:48:49.635194487 (7h22m44.066274618s) [upload=7718]: Upload finished. err: <nil> Duration: 6.115094755s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 713.266989ms FAIL (2025-08-09 01:01:07 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 713.303258ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.392395304s FAIL (2025-08-09 01:00:53 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.39241867s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 748.182993ms FAIL (2025-08-09 01:00:45 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 748.211829ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [......................X.X.....X................X.........X..] duration: 1.918830847s FAIL (2025-08-09 01:00:30 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 00:58:59.084188727 (7h32m53.515268878s) [upload=7898]: Starting upload Aug 9 00:58:59.084275873 (7h32m53.515356004s) [upload=7898]: Done starting upload Aug 9 00:58:59.084337591 (7h32m53.515417712s) [upload=7898]: Uploading segments... Aug 9 00:58:59.084378901 (7h32m53.515459032s) [upload=7898]: Got next segment. Inline: true Aug 9 00:58:59.084384140 (7h32m53.515464302s) [upload=7898]: Waiting for error group managing segments... Aug 9 00:58:59.084461699 (7h32m53.51554182s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:58:59.084466568 (7h32m53.515546699s) [upload=7898]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:58:59.084469013 (7h32m53.515549144s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:58:59.375040151 (7h32m53.806120282s) [upload=7898]: Done uploading segments... Aug 9 00:58:59.375058565 (7h32m53.806138686s) [upload=7898]: Upload finished. err: <nil> Duration:* 1.918862219s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.......................X.X.....X................X.........X.] duration: 1.887014062s FAIL (2025-08-09 01:00:13 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 00:58:59.084188727 (7h32m53.515268878s) [upload=7898]: Starting upload Aug 9 00:58:59.084275873 (7h32m53.515356004s) [upload=7898]: Done starting upload Aug 9 00:58:59.084337591 (7h32m53.515417712s) [upload=7898]: Uploading segments... Aug 9 00:58:59.084378901 (7h32m53.515459032s) [upload=7898]: Got next segment. Inline: true Aug 9 00:58:59.084384140 (7h32m53.515464302s) [upload=7898]: Waiting for error group managing segments... Aug 9 00:58:59.084461699 (7h32m53.51554182s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:58:59.084466568 (7h32m53.515546699s) [upload=7898]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:58:59.084469013 (7h32m53.515549144s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:58:59.375040151 (7h32m53.806120282s) [upload=7898]: Done uploading segments... Aug 9 00:58:59.375058565 (7h32m53.806138686s) [upload=7898]: Upload finished. err: <nil> Duration:* 1.887046335s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................X.......................X...X.............] duration: 7.23967685s FAIL (2025-08-09 01:00:12 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 9 00:48:46.017517689 (7h22m40.44859781s) [upload=7718]: Starting upload Aug 9 00:48:46.017561742 (7h22m40.448641863s) [upload=7718]: Done starting upload Aug 9 00:48:46.017629412 (7h22m40.448709543s) [upload=7718]: Uploading segments... Aug 9 00:48:46.017700498 (7h22m40.448780629s) [upload=7718]: Got next segment. Inline: false Aug 9 00:48:46.017739152 (7h22m40.448819273s) [upload=7718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:48:46.017743611 (7h22m40.448823742s) [upload=7718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 00:48:46.487633950 (7h22m40.918714081s) [seg_pos={0 0}, upload=7718]: Begin upload segment... Aug 9 00:48:46.487687452 (7h22m40.918767583s) [seg_pos={0 0}, upload=7718]: Done begin upload segment. Aug 9 00:48:46.487711057 (7h22m40.918791188s) [noise=true , address=45.91.116.11:4138 , piece_id=UWX4NN52D37ZJXXA5CKNE4N6ZYEWEYPMPPDZ37QM3B5CMQ2MLGMA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.487756925 (7h22m40.918837056s) [noise=true , address=45.91.116.11:4141 , piece_id=UBHP6JVK2FUFYLRVOULFRBMSOTUJCE56E76BU4EI23FHGF6SXPWQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488097557 (7h22m40.919177688s) [noise=true , address=104.36.82.19:4404 , piece_id=5VYJZAMM3H22UKBZWAA2SERPBXBOHUXC7HCIO2UNCJEDIXG3XQYA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488233727 (7h22m40.919313858s) [noise=true , address=104.36.82.15:4292 , piece_id=ZG53SGOH4M4OECCYW5KQKS6XL5PK3H322GP6LX5WFY7O454RAUTA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488374266 (7h22m40.919454397s) [noise=true , address=104.36.82.60:4370 , piece_id=72LHFQLVXCW5X2EYKC7TUUQICLE7R4KXXOE3UVEBC6K24KUON3LA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488628011 (7h22m40.919708142s) [noise=true , address=64.49.13.137:4500 , piece_id=74XIQN5DD2QOUR5D7DRT5CUCENQR74UKK45UEPH6LOHJ3HBURHYQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488856018 (7h22m40.919936139s) [noise=true , address=104.36.82.45:4918 , piece_id=TE7ASCIZM6CWQGUNON6L2WETJPGVRAGISW6LAXHPXHTBZPBEXPCA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489126416 (7h22m40.920206537s) [noise=true , address=104.36.82.4:4812 , piece_id=JX6L3CMRDWCGHMIQI2PIP4LHVXNNHLSKS2RNLAYBMXFJOZU2QCNA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489348511 (7h22m40.920428642s) [noise=true , address=104.36.82.44:4894 , piece_id=YEAPGAAV4XQQTGBJ7AIA4KJPZFPSQ44JDDCCZ2Q4OOBZWDOATFWA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489581706 (7h22m40.920661837s) [noise=true , address=104.36.82.14:4236 , piece_id=IVEBYXCNOQ3AQ4TOBTJEJIJKKB7MB4CHNZFQF2I2DWADEIMFTT2A, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489787100 (7h22m40.920867231s) [noise=true , address=104.36.82.22:4512 , piece_id=ERJOH5YWZ3BAKEMSSWW26EYQBP3ZEDTYMACULERDJ5MBVHGUJP6Q, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489998043 (7h22m40.921078174s) [noise=true , address=104.36.82.35:4588 , piece_id=S2JRBW2BJDMVTOWAN66SAIEOFWDW2ZMV6PCC4JSTUAMZWT566YVA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490181434 (7h22m40.921261565s) [noise=true , address=104.36.82.9:4017 , piece_id=A737253TXYKIQFEZ2CDOR5AQGKFBMONN3MCLIALGZBAQ3IVPENNQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490363022 (7h22m40.921443153s) [noise=true , address=64.49.13.138:4484 , piece_id=XJCMFVWHATEUVJLLD5VQFYG4ZXDH7TNBDOEFH7KV2JL4HM4X4IHQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490552123 (7h22m40.921632254s) [noise=true , address=64.49.13.169:4710 , piece_id=ZEKXCRSD434VSC2ORGR4QPLHOHMJCBQYGVTWIJLWR2XFM5DG5AWA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490745964 (7h22m40.921826085s) [noise=true , address=104.36.82.45:4909 , piece_id=DRFHX4YPP5SMIBBBUQBGDBSVPPLP3LOJKEU5D3VAP6ZFK5YSGU5Q, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490924466 (7h22m40.922004597s) [noise=true , address=104.36.82.37:4663 , piece_id=6PS327IZB4Y26F3W7B6PR5SAVZXJE6OIH5ZFHNOLZJXDI4LICQZA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.491108248 (7h22m40.922188379s) [noise=true , address=104.36.82.62:4435 , piece_id=QTZA2CCHRZK474D4T7MK5DDY2ZUB25XAOWDYYICFWYXHHN4U4GSA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:47.595108697 (7h22m42.026188828s) [upload=7718]: Next returned nil segment Aug 9 00:48:47.595125159 (7h22m42.02620529s) [upload=7718]: Waiting for error group managing segments... Aug 9 00:48:47.877294483 (7h22m42.308374614s) [noise=true , address=64.49.13.138:4484 , piece_id=XJCMFVWHATEUVJLLD5VQFYG4ZXDH7TNBDOEFH7KV2JL4HM4X4IHQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:47.948937908 (7h22m42.380018039s) [noise=true , address=64.49.13.137:4500 , piece_id=74XIQN5DD2QOUR5D7DRT5CUCENQR74UKK45UEPH6LOHJ3HBURHYQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:47.968047280 (7h22m42.399127411s) [noise=true , address=64.49.13.169:4710 , piece_id=ZEKXCRSD434VSC2ORGR4QPLHOHMJCBQYGVTWIJLWR2XFM5DG5AWA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.520661895 (7h22m42.951742026s) [noise=true , address=104.36.82.22:4512 , piece_id=ERJOH5YWZ3BAKEMSSWW26EYQBP3ZEDTYMACULERDJ5MBVHGUJP6Q, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.523938645 (7h22m42.955018776s) [noise=true , address=45.91.116.11:4138 , piece_id=UWX4NN52D37ZJXXA5CKNE4N6ZYEWEYPMPPDZ37QM3B5CMQ2MLGMA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.544420141 (7h22m42.975500272s) [noise=true , address=104.36.82.35:4588 , piece_id=S2JRBW2BJDMVTOWAN66SAIEOFWDW2ZMV6PCC4JSTUAMZWT566YVA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.566672848 (7h22m42.997752979s) [noise=true , address=45.91.116.11:4141 , piece_id=UBHP6JVK2FUFYLRVOULFRBMSOTUJCE56E76BU4EI23FHGF6SXPWQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.582416790 (7h22m43.013496921s) [noise=true , address=104.36.82.60:4370 , piece_id=72LHFQLVXCW5X2EYKC7TUUQICLE7R4KXXOE3UVEBC6K24KUON3LA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.585069256 (7h22m43.016149387s) [noise=true , address=104.36.82.62:4435 , piece_id=QTZA2CCHRZK474D4T7MK5DDY2ZUB25XAOWDYYICFWYXHHN4U4GSA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.658756792 (7h22m43.089836923s) [noise=true , address=104.36.82.37:4663 , piece_id=6PS327IZB4Y26F3W7B6PR5SAVZXJE6OIH5ZFHNOLZJXDI4LICQZA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.659623009 (7h22m43.09070314s) [noise=true , address=104.36.82.14:4236 , piece_id=IVEBYXCNOQ3AQ4TOBTJEJIJKKB7MB4CHNZFQF2I2DWADEIMFTT2A, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.873462627 (7h22m43.304542758s) [noise=true , address=104.36.82.4:4812 , piece_id=JX6L3CMRDWCGHMIQI2PIP4LHVXNNHLSKS2RNLAYBMXFJOZU2QCNA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.259262096 (7h22m43.690342227s) [noise=true , address=104.36.82.9:4017 , piece_id=A737253TXYKIQFEZ2CDOR5AQGKFBMONN3MCLIALGZBAQ3IVPENNQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.319042805 (7h22m43.750122936s) [noise=true , address=104.36.82.45:4909 , piece_id=DRFHX4YPP5SMIBBBUQBGDBSVPPLP3LOJKEU5D3VAP6ZFK5YSGU5Q, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.319066630 (7h22m43.750146761s) [seg_pos={0 0}, upload=7718]: Segment reached optimal threshold of 14 pieces. Aug 9 00:48:49.319407803 (7h22m43.750487934s) [noise=true , address=104.36.82.44:4894 , piece_id=YEAPGAAV4XQQTGBJ7AIA4KJPZFPSQ44JDDCCZ2Q4OOBZWDOATFWA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: rpc: dial tcp 104.36.82.44:4894: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319452639 (7h22m43.75053277s) [noise=true , address=104.36.82.15:4292 , piece_id=ZG53SGOH4M4OECCYW5KQKS6XL5PK3H322GP6LX5WFY7O454RAUTA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UpWmMhEmk5veKZvzsQ3MCxCMnfEKtFgCugBTsYfy9Ejm7G4xD): protocol: read tcp 188.166.225.170:35022->104.36.82.15:4292: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319470654 (7h22m43.750550785s) [noise=true , address=104.36.82.45:4918 , piece_id=TE7ASCIZM6CWQGUNON6L2WETJPGVRAGISW6LAXHPXHTBZPBEXPCA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Nw78dd9WPnmCwv5bFQR3VpV39776Pye2QVGSNMTs3zq2BtaGJ): protocol: expected piece hash; context canceled; EOF Aug 9 00:48:49.319573690 (7h22m43.750653821s) [noise=true , address=104.36.82.19:4404 , piece_id=5VYJZAMM3H22UKBZWAA2SERPBXBOHUXC7HCIO2UNCJEDIXG3XQYA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b): protocol: write tcp 188.166.225.170:41310->104.36.82.19:4404: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319629567 (7h22m43.750709698s) [seg_pos={0 0}, upload=7718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 00:48:49.319709189 (7h22m43.75078932s) [upload=7718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 00:48:49.319714160 (7h22m43.750794291s) [upload=7718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:48:49.635176021 (7h22m44.066256152s) [upload=7718]: Done uploading segments... Aug 9 00:48:49.635194487 (7h22m44.066274618s) [upload=7718]: Upload finished. err: <nil> Duration: 7.239724541s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.342231039s FAIL (2025-08-09 01:00:12 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.342271005s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 725.572864ms FAIL (2025-08-09 01:00:00 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 725.603162ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.27568184s FAIL (2025-08-09 00:59:49 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.275717788s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.326390808s FAIL (2025-08-09 00:59:18 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.326404364s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 746.21595ms FAIL (2025-08-09 00:59:04 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 746.253653ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................X.......................X...X............] duration: 7.620250817s FAIL (2025-08-09 00:59:03 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 9 00:48:46.017517689 (7h22m40.44859781s) [upload=7718]: Starting upload Aug 9 00:48:46.017561742 (7h22m40.448641863s) [upload=7718]: Done starting upload Aug 9 00:48:46.017629412 (7h22m40.448709543s) [upload=7718]: Uploading segments... Aug 9 00:48:46.017700498 (7h22m40.448780629s) [upload=7718]: Got next segment. Inline: false Aug 9 00:48:46.017739152 (7h22m40.448819273s) [upload=7718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:48:46.017743611 (7h22m40.448823742s) [upload=7718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 00:48:46.487633950 (7h22m40.918714081s) [seg_pos={0 0}, upload=7718]: Begin upload segment... Aug 9 00:48:46.487687452 (7h22m40.918767583s) [seg_pos={0 0}, upload=7718]: Done begin upload segment. Aug 9 00:48:46.487711057 (7h22m40.918791188s) [noise=true , address=45.91.116.11:4138 , piece_id=UWX4NN52D37ZJXXA5CKNE4N6ZYEWEYPMPPDZ37QM3B5CMQ2MLGMA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.487756925 (7h22m40.918837056s) [noise=true , address=45.91.116.11:4141 , piece_id=UBHP6JVK2FUFYLRVOULFRBMSOTUJCE56E76BU4EI23FHGF6SXPWQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488097557 (7h22m40.919177688s) [noise=true , address=104.36.82.19:4404 , piece_id=5VYJZAMM3H22UKBZWAA2SERPBXBOHUXC7HCIO2UNCJEDIXG3XQYA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488233727 (7h22m40.919313858s) [noise=true , address=104.36.82.15:4292 , piece_id=ZG53SGOH4M4OECCYW5KQKS6XL5PK3H322GP6LX5WFY7O454RAUTA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488374266 (7h22m40.919454397s) [noise=true , address=104.36.82.60:4370 , piece_id=72LHFQLVXCW5X2EYKC7TUUQICLE7R4KXXOE3UVEBC6K24KUON3LA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488628011 (7h22m40.919708142s) [noise=true , address=64.49.13.137:4500 , piece_id=74XIQN5DD2QOUR5D7DRT5CUCENQR74UKK45UEPH6LOHJ3HBURHYQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488856018 (7h22m40.919936139s) [noise=true , address=104.36.82.45:4918 , piece_id=TE7ASCIZM6CWQGUNON6L2WETJPGVRAGISW6LAXHPXHTBZPBEXPCA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489126416 (7h22m40.920206537s) [noise=true , address=104.36.82.4:4812 , piece_id=JX6L3CMRDWCGHMIQI2PIP4LHVXNNHLSKS2RNLAYBMXFJOZU2QCNA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489348511 (7h22m40.920428642s) [noise=true , address=104.36.82.44:4894 , piece_id=YEAPGAAV4XQQTGBJ7AIA4KJPZFPSQ44JDDCCZ2Q4OOBZWDOATFWA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489581706 (7h22m40.920661837s) [noise=true , address=104.36.82.14:4236 , piece_id=IVEBYXCNOQ3AQ4TOBTJEJIJKKB7MB4CHNZFQF2I2DWADEIMFTT2A, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489787100 (7h22m40.920867231s) [noise=true , address=104.36.82.22:4512 , piece_id=ERJOH5YWZ3BAKEMSSWW26EYQBP3ZEDTYMACULERDJ5MBVHGUJP6Q, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489998043 (7h22m40.921078174s) [noise=true , address=104.36.82.35:4588 , piece_id=S2JRBW2BJDMVTOWAN66SAIEOFWDW2ZMV6PCC4JSTUAMZWT566YVA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490181434 (7h22m40.921261565s) [noise=true , address=104.36.82.9:4017 , piece_id=A737253TXYKIQFEZ2CDOR5AQGKFBMONN3MCLIALGZBAQ3IVPENNQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490363022 (7h22m40.921443153s) [noise=true , address=64.49.13.138:4484 , piece_id=XJCMFVWHATEUVJLLD5VQFYG4ZXDH7TNBDOEFH7KV2JL4HM4X4IHQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490552123 (7h22m40.921632254s) [noise=true , address=64.49.13.169:4710 , piece_id=ZEKXCRSD434VSC2ORGR4QPLHOHMJCBQYGVTWIJLWR2XFM5DG5AWA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490745964 (7h22m40.921826085s) [noise=true , address=104.36.82.45:4909 , piece_id=DRFHX4YPP5SMIBBBUQBGDBSVPPLP3LOJKEU5D3VAP6ZFK5YSGU5Q, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490924466 (7h22m40.922004597s) [noise=true , address=104.36.82.37:4663 , piece_id=6PS327IZB4Y26F3W7B6PR5SAVZXJE6OIH5ZFHNOLZJXDI4LICQZA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.491108248 (7h22m40.922188379s) [noise=true , address=104.36.82.62:4435 , piece_id=QTZA2CCHRZK474D4T7MK5DDY2ZUB25XAOWDYYICFWYXHHN4U4GSA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:47.595108697 (7h22m42.026188828s) [upload=7718]: Next returned nil segment Aug 9 00:48:47.595125159 (7h22m42.02620529s) [upload=7718]: Waiting for error group managing segments... Aug 9 00:48:47.877294483 (7h22m42.308374614s) [noise=true , address=64.49.13.138:4484 , piece_id=XJCMFVWHATEUVJLLD5VQFYG4ZXDH7TNBDOEFH7KV2JL4HM4X4IHQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:47.948937908 (7h22m42.380018039s) [noise=true , address=64.49.13.137:4500 , piece_id=74XIQN5DD2QOUR5D7DRT5CUCENQR74UKK45UEPH6LOHJ3HBURHYQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:47.968047280 (7h22m42.399127411s) [noise=true , address=64.49.13.169:4710 , piece_id=ZEKXCRSD434VSC2ORGR4QPLHOHMJCBQYGVTWIJLWR2XFM5DG5AWA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.520661895 (7h22m42.951742026s) [noise=true , address=104.36.82.22:4512 , piece_id=ERJOH5YWZ3BAKEMSSWW26EYQBP3ZEDTYMACULERDJ5MBVHGUJP6Q, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.523938645 (7h22m42.955018776s) [noise=true , address=45.91.116.11:4138 , piece_id=UWX4NN52D37ZJXXA5CKNE4N6ZYEWEYPMPPDZ37QM3B5CMQ2MLGMA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.544420141 (7h22m42.975500272s) [noise=true , address=104.36.82.35:4588 , piece_id=S2JRBW2BJDMVTOWAN66SAIEOFWDW2ZMV6PCC4JSTUAMZWT566YVA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.566672848 (7h22m42.997752979s) [noise=true , address=45.91.116.11:4141 , piece_id=UBHP6JVK2FUFYLRVOULFRBMSOTUJCE56E76BU4EI23FHGF6SXPWQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.582416790 (7h22m43.013496921s) [noise=true , address=104.36.82.60:4370 , piece_id=72LHFQLVXCW5X2EYKC7TUUQICLE7R4KXXOE3UVEBC6K24KUON3LA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.585069256 (7h22m43.016149387s) [noise=true , address=104.36.82.62:4435 , piece_id=QTZA2CCHRZK474D4T7MK5DDY2ZUB25XAOWDYYICFWYXHHN4U4GSA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.658756792 (7h22m43.089836923s) [noise=true , address=104.36.82.37:4663 , piece_id=6PS327IZB4Y26F3W7B6PR5SAVZXJE6OIH5ZFHNOLZJXDI4LICQZA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.659623009 (7h22m43.09070314s) [noise=true , address=104.36.82.14:4236 , piece_id=IVEBYXCNOQ3AQ4TOBTJEJIJKKB7MB4CHNZFQF2I2DWADEIMFTT2A, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.873462627 (7h22m43.304542758s) [noise=true , address=104.36.82.4:4812 , piece_id=JX6L3CMRDWCGHMIQI2PIP4LHVXNNHLSKS2RNLAYBMXFJOZU2QCNA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.259262096 (7h22m43.690342227s) [noise=true , address=104.36.82.9:4017 , piece_id=A737253TXYKIQFEZ2CDOR5AQGKFBMONN3MCLIALGZBAQ3IVPENNQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.319042805 (7h22m43.750122936s) [noise=true , address=104.36.82.45:4909 , piece_id=DRFHX4YPP5SMIBBBUQBGDBSVPPLP3LOJKEU5D3VAP6ZFK5YSGU5Q, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.319066630 (7h22m43.750146761s) [seg_pos={0 0}, upload=7718]: Segment reached optimal threshold of 14 pieces. Aug 9 00:48:49.319407803 (7h22m43.750487934s) [noise=true , address=104.36.82.44:4894 , piece_id=YEAPGAAV4XQQTGBJ7AIA4KJPZFPSQ44JDDCCZ2Q4OOBZWDOATFWA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: rpc: dial tcp 104.36.82.44:4894: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319452639 (7h22m43.75053277s) [noise=true , address=104.36.82.15:4292 , piece_id=ZG53SGOH4M4OECCYW5KQKS6XL5PK3H322GP6LX5WFY7O454RAUTA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UpWmMhEmk5veKZvzsQ3MCxCMnfEKtFgCugBTsYfy9Ejm7G4xD): protocol: read tcp 188.166.225.170:35022->104.36.82.15:4292: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319470654 (7h22m43.750550785s) [noise=true , address=104.36.82.45:4918 , piece_id=TE7ASCIZM6CWQGUNON6L2WETJPGVRAGISW6LAXHPXHTBZPBEXPCA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Nw78dd9WPnmCwv5bFQR3VpV39776Pye2QVGSNMTs3zq2BtaGJ): protocol: expected piece hash; context canceled; EOF Aug 9 00:48:49.319573690 (7h22m43.750653821s) [noise=true , address=104.36.82.19:4404 , piece_id=5VYJZAMM3H22UKBZWAA2SERPBXBOHUXC7HCIO2UNCJEDIXG3XQYA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b): protocol: write tcp 188.166.225.170:41310->104.36.82.19:4404: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319629567 (7h22m43.750709698s) [seg_pos={0 0}, upload=7718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 00:48:49.319709189 (7h22m43.75078932s) [upload=7718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 00:48:49.319714160 (7h22m43.750794291s) [upload=7718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:48:49.635176021 (7h22m44.066256152s) [upload=7718]: Done uploading segments... Aug 9 00:48:49.635194487 (7h22m44.066274618s) [upload=7718]: Upload finished. err: <nil> Duration: 7.620274754s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [........................X.X.....X................X.........X] duration: 1.625909794s FAIL (2025-08-09 00:59:00 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 00:58:59.084188727 (7h32m53.515268878s) [upload=7898]: Starting upload Aug 9 00:58:59.084275873 (7h32m53.515356004s) [upload=7898]: Done starting upload Aug 9 00:58:59.084337591 (7h32m53.515417712s) [upload=7898]: Uploading segments... Aug 9 00:58:59.084378901 (7h32m53.515459032s) [upload=7898]: Got next segment. Inline: true Aug 9 00:58:59.084384140 (7h32m53.515464302s) [upload=7898]: Waiting for error group managing segments... Aug 9 00:58:59.084461699 (7h32m53.51554182s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:58:59.084466568 (7h32m53.515546699s) [upload=7898]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:58:59.084469013 (7h32m53.515549144s) [upload=7898]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:58:59.375040151 (7h32m53.806120282s) [upload=7898]: Done uploading segments... Aug 9 00:58:59.375058565 (7h32m53.806138686s) [upload=7898]: Upload finished. err: <nil> Duration:* 1.625933569s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................X.......................X...X...........] duration: 6.39787338s FAIL (2025-08-09 00:58:44 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 9 00:48:46.017517689 (7h22m40.44859781s) [upload=7718]: Starting upload Aug 9 00:48:46.017561742 (7h22m40.448641863s) [upload=7718]: Done starting upload Aug 9 00:48:46.017629412 (7h22m40.448709543s) [upload=7718]: Uploading segments... Aug 9 00:48:46.017700498 (7h22m40.448780629s) [upload=7718]: Got next segment. Inline: false Aug 9 00:48:46.017739152 (7h22m40.448819273s) [upload=7718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:48:46.017743611 (7h22m40.448823742s) [upload=7718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 00:48:46.487633950 (7h22m40.918714081s) [seg_pos={0 0}, upload=7718]: Begin upload segment... Aug 9 00:48:46.487687452 (7h22m40.918767583s) [seg_pos={0 0}, upload=7718]: Done begin upload segment. Aug 9 00:48:46.487711057 (7h22m40.918791188s) [noise=true , address=45.91.116.11:4138 , piece_id=UWX4NN52D37ZJXXA5CKNE4N6ZYEWEYPMPPDZ37QM3B5CMQ2MLGMA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.487756925 (7h22m40.918837056s) [noise=true , address=45.91.116.11:4141 , piece_id=UBHP6JVK2FUFYLRVOULFRBMSOTUJCE56E76BU4EI23FHGF6SXPWQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488097557 (7h22m40.919177688s) [noise=true , address=104.36.82.19:4404 , piece_id=5VYJZAMM3H22UKBZWAA2SERPBXBOHUXC7HCIO2UNCJEDIXG3XQYA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488233727 (7h22m40.919313858s) [noise=true , address=104.36.82.15:4292 , piece_id=ZG53SGOH4M4OECCYW5KQKS6XL5PK3H322GP6LX5WFY7O454RAUTA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488374266 (7h22m40.919454397s) [noise=true , address=104.36.82.60:4370 , piece_id=72LHFQLVXCW5X2EYKC7TUUQICLE7R4KXXOE3UVEBC6K24KUON3LA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488628011 (7h22m40.919708142s) [noise=true , address=64.49.13.137:4500 , piece_id=74XIQN5DD2QOUR5D7DRT5CUCENQR74UKK45UEPH6LOHJ3HBURHYQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488856018 (7h22m40.919936139s) [noise=true , address=104.36.82.45:4918 , piece_id=TE7ASCIZM6CWQGUNON6L2WETJPGVRAGISW6LAXHPXHTBZPBEXPCA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489126416 (7h22m40.920206537s) [noise=true , address=104.36.82.4:4812 , piece_id=JX6L3CMRDWCGHMIQI2PIP4LHVXNNHLSKS2RNLAYBMXFJOZU2QCNA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489348511 (7h22m40.920428642s) [noise=true , address=104.36.82.44:4894 , piece_id=YEAPGAAV4XQQTGBJ7AIA4KJPZFPSQ44JDDCCZ2Q4OOBZWDOATFWA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489581706 (7h22m40.920661837s) [noise=true , address=104.36.82.14:4236 , piece_id=IVEBYXCNOQ3AQ4TOBTJEJIJKKB7MB4CHNZFQF2I2DWADEIMFTT2A, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489787100 (7h22m40.920867231s) [noise=true , address=104.36.82.22:4512 , piece_id=ERJOH5YWZ3BAKEMSSWW26EYQBP3ZEDTYMACULERDJ5MBVHGUJP6Q, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489998043 (7h22m40.921078174s) [noise=true , address=104.36.82.35:4588 , piece_id=S2JRBW2BJDMVTOWAN66SAIEOFWDW2ZMV6PCC4JSTUAMZWT566YVA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490181434 (7h22m40.921261565s) [noise=true , address=104.36.82.9:4017 , piece_id=A737253TXYKIQFEZ2CDOR5AQGKFBMONN3MCLIALGZBAQ3IVPENNQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490363022 (7h22m40.921443153s) [noise=true , address=64.49.13.138:4484 , piece_id=XJCMFVWHATEUVJLLD5VQFYG4ZXDH7TNBDOEFH7KV2JL4HM4X4IHQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490552123 (7h22m40.921632254s) [noise=true , address=64.49.13.169:4710 , piece_id=ZEKXCRSD434VSC2ORGR4QPLHOHMJCBQYGVTWIJLWR2XFM5DG5AWA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490745964 (7h22m40.921826085s) [noise=true , address=104.36.82.45:4909 , piece_id=DRFHX4YPP5SMIBBBUQBGDBSVPPLP3LOJKEU5D3VAP6ZFK5YSGU5Q, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490924466 (7h22m40.922004597s) [noise=true , address=104.36.82.37:4663 , piece_id=6PS327IZB4Y26F3W7B6PR5SAVZXJE6OIH5ZFHNOLZJXDI4LICQZA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.491108248 (7h22m40.922188379s) [noise=true , address=104.36.82.62:4435 , piece_id=QTZA2CCHRZK474D4T7MK5DDY2ZUB25XAOWDYYICFWYXHHN4U4GSA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:47.595108697 (7h22m42.026188828s) [upload=7718]: Next returned nil segment Aug 9 00:48:47.595125159 (7h22m42.02620529s) [upload=7718]: Waiting for error group managing segments... Aug 9 00:48:47.877294483 (7h22m42.308374614s) [noise=true , address=64.49.13.138:4484 , piece_id=XJCMFVWHATEUVJLLD5VQFYG4ZXDH7TNBDOEFH7KV2JL4HM4X4IHQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:47.948937908 (7h22m42.380018039s) [noise=true , address=64.49.13.137:4500 , piece_id=74XIQN5DD2QOUR5D7DRT5CUCENQR74UKK45UEPH6LOHJ3HBURHYQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:47.968047280 (7h22m42.399127411s) [noise=true , address=64.49.13.169:4710 , piece_id=ZEKXCRSD434VSC2ORGR4QPLHOHMJCBQYGVTWIJLWR2XFM5DG5AWA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.520661895 (7h22m42.951742026s) [noise=true , address=104.36.82.22:4512 , piece_id=ERJOH5YWZ3BAKEMSSWW26EYQBP3ZEDTYMACULERDJ5MBVHGUJP6Q, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.523938645 (7h22m42.955018776s) [noise=true , address=45.91.116.11:4138 , piece_id=UWX4NN52D37ZJXXA5CKNE4N6ZYEWEYPMPPDZ37QM3B5CMQ2MLGMA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.544420141 (7h22m42.975500272s) [noise=true , address=104.36.82.35:4588 , piece_id=S2JRBW2BJDMVTOWAN66SAIEOFWDW2ZMV6PCC4JSTUAMZWT566YVA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.566672848 (7h22m42.997752979s) [noise=true , address=45.91.116.11:4141 , piece_id=UBHP6JVK2FUFYLRVOULFRBMSOTUJCE56E76BU4EI23FHGF6SXPWQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.582416790 (7h22m43.013496921s) [noise=true , address=104.36.82.60:4370 , piece_id=72LHFQLVXCW5X2EYKC7TUUQICLE7R4KXXOE3UVEBC6K24KUON3LA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.585069256 (7h22m43.016149387s) [noise=true , address=104.36.82.62:4435 , piece_id=QTZA2CCHRZK474D4T7MK5DDY2ZUB25XAOWDYYICFWYXHHN4U4GSA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.658756792 (7h22m43.089836923s) [noise=true , address=104.36.82.37:4663 , piece_id=6PS327IZB4Y26F3W7B6PR5SAVZXJE6OIH5ZFHNOLZJXDI4LICQZA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.659623009 (7h22m43.09070314s) [noise=true , address=104.36.82.14:4236 , piece_id=IVEBYXCNOQ3AQ4TOBTJEJIJKKB7MB4CHNZFQF2I2DWADEIMFTT2A, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.873462627 (7h22m43.304542758s) [noise=true , address=104.36.82.4:4812 , piece_id=JX6L3CMRDWCGHMIQI2PIP4LHVXNNHLSKS2RNLAYBMXFJOZU2QCNA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.259262096 (7h22m43.690342227s) [noise=true , address=104.36.82.9:4017 , piece_id=A737253TXYKIQFEZ2CDOR5AQGKFBMONN3MCLIALGZBAQ3IVPENNQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.319042805 (7h22m43.750122936s) [noise=true , address=104.36.82.45:4909 , piece_id=DRFHX4YPP5SMIBBBUQBGDBSVPPLP3LOJKEU5D3VAP6ZFK5YSGU5Q, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.319066630 (7h22m43.750146761s) [seg_pos={0 0}, upload=7718]: Segment reached optimal threshold of 14 pieces. Aug 9 00:48:49.319407803 (7h22m43.750487934s) [noise=true , address=104.36.82.44:4894 , piece_id=YEAPGAAV4XQQTGBJ7AIA4KJPZFPSQ44JDDCCZ2Q4OOBZWDOATFWA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: rpc: dial tcp 104.36.82.44:4894: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319452639 (7h22m43.75053277s) [noise=true , address=104.36.82.15:4292 , piece_id=ZG53SGOH4M4OECCYW5KQKS6XL5PK3H322GP6LX5WFY7O454RAUTA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UpWmMhEmk5veKZvzsQ3MCxCMnfEKtFgCugBTsYfy9Ejm7G4xD): protocol: read tcp 188.166.225.170:35022->104.36.82.15:4292: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319470654 (7h22m43.750550785s) [noise=true , address=104.36.82.45:4918 , piece_id=TE7ASCIZM6CWQGUNON6L2WETJPGVRAGISW6LAXHPXHTBZPBEXPCA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Nw78dd9WPnmCwv5bFQR3VpV39776Pye2QVGSNMTs3zq2BtaGJ): protocol: expected piece hash; context canceled; EOF Aug 9 00:48:49.319573690 (7h22m43.750653821s) [noise=true , address=104.36.82.19:4404 , piece_id=5VYJZAMM3H22UKBZWAA2SERPBXBOHUXC7HCIO2UNCJEDIXG3XQYA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b): protocol: write tcp 188.166.225.170:41310->104.36.82.19:4404: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319629567 (7h22m43.750709698s) [seg_pos={0 0}, upload=7718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 00:48:49.319709189 (7h22m43.75078932s) [upload=7718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 00:48:49.319714160 (7h22m43.750794291s) [upload=7718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:48:49.635176021 (7h22m44.066256152s) [upload=7718]: Done uploading segments... Aug 9 00:48:49.635194487 (7h22m44.066274618s) [upload=7718]: Upload finished. err: <nil> Duration: 6.397904371s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.........................X.X.....X................X.........] duration: 2.119004197s FAIL (2025-08-09 00:58:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:53:50.823389357 (7h27m45.254469488s) [upload=7803]: Starting upload Aug 9 00:53:50.823435035 (7h27m45.254515166s) [upload=7803]: Done starting upload Aug 9 00:53:50.823486734 (7h27m45.254566855s) [upload=7803]: Uploading segments... Aug 9 00:53:50.823519837 (7h27m45.254599968s) [upload=7803]: Got next segment. Inline: true Aug 9 00:53:50.823534765 (7h27m45.254614896s) [upload=7803]: Waiting for error group managing segments... Aug 9 00:53:50.823567247 (7h27m45.254647378s) [upload=7803]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:53:50.823571045 (7h27m45.254651176s) [upload=7803]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:53:50.823573500 (7h27m45.254653621s) [upload=7803]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:53:51.036378597 (7h27m45.467458728s) [upload=7803]: Done uploading segments... Aug 9 00:53:51.036397072 (7h27m45.467477203s) [upload=7803]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.119046008s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.311146581s FAIL (2025-08-09 00:58:37 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.311165357s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 768.192899ms FAIL (2025-08-09 00:58:26 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 768.221364ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..........................X.X.....X................X........] duration: 1.850606926s FAIL (2025-08-09 00:57:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:53:50.823389357 (7h27m45.254469488s) [upload=7803]: Starting upload Aug 9 00:53:50.823435035 (7h27m45.254515166s) [upload=7803]: Done starting upload Aug 9 00:53:50.823486734 (7h27m45.254566855s) [upload=7803]: Uploading segments... Aug 9 00:53:50.823519837 (7h27m45.254599968s) [upload=7803]: Got next segment. Inline: true Aug 9 00:53:50.823534765 (7h27m45.254614896s) [upload=7803]: Waiting for error group managing segments... Aug 9 00:53:50.823567247 (7h27m45.254647378s) [upload=7803]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:53:50.823571045 (7h27m45.254651176s) [upload=7803]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:53:50.823573500 (7h27m45.254653621s) [upload=7803]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:53:51.036378597 (7h27m45.467458728s) [upload=7803]: Done uploading segments... Aug 9 00:53:51.036397072 (7h27m45.467477203s) [upload=7803]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.850629109s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................X.......................X...X..........] duration: 6.337364129s FAIL (2025-08-09 00:57:52 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 9 00:48:46.017517689 (7h22m40.44859781s) [upload=7718]: Starting upload Aug 9 00:48:46.017561742 (7h22m40.448641863s) [upload=7718]: Done starting upload Aug 9 00:48:46.017629412 (7h22m40.448709543s) [upload=7718]: Uploading segments... Aug 9 00:48:46.017700498 (7h22m40.448780629s) [upload=7718]: Got next segment. Inline: false Aug 9 00:48:46.017739152 (7h22m40.448819273s) [upload=7718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:48:46.017743611 (7h22m40.448823742s) [upload=7718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 00:48:46.487633950 (7h22m40.918714081s) [seg_pos={0 0}, upload=7718]: Begin upload segment... Aug 9 00:48:46.487687452 (7h22m40.918767583s) [seg_pos={0 0}, upload=7718]: Done begin upload segment. Aug 9 00:48:46.487711057 (7h22m40.918791188s) [noise=true , address=45.91.116.11:4138 , piece_id=UWX4NN52D37ZJXXA5CKNE4N6ZYEWEYPMPPDZ37QM3B5CMQ2MLGMA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.487756925 (7h22m40.918837056s) [noise=true , address=45.91.116.11:4141 , piece_id=UBHP6JVK2FUFYLRVOULFRBMSOTUJCE56E76BU4EI23FHGF6SXPWQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488097557 (7h22m40.919177688s) [noise=true , address=104.36.82.19:4404 , piece_id=5VYJZAMM3H22UKBZWAA2SERPBXBOHUXC7HCIO2UNCJEDIXG3XQYA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488233727 (7h22m40.919313858s) [noise=true , address=104.36.82.15:4292 , piece_id=ZG53SGOH4M4OECCYW5KQKS6XL5PK3H322GP6LX5WFY7O454RAUTA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488374266 (7h22m40.919454397s) [noise=true , address=104.36.82.60:4370 , piece_id=72LHFQLVXCW5X2EYKC7TUUQICLE7R4KXXOE3UVEBC6K24KUON3LA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488628011 (7h22m40.919708142s) [noise=true , address=64.49.13.137:4500 , piece_id=74XIQN5DD2QOUR5D7DRT5CUCENQR74UKK45UEPH6LOHJ3HBURHYQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.488856018 (7h22m40.919936139s) [noise=true , address=104.36.82.45:4918 , piece_id=TE7ASCIZM6CWQGUNON6L2WETJPGVRAGISW6LAXHPXHTBZPBEXPCA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489126416 (7h22m40.920206537s) [noise=true , address=104.36.82.4:4812 , piece_id=JX6L3CMRDWCGHMIQI2PIP4LHVXNNHLSKS2RNLAYBMXFJOZU2QCNA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489348511 (7h22m40.920428642s) [noise=true , address=104.36.82.44:4894 , piece_id=YEAPGAAV4XQQTGBJ7AIA4KJPZFPSQ44JDDCCZ2Q4OOBZWDOATFWA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489581706 (7h22m40.920661837s) [noise=true , address=104.36.82.14:4236 , piece_id=IVEBYXCNOQ3AQ4TOBTJEJIJKKB7MB4CHNZFQF2I2DWADEIMFTT2A, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489787100 (7h22m40.920867231s) [noise=true , address=104.36.82.22:4512 , piece_id=ERJOH5YWZ3BAKEMSSWW26EYQBP3ZEDTYMACULERDJ5MBVHGUJP6Q, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.489998043 (7h22m40.921078174s) [noise=true , address=104.36.82.35:4588 , piece_id=S2JRBW2BJDMVTOWAN66SAIEOFWDW2ZMV6PCC4JSTUAMZWT566YVA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490181434 (7h22m40.921261565s) [noise=true , address=104.36.82.9:4017 , piece_id=A737253TXYKIQFEZ2CDOR5AQGKFBMONN3MCLIALGZBAQ3IVPENNQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490363022 (7h22m40.921443153s) [noise=true , address=64.49.13.138:4484 , piece_id=XJCMFVWHATEUVJLLD5VQFYG4ZXDH7TNBDOEFH7KV2JL4HM4X4IHQ, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490552123 (7h22m40.921632254s) [noise=true , address=64.49.13.169:4710 , piece_id=ZEKXCRSD434VSC2ORGR4QPLHOHMJCBQYGVTWIJLWR2XFM5DG5AWA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490745964 (7h22m40.921826085s) [noise=true , address=104.36.82.45:4909 , piece_id=DRFHX4YPP5SMIBBBUQBGDBSVPPLP3LOJKEU5D3VAP6ZFK5YSGU5Q, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.490924466 (7h22m40.922004597s) [noise=true , address=104.36.82.37:4663 , piece_id=6PS327IZB4Y26F3W7B6PR5SAVZXJE6OIH5ZFHNOLZJXDI4LICQZA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:46.491108248 (7h22m40.922188379s) [noise=true , address=104.36.82.62:4435 , piece_id=QTZA2CCHRZK474D4T7MK5DDY2ZUB25XAOWDYYICFWYXHHN4U4GSA, seg_pos={0 0}, upload=7718]: Uploading piece... Aug 9 00:48:47.595108697 (7h22m42.026188828s) [upload=7718]: Next returned nil segment Aug 9 00:48:47.595125159 (7h22m42.02620529s) [upload=7718]: Waiting for error group managing segments... Aug 9 00:48:47.877294483 (7h22m42.308374614s) [noise=true , address=64.49.13.138:4484 , piece_id=XJCMFVWHATEUVJLLD5VQFYG4ZXDH7TNBDOEFH7KV2JL4HM4X4IHQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:47.948937908 (7h22m42.380018039s) [noise=true , address=64.49.13.137:4500 , piece_id=74XIQN5DD2QOUR5D7DRT5CUCENQR74UKK45UEPH6LOHJ3HBURHYQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:47.968047280 (7h22m42.399127411s) [noise=true , address=64.49.13.169:4710 , piece_id=ZEKXCRSD434VSC2ORGR4QPLHOHMJCBQYGVTWIJLWR2XFM5DG5AWA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.520661895 (7h22m42.951742026s) [noise=true , address=104.36.82.22:4512 , piece_id=ERJOH5YWZ3BAKEMSSWW26EYQBP3ZEDTYMACULERDJ5MBVHGUJP6Q, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.523938645 (7h22m42.955018776s) [noise=true , address=45.91.116.11:4138 , piece_id=UWX4NN52D37ZJXXA5CKNE4N6ZYEWEYPMPPDZ37QM3B5CMQ2MLGMA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.544420141 (7h22m42.975500272s) [noise=true , address=104.36.82.35:4588 , piece_id=S2JRBW2BJDMVTOWAN66SAIEOFWDW2ZMV6PCC4JSTUAMZWT566YVA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.566672848 (7h22m42.997752979s) [noise=true , address=45.91.116.11:4141 , piece_id=UBHP6JVK2FUFYLRVOULFRBMSOTUJCE56E76BU4EI23FHGF6SXPWQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.582416790 (7h22m43.013496921s) [noise=true , address=104.36.82.60:4370 , piece_id=72LHFQLVXCW5X2EYKC7TUUQICLE7R4KXXOE3UVEBC6K24KUON3LA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.585069256 (7h22m43.016149387s) [noise=true , address=104.36.82.62:4435 , piece_id=QTZA2CCHRZK474D4T7MK5DDY2ZUB25XAOWDYYICFWYXHHN4U4GSA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.658756792 (7h22m43.089836923s) [noise=true , address=104.36.82.37:4663 , piece_id=6PS327IZB4Y26F3W7B6PR5SAVZXJE6OIH5ZFHNOLZJXDI4LICQZA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.659623009 (7h22m43.09070314s) [noise=true , address=104.36.82.14:4236 , piece_id=IVEBYXCNOQ3AQ4TOBTJEJIJKKB7MB4CHNZFQF2I2DWADEIMFTT2A, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:48.873462627 (7h22m43.304542758s) [noise=true , address=104.36.82.4:4812 , piece_id=JX6L3CMRDWCGHMIQI2PIP4LHVXNNHLSKS2RNLAYBMXFJOZU2QCNA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.259262096 (7h22m43.690342227s) [noise=true , address=104.36.82.9:4017 , piece_id=A737253TXYKIQFEZ2CDOR5AQGKFBMONN3MCLIALGZBAQ3IVPENNQ, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.319042805 (7h22m43.750122936s) [noise=true , address=104.36.82.45:4909 , piece_id=DRFHX4YPP5SMIBBBUQBGDBSVPPLP3LOJKEU5D3VAP6ZFK5YSGU5Q, seg_pos={0 0}, upload=7718]: Done uploading piece. err: <nil> Aug 9 00:48:49.319066630 (7h22m43.750146761s) [seg_pos={0 0}, upload=7718]: Segment reached optimal threshold of 14 pieces. Aug 9 00:48:49.319407803 (7h22m43.750487934s) [noise=true , address=104.36.82.44:4894 , piece_id=YEAPGAAV4XQQTGBJ7AIA4KJPZFPSQ44JDDCCZ2Q4OOBZWDOATFWA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: rpc: dial tcp 104.36.82.44:4894: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319452639 (7h22m43.75053277s) [noise=true , address=104.36.82.15:4292 , piece_id=ZG53SGOH4M4OECCYW5KQKS6XL5PK3H322GP6LX5WFY7O454RAUTA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UpWmMhEmk5veKZvzsQ3MCxCMnfEKtFgCugBTsYfy9Ejm7G4xD): protocol: read tcp 188.166.225.170:35022->104.36.82.15:4292: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319470654 (7h22m43.750550785s) [noise=true , address=104.36.82.45:4918 , piece_id=TE7ASCIZM6CWQGUNON6L2WETJPGVRAGISW6LAXHPXHTBZPBEXPCA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Nw78dd9WPnmCwv5bFQR3VpV39776Pye2QVGSNMTs3zq2BtaGJ): protocol: expected piece hash; context canceled; EOF Aug 9 00:48:49.319573690 (7h22m43.750653821s) [noise=true , address=104.36.82.19:4404 , piece_id=5VYJZAMM3H22UKBZWAA2SERPBXBOHUXC7HCIO2UNCJEDIXG3XQYA, seg_pos={0 0}, upload=7718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b): protocol: write tcp 188.166.225.170:41310->104.36.82.19:4404: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 00:48:49.319629567 (7h22m43.750709698s) [seg_pos={0 0}, upload=7718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 00:48:49.319709189 (7h22m43.75078932s) [upload=7718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 00:48:49.319714160 (7h22m43.750794291s) [upload=7718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:48:49.635176021 (7h22m44.066256152s) [upload=7718]: Done uploading segments... Aug 9 00:48:49.635194487 (7h22m44.066274618s) [upload=7718]: Upload finished. err: <nil> Duration: 6.337387844s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [X..........................X.X.....X................X.......] duration: 1.910140101s FAIL (2025-08-09 00:57:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:53:50.823389357 (7h27m45.254469488s) [upload=7803]: Starting upload Aug 9 00:53:50.823435035 (7h27m45.254515166s) [upload=7803]: Done starting upload Aug 9 00:53:50.823486734 (7h27m45.254566855s) [upload=7803]: Uploading segments... Aug 9 00:53:50.823519837 (7h27m45.254599968s) [upload=7803]: Got next segment. Inline: true Aug 9 00:53:50.823534765 (7h27m45.254614896s) [upload=7803]: Waiting for error group managing segments... Aug 9 00:53:50.823567247 (7h27m45.254647378s) [upload=7803]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:53:50.823571045 (7h27m45.254651176s) [upload=7803]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:53:50.823573500 (7h27m45.254653621s) [upload=7803]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:53:51.036378597 (7h27m45.467458728s) [upload=7803]: Done uploading segments... Aug 9 00:53:51.036397072 (7h27m45.467477203s) [upload=7803]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.910165568s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.430434401s FAIL (2025-08-09 00:57:26 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.430458166s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 727.989427ms FAIL (2025-08-09 00:57:22 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 728.018574ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.X..........................X.X.....X................X......] duration: 1.885101383s FAIL (2025-08-09 00:57:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:53:50.823389357 (7h27m45.254469488s) [upload=7803]: Starting upload Aug 9 00:53:50.823435035 (7h27m45.254515166s) [upload=7803]: Done starting upload Aug 9 00:53:50.823486734 (7h27m45.254566855s) [upload=7803]: Uploading segments... Aug 9 00:53:50.823519837 (7h27m45.254599968s) [upload=7803]: Got next segment. Inline: true Aug 9 00:53:50.823534765 (7h27m45.254614896s) [upload=7803]: Waiting for error group managing segments... Aug 9 00:53:50.823567247 (7h27m45.254647378s) [upload=7803]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:53:50.823571045 (7h27m45.254651176s) [upload=7803]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:53:50.823573500 (7h27m45.254653621s) [upload=7803]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:53:51.036378597 (7h27m45.467458728s) [upload=7803]: Done uploading segments... Aug 9 00:53:51.036397072 (7h27m45.467477203s) [upload=7803]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.885136591s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)