Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.62148934s
FAIL (2025-08-07 05:57:46 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e46dcb859def614b0fb4ab1704e8a31c32f5fb5a10f382f96ffc76296af4538c != before d300fadf0a511ec089ac4c68f074a6a3da7458edd8ef29303b4445cb32a21983
Duration: 5.621513927s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
1.87370465s
FAIL (2025-08-07 05:57:29 UTC)
orbiter warning: operation: DownloadObject
uplink: object not found ("orbiter_us_0/1K")
Duration: 1.873743095s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.576704559s
FAIL (2025-08-07 05:57:26 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e46dcb859def614b0fb4ab1704e8a31c32f5fb5a10f382f96ffc76296af4538c != before d300fadf0a511ec089ac4c68f074a6a3da7458edd8ef29303b4445cb32a21983
Duration: 5.576726472s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
1.974245511s
FAIL (2025-08-07 05:56:38 UTC)
orbiter warning: operation: DownloadObject
uplink: object not found ("orbiter_us_0/1K")
Duration: 1.974262272s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.762583705s
FAIL (2025-08-07 05:56:24 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e46dcb859def614b0fb4ab1704e8a31c32f5fb5a10f382f96ffc76296af4538c != before d300fadf0a511ec089ac4c68f074a6a3da7458edd8ef29303b4445cb32a21983
Duration: 5.76261175s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.044320383s
FAIL (2025-08-07 05:56:13 UTC)
orbiter warning: operation: DownloadObject
uplink: object not found ("orbiter_us_0/1K")
Duration: 2.044348067s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
1.850465835s
FAIL (2025-08-07 05:55:55 UTC)
orbiter warning: operation: DownloadObject
uplink: object not found ("orbiter_us_0/1K")
Duration: 1.850491945s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.234149228s
FAIL (2025-08-07 05:55:27 UTC)
orbiter warning: operation: DownloadObject
uplink: object not found ("orbiter_us_0/1K")
Duration: 2.234175528s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.753417837s
FAIL (2025-08-07 05:55:20 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e46dcb859def614b0fb4ab1704e8a31c32f5fb5a10f382f96ffc76296af4538c != before d300fadf0a511ec089ac4c68f074a6a3da7458edd8ef29303b4445cb32a21983
Duration: 5.753452304s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
5.718899958s
FAIL (2025-08-07 05:55:02 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e46dcb859def614b0fb4ab1704e8a31c32f5fb5a10f382f96ffc76296af4538c != before d300fadf0a511ec089ac4c68f074a6a3da7458edd8ef29303b4445cb32a21983
Duration: 5.718948511s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
5.791511344s
FAIL (2025-08-07 05:54:34 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e46dcb859def614b0fb4ab1704e8a31c32f5fb5a10f382f96ffc76296af4538c != before d300fadf0a511ec089ac4c68f074a6a3da7458edd8ef29303b4445cb32a21983
Duration: 5.791540418s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
1.826009233s
FAIL (2025-08-07 05:54:24 UTC)
orbiter warning: operation: DownloadObject
uplink: object not found ("orbiter_us_0/1K")
Duration: 1.826033169s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.633707571s
FAIL (2025-08-07 05:53:54 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e46dcb859def614b0fb4ab1704e8a31c32f5fb5a10f382f96ffc76296af4538c != before d300fadf0a511ec089ac4c68f074a6a3da7458edd8ef29303b4445cb32a21983
Duration: 5.633734983s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.160137713s
FAIL (2025-08-07 05:53:13 UTC)
orbiter warning: operation: DownloadObject
uplink: object not found ("orbiter_us_0/1K")
Duration: 2.160158272s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X..............................................X............] duration:
5.813976484s
FAIL (2025-08-07 05:52:40 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e46dcb859def614b0fb4ab1704e8a31c32f5fb5a10f382f96ffc76296af4538c != before d300fadf0a511ec089ac4c68f074a6a3da7458edd8ef29303b4445cb32a21983
Duration: 5.814003456s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.100300675s
FAIL (2025-08-07 05:52:28 UTC)
orbiter warning: operation: DownloadObject
uplink: object not found ("orbiter_us_0/1K")
Duration: 2.100330162s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X..............................................X...........] duration:
5.708050158s
FAIL (2025-08-07 05:52:03 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e46dcb859def614b0fb4ab1704e8a31c32f5fb5a10f382f96ffc76296af4538c != before d300fadf0a511ec089ac4c68f074a6a3da7458edd8ef29303b4445cb32a21983
Duration: 5.708067932s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.865235294s
FAIL (2025-08-07 05:51:50 UTC)
orbiter warning: operation: DownloadObject
uplink: object not found ("orbiter_us_0/1K")
Duration: 1.865261845s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X..............................................X..........] duration:
5.677776818s
FAIL (2025-08-07 05:51:17 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e46dcb859def614b0fb4ab1704e8a31c32f5fb5a10f382f96ffc76296af4538c != before d300fadf0a511ec089ac4c68f074a6a3da7458edd8ef29303b4445cb32a21983
Duration: 5.677798028s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.997037668s
FAIL (2025-08-07 05:51:14 UTC)
orbiter warning: operation: DownloadObject
uplink: object not found ("orbiter_us_0/1K")
Duration: 1.997071022s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.092518118s
FAIL (2025-08-07 05:50:54 UTC)
orbiter warning: operation: DownloadObject
uplink: object not found ("orbiter_us_0/1K")
Duration: 2.092544128s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X..............................................X.........] duration:
6.016554658s
FAIL (2025-08-07 05:50:49 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e46dcb859def614b0fb4ab1704e8a31c32f5fb5a10f382f96ffc76296af4538c != before d300fadf0a511ec089ac4c68f074a6a3da7458edd8ef29303b4445cb32a21983
Duration: 6.016583344s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X..............................................X........] duration:
5.796138248s
FAIL (2025-08-07 05:50:19 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e46dcb859def614b0fb4ab1704e8a31c32f5fb5a10f382f96ffc76296af4538c != before d300fadf0a511ec089ac4c68f074a6a3da7458edd8ef29303b4445cb32a21983
Duration: 5.79616618s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.921118232s
FAIL (2025-08-07 05:50:10 UTC)
orbiter warning: operation: DownloadObject
uplink: object not found ("orbiter_us_0/1K")
Duration: 1.921151126s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
1.898042263s
FAIL (2025-08-07 05:49:51 UTC)
orbiter warning: operation: DownloadObject
uplink: object not found ("orbiter_us_0/1K")
Duration: 1.898067091s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.039606564s
FAIL (2025-08-07 05:49:12 UTC)
orbiter warning: operation: DownloadObject
uplink: object not found ("orbiter_us_0/1K")
Duration: 2.039634428s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X..............................................X.......] duration:
5.602050252s
FAIL (2025-08-07 05:49:06 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e46dcb859def614b0fb4ab1704e8a31c32f5fb5a10f382f96ffc76296af4538c != before d300fadf0a511ec089ac4c68f074a6a3da7458edd8ef29303b4445cb32a21983
Duration: 5.602077593s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
1.855488596s
FAIL (2025-08-07 05:48:00 UTC)
orbiter warning: operation: DownloadObject
uplink: object not found ("orbiter_us_0/1K")
Duration: 1.855517492s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X..............................................X......] duration:
5.747468526s
FAIL (2025-08-07 05:47:57 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e46dcb859def614b0fb4ab1704e8a31c32f5fb5a10f382f96ffc76296af4538c != before d300fadf0a511ec089ac4c68f074a6a3da7458edd8ef29303b4445cb32a21983
Duration: 5.747496689s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.070937107s
FAIL (2025-08-07 05:47:15 UTC)
orbiter warning: operation: DownloadObject
uplink: object not found ("orbiter_us_0/1K")
Duration: 2.070970631s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X..............................................X.....] duration:
5.663079468s
FAIL (2025-08-07 05:46:57 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e46dcb859def614b0fb4ab1704e8a31c32f5fb5a10f382f96ffc76296af4538c != before d300fadf0a511ec089ac4c68f074a6a3da7458edd8ef29303b4445cb32a21983
Duration: 5.663104096s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1.634792875s
FAIL (2025-08-07 05:46:15 UTC)
orbiter warning: operation: DownloadObject
uplink: object not found ("orbiter_us_0/1K")
Duration: 1.634823565s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X..............................................X....] duration:
5.693336498s
FAIL (2025-08-07 05:45:52 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e46dcb859def614b0fb4ab1704e8a31c32f5fb5a10f382f96ffc76296af4538c != before d300fadf0a511ec089ac4c68f074a6a3da7458edd8ef29303b4445cb32a21983
Duration: 5.693360475s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X..............................................X...] duration:
5.563796741s
FAIL (2025-08-07 05:44:50 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e46dcb859def614b0fb4ab1704e8a31c32f5fb5a10f382f96ffc76296af4538c != before d300fadf0a511ec089ac4c68f074a6a3da7458edd8ef29303b4445cb32a21983
Duration: 5.563823753s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X..............................................X..] duration:
5.881004509s
FAIL (2025-08-07 05:44:29 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e46dcb859def614b0fb4ab1704e8a31c32f5fb5a10f382f96ffc76296af4538c != before d300fadf0a511ec089ac4c68f074a6a3da7458edd8ef29303b4445cb32a21983
Duration: 5.881025839s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X..............................................X.] duration:
5.740152189s
FAIL (2025-08-07 05:43:53 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e46dcb859def614b0fb4ab1704e8a31c32f5fb5a10f382f96ffc76296af4538c != before d300fadf0a511ec089ac4c68f074a6a3da7458edd8ef29303b4445cb32a21983
Duration: 5.74017885s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X..............................................X] duration:
5.893504063s
FAIL (2025-08-07 05:43:02 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e46dcb859def614b0fb4ab1704e8a31c32f5fb5a10f382f96ffc76296af4538c != before d300fadf0a511ec089ac4c68f074a6a3da7458edd8ef29303b4445cb32a21983
Duration: 5.893533841s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
5.628624669s
FAIL (2025-08-07 05:42:26 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938
Duration: 5.628649296s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
6.038708187s
FAIL (2025-08-07 05:41:44 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938
Duration: 6.038727143s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
6.077833679s
FAIL (2025-08-07 05:40:51 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938
Duration: 6.077855861s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
5.770500404s
FAIL (2025-08-07 05:40:10 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF
Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF
Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments...
Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil>
Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload
Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload
Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments...
Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false
Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment...
Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment.
Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment
Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments...
Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces.
Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF
Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments...
Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil>
Duration: 5.770520123s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
5.764729074s
FAIL (2025-08-07 05:39:59 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938
Duration: 5.764751796s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
5.655049495s
FAIL (2025-08-07 05:39:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF
Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF
Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments...
Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil>
Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload
Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload
Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments...
Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false
Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment...
Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment.
Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment
Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments...
Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces.
Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF
Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments...
Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil>
Duration: 5.655077167s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
5.59534303s
FAIL (2025-08-07 05:39:02 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938
Duration: 5.595375583s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
5.90757235s
FAIL (2025-08-07 05:38:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF
Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF
Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments...
Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil>
Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload
Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload
Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments...
Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false
Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment...
Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment.
Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment
Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments...
Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces.
Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF
Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments...
Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil>
Duration: 5.907600324s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
5.817237888s
FAIL (2025-08-07 05:38:31 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF
Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF
Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments...
Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil>
Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload
Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload
Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments...
Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false
Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment...
Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment.
Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment
Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments...
Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces.
Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF
Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments...
Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil>
Duration: 5.817266662s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
5.862295424s
FAIL (2025-08-07 05:38:21 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938
Duration: 5.862317756s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
5.650897291s
FAIL (2025-08-07 05:37:58 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938
Duration: 5.650921709s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
5.797076231s
FAIL (2025-08-07 05:37:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF
Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF
Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments...
Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil>
Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload
Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload
Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments...
Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false
Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment...
Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment.
Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece...
Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment
Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments...
Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil>
Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces.
Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF
Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF
Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments...
Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil>
Duration: 5.797102371s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
5.573844267s
FAIL (2025-08-07 05:36:53 UTC)
orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938
Duration: 5.573869977s
core
uplink
us-select-1
us1-placement-20
|