Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X.................................X...............] duration:
1.986597057s
FAIL (2025-07-25 10:34:00 UTC)
orbiter warning: digest mismatch: after 1ed386b357b89dd553efed6bf69159018be3509ad36305c9859b6b75181cfa56 != before 9305667013ef0186919834c24e3ebd5b687bbcea091e48d7b1c153546750ae65
Duration: 1.986624389s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
5.803105731s
FAIL (2025-07-25 10:33:38 UTC)
orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M
Duration: 5.803124597s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X.................................X..............] duration:
1.877714449s
FAIL (2025-07-25 10:33:32 UTC)
orbiter warning: digest mismatch: after 1ed386b357b89dd553efed6bf69159018be3509ad36305c9859b6b75181cfa56 != before 9305667013ef0186919834c24e3ebd5b687bbcea091e48d7b1c153546750ae65
Duration: 1.877739497s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
5.763850624s
FAIL (2025-07-25 10:33:10 UTC)
orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M
Duration: 5.763880802s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
5.780066871s
FAIL (2025-07-25 10:32:52 UTC)
orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M
Duration: 5.780094694s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X.................................X.............] duration:
1.884573343s
FAIL (2025-07-25 10:32:52 UTC)
orbiter warning: digest mismatch: after 1ed386b357b89dd553efed6bf69159018be3509ad36305c9859b6b75181cfa56 != before 9305667013ef0186919834c24e3ebd5b687bbcea091e48d7b1c153546750ae65
Duration: 1.884605505s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
5.775007067s
FAIL (2025-07-25 10:31:55 UTC)
orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M
Duration: 5.775032917s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X.................................X............] duration:
1.816970258s
FAIL (2025-07-25 10:31:41 UTC)
orbiter warning: digest mismatch: after 1ed386b357b89dd553efed6bf69159018be3509ad36305c9859b6b75181cfa56 != before 9305667013ef0186919834c24e3ebd5b687bbcea091e48d7b1c153546750ae65
Duration: 1.817007309s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X.................................X...........] duration:
1.967277613s
FAIL (2025-07-25 10:31:08 UTC)
orbiter warning: digest mismatch: after 1ed386b357b89dd553efed6bf69159018be3509ad36305c9859b6b75181cfa56 != before 9305667013ef0186919834c24e3ebd5b687bbcea091e48d7b1c153546750ae65
Duration: 1.967314373s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
5.792430178s
FAIL (2025-07-25 10:31:04 UTC)
orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M
Duration: 5.792458059s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
5.887008983s
FAIL (2025-07-25 10:30:47 UTC)
orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M
Duration: 5.88703901s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
5.798534514s
FAIL (2025-07-25 10:30:13 UTC)
orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M
Duration: 5.798561325s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X.................................X..........] duration:
1.844852263s
FAIL (2025-07-25 10:30:07 UTC)
orbiter warning: digest mismatch: after 1ed386b357b89dd553efed6bf69159018be3509ad36305c9859b6b75181cfa56 != before 9305667013ef0186919834c24e3ebd5b687bbcea091e48d7b1c153546750ae65
Duration: 1.844879626s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
5.756877266s
FAIL (2025-07-25 10:29:02 UTC)
orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M
Duration: 5.756903176s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X.................................X.........] duration:
1.900526087s
FAIL (2025-07-25 10:28:52 UTC)
orbiter warning: digest mismatch: after 1ed386b357b89dd553efed6bf69159018be3509ad36305c9859b6b75181cfa56 != before 9305667013ef0186919834c24e3ebd5b687bbcea091e48d7b1c153546750ae65
Duration: 1.90055445s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X.................................X........] duration:
1.850096878s
FAIL (2025-07-25 10:28:10 UTC)
orbiter warning: digest mismatch: after 1ed386b357b89dd553efed6bf69159018be3509ad36305c9859b6b75181cfa56 != before 9305667013ef0186919834c24e3ebd5b687bbcea091e48d7b1c153546750ae65
Duration: 1.850126775s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
5.739272516s
FAIL (2025-07-25 10:27:49 UTC)
orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M
Duration: 5.739312191s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X.................................X.......] duration:
1.861257151s
FAIL (2025-07-25 10:27:36 UTC)
orbiter warning: digest mismatch: after 1ed386b357b89dd553efed6bf69159018be3509ad36305c9859b6b75181cfa56 != before 9305667013ef0186919834c24e3ebd5b687bbcea091e48d7b1c153546750ae65
Duration: 1.861287669s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
5.79002747s
FAIL (2025-07-25 10:27:10 UTC)
orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M
Duration: 5.79005911s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X.................................X......] duration:
2.137939625s
FAIL (2025-07-25 10:26:44 UTC)
orbiter warning: digest mismatch: after 1ed386b357b89dd553efed6bf69159018be3509ad36305c9859b6b75181cfa56 != before 9305667013ef0186919834c24e3ebd5b687bbcea091e48d7b1c153546750ae65
Duration: 2.137971306s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
5.745103915s
FAIL (2025-07-25 10:26:34 UTC)
orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M
Duration: 5.74513267s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X.................................X.....] duration:
1.897050697s
FAIL (2025-07-25 10:26:27 UTC)
orbiter warning: digest mismatch: after 1ed386b357b89dd553efed6bf69159018be3509ad36305c9859b6b75181cfa56 != before 9305667013ef0186919834c24e3ebd5b687bbcea091e48d7b1c153546750ae65
Duration: 1.897081395s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
5.869010168s
FAIL (2025-07-25 10:26:19 UTC)
orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M
Duration: 5.869033403s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
5.795699373s
FAIL (2025-07-25 10:25:57 UTC)
orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M
Duration: 5.795722306s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X.................................X....] duration:
1.841023948s
FAIL (2025-07-25 10:25:50 UTC)
orbiter warning: digest mismatch: after 1ed386b357b89dd553efed6bf69159018be3509ad36305c9859b6b75181cfa56 != before 9305667013ef0186919834c24e3ebd5b687bbcea091e48d7b1c153546750ae65
Duration: 1.841063274s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.779884633s
FAIL (2025-07-25 10:25:24 UTC)
orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M
Duration: 5.779911504s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X.................................X...] duration:
1.870352413s
FAIL (2025-07-25 10:25:23 UTC)
orbiter warning: digest mismatch: after 1ed386b357b89dd553efed6bf69159018be3509ad36305c9859b6b75181cfa56 != before 9305667013ef0186919834c24e3ebd5b687bbcea091e48d7b1c153546750ae65
Duration: 1.870378182s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X.................................X..] duration:
1.980554667s
FAIL (2025-07-25 10:24:13 UTC)
orbiter warning: digest mismatch: after 1ed386b357b89dd553efed6bf69159018be3509ad36305c9859b6b75181cfa56 != before 9305667013ef0186919834c24e3ebd5b687bbcea091e48d7b1c153546750ae65
Duration: 1.980581118s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.903282272s
FAIL (2025-07-25 10:24:10 UTC)
orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M
Duration: 5.90331212s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X.................................X.] duration:
1.954297129s
FAIL (2025-07-25 10:23:46 UTC)
orbiter warning: digest mismatch: after 1ed386b357b89dd553efed6bf69159018be3509ad36305c9859b6b75181cfa56 != before 9305667013ef0186919834c24e3ebd5b687bbcea091e48d7b1c153546750ae65
Duration: 1.954328058s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.975780287s
FAIL (2025-07-25 10:23:41 UTC)
orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M
Duration: 5.975809693s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X........................X.................................X] duration:
1.60346472s
FAIL (2025-07-25 10:22:32 UTC)
orbiter warning: digest mismatch: after 1ed386b357b89dd553efed6bf69159018be3509ad36305c9859b6b75181cfa56 != before 9305667013ef0186919834c24e3ebd5b687bbcea091e48d7b1c153546750ae65
Duration: 1.603492002s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.819264179s
FAIL (2025-07-25 10:22:28 UTC)
orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M
Duration: 5.8192908s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.136270651s
FAIL (2025-07-25 10:22:20 UTC)
orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Jul 25 09:26:34.570036631 (21h50m44.292599671s) [upload=20980]: Upload finished. err: <nil> Jul 25 09:26:49.200928904 (21h50m58.923491944s) [upload=20986]: Starting upload Jul 25 09:26:49.200980633 (21h50m58.923543673s) [upload=20986]: Done starting upload Jul 25 09:26:49.201056208 (21h50m58.923619248s) [upload=20986]: Uploading segments... Jul 25 09:26:49.201090293 (21h50m58.923653333s) [upload=20986]: Got next segment. Inline: true Jul 25 09:26:49.201094100 (21h50m58.92365714s) [upload=20986]: Waiting for error group managing segments... Jul 25 09:26:49.201126071 (21h50m58.923689111s) [upload=20986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:26:49.201130601 (21h50m58.923693641s) [upload=20986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:26:49.201133486 (21h50m58.923696526s) [upload=20986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:26:49.604840728 (21h50m59.327403768s) [upload=20986]: Done uploading segments... Jul 25 09:26:49.604861357 (21h50m59.327424398s) [upload=20986]: Upload finished. err: <nil> Jul 25 09:27:53.078396941 (21h52m2.800959981s) [upload=21002]: Starting upload Jul 25 09:27:53.078484157 (21h52m2.801047197s) [upload=21002]: Done starting upload Jul 25 09:27:53.078544112 (21h52m2.801107142s) [upload=21002]: Uploading segments... Jul 25 09:27:53.078584009 (21h52m2.801147039s) [upload=21002]: Got next segment. Inline: true Jul 25 09:27:53.078588026 (21h52m2.801151066s) [upload=21002]: Waiting for error group managing segments... Jul 25 09:27:53.078630116 (21h52m2.801193156s) [upload=21002]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:27:53.078634464 (21h52m2.801197504s) [upload=21002]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:27:53.078636810 (21h52m2.80119985s) [upload=21002]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:27:53.336646507 (21h52m3.059209587s) [upload=21002]: Done uploading segments... Jul 25 09:27:53.336667287 (21h52m3.059230337s) [upload=21002]: Upload finished. err: <nil> Jul 25 09:29:06.978452311 (21h53m16.701015351s) [upload=21021]: Starting upload Jul 25 09:29:06.978520191 (21h53m16.701083221s) [upload=21021]: Done starting upload Jul 25 09:29:06.978597849 (21h53m16.701160889s) [upload=21021]: Uploading segments... Jul 25 09:29:06.978698231 (21h53m16.701261281s) [upload=21021]: Got next segment. Inline: true Jul 25 09:29:06.978706287 (21h53m16.701269347s) [upload=21021]: Waiting for error group managing segments... Jul 25 09:29:06.978753848 (21h53m16.701316878s) [upload=21021]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:29:06.978758897 (21h53m16.701321937s) [upload=21021]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:29:06.978761131 (21h53m16.701324171s) [upload=21021]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:29:07.240912794 (21h53m16.963475834s) [upload=21021]: Done uploading segments... Jul 25 09:29:07.240931219 (21h53m16.963494259s) [upload=21021]: Upload finished. err: <nil> Jul 25 09:30:11.152587399 (21h54m20.875150439s) [upload=21037]: Starting upload Jul 25 09:30:11.152643596 (21h54m20.875206636s) [upload=21037]: Done starting upload Jul 25 09:30:11.152684424 (21h54m20.875247464s) [upload=21037]: Uploading segments... Jul 25 09:30:11.152739640 (21h54m20.87530268s) [upload=21037]: Got next segment. Inline: true Jul 25 09:30:11.152744549 (21h54m20.875307589s) [upload=21037]: Waiting for error group managing segments... Jul 25 09:30:11.152785127 (21h54m20.875348167s) [upload=21037]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:30:11.152790467 (21h54m20.875353507s) [upload=21037]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:30:11.152793052 (21h54m20.875356092s) [upload=21037]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:30:11.421977889 (21h54m21.144540919s) [upload=21037]: Done uploading segments... Jul 25 09:30:11.421995103 (21h54m21.144558143s) [upload=21037]: Upload finished. err: <nil> Jul 25 09:31:21.388209097 (21h55m31.110772137s) [upload=21053]: Starting upload Jul 25 09:31:21.388300943 (21h55m31.110863983s) [upload=21053]: Done starting upload Jul 25 09:31:21.388424629 (21h55m31.110987669s) [upload=21053]: Uploading segments... Jul 25 09:31:21.388526104 (21h55m31.111089144s) [upload=21053]: Got next segment. Inline: true Jul 25 09:31:21.388530682 (21h55m31.111093722s) [upload=21053]: Waiting for error group managing segments... Jul 25 09:31:21.388591739 (21h55m31.111154779s) [upload=21053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:31:21.388600687 (21h55m31.111163727s) [upload=21053]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:31:21.388603402 (21h55m31.111166442s) [upload=21053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:31:21.651857102 (21h55m31.374420132s) [upload=21053]: Done uploading segments... Jul 25 09:31:21.651874595 (21h55m31.374437625s) [upload=21053]: Upload finished. err: <nil> Jul 25 09:32:08.831277463 (21h56m18.553840503s) [upload=21065]: Starting upload Jul 25 09:32:08.831391121 (21h56m18.553954171s) [upload=21065]: Done starting upload Jul 25 09:32:08.831498536 (21h56m18.554061576s) [upload=21065]: Uploading segments... Jul 25 09:32:08.831577387 (21h56m18.554140437s) [upload=21065]: Got next segment. Inline: true Jul 25 09:32:08.831583599 (21h56m18.554146639s) [upload=21065]: Waiting for error group managing segments... Jul 25 09:32:08.831632082 (21h56m18.554195122s) [upload=21065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:32:08.831638153 (21h56m18.554201193s) [upload=21065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:32:08.831658842 (21h56m18.554221882s) [upload=21065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:32:09.099387434 (21h56m18.821950484s) [upload=21065]: Done uploading segments... Jul 25 09:32:09.099442660 (21h56m18.8220057s) [upload=21065]: Upload finished. err: <nil> Jul 25 09:33:13.963999397 (21h57m23.686562427s) [upload=21085]: Starting upload Jul 25 09:33:13.964075112 (21h57m23.686638152s) [upload=21085]: Done starting upload Jul 25 09:33:13.964129967 (21h57m23.686693007s) [upload=21085]: Uploading segments... Jul 25 09:33:13.964160586 (21h57m23.686723626s) [upload=21085]: Got next segment. Inline: true Jul 25 09:33:13.964164894 (21h57m23.686727934s) [upload=21085]: Waiting for error group managing segments... Jul 25 09:33:13.964202505 (21h57m23.686765545s) [upload=21085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:33:13.964207115 (21h57m23.686770155s) [upload=21085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:33:13.964209650 (21h57m23.68677269s) [upload=21085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:33:14.232920338 (21h57m23.955483378s) [upload=21085]: Done uploading segments... Jul 25 09:33:14.232938894 (21h57m23.955501934s) [upload=21085]: Upload finished. err: <nil> Jul 25 09:33:43.505781098 (21h57m53.228344148s) [upload=21092]: Starting upload Jul 25 09:33:43.505886630 (21h57m53.22844967s) [upload=21092]: Done starting upload Jul 25 09:33:43.505958236 (21h57m53.228521276s) [upload=21092]: Uploading segments... Jul 25 09:33:43.506013322 (21h57m53.228576362s) [upload=21092]: Got next segment. Inline: true Jul 25 09:33:43.506018011 (21h57m53.228581051s) [upload=21092]: Waiting for error group managing segments... Jul 25 09:33:43.506062997 (21h57m53.228626037s) [upload=21092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:33:43.506068237 (21h57m53.228631277s) [upload=21092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:33:43.506071313 (21h57m53.228634353s) [upload=21092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:33:43.974697177 (21h57m53.697260217s) [upload=21092]: Done uploading segments... Jul 25 09:33:43.974715503 (21h57m53.697278543s) [upload=21092]: Upload finished. err: <nil> Jul 25 09:35:21.634207561 (21h59m31.356770601s) [upload=21112]: Starting upload Jul 25 09:35:21.634263188 (21h59m31.356826228s) [upload=21112]: Done starting upload Jul 25 09:35:21.634309175 (21h59m31.356872215s) [upload=21112]: Uploading segments... Jul 25 09:35:21.634341738 (21h59m31.356904778s) [upload=21112]: Got next segment. Inline: true Jul 25 09:35:21.634345235 (21h59m31.356908275s) [upload=21112]: Waiting for error group managing segments... Jul 25 09:35:21.634382045 (21h59m31.356945075s) [upload=21112]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:35:21.634386453 (21h59m31.356949493s) [upload=21112]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:35:21.634388888 (21h59m31.356951918s) [upload=21112]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:35:21.912198648 (21h59m31.634761688s) [upload=21112]: Done uploading segments... Jul 25 09:35:21.912214678 (21h59m31.634777719s) [upload=21112]: Upload finished. err: <nil> Jul 25 09:36:16.777669823 (22h0m26.500232863s) [upload=21123]: Starting upload Jul 25 09:36:16.777732162 (22h0m26.500295202s) [upload=21123]: Done starting upload Jul 25 09:36:16.777828126 (22h0m26.500391166s) [upload=21123]: Uploading segments... Jul 25 09:36:16.777862512 (22h0m26.500425542s) [upload=21123]: Got next segment. Inline: true Jul 25 09:36:16.777866379 (22h0m26.500429419s) [upload=21123]: Waiting for error group managing segments... Jul 25 09:36:16.777902208 (22h0m26.500465248s) [upload=21123]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:36:16.777908921 (22h0m26.500471961s) [upload=21123]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:36:16.777911355 (22h0m26.500474395s) [upload=21123]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:36:21.722625410 (22h0m31.44518845s) [upload=21123]: Done uploading segments... Jul 25 09:36:21.722650267 (22h0m31.445213318s) [upload=21123]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.136294277s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X........................X.................................] duration:
1.919419015s
FAIL (2025-07-25 10:21:59 UTC)
orbiter warning: uplink: object not found ("orbiter_us_0/1K")
Duration: 1.919452088s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X........................X................................] duration:
1.863176123s
FAIL (2025-07-25 10:21:31 UTC)
orbiter warning: uplink: object not found ("orbiter_us_0/1K")
Duration: 1.86320554s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X...........................................X...............] duration:
5.786787649s
FAIL (2025-07-25 10:21:22 UTC)
orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M
Duration: 5.786828567s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.220691628s
FAIL (2025-07-25 10:21:05 UTC)
orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Jul 25 09:26:34.570036631 (21h50m44.292599671s) [upload=20980]: Upload finished. err: <nil> Jul 25 09:26:49.200928904 (21h50m58.923491944s) [upload=20986]: Starting upload Jul 25 09:26:49.200980633 (21h50m58.923543673s) [upload=20986]: Done starting upload Jul 25 09:26:49.201056208 (21h50m58.923619248s) [upload=20986]: Uploading segments... Jul 25 09:26:49.201090293 (21h50m58.923653333s) [upload=20986]: Got next segment. Inline: true Jul 25 09:26:49.201094100 (21h50m58.92365714s) [upload=20986]: Waiting for error group managing segments... Jul 25 09:26:49.201126071 (21h50m58.923689111s) [upload=20986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:26:49.201130601 (21h50m58.923693641s) [upload=20986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:26:49.201133486 (21h50m58.923696526s) [upload=20986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:26:49.604840728 (21h50m59.327403768s) [upload=20986]: Done uploading segments... Jul 25 09:26:49.604861357 (21h50m59.327424398s) [upload=20986]: Upload finished. err: <nil> Jul 25 09:27:53.078396941 (21h52m2.800959981s) [upload=21002]: Starting upload Jul 25 09:27:53.078484157 (21h52m2.801047197s) [upload=21002]: Done starting upload Jul 25 09:27:53.078544112 (21h52m2.801107142s) [upload=21002]: Uploading segments... Jul 25 09:27:53.078584009 (21h52m2.801147039s) [upload=21002]: Got next segment. Inline: true Jul 25 09:27:53.078588026 (21h52m2.801151066s) [upload=21002]: Waiting for error group managing segments... Jul 25 09:27:53.078630116 (21h52m2.801193156s) [upload=21002]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:27:53.078634464 (21h52m2.801197504s) [upload=21002]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:27:53.078636810 (21h52m2.80119985s) [upload=21002]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:27:53.336646507 (21h52m3.059209587s) [upload=21002]: Done uploading segments... Jul 25 09:27:53.336667287 (21h52m3.059230337s) [upload=21002]: Upload finished. err: <nil> Jul 25 09:29:06.978452311 (21h53m16.701015351s) [upload=21021]: Starting upload Jul 25 09:29:06.978520191 (21h53m16.701083221s) [upload=21021]: Done starting upload Jul 25 09:29:06.978597849 (21h53m16.701160889s) [upload=21021]: Uploading segments... Jul 25 09:29:06.978698231 (21h53m16.701261281s) [upload=21021]: Got next segment. Inline: true Jul 25 09:29:06.978706287 (21h53m16.701269347s) [upload=21021]: Waiting for error group managing segments... Jul 25 09:29:06.978753848 (21h53m16.701316878s) [upload=21021]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:29:06.978758897 (21h53m16.701321937s) [upload=21021]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:29:06.978761131 (21h53m16.701324171s) [upload=21021]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:29:07.240912794 (21h53m16.963475834s) [upload=21021]: Done uploading segments... Jul 25 09:29:07.240931219 (21h53m16.963494259s) [upload=21021]: Upload finished. err: <nil> Jul 25 09:30:11.152587399 (21h54m20.875150439s) [upload=21037]: Starting upload Jul 25 09:30:11.152643596 (21h54m20.875206636s) [upload=21037]: Done starting upload Jul 25 09:30:11.152684424 (21h54m20.875247464s) [upload=21037]: Uploading segments... Jul 25 09:30:11.152739640 (21h54m20.87530268s) [upload=21037]: Got next segment. Inline: true Jul 25 09:30:11.152744549 (21h54m20.875307589s) [upload=21037]: Waiting for error group managing segments... Jul 25 09:30:11.152785127 (21h54m20.875348167s) [upload=21037]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:30:11.152790467 (21h54m20.875353507s) [upload=21037]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:30:11.152793052 (21h54m20.875356092s) [upload=21037]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:30:11.421977889 (21h54m21.144540919s) [upload=21037]: Done uploading segments... Jul 25 09:30:11.421995103 (21h54m21.144558143s) [upload=21037]: Upload finished. err: <nil> Jul 25 09:31:21.388209097 (21h55m31.110772137s) [upload=21053]: Starting upload Jul 25 09:31:21.388300943 (21h55m31.110863983s) [upload=21053]: Done starting upload Jul 25 09:31:21.388424629 (21h55m31.110987669s) [upload=21053]: Uploading segments... Jul 25 09:31:21.388526104 (21h55m31.111089144s) [upload=21053]: Got next segment. Inline: true Jul 25 09:31:21.388530682 (21h55m31.111093722s) [upload=21053]: Waiting for error group managing segments... Jul 25 09:31:21.388591739 (21h55m31.111154779s) [upload=21053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:31:21.388600687 (21h55m31.111163727s) [upload=21053]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:31:21.388603402 (21h55m31.111166442s) [upload=21053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:31:21.651857102 (21h55m31.374420132s) [upload=21053]: Done uploading segments... Jul 25 09:31:21.651874595 (21h55m31.374437625s) [upload=21053]: Upload finished. err: <nil> Jul 25 09:32:08.831277463 (21h56m18.553840503s) [upload=21065]: Starting upload Jul 25 09:32:08.831391121 (21h56m18.553954171s) [upload=21065]: Done starting upload Jul 25 09:32:08.831498536 (21h56m18.554061576s) [upload=21065]: Uploading segments... Jul 25 09:32:08.831577387 (21h56m18.554140437s) [upload=21065]: Got next segment. Inline: true Jul 25 09:32:08.831583599 (21h56m18.554146639s) [upload=21065]: Waiting for error group managing segments... Jul 25 09:32:08.831632082 (21h56m18.554195122s) [upload=21065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:32:08.831638153 (21h56m18.554201193s) [upload=21065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:32:08.831658842 (21h56m18.554221882s) [upload=21065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:32:09.099387434 (21h56m18.821950484s) [upload=21065]: Done uploading segments... Jul 25 09:32:09.099442660 (21h56m18.8220057s) [upload=21065]: Upload finished. err: <nil> Jul 25 09:33:13.963999397 (21h57m23.686562427s) [upload=21085]: Starting upload Jul 25 09:33:13.964075112 (21h57m23.686638152s) [upload=21085]: Done starting upload Jul 25 09:33:13.964129967 (21h57m23.686693007s) [upload=21085]: Uploading segments... Jul 25 09:33:13.964160586 (21h57m23.686723626s) [upload=21085]: Got next segment. Inline: true Jul 25 09:33:13.964164894 (21h57m23.686727934s) [upload=21085]: Waiting for error group managing segments... Jul 25 09:33:13.964202505 (21h57m23.686765545s) [upload=21085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:33:13.964207115 (21h57m23.686770155s) [upload=21085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:33:13.964209650 (21h57m23.68677269s) [upload=21085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:33:14.232920338 (21h57m23.955483378s) [upload=21085]: Done uploading segments... Jul 25 09:33:14.232938894 (21h57m23.955501934s) [upload=21085]: Upload finished. err: <nil> Jul 25 09:33:43.505781098 (21h57m53.228344148s) [upload=21092]: Starting upload Jul 25 09:33:43.505886630 (21h57m53.22844967s) [upload=21092]: Done starting upload Jul 25 09:33:43.505958236 (21h57m53.228521276s) [upload=21092]: Uploading segments... Jul 25 09:33:43.506013322 (21h57m53.228576362s) [upload=21092]: Got next segment. Inline: true Jul 25 09:33:43.506018011 (21h57m53.228581051s) [upload=21092]: Waiting for error group managing segments... Jul 25 09:33:43.506062997 (21h57m53.228626037s) [upload=21092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:33:43.506068237 (21h57m53.228631277s) [upload=21092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:33:43.506071313 (21h57m53.228634353s) [upload=21092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:33:43.974697177 (21h57m53.697260217s) [upload=21092]: Done uploading segments... Jul 25 09:33:43.974715503 (21h57m53.697278543s) [upload=21092]: Upload finished. err: <nil> Jul 25 09:35:21.634207561 (21h59m31.356770601s) [upload=21112]: Starting upload Jul 25 09:35:21.634263188 (21h59m31.356826228s) [upload=21112]: Done starting upload Jul 25 09:35:21.634309175 (21h59m31.356872215s) [upload=21112]: Uploading segments... Jul 25 09:35:21.634341738 (21h59m31.356904778s) [upload=21112]: Got next segment. Inline: true Jul 25 09:35:21.634345235 (21h59m31.356908275s) [upload=21112]: Waiting for error group managing segments... Jul 25 09:35:21.634382045 (21h59m31.356945075s) [upload=21112]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:35:21.634386453 (21h59m31.356949493s) [upload=21112]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:35:21.634388888 (21h59m31.356951918s) [upload=21112]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:35:21.912198648 (21h59m31.634761688s) [upload=21112]: Done uploading segments... Jul 25 09:35:21.912214678 (21h59m31.634777719s) [upload=21112]: Upload finished. err: <nil> Jul 25 09:36:16.777669823 (22h0m26.500232863s) [upload=21123]: Starting upload Jul 25 09:36:16.777732162 (22h0m26.500295202s) [upload=21123]: Done starting upload Jul 25 09:36:16.777828126 (22h0m26.500391166s) [upload=21123]: Uploading segments... Jul 25 09:36:16.777862512 (22h0m26.500425542s) [upload=21123]: Got next segment. Inline: true Jul 25 09:36:16.777866379 (22h0m26.500429419s) [upload=21123]: Waiting for error group managing segments... Jul 25 09:36:16.777902208 (22h0m26.500465248s) [upload=21123]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:36:16.777908921 (22h0m26.500471961s) [upload=21123]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:36:16.777911355 (22h0m26.500474395s) [upload=21123]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:36:21.722625410 (22h0m31.44518845s) [upload=21123]: Done uploading segments... Jul 25 09:36:21.722650267 (22h0m31.445213318s) [upload=21123]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.220716845s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [XX...........................................X..............] duration:
5.812250704s
FAIL (2025-07-25 10:20:32 UTC)
orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M
Duration: 5.812275462s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
5.834989678s
FAIL (2025-07-25 10:20:29 UTC)
orbiter warning:
======ERROR======
uplink: permission denied (bucket: metaclient: Unauthorized API credentials)
======LOGS======
3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF
Jul 25 09:33:07.978190206 (21h57m17.700753236s) [noise=true , address=45.91.116.11:4118 , piece_id=DVDR7JBJL2ISRJKZ6NJO6ZFOQEYJL255CMKP7JIMLQNZ56HE7O4A, seg_pos={0 0}, upload=21083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF
Jul 25 09:33:07.978226436 (21h57m17.700789476s) [seg_pos={0 0}, upload=21083]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 25 09:33:07.978290728 (21h57m17.700853768s) [upload=21083]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 25 09:33:07.978295116 (21h57m17.700858156s) [upload=21083]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 25 09:33:08.272621008 (21h57m17.995184058s) [upload=21083]: Done uploading segments...
Jul 25 09:33:08.272644353 (21h57m17.995207393s) [upload=21083]: Upload finished. err: <nil>
Jul 25 09:34:19.155612153 (21h58m28.878175193s) [upload=21099]: Starting upload
Jul 25 09:34:19.155671557 (21h58m28.878234597s) [upload=21099]: Done starting upload
Jul 25 09:34:19.155788951 (21h58m28.878351992s) [upload=21099]: Uploading segments...
Jul 25 09:34:19.155880987 (21h58m28.878444027s) [upload=21099]: Got next segment. Inline: false
Jul 25 09:34:19.155911836 (21h58m28.878474876s) [upload=21099]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 25 09:34:19.155916906 (21h58m28.878479946s) [upload=21099]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 25 09:34:19.474089123 (21h58m29.196652163s) [seg_pos={0 0}, upload=21099]: Begin upload segment...
Jul 25 09:34:19.474169006 (21h58m29.196732046s) [seg_pos={0 0}, upload=21099]: Done begin upload segment.
Jul 25 09:34:19.474204834 (21h58m29.196767884s) [noise=true , address=45.91.116.9:4263 , piece_id=4MSCHEXYQET4LCKMS2DRXZUDLJEEGBJRDPPRD7FV5HIZYGTQE46Q, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.474220154 (21h58m29.196783194s) [noise=true , address=104.36.82.6:4875 , piece_id=ICQB7MCL4MEBXDRUXJQR7TWBNJG5FDXK2HC7HCDSLP5D2AKZU2IQ, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.474645958 (21h58m29.197209008s) [noise=true , address=104.36.82.2:4729 , piece_id=Y5KJG5VJCHWRDBLIMSZZUE5ISYOCEZ3Z5FAP4MXTCAFKN2AMAFFQ, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.474854367 (21h58m29.197417407s) [noise=true , address=45.91.116.7:4011 , piece_id=SKT2T7L42JDMB5JR74IACUTSRADSRSGBXUAGKWXWVINNVUQAPOUA, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.475043850 (21h58m29.19760689s) [noise=true , address=104.36.82.15:4259 , piece_id=D64MTLWFIGPHK4OCHEF3WEY4I2DPPIGIG3UTJXVO5EC77TWV6TMA, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.475224505 (21h58m29.197787545s) [noise=true , address=45.91.116.4:4938 , piece_id=EZOQH3VH4DHZQZNPQZJL3SQ3PD5EOHQMD3JRGOYZI2ETJHSE4W7A, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.475458443 (21h58m29.198021473s) [noise=true , address=104.36.82.7:4909 , piece_id=DVC47Y53A73WTZJ5CEAM6M5NTFWFNEXPRVZJV6RZSQLXGSIN7QCA, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.475717659 (21h58m29.198280699s) [noise=true , address=45.91.116.6:4974 , piece_id=Q56R4JCGQIZQG7ALI2QO3HTN7PQCJCOQEMLW6HCIVOJRT5MEX6KQ, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.475971265 (21h58m29.198534305s) [noise=true , address=45.91.116.9:4262 , piece_id=YF6TLUROKJZYIV5ARC22MEZ34WRAJCEBGKP5VSLFXUOF53CZTOVA, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.476371320 (21h58m29.19893436s) [noise=true , address=45.91.116.4:4939 , piece_id=JVCWPOF2CLF2WBVBZZQSAZ3KP3XVPMYUXC7HG5QVICE6MC23VCNA, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.478271665 (21h58m29.200834705s) [noise=true , address=45.91.116.5:4297 , piece_id=MD2EEVFUOLH6WJEFLM7KFBLWUGLBGWDSOAAL3ON56DJMEMPAD37Q, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.479648920 (21h58m29.20221195s) [noise=true , address=104.36.82.11:4114 , piece_id=4LNS6F6FDLNPOGMZ4HPIJ44ZP2Q5XTA2T4UJNHIVHBGBOQKYIMSA, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.479910261 (21h58m29.202473321s) [noise=true , address=104.36.82.15:4258 , piece_id=OBQ3LQJUCGAZCEEO4T76MXDEPVOUKACTKOO6YR35GCS6LJ7GSXEQ, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.482494515 (21h58m29.205057555s) [noise=true , address=104.36.82.8:4970 , piece_id=MW4ZOSF4XPKSX3GVQE44U6ZIKDWWRATC2YRHOLLSVOLBLVITR6MQ, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.483910805 (21h58m29.206473845s) [noise=true , address=104.36.82.9:4005 , piece_id=3XGPJOYMTCQCA5PJPKXBI4QZBRLFK67IRTLB434LEMWLNCZOMXHQ, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.489619007 (21h58m29.212182057s) [noise=true , address=45.91.116.14:4189 , piece_id=6ML7BRXV4AGZBWR523WB3IHVRU7IVHNNHDN6G5ONERT23ODBWQ7A, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:21.166728613 (21h58m30.889291653s) [upload=21099]: Next returned nil segment
Jul 25 09:34:21.166748240 (21h58m30.88931128s) [upload=21099]: Waiting for error group managing segments...
Jul 25 09:34:21.499554977 (21h58m31.222118017s) [noise=true , address=45.91.116.6:4974 , piece_id=Q56R4JCGQIZQG7ALI2QO3HTN7PQCJCOQEMLW6HCIVOJRT5MEX6KQ, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.504744947 (21h58m31.227307988s) [noise=true , address=45.91.116.7:4011 , piece_id=SKT2T7L42JDMB5JR74IACUTSRADSRSGBXUAGKWXWVINNVUQAPOUA, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.507097449 (21h58m31.229660489s) [noise=true , address=45.91.116.14:4189 , piece_id=6ML7BRXV4AGZBWR523WB3IHVRU7IVHNNHDN6G5ONERT23ODBWQ7A, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.517304048 (21h58m31.239867088s) [noise=true , address=104.36.82.11:4114 , piece_id=4LNS6F6FDLNPOGMZ4HPIJ44ZP2Q5XTA2T4UJNHIVHBGBOQKYIMSA, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.524928355 (21h58m31.247491395s) [noise=true , address=104.36.82.2:4729 , piece_id=Y5KJG5VJCHWRDBLIMSZZUE5ISYOCEZ3Z5FAP4MXTCAFKN2AMAFFQ, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.533139686 (21h58m31.255702726s) [noise=true , address=104.36.82.6:4875 , piece_id=ICQB7MCL4MEBXDRUXJQR7TWBNJG5FDXK2HC7HCDSLP5D2AKZU2IQ, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.549770536 (21h58m31.272333576s) [noise=true , address=104.36.82.9:4005 , piece_id=3XGPJOYMTCQCA5PJPKXBI4QZBRLFK67IRTLB434LEMWLNCZOMXHQ, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.556227130 (21h58m31.27879017s) [noise=true , address=104.36.82.7:4909 , piece_id=DVC47Y53A73WTZJ5CEAM6M5NTFWFNEXPRVZJV6RZSQLXGSIN7QCA, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.589316551 (21h58m31.311879591s) [noise=true , address=45.91.116.4:4939 , piece_id=JVCWPOF2CLF2WBVBZZQSAZ3KP3XVPMYUXC7HG5QVICE6MC23VCNA, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.595855452 (21h58m31.318418492s) [noise=true , address=45.91.116.9:4263 , piece_id=4MSCHEXYQET4LCKMS2DRXZUDLJEEGBJRDPPRD7FV5HIZYGTQE46Q, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.599202887 (21h58m31.321765927s) [noise=true , address=45.91.116.4:4938 , piece_id=EZOQH3VH4DHZQZNPQZJL3SQ3PD5EOHQMD3JRGOYZI2ETJHSE4W7A, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.623718644 (21h58m31.346281684s) [noise=true , address=104.36.82.8:4970 , piece_id=MW4ZOSF4XPKSX3GVQE44U6ZIKDWWRATC2YRHOLLSVOLBLVITR6MQ, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.663640467 (21h58m31.386203507s) [noise=true , address=45.91.116.5:4297 , piece_id=MD2EEVFUOLH6WJEFLM7KFBLWUGLBGWDSOAAL3ON56DJMEMPAD37Q, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.663689460 (21h58m31.3862525s) [seg_pos={0 0}, upload=21099]: Segment reached optimal threshold of 13 pieces.
Jul 25 09:34:21.663792598 (21h58m31.386355638s) [noise=true , address=104.36.82.15:4258 , piece_id=OBQ3LQJUCGAZCEEO4T76MXDEPVOUKACTKOO6YR35GCS6LJ7GSXEQ, seg_pos={0 0}, upload=21099]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jul 25 09:34:21.663848695 (21h58m31.386411725s) [noise=true , address=45.91.116.9:4262 , piece_id=YF6TLUROKJZYIV5ARC22MEZ34WRAJCEBGKP5VSLFXUOF53CZTOVA, seg_pos={0 0}, upload=21099]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 25 09:34:21.663942966 (21h58m31.386506046s) [noise=true , address=104.36.82.15:4259 , piece_id=D64MTLWFIGPHK4OCHEF3WEY4I2DPPIGIG3UTJXVO5EC77TWV6TMA, seg_pos={0 0}, upload=21099]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: expected piece hash; context canceled; EOF
Jul 25 09:34:21.663986699 (21h58m31.386549739s) [seg_pos={0 0}, upload=21099]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 25 09:34:21.664102931 (21h58m31.386665961s) [upload=21099]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 25 09:34:21.664107882 (21h58m31.386670922s) [upload=21099]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 25 09:34:21.949888312 (21h58m31.672451352s) [upload=21099]: Done uploading segments...
Jul 25 09:34:21.949900605 (21h58m31.672463645s) [upload=21099]: Upload finished. err: <nil>
Duration: 5.835015916s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X........................X...............................] duration:
1.87342932s
FAIL (2025-07-25 10:20:28 UTC)
orbiter warning: uplink: object not found ("orbiter_us_0/1K")
Duration: 1.873478925s
core
uplink
us1
vivint
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
6.46772243s
FAIL (2025-07-25 10:20:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.467750384s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
5.955442881s
FAIL (2025-07-25 10:20:10 UTC)
orbiter warning:
======ERROR======
uplink: permission denied (bucket: metaclient: Unauthorized API credentials)
======LOGS======
3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF
Jul 25 09:33:07.978190206 (21h57m17.700753236s) [noise=true , address=45.91.116.11:4118 , piece_id=DVDR7JBJL2ISRJKZ6NJO6ZFOQEYJL255CMKP7JIMLQNZ56HE7O4A, seg_pos={0 0}, upload=21083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF
Jul 25 09:33:07.978226436 (21h57m17.700789476s) [seg_pos={0 0}, upload=21083]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 25 09:33:07.978290728 (21h57m17.700853768s) [upload=21083]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 25 09:33:07.978295116 (21h57m17.700858156s) [upload=21083]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 25 09:33:08.272621008 (21h57m17.995184058s) [upload=21083]: Done uploading segments...
Jul 25 09:33:08.272644353 (21h57m17.995207393s) [upload=21083]: Upload finished. err: <nil>
Jul 25 09:34:19.155612153 (21h58m28.878175193s) [upload=21099]: Starting upload
Jul 25 09:34:19.155671557 (21h58m28.878234597s) [upload=21099]: Done starting upload
Jul 25 09:34:19.155788951 (21h58m28.878351992s) [upload=21099]: Uploading segments...
Jul 25 09:34:19.155880987 (21h58m28.878444027s) [upload=21099]: Got next segment. Inline: false
Jul 25 09:34:19.155911836 (21h58m28.878474876s) [upload=21099]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 25 09:34:19.155916906 (21h58m28.878479946s) [upload=21099]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 25 09:34:19.474089123 (21h58m29.196652163s) [seg_pos={0 0}, upload=21099]: Begin upload segment...
Jul 25 09:34:19.474169006 (21h58m29.196732046s) [seg_pos={0 0}, upload=21099]: Done begin upload segment.
Jul 25 09:34:19.474204834 (21h58m29.196767884s) [noise=true , address=45.91.116.9:4263 , piece_id=4MSCHEXYQET4LCKMS2DRXZUDLJEEGBJRDPPRD7FV5HIZYGTQE46Q, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.474220154 (21h58m29.196783194s) [noise=true , address=104.36.82.6:4875 , piece_id=ICQB7MCL4MEBXDRUXJQR7TWBNJG5FDXK2HC7HCDSLP5D2AKZU2IQ, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.474645958 (21h58m29.197209008s) [noise=true , address=104.36.82.2:4729 , piece_id=Y5KJG5VJCHWRDBLIMSZZUE5ISYOCEZ3Z5FAP4MXTCAFKN2AMAFFQ, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.474854367 (21h58m29.197417407s) [noise=true , address=45.91.116.7:4011 , piece_id=SKT2T7L42JDMB5JR74IACUTSRADSRSGBXUAGKWXWVINNVUQAPOUA, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.475043850 (21h58m29.19760689s) [noise=true , address=104.36.82.15:4259 , piece_id=D64MTLWFIGPHK4OCHEF3WEY4I2DPPIGIG3UTJXVO5EC77TWV6TMA, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.475224505 (21h58m29.197787545s) [noise=true , address=45.91.116.4:4938 , piece_id=EZOQH3VH4DHZQZNPQZJL3SQ3PD5EOHQMD3JRGOYZI2ETJHSE4W7A, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.475458443 (21h58m29.198021473s) [noise=true , address=104.36.82.7:4909 , piece_id=DVC47Y53A73WTZJ5CEAM6M5NTFWFNEXPRVZJV6RZSQLXGSIN7QCA, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.475717659 (21h58m29.198280699s) [noise=true , address=45.91.116.6:4974 , piece_id=Q56R4JCGQIZQG7ALI2QO3HTN7PQCJCOQEMLW6HCIVOJRT5MEX6KQ, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.475971265 (21h58m29.198534305s) [noise=true , address=45.91.116.9:4262 , piece_id=YF6TLUROKJZYIV5ARC22MEZ34WRAJCEBGKP5VSLFXUOF53CZTOVA, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.476371320 (21h58m29.19893436s) [noise=true , address=45.91.116.4:4939 , piece_id=JVCWPOF2CLF2WBVBZZQSAZ3KP3XVPMYUXC7HG5QVICE6MC23VCNA, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.478271665 (21h58m29.200834705s) [noise=true , address=45.91.116.5:4297 , piece_id=MD2EEVFUOLH6WJEFLM7KFBLWUGLBGWDSOAAL3ON56DJMEMPAD37Q, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.479648920 (21h58m29.20221195s) [noise=true , address=104.36.82.11:4114 , piece_id=4LNS6F6FDLNPOGMZ4HPIJ44ZP2Q5XTA2T4UJNHIVHBGBOQKYIMSA, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.479910261 (21h58m29.202473321s) [noise=true , address=104.36.82.15:4258 , piece_id=OBQ3LQJUCGAZCEEO4T76MXDEPVOUKACTKOO6YR35GCS6LJ7GSXEQ, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.482494515 (21h58m29.205057555s) [noise=true , address=104.36.82.8:4970 , piece_id=MW4ZOSF4XPKSX3GVQE44U6ZIKDWWRATC2YRHOLLSVOLBLVITR6MQ, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.483910805 (21h58m29.206473845s) [noise=true , address=104.36.82.9:4005 , piece_id=3XGPJOYMTCQCA5PJPKXBI4QZBRLFK67IRTLB434LEMWLNCZOMXHQ, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.489619007 (21h58m29.212182057s) [noise=true , address=45.91.116.14:4189 , piece_id=6ML7BRXV4AGZBWR523WB3IHVRU7IVHNNHDN6G5ONERT23ODBWQ7A, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:21.166728613 (21h58m30.889291653s) [upload=21099]: Next returned nil segment
Jul 25 09:34:21.166748240 (21h58m30.88931128s) [upload=21099]: Waiting for error group managing segments...
Jul 25 09:34:21.499554977 (21h58m31.222118017s) [noise=true , address=45.91.116.6:4974 , piece_id=Q56R4JCGQIZQG7ALI2QO3HTN7PQCJCOQEMLW6HCIVOJRT5MEX6KQ, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.504744947 (21h58m31.227307988s) [noise=true , address=45.91.116.7:4011 , piece_id=SKT2T7L42JDMB5JR74IACUTSRADSRSGBXUAGKWXWVINNVUQAPOUA, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.507097449 (21h58m31.229660489s) [noise=true , address=45.91.116.14:4189 , piece_id=6ML7BRXV4AGZBWR523WB3IHVRU7IVHNNHDN6G5ONERT23ODBWQ7A, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.517304048 (21h58m31.239867088s) [noise=true , address=104.36.82.11:4114 , piece_id=4LNS6F6FDLNPOGMZ4HPIJ44ZP2Q5XTA2T4UJNHIVHBGBOQKYIMSA, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.524928355 (21h58m31.247491395s) [noise=true , address=104.36.82.2:4729 , piece_id=Y5KJG5VJCHWRDBLIMSZZUE5ISYOCEZ3Z5FAP4MXTCAFKN2AMAFFQ, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.533139686 (21h58m31.255702726s) [noise=true , address=104.36.82.6:4875 , piece_id=ICQB7MCL4MEBXDRUXJQR7TWBNJG5FDXK2HC7HCDSLP5D2AKZU2IQ, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.549770536 (21h58m31.272333576s) [noise=true , address=104.36.82.9:4005 , piece_id=3XGPJOYMTCQCA5PJPKXBI4QZBRLFK67IRTLB434LEMWLNCZOMXHQ, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.556227130 (21h58m31.27879017s) [noise=true , address=104.36.82.7:4909 , piece_id=DVC47Y53A73WTZJ5CEAM6M5NTFWFNEXPRVZJV6RZSQLXGSIN7QCA, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.589316551 (21h58m31.311879591s) [noise=true , address=45.91.116.4:4939 , piece_id=JVCWPOF2CLF2WBVBZZQSAZ3KP3XVPMYUXC7HG5QVICE6MC23VCNA, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.595855452 (21h58m31.318418492s) [noise=true , address=45.91.116.9:4263 , piece_id=4MSCHEXYQET4LCKMS2DRXZUDLJEEGBJRDPPRD7FV5HIZYGTQE46Q, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.599202887 (21h58m31.321765927s) [noise=true , address=45.91.116.4:4938 , piece_id=EZOQH3VH4DHZQZNPQZJL3SQ3PD5EOHQMD3JRGOYZI2ETJHSE4W7A, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.623718644 (21h58m31.346281684s) [noise=true , address=104.36.82.8:4970 , piece_id=MW4ZOSF4XPKSX3GVQE44U6ZIKDWWRATC2YRHOLLSVOLBLVITR6MQ, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.663640467 (21h58m31.386203507s) [noise=true , address=45.91.116.5:4297 , piece_id=MD2EEVFUOLH6WJEFLM7KFBLWUGLBGWDSOAAL3ON56DJMEMPAD37Q, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.663689460 (21h58m31.3862525s) [seg_pos={0 0}, upload=21099]: Segment reached optimal threshold of 13 pieces.
Jul 25 09:34:21.663792598 (21h58m31.386355638s) [noise=true , address=104.36.82.15:4258 , piece_id=OBQ3LQJUCGAZCEEO4T76MXDEPVOUKACTKOO6YR35GCS6LJ7GSXEQ, seg_pos={0 0}, upload=21099]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jul 25 09:34:21.663848695 (21h58m31.386411725s) [noise=true , address=45.91.116.9:4262 , piece_id=YF6TLUROKJZYIV5ARC22MEZ34WRAJCEBGKP5VSLFXUOF53CZTOVA, seg_pos={0 0}, upload=21099]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 25 09:34:21.663942966 (21h58m31.386506046s) [noise=true , address=104.36.82.15:4259 , piece_id=D64MTLWFIGPHK4OCHEF3WEY4I2DPPIGIG3UTJXVO5EC77TWV6TMA, seg_pos={0 0}, upload=21099]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: expected piece hash; context canceled; EOF
Jul 25 09:34:21.663986699 (21h58m31.386549739s) [seg_pos={0 0}, upload=21099]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 25 09:34:21.664102931 (21h58m31.386665961s) [upload=21099]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 25 09:34:21.664107882 (21h58m31.386670922s) [upload=21099]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 25 09:34:21.949888312 (21h58m31.672451352s) [upload=21099]: Done uploading segments...
Jul 25 09:34:21.949900605 (21h58m31.672463645s) [upload=21099]: Upload finished. err: <nil>
Duration: 5.955464464s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.XX...........................................X.............] duration:
5.783897791s
FAIL (2025-07-25 10:20:07 UTC)
orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M
Duration: 5.783957615s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
5.669237099s
FAIL (2025-07-25 10:20:02 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.6692634s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.146348996s
FAIL (2025-07-25 10:19:59 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 2.146369816s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
2 out of 60 is failed (threshold=3) [X.X.........................................................] duration:
1.953121909s
FAIL (2025-07-25 10:19:57 UTC)
orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Jul 25 09:26:34.570036631 (21h50m44.292599671s) [upload=20980]: Upload finished. err: <nil> Jul 25 09:26:49.200928904 (21h50m58.923491944s) [upload=20986]: Starting upload Jul 25 09:26:49.200980633 (21h50m58.923543673s) [upload=20986]: Done starting upload Jul 25 09:26:49.201056208 (21h50m58.923619248s) [upload=20986]: Uploading segments... Jul 25 09:26:49.201090293 (21h50m58.923653333s) [upload=20986]: Got next segment. Inline: true Jul 25 09:26:49.201094100 (21h50m58.92365714s) [upload=20986]: Waiting for error group managing segments... Jul 25 09:26:49.201126071 (21h50m58.923689111s) [upload=20986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:26:49.201130601 (21h50m58.923693641s) [upload=20986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:26:49.201133486 (21h50m58.923696526s) [upload=20986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:26:49.604840728 (21h50m59.327403768s) [upload=20986]: Done uploading segments... Jul 25 09:26:49.604861357 (21h50m59.327424398s) [upload=20986]: Upload finished. err: <nil> Jul 25 09:27:53.078396941 (21h52m2.800959981s) [upload=21002]: Starting upload Jul 25 09:27:53.078484157 (21h52m2.801047197s) [upload=21002]: Done starting upload Jul 25 09:27:53.078544112 (21h52m2.801107142s) [upload=21002]: Uploading segments... Jul 25 09:27:53.078584009 (21h52m2.801147039s) [upload=21002]: Got next segment. Inline: true Jul 25 09:27:53.078588026 (21h52m2.801151066s) [upload=21002]: Waiting for error group managing segments... Jul 25 09:27:53.078630116 (21h52m2.801193156s) [upload=21002]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:27:53.078634464 (21h52m2.801197504s) [upload=21002]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:27:53.078636810 (21h52m2.80119985s) [upload=21002]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:27:53.336646507 (21h52m3.059209587s) [upload=21002]: Done uploading segments... Jul 25 09:27:53.336667287 (21h52m3.059230337s) [upload=21002]: Upload finished. err: <nil> Jul 25 09:29:06.978452311 (21h53m16.701015351s) [upload=21021]: Starting upload Jul 25 09:29:06.978520191 (21h53m16.701083221s) [upload=21021]: Done starting upload Jul 25 09:29:06.978597849 (21h53m16.701160889s) [upload=21021]: Uploading segments... Jul 25 09:29:06.978698231 (21h53m16.701261281s) [upload=21021]: Got next segment. Inline: true Jul 25 09:29:06.978706287 (21h53m16.701269347s) [upload=21021]: Waiting for error group managing segments... Jul 25 09:29:06.978753848 (21h53m16.701316878s) [upload=21021]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:29:06.978758897 (21h53m16.701321937s) [upload=21021]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:29:06.978761131 (21h53m16.701324171s) [upload=21021]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:29:07.240912794 (21h53m16.963475834s) [upload=21021]: Done uploading segments... Jul 25 09:29:07.240931219 (21h53m16.963494259s) [upload=21021]: Upload finished. err: <nil> Jul 25 09:30:11.152587399 (21h54m20.875150439s) [upload=21037]: Starting upload Jul 25 09:30:11.152643596 (21h54m20.875206636s) [upload=21037]: Done starting upload Jul 25 09:30:11.152684424 (21h54m20.875247464s) [upload=21037]: Uploading segments... Jul 25 09:30:11.152739640 (21h54m20.87530268s) [upload=21037]: Got next segment. Inline: true Jul 25 09:30:11.152744549 (21h54m20.875307589s) [upload=21037]: Waiting for error group managing segments... Jul 25 09:30:11.152785127 (21h54m20.875348167s) [upload=21037]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:30:11.152790467 (21h54m20.875353507s) [upload=21037]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:30:11.152793052 (21h54m20.875356092s) [upload=21037]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:30:11.421977889 (21h54m21.144540919s) [upload=21037]: Done uploading segments... Jul 25 09:30:11.421995103 (21h54m21.144558143s) [upload=21037]: Upload finished. err: <nil> Jul 25 09:31:21.388209097 (21h55m31.110772137s) [upload=21053]: Starting upload Jul 25 09:31:21.388300943 (21h55m31.110863983s) [upload=21053]: Done starting upload Jul 25 09:31:21.388424629 (21h55m31.110987669s) [upload=21053]: Uploading segments... Jul 25 09:31:21.388526104 (21h55m31.111089144s) [upload=21053]: Got next segment. Inline: true Jul 25 09:31:21.388530682 (21h55m31.111093722s) [upload=21053]: Waiting for error group managing segments... Jul 25 09:31:21.388591739 (21h55m31.111154779s) [upload=21053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:31:21.388600687 (21h55m31.111163727s) [upload=21053]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:31:21.388603402 (21h55m31.111166442s) [upload=21053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:31:21.651857102 (21h55m31.374420132s) [upload=21053]: Done uploading segments... Jul 25 09:31:21.651874595 (21h55m31.374437625s) [upload=21053]: Upload finished. err: <nil> Jul 25 09:32:08.831277463 (21h56m18.553840503s) [upload=21065]: Starting upload Jul 25 09:32:08.831391121 (21h56m18.553954171s) [upload=21065]: Done starting upload Jul 25 09:32:08.831498536 (21h56m18.554061576s) [upload=21065]: Uploading segments... Jul 25 09:32:08.831577387 (21h56m18.554140437s) [upload=21065]: Got next segment. Inline: true Jul 25 09:32:08.831583599 (21h56m18.554146639s) [upload=21065]: Waiting for error group managing segments... Jul 25 09:32:08.831632082 (21h56m18.554195122s) [upload=21065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:32:08.831638153 (21h56m18.554201193s) [upload=21065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:32:08.831658842 (21h56m18.554221882s) [upload=21065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:32:09.099387434 (21h56m18.821950484s) [upload=21065]: Done uploading segments... Jul 25 09:32:09.099442660 (21h56m18.8220057s) [upload=21065]: Upload finished. err: <nil> Jul 25 09:33:13.963999397 (21h57m23.686562427s) [upload=21085]: Starting upload Jul 25 09:33:13.964075112 (21h57m23.686638152s) [upload=21085]: Done starting upload Jul 25 09:33:13.964129967 (21h57m23.686693007s) [upload=21085]: Uploading segments... Jul 25 09:33:13.964160586 (21h57m23.686723626s) [upload=21085]: Got next segment. Inline: true Jul 25 09:33:13.964164894 (21h57m23.686727934s) [upload=21085]: Waiting for error group managing segments... Jul 25 09:33:13.964202505 (21h57m23.686765545s) [upload=21085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:33:13.964207115 (21h57m23.686770155s) [upload=21085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:33:13.964209650 (21h57m23.68677269s) [upload=21085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:33:14.232920338 (21h57m23.955483378s) [upload=21085]: Done uploading segments... Jul 25 09:33:14.232938894 (21h57m23.955501934s) [upload=21085]: Upload finished. err: <nil> Jul 25 09:33:43.505781098 (21h57m53.228344148s) [upload=21092]: Starting upload Jul 25 09:33:43.505886630 (21h57m53.22844967s) [upload=21092]: Done starting upload Jul 25 09:33:43.505958236 (21h57m53.228521276s) [upload=21092]: Uploading segments... Jul 25 09:33:43.506013322 (21h57m53.228576362s) [upload=21092]: Got next segment. Inline: true Jul 25 09:33:43.506018011 (21h57m53.228581051s) [upload=21092]: Waiting for error group managing segments... Jul 25 09:33:43.506062997 (21h57m53.228626037s) [upload=21092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:33:43.506068237 (21h57m53.228631277s) [upload=21092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:33:43.506071313 (21h57m53.228634353s) [upload=21092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:33:43.974697177 (21h57m53.697260217s) [upload=21092]: Done uploading segments... Jul 25 09:33:43.974715503 (21h57m53.697278543s) [upload=21092]: Upload finished. err: <nil> Jul 25 09:35:21.634207561 (21h59m31.356770601s) [upload=21112]: Starting upload Jul 25 09:35:21.634263188 (21h59m31.356826228s) [upload=21112]: Done starting upload Jul 25 09:35:21.634309175 (21h59m31.356872215s) [upload=21112]: Uploading segments... Jul 25 09:35:21.634341738 (21h59m31.356904778s) [upload=21112]: Got next segment. Inline: true Jul 25 09:35:21.634345235 (21h59m31.356908275s) [upload=21112]: Waiting for error group managing segments... Jul 25 09:35:21.634382045 (21h59m31.356945075s) [upload=21112]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:35:21.634386453 (21h59m31.356949493s) [upload=21112]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:35:21.634388888 (21h59m31.356951918s) [upload=21112]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:35:21.912198648 (21h59m31.634761688s) [upload=21112]: Done uploading segments... Jul 25 09:35:21.912214678 (21h59m31.634777719s) [upload=21112]: Upload finished. err: <nil> Jul 25 09:36:16.777669823 (22h0m26.500232863s) [upload=21123]: Starting upload Jul 25 09:36:16.777732162 (22h0m26.500295202s) [upload=21123]: Done starting upload Jul 25 09:36:16.777828126 (22h0m26.500391166s) [upload=21123]: Uploading segments... Jul 25 09:36:16.777862512 (22h0m26.500425542s) [upload=21123]: Got next segment. Inline: true Jul 25 09:36:16.777866379 (22h0m26.500429419s) [upload=21123]: Waiting for error group managing segments... Jul 25 09:36:16.777902208 (22h0m26.500465248s) [upload=21123]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 25 09:36:16.777908921 (22h0m26.500471961s) [upload=21123]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 25 09:36:16.777911355 (22h0m26.500474395s) [upload=21123]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 25 09:36:21.722625410 (22h0m31.44518845s) [upload=21123]: Done uploading segments... Jul 25 09:36:21.722650267 (22h0m31.445213318s) [upload=21123]: Upload finished. err: metaclient: context deadline exceeded
Duration: 1.953152037s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X........................X..............................] duration:
1.939026008s
FAIL (2025-07-25 10:19:36 UTC)
orbiter warning: uplink: object not found ("orbiter_us_0/1K")
Duration: 1.939056026s
core
uplink
us1
vivint
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................] duration:
5.850942774s
FAIL (2025-07-25 10:19:24 UTC)
orbiter warning:
======ERROR======
uplink: permission denied (bucket: metaclient: Unauthorized API credentials)
======LOGS======
3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF
Jul 25 09:33:07.978190206 (21h57m17.700753236s) [noise=true , address=45.91.116.11:4118 , piece_id=DVDR7JBJL2ISRJKZ6NJO6ZFOQEYJL255CMKP7JIMLQNZ56HE7O4A, seg_pos={0 0}, upload=21083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF
Jul 25 09:33:07.978226436 (21h57m17.700789476s) [seg_pos={0 0}, upload=21083]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 25 09:33:07.978290728 (21h57m17.700853768s) [upload=21083]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 25 09:33:07.978295116 (21h57m17.700858156s) [upload=21083]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 25 09:33:08.272621008 (21h57m17.995184058s) [upload=21083]: Done uploading segments...
Jul 25 09:33:08.272644353 (21h57m17.995207393s) [upload=21083]: Upload finished. err: <nil>
Jul 25 09:34:19.155612153 (21h58m28.878175193s) [upload=21099]: Starting upload
Jul 25 09:34:19.155671557 (21h58m28.878234597s) [upload=21099]: Done starting upload
Jul 25 09:34:19.155788951 (21h58m28.878351992s) [upload=21099]: Uploading segments...
Jul 25 09:34:19.155880987 (21h58m28.878444027s) [upload=21099]: Got next segment. Inline: false
Jul 25 09:34:19.155911836 (21h58m28.878474876s) [upload=21099]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 25 09:34:19.155916906 (21h58m28.878479946s) [upload=21099]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 25 09:34:19.474089123 (21h58m29.196652163s) [seg_pos={0 0}, upload=21099]: Begin upload segment...
Jul 25 09:34:19.474169006 (21h58m29.196732046s) [seg_pos={0 0}, upload=21099]: Done begin upload segment.
Jul 25 09:34:19.474204834 (21h58m29.196767884s) [noise=true , address=45.91.116.9:4263 , piece_id=4MSCHEXYQET4LCKMS2DRXZUDLJEEGBJRDPPRD7FV5HIZYGTQE46Q, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.474220154 (21h58m29.196783194s) [noise=true , address=104.36.82.6:4875 , piece_id=ICQB7MCL4MEBXDRUXJQR7TWBNJG5FDXK2HC7HCDSLP5D2AKZU2IQ, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.474645958 (21h58m29.197209008s) [noise=true , address=104.36.82.2:4729 , piece_id=Y5KJG5VJCHWRDBLIMSZZUE5ISYOCEZ3Z5FAP4MXTCAFKN2AMAFFQ, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.474854367 (21h58m29.197417407s) [noise=true , address=45.91.116.7:4011 , piece_id=SKT2T7L42JDMB5JR74IACUTSRADSRSGBXUAGKWXWVINNVUQAPOUA, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.475043850 (21h58m29.19760689s) [noise=true , address=104.36.82.15:4259 , piece_id=D64MTLWFIGPHK4OCHEF3WEY4I2DPPIGIG3UTJXVO5EC77TWV6TMA, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.475224505 (21h58m29.197787545s) [noise=true , address=45.91.116.4:4938 , piece_id=EZOQH3VH4DHZQZNPQZJL3SQ3PD5EOHQMD3JRGOYZI2ETJHSE4W7A, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.475458443 (21h58m29.198021473s) [noise=true , address=104.36.82.7:4909 , piece_id=DVC47Y53A73WTZJ5CEAM6M5NTFWFNEXPRVZJV6RZSQLXGSIN7QCA, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.475717659 (21h58m29.198280699s) [noise=true , address=45.91.116.6:4974 , piece_id=Q56R4JCGQIZQG7ALI2QO3HTN7PQCJCOQEMLW6HCIVOJRT5MEX6KQ, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.475971265 (21h58m29.198534305s) [noise=true , address=45.91.116.9:4262 , piece_id=YF6TLUROKJZYIV5ARC22MEZ34WRAJCEBGKP5VSLFXUOF53CZTOVA, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.476371320 (21h58m29.19893436s) [noise=true , address=45.91.116.4:4939 , piece_id=JVCWPOF2CLF2WBVBZZQSAZ3KP3XVPMYUXC7HG5QVICE6MC23VCNA, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.478271665 (21h58m29.200834705s) [noise=true , address=45.91.116.5:4297 , piece_id=MD2EEVFUOLH6WJEFLM7KFBLWUGLBGWDSOAAL3ON56DJMEMPAD37Q, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.479648920 (21h58m29.20221195s) [noise=true , address=104.36.82.11:4114 , piece_id=4LNS6F6FDLNPOGMZ4HPIJ44ZP2Q5XTA2T4UJNHIVHBGBOQKYIMSA, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.479910261 (21h58m29.202473321s) [noise=true , address=104.36.82.15:4258 , piece_id=OBQ3LQJUCGAZCEEO4T76MXDEPVOUKACTKOO6YR35GCS6LJ7GSXEQ, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.482494515 (21h58m29.205057555s) [noise=true , address=104.36.82.8:4970 , piece_id=MW4ZOSF4XPKSX3GVQE44U6ZIKDWWRATC2YRHOLLSVOLBLVITR6MQ, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.483910805 (21h58m29.206473845s) [noise=true , address=104.36.82.9:4005 , piece_id=3XGPJOYMTCQCA5PJPKXBI4QZBRLFK67IRTLB434LEMWLNCZOMXHQ, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:19.489619007 (21h58m29.212182057s) [noise=true , address=45.91.116.14:4189 , piece_id=6ML7BRXV4AGZBWR523WB3IHVRU7IVHNNHDN6G5ONERT23ODBWQ7A, seg_pos={0 0}, upload=21099]: Uploading piece...
Jul 25 09:34:21.166728613 (21h58m30.889291653s) [upload=21099]: Next returned nil segment
Jul 25 09:34:21.166748240 (21h58m30.88931128s) [upload=21099]: Waiting for error group managing segments...
Jul 25 09:34:21.499554977 (21h58m31.222118017s) [noise=true , address=45.91.116.6:4974 , piece_id=Q56R4JCGQIZQG7ALI2QO3HTN7PQCJCOQEMLW6HCIVOJRT5MEX6KQ, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.504744947 (21h58m31.227307988s) [noise=true , address=45.91.116.7:4011 , piece_id=SKT2T7L42JDMB5JR74IACUTSRADSRSGBXUAGKWXWVINNVUQAPOUA, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.507097449 (21h58m31.229660489s) [noise=true , address=45.91.116.14:4189 , piece_id=6ML7BRXV4AGZBWR523WB3IHVRU7IVHNNHDN6G5ONERT23ODBWQ7A, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.517304048 (21h58m31.239867088s) [noise=true , address=104.36.82.11:4114 , piece_id=4LNS6F6FDLNPOGMZ4HPIJ44ZP2Q5XTA2T4UJNHIVHBGBOQKYIMSA, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.524928355 (21h58m31.247491395s) [noise=true , address=104.36.82.2:4729 , piece_id=Y5KJG5VJCHWRDBLIMSZZUE5ISYOCEZ3Z5FAP4MXTCAFKN2AMAFFQ, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.533139686 (21h58m31.255702726s) [noise=true , address=104.36.82.6:4875 , piece_id=ICQB7MCL4MEBXDRUXJQR7TWBNJG5FDXK2HC7HCDSLP5D2AKZU2IQ, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.549770536 (21h58m31.272333576s) [noise=true , address=104.36.82.9:4005 , piece_id=3XGPJOYMTCQCA5PJPKXBI4QZBRLFK67IRTLB434LEMWLNCZOMXHQ, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.556227130 (21h58m31.27879017s) [noise=true , address=104.36.82.7:4909 , piece_id=DVC47Y53A73WTZJ5CEAM6M5NTFWFNEXPRVZJV6RZSQLXGSIN7QCA, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.589316551 (21h58m31.311879591s) [noise=true , address=45.91.116.4:4939 , piece_id=JVCWPOF2CLF2WBVBZZQSAZ3KP3XVPMYUXC7HG5QVICE6MC23VCNA, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.595855452 (21h58m31.318418492s) [noise=true , address=45.91.116.9:4263 , piece_id=4MSCHEXYQET4LCKMS2DRXZUDLJEEGBJRDPPRD7FV5HIZYGTQE46Q, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.599202887 (21h58m31.321765927s) [noise=true , address=45.91.116.4:4938 , piece_id=EZOQH3VH4DHZQZNPQZJL3SQ3PD5EOHQMD3JRGOYZI2ETJHSE4W7A, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.623718644 (21h58m31.346281684s) [noise=true , address=104.36.82.8:4970 , piece_id=MW4ZOSF4XPKSX3GVQE44U6ZIKDWWRATC2YRHOLLSVOLBLVITR6MQ, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.663640467 (21h58m31.386203507s) [noise=true , address=45.91.116.5:4297 , piece_id=MD2EEVFUOLH6WJEFLM7KFBLWUGLBGWDSOAAL3ON56DJMEMPAD37Q, seg_pos={0 0}, upload=21099]: Done uploading piece. err: <nil>
Jul 25 09:34:21.663689460 (21h58m31.3862525s) [seg_pos={0 0}, upload=21099]: Segment reached optimal threshold of 13 pieces.
Jul 25 09:34:21.663792598 (21h58m31.386355638s) [noise=true , address=104.36.82.15:4258 , piece_id=OBQ3LQJUCGAZCEEO4T76MXDEPVOUKACTKOO6YR35GCS6LJ7GSXEQ, seg_pos={0 0}, upload=21099]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jul 25 09:34:21.663848695 (21h58m31.386411725s) [noise=true , address=45.91.116.9:4262 , piece_id=YF6TLUROKJZYIV5ARC22MEZ34WRAJCEBGKP5VSLFXUOF53CZTOVA, seg_pos={0 0}, upload=21099]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 25 09:34:21.663942966 (21h58m31.386506046s) [noise=true , address=104.36.82.15:4259 , piece_id=D64MTLWFIGPHK4OCHEF3WEY4I2DPPIGIG3UTJXVO5EC77TWV6TMA, seg_pos={0 0}, upload=21099]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: expected piece hash; context canceled; EOF
Jul 25 09:34:21.663986699 (21h58m31.386549739s) [seg_pos={0 0}, upload=21099]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 25 09:34:21.664102931 (21h58m31.386665961s) [upload=21099]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 25 09:34:21.664107882 (21h58m31.386670922s) [upload=21099]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 25 09:34:21.949888312 (21h58m31.672451352s) [upload=21099]: Done uploading segments...
Jul 25 09:34:21.949900605 (21h58m31.672463645s) [upload=21099]: Upload finished. err: <nil>
Duration: 5.850965276s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
5.558860177s
FAIL (2025-07-25 10:19:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.558883682s
edge
gateway
us-select-1
|