Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 434403 reports (Page 8113 of 8689)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
5.81468406s
FAIL (2025-07-19 06:32:15 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.814712965s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
5.839657364s
FAIL (2025-07-19 06:31:22 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.839681068s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
5.712321462s
FAIL (2025-07-19 06:30:17 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.712348323s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................]
duration:
5.837804805s
FAIL (2025-07-19 06:29:52 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.837830375s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................]
duration:
5.516701306s
FAIL (2025-07-19 06:28:41 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.516724952s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................]
duration:
5.777333213s
FAIL (2025-07-19 06:27:56 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.777356948s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................]
duration:
5.737007519s
FAIL (2025-07-19 06:27:36 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.737026865s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................]
duration:
5.860366011s
FAIL (2025-07-19 06:26:30 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.860393142s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................]
duration:
5.857545003s
FAIL (2025-07-19 06:25:29 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.857572356s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................]
duration:
5.770461945s
FAIL (2025-07-19 06:24:29 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.770504186s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................]
duration:
5.928958651s
FAIL (2025-07-19 06:23:52 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.928985292s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................]
duration:
5.849636226s
FAIL (2025-07-19 06:23:14 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.849662837s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration:
5.825194618s
FAIL (2025-07-19 06:22:05 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.825215748s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration:
5.803701414s
FAIL (2025-07-19 06:21:40 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.803733938s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................]
duration:
5.808358854s
FAIL (2025-07-19 06:20:38 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.808385084s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration:
5.571556217s
FAIL (2025-07-19 06:20:13 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.571580543s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration:
5.715831542s
FAIL (2025-07-19 06:19:48 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.71585726s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................]
duration:
5.828311473s
FAIL (2025-07-19 06:19:14 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.828333393s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................]
duration:
5.988409712s
FAIL (2025-07-19 06:18:06 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.988430451s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................]
duration:
5.727917995s
FAIL (2025-07-19 06:17:01 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.728059496s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................]
duration:
5.824955745s
FAIL (2025-07-19 06:15:59 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.824981313s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................]
duration:
5.777356107s
FAIL (2025-07-19 06:15:04 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.777384512s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................]
duration:
5.806264338s
FAIL (2025-07-19 06:14:47 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.806288594s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................]
duration:
5.581852962s
FAIL (2025-07-19 06:13:51 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.581890333s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration:
5.841620416s
FAIL (2025-07-19 06:12:51 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.841644001s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration:
6.02544202s
FAIL (2025-07-19 06:12:14 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 6.02546885s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................]
duration:
5.553653844s
FAIL (2025-07-19 06:11:42 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.553673271s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................]
duration:
5.97256915s
FAIL (2025-07-19 06:11:19 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.972604488s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................]
duration:
5.837543643s
FAIL (2025-07-19 06:10:56 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.837566528s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................]
duration:
5.839166662s
FAIL (2025-07-19 06:10:14 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.839194887s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................]
duration:
5.856747996s
FAIL (2025-07-19 06:08:59 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.856780399s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration:
5.771952601s
FAIL (2025-07-19 06:08:29 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.771976376s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration:
5.767925146s
FAIL (2025-07-19 06:07:56 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.76794834s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................]
duration:
5.756163644s
FAIL (2025-07-19 06:06:56 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.756190674s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................]
duration:
5.744079121s
FAIL (2025-07-19 06:06:23 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.74411061s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................]
duration:
5.543504315s
FAIL (2025-07-19 06:06:01 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.543528653s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration:
5.844815703s
FAIL (2025-07-19 06:05:26 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.844839268s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
5.908782972s
FAIL (2025-07-19 06:05:25 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
gment. successful: 13 optimal: 13 errs: <nil>
Jul 19 05:14:35.936262577 (6h23m42.308841932s) [upload=5075]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 05:14:35.936281884 (6h23m42.308861239s) [upload=5075]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 05:14:36.234171969 (6h23m42.606751314s) [upload=5075]: Done uploading segments...
Jul 19 05:14:36.234192037 (6h23m42.606771382s) [upload=5075]: Upload finished. err: <nil>
Jul 19 05:14:55.587986728 (6h24m1.960566093s) [upload=5081]: Starting upload
Jul 19 05:14:55.588051823 (6h24m1.960631178s) [upload=5081]: Done starting upload
Jul 19 05:14:55.588146724 (6h24m1.960726079s) [upload=5081]: Uploading segments...
Jul 19 05:14:55.588391873 (6h24m1.960971228s) [upload=5081]: Got next segment. Inline: false
Jul 19 05:14:55.588649837 (6h24m1.961229193s) [upload=5081]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 05:14:55.588655057 (6h24m1.961234402s) [upload=5081]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 05:14:55.823387692 (6h24m2.195967047s) [seg_pos={0 0}, upload=5081]: Begin upload segment...
Jul 19 05:14:55.823450572 (6h24m2.196029927s) [seg_pos={0 0}, upload=5081]: Done begin upload segment.
Jul 19 05:14:55.823481952 (6h24m2.196061307s) [noise=true , address=77.90.31.17:4772     , piece_id=B544E3F2UC3UVE2ITUQAWGVDMSPS2HFIVHXZ2OLWB3T25AHMFAVA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.823491401 (6h24m2.196070756s) [noise=true , address=45.91.116.10:4082    , piece_id=HZDMC4J5O5UHVDH5SOQBKAFPN6RJUHIWKEZ4OPVMW2HSN7NDZMZA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.823923789 (6h24m2.196503144s) [noise=true , address=45.91.116.9:4262     , piece_id=FRIATDM7LPPHXYAMUISAYRTQWAKSTB4EYUANHGEMQHM6JQADDTRQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.823949737 (6h24m2.196529092s) [noise=true , address=45.91.116.12:4227    , piece_id=QB7YKZFXWMRB3VQ3HSFMMMLLX5YFWOXG4Y4GJGGYT6HDV4FQ65VA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824310158 (6h24m2.196889513s) [noise=true , address=45.91.116.4:4937     , piece_id=V2IOOA7DVCGZBH3D43ROYHT6ZECPY6GTC5M7NFO2RWPQB6EYGALA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824403045 (6h24m2.19698239s) [noise=true , address=77.90.31.11:4555     , piece_id=YICA5IVHSCC3RPC5FRKD26BSMY6N5WJQA5LCABJSRJYL6BZJYL6A, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824651210 (6h24m2.197230565s) [noise=true , address=77.90.31.13:4627     , piece_id=E7GSSBZ653K2AA4TP6A4BRT5BDZCBODNRAZM3P6SYJXJFQU2BACQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824716334 (6h24m2.197295689s) [noise=true , address=77.90.31.16:4734     , piece_id=YUW6MWSUDNLAC2VHLBT6H4T27YTNJ3RDK4BSGE7OZQCO3F2LBH4A, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824960491 (6h24m2.197539856s) [noise=true , address=45.91.116.7:4010     , piece_id=BH76RM4NXGEAI2J2424ALK4PFSXUTBCYOH777BUOIDW7BW2IJUJA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824977494 (6h24m2.197556849s) [noise=true , address=45.91.116.14:4190    , piece_id=RUU2MICSAWOECAAYNOBS75SE2YKSUBMSSFKLPON7FWK77UNJEYGQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825213285 (6h24m2.19779264s) [noise=true , address=45.91.116.8:4047     , piece_id=6UOFOV4VCVT6DB7D7Q23REAX7VZPAW5PSG5PLA54LISOUWMPQBBQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825271547 (6h24m2.197850902s) [noise=true , address=77.90.31.18:4806     , piece_id=67PXFJMJB6XWNU6JMOKPO4BXKDD2Z225ZKTB7DZEA46OMSSXHHMQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825445860 (6h24m2.198025215s) [noise=true , address=45.91.116.7:4009     , piece_id=HH5I32ZYT5LVXHDLBVSAVX6T23MJ6RGNPNAWPIQAREJ4ELPFJGYA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825568244 (6h24m2.198147599s) [noise=true , address=77.90.31.15:4697     , piece_id=W62ARDAVLI64P6VYSPVFRTDKB5H2WXTSCF2VKP3UN7JKGBCUEZTQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825902985 (6h24m2.19848234s) [noise=true , address=45.91.116.5:4299     , piece_id=JQLK5LIMCMW6R2UZEJZSG6QAP2M65XBVE6JFEXY5KDWBVNDG2VCQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.826216495 (6h24m2.19879585s) [noise=true , address=77.90.31.14:4663     , piece_id=LNTFUWB6LUUFD2EB536ZHBSNVVXYZPOOB4DUZB2M6BXSSFEL3UMQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:58.633690556 (6h24m5.006269911s) [upload=5081]: Next returned nil segment
Jul 19 05:14:58.633708100 (6h24m5.006287445s) [upload=5081]: Waiting for error group managing segments...
Jul 19 05:14:58.915966948 (6h24m5.288546293s) [noise=true , address=45.91.116.7:4009     , piece_id=HH5I32ZYT5LVXHDLBVSAVX6T23MJ6RGNPNAWPIQAREJ4ELPFJGYA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.916093541 (6h24m5.288672896s) [noise=true , address=45.91.116.12:4227    , piece_id=QB7YKZFXWMRB3VQ3HSFMMMLLX5YFWOXG4Y4GJGGYT6HDV4FQ65VA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.923615462 (6h24m5.296194817s) [noise=true , address=45.91.116.14:4190    , piece_id=RUU2MICSAWOECAAYNOBS75SE2YKSUBMSSFKLPON7FWK77UNJEYGQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.928612934 (6h24m5.301192289s) [noise=true , address=45.91.116.7:4010     , piece_id=BH76RM4NXGEAI2J2424ALK4PFSXUTBCYOH777BUOIDW7BW2IJUJA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.990915468 (6h24m5.363494833s) [noise=true , address=45.91.116.4:4937     , piece_id=V2IOOA7DVCGZBH3D43ROYHT6ZECPY6GTC5M7NFO2RWPQB6EYGALA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.992136464 (6h24m5.364715819s) [noise=true , address=45.91.116.8:4047     , piece_id=6UOFOV4VCVT6DB7D7Q23REAX7VZPAW5PSG5PLA54LISOUWMPQBBQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.997711812 (6h24m5.370291157s) [noise=true , address=45.91.116.9:4262     , piece_id=FRIATDM7LPPHXYAMUISAYRTQWAKSTB4EYUANHGEMQHM6JQADDTRQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:59.010548391 (6h24m5.383127746s) [noise=true , address=45.91.116.10:4082    , piece_id=HZDMC4J5O5UHVDH5SOQBKAFPN6RJUHIWKEZ4OPVMW2HSN7NDZMZA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:59.039607621 (6h24m5.412186996s) [noise=true , address=45.91.116.5:4299     , piece_id=JQLK5LIMCMW6R2UZEJZSG6QAP2M65XBVE6JFEXY5KDWBVNDG2VCQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:15:19.998482215 (6h24m26.37106157s) [noise=true , address=77.90.31.14:4663     , piece_id=LNTFUWB6LUUFD2EB536ZHBSNVVXYZPOOB4DUZB2M6BXSSFEL3UMQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:15:21.170089451 (6h24m27.542668806s) [noise=true , address=77.90.31.13:4627     , piece_id=E7GSSBZ653K2AA4TP6A4BRT5BDZCBODNRAZM3P6SYJXJFQU2BACQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:15:24.941469148 (6h24m31.314048503s) [noise=true , address=77.90.31.15:4697     , piece_id=W62ARDAVLI64P6VYSPVFRTDKB5H2WXTSCF2VKP3UN7JKGBCUEZTQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: expected piece hash; context deadline exceeded; EOF
Jul 19 05:15:24.941530766 (6h24m31.314110121s) [noise=true , address=77.90.31.17:4772     , piece_id=B544E3F2UC3UVE2ITUQAWGVDMSPS2HFIVHXZ2OLWB3T25AHMFAVA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:44456->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:44456->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44456->77.90.31.17:4772: use of closed network connection
Jul 19 05:15:24.941543591 (6h24m31.314122946s) [noise=true , address=77.90.31.16:4734     , piece_id=YUW6MWSUDNLAC2VHLBT6H4T27YTNJ3RDK4BSGE7OZQCO3F2LBH4A, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 19 05:15:24.941614786 (6h24m31.314194141s) [noise=true , address=77.90.31.11:4555     , piece_id=YICA5IVHSCC3RPC5FRKD26BSMY6N5WJQA5LCABJSRJYL6BZJYL6A, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 188.166.225.170:37392->77.90.31.11:4555: use of closed network connection; write tcp 188.166.225.170:37392->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37392->77.90.31.11:4555: use of closed network connection
Jul 19 05:15:24.941641888 (6h24m31.314221243s) [noise=true , address=77.90.31.18:4806     , piece_id=67PXFJMJB6XWNU6JMOKPO4BXKDD2Z225ZKTB7DZEA46OMSSXHHMQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:47114->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:47114->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47114->77.90.31.18:4806: use of closed network connection
Jul 19 05:15:24.941663099 (6h24m31.314242454s) [seg_pos={0 0}, upload=5081]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jul 19 05:15:25.179949476 (6h24m31.552528831s) [upload=5081]: Done uploading segments...
Jul 19 05:15:25.179975797 (6h24m31.552555152s) [upload=5081]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 5.90880771s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
5.870156709s
FAIL (2025-07-19 06:04:57 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.870177289s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
5.834962639s
FAIL (2025-07-19 06:04:30 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.834985984s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
5.759358766s
FAIL (2025-07-19 06:04:16 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
gment. successful: 13 optimal: 13 errs: <nil>
Jul 19 05:14:35.936262577 (6h23m42.308841932s) [upload=5075]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 05:14:35.936281884 (6h23m42.308861239s) [upload=5075]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 05:14:36.234171969 (6h23m42.606751314s) [upload=5075]: Done uploading segments...
Jul 19 05:14:36.234192037 (6h23m42.606771382s) [upload=5075]: Upload finished. err: <nil>
Jul 19 05:14:55.587986728 (6h24m1.960566093s) [upload=5081]: Starting upload
Jul 19 05:14:55.588051823 (6h24m1.960631178s) [upload=5081]: Done starting upload
Jul 19 05:14:55.588146724 (6h24m1.960726079s) [upload=5081]: Uploading segments...
Jul 19 05:14:55.588391873 (6h24m1.960971228s) [upload=5081]: Got next segment. Inline: false
Jul 19 05:14:55.588649837 (6h24m1.961229193s) [upload=5081]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 05:14:55.588655057 (6h24m1.961234402s) [upload=5081]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 05:14:55.823387692 (6h24m2.195967047s) [seg_pos={0 0}, upload=5081]: Begin upload segment...
Jul 19 05:14:55.823450572 (6h24m2.196029927s) [seg_pos={0 0}, upload=5081]: Done begin upload segment.
Jul 19 05:14:55.823481952 (6h24m2.196061307s) [noise=true , address=77.90.31.17:4772     , piece_id=B544E3F2UC3UVE2ITUQAWGVDMSPS2HFIVHXZ2OLWB3T25AHMFAVA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.823491401 (6h24m2.196070756s) [noise=true , address=45.91.116.10:4082    , piece_id=HZDMC4J5O5UHVDH5SOQBKAFPN6RJUHIWKEZ4OPVMW2HSN7NDZMZA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.823923789 (6h24m2.196503144s) [noise=true , address=45.91.116.9:4262     , piece_id=FRIATDM7LPPHXYAMUISAYRTQWAKSTB4EYUANHGEMQHM6JQADDTRQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.823949737 (6h24m2.196529092s) [noise=true , address=45.91.116.12:4227    , piece_id=QB7YKZFXWMRB3VQ3HSFMMMLLX5YFWOXG4Y4GJGGYT6HDV4FQ65VA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824310158 (6h24m2.196889513s) [noise=true , address=45.91.116.4:4937     , piece_id=V2IOOA7DVCGZBH3D43ROYHT6ZECPY6GTC5M7NFO2RWPQB6EYGALA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824403045 (6h24m2.19698239s) [noise=true , address=77.90.31.11:4555     , piece_id=YICA5IVHSCC3RPC5FRKD26BSMY6N5WJQA5LCABJSRJYL6BZJYL6A, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824651210 (6h24m2.197230565s) [noise=true , address=77.90.31.13:4627     , piece_id=E7GSSBZ653K2AA4TP6A4BRT5BDZCBODNRAZM3P6SYJXJFQU2BACQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824716334 (6h24m2.197295689s) [noise=true , address=77.90.31.16:4734     , piece_id=YUW6MWSUDNLAC2VHLBT6H4T27YTNJ3RDK4BSGE7OZQCO3F2LBH4A, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824960491 (6h24m2.197539856s) [noise=true , address=45.91.116.7:4010     , piece_id=BH76RM4NXGEAI2J2424ALK4PFSXUTBCYOH777BUOIDW7BW2IJUJA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824977494 (6h24m2.197556849s) [noise=true , address=45.91.116.14:4190    , piece_id=RUU2MICSAWOECAAYNOBS75SE2YKSUBMSSFKLPON7FWK77UNJEYGQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825213285 (6h24m2.19779264s) [noise=true , address=45.91.116.8:4047     , piece_id=6UOFOV4VCVT6DB7D7Q23REAX7VZPAW5PSG5PLA54LISOUWMPQBBQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825271547 (6h24m2.197850902s) [noise=true , address=77.90.31.18:4806     , piece_id=67PXFJMJB6XWNU6JMOKPO4BXKDD2Z225ZKTB7DZEA46OMSSXHHMQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825445860 (6h24m2.198025215s) [noise=true , address=45.91.116.7:4009     , piece_id=HH5I32ZYT5LVXHDLBVSAVX6T23MJ6RGNPNAWPIQAREJ4ELPFJGYA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825568244 (6h24m2.198147599s) [noise=true , address=77.90.31.15:4697     , piece_id=W62ARDAVLI64P6VYSPVFRTDKB5H2WXTSCF2VKP3UN7JKGBCUEZTQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825902985 (6h24m2.19848234s) [noise=true , address=45.91.116.5:4299     , piece_id=JQLK5LIMCMW6R2UZEJZSG6QAP2M65XBVE6JFEXY5KDWBVNDG2VCQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.826216495 (6h24m2.19879585s) [noise=true , address=77.90.31.14:4663     , piece_id=LNTFUWB6LUUFD2EB536ZHBSNVVXYZPOOB4DUZB2M6BXSSFEL3UMQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:58.633690556 (6h24m5.006269911s) [upload=5081]: Next returned nil segment
Jul 19 05:14:58.633708100 (6h24m5.006287445s) [upload=5081]: Waiting for error group managing segments...
Jul 19 05:14:58.915966948 (6h24m5.288546293s) [noise=true , address=45.91.116.7:4009     , piece_id=HH5I32ZYT5LVXHDLBVSAVX6T23MJ6RGNPNAWPIQAREJ4ELPFJGYA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.916093541 (6h24m5.288672896s) [noise=true , address=45.91.116.12:4227    , piece_id=QB7YKZFXWMRB3VQ3HSFMMMLLX5YFWOXG4Y4GJGGYT6HDV4FQ65VA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.923615462 (6h24m5.296194817s) [noise=true , address=45.91.116.14:4190    , piece_id=RUU2MICSAWOECAAYNOBS75SE2YKSUBMSSFKLPON7FWK77UNJEYGQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.928612934 (6h24m5.301192289s) [noise=true , address=45.91.116.7:4010     , piece_id=BH76RM4NXGEAI2J2424ALK4PFSXUTBCYOH777BUOIDW7BW2IJUJA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.990915468 (6h24m5.363494833s) [noise=true , address=45.91.116.4:4937     , piece_id=V2IOOA7DVCGZBH3D43ROYHT6ZECPY6GTC5M7NFO2RWPQB6EYGALA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.992136464 (6h24m5.364715819s) [noise=true , address=45.91.116.8:4047     , piece_id=6UOFOV4VCVT6DB7D7Q23REAX7VZPAW5PSG5PLA54LISOUWMPQBBQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.997711812 (6h24m5.370291157s) [noise=true , address=45.91.116.9:4262     , piece_id=FRIATDM7LPPHXYAMUISAYRTQWAKSTB4EYUANHGEMQHM6JQADDTRQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:59.010548391 (6h24m5.383127746s) [noise=true , address=45.91.116.10:4082    , piece_id=HZDMC4J5O5UHVDH5SOQBKAFPN6RJUHIWKEZ4OPVMW2HSN7NDZMZA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:59.039607621 (6h24m5.412186996s) [noise=true , address=45.91.116.5:4299     , piece_id=JQLK5LIMCMW6R2UZEJZSG6QAP2M65XBVE6JFEXY5KDWBVNDG2VCQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:15:19.998482215 (6h24m26.37106157s) [noise=true , address=77.90.31.14:4663     , piece_id=LNTFUWB6LUUFD2EB536ZHBSNVVXYZPOOB4DUZB2M6BXSSFEL3UMQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:15:21.170089451 (6h24m27.542668806s) [noise=true , address=77.90.31.13:4627     , piece_id=E7GSSBZ653K2AA4TP6A4BRT5BDZCBODNRAZM3P6SYJXJFQU2BACQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:15:24.941469148 (6h24m31.314048503s) [noise=true , address=77.90.31.15:4697     , piece_id=W62ARDAVLI64P6VYSPVFRTDKB5H2WXTSCF2VKP3UN7JKGBCUEZTQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: expected piece hash; context deadline exceeded; EOF
Jul 19 05:15:24.941530766 (6h24m31.314110121s) [noise=true , address=77.90.31.17:4772     , piece_id=B544E3F2UC3UVE2ITUQAWGVDMSPS2HFIVHXZ2OLWB3T25AHMFAVA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:44456->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:44456->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44456->77.90.31.17:4772: use of closed network connection
Jul 19 05:15:24.941543591 (6h24m31.314122946s) [noise=true , address=77.90.31.16:4734     , piece_id=YUW6MWSUDNLAC2VHLBT6H4T27YTNJ3RDK4BSGE7OZQCO3F2LBH4A, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 19 05:15:24.941614786 (6h24m31.314194141s) [noise=true , address=77.90.31.11:4555     , piece_id=YICA5IVHSCC3RPC5FRKD26BSMY6N5WJQA5LCABJSRJYL6BZJYL6A, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 188.166.225.170:37392->77.90.31.11:4555: use of closed network connection; write tcp 188.166.225.170:37392->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37392->77.90.31.11:4555: use of closed network connection
Jul 19 05:15:24.941641888 (6h24m31.314221243s) [noise=true , address=77.90.31.18:4806     , piece_id=67PXFJMJB6XWNU6JMOKPO4BXKDD2Z225ZKTB7DZEA46OMSSXHHMQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:47114->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:47114->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47114->77.90.31.18:4806: use of closed network connection
Jul 19 05:15:24.941663099 (6h24m31.314242454s) [seg_pos={0 0}, upload=5081]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jul 19 05:15:25.179949476 (6h24m31.552528831s) [upload=5081]: Done uploading segments...
Jul 19 05:15:25.179975797 (6h24m31.552555152s) [upload=5081]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 5.759380498s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
5.720467274s
FAIL (2025-07-19 06:03:28 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.720497572s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [X.X.........................................................]
duration:
5.836074156s
FAIL (2025-07-19 06:03:12 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
gment. successful: 13 optimal: 13 errs: <nil>
Jul 19 05:14:35.936262577 (6h23m42.308841932s) [upload=5075]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 05:14:35.936281884 (6h23m42.308861239s) [upload=5075]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 05:14:36.234171969 (6h23m42.606751314s) [upload=5075]: Done uploading segments...
Jul 19 05:14:36.234192037 (6h23m42.606771382s) [upload=5075]: Upload finished. err: <nil>
Jul 19 05:14:55.587986728 (6h24m1.960566093s) [upload=5081]: Starting upload
Jul 19 05:14:55.588051823 (6h24m1.960631178s) [upload=5081]: Done starting upload
Jul 19 05:14:55.588146724 (6h24m1.960726079s) [upload=5081]: Uploading segments...
Jul 19 05:14:55.588391873 (6h24m1.960971228s) [upload=5081]: Got next segment. Inline: false
Jul 19 05:14:55.588649837 (6h24m1.961229193s) [upload=5081]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 05:14:55.588655057 (6h24m1.961234402s) [upload=5081]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 05:14:55.823387692 (6h24m2.195967047s) [seg_pos={0 0}, upload=5081]: Begin upload segment...
Jul 19 05:14:55.823450572 (6h24m2.196029927s) [seg_pos={0 0}, upload=5081]: Done begin upload segment.
Jul 19 05:14:55.823481952 (6h24m2.196061307s) [noise=true , address=77.90.31.17:4772     , piece_id=B544E3F2UC3UVE2ITUQAWGVDMSPS2HFIVHXZ2OLWB3T25AHMFAVA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.823491401 (6h24m2.196070756s) [noise=true , address=45.91.116.10:4082    , piece_id=HZDMC4J5O5UHVDH5SOQBKAFPN6RJUHIWKEZ4OPVMW2HSN7NDZMZA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.823923789 (6h24m2.196503144s) [noise=true , address=45.91.116.9:4262     , piece_id=FRIATDM7LPPHXYAMUISAYRTQWAKSTB4EYUANHGEMQHM6JQADDTRQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.823949737 (6h24m2.196529092s) [noise=true , address=45.91.116.12:4227    , piece_id=QB7YKZFXWMRB3VQ3HSFMMMLLX5YFWOXG4Y4GJGGYT6HDV4FQ65VA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824310158 (6h24m2.196889513s) [noise=true , address=45.91.116.4:4937     , piece_id=V2IOOA7DVCGZBH3D43ROYHT6ZECPY6GTC5M7NFO2RWPQB6EYGALA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824403045 (6h24m2.19698239s) [noise=true , address=77.90.31.11:4555     , piece_id=YICA5IVHSCC3RPC5FRKD26BSMY6N5WJQA5LCABJSRJYL6BZJYL6A, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824651210 (6h24m2.197230565s) [noise=true , address=77.90.31.13:4627     , piece_id=E7GSSBZ653K2AA4TP6A4BRT5BDZCBODNRAZM3P6SYJXJFQU2BACQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824716334 (6h24m2.197295689s) [noise=true , address=77.90.31.16:4734     , piece_id=YUW6MWSUDNLAC2VHLBT6H4T27YTNJ3RDK4BSGE7OZQCO3F2LBH4A, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824960491 (6h24m2.197539856s) [noise=true , address=45.91.116.7:4010     , piece_id=BH76RM4NXGEAI2J2424ALK4PFSXUTBCYOH777BUOIDW7BW2IJUJA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824977494 (6h24m2.197556849s) [noise=true , address=45.91.116.14:4190    , piece_id=RUU2MICSAWOECAAYNOBS75SE2YKSUBMSSFKLPON7FWK77UNJEYGQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825213285 (6h24m2.19779264s) [noise=true , address=45.91.116.8:4047     , piece_id=6UOFOV4VCVT6DB7D7Q23REAX7VZPAW5PSG5PLA54LISOUWMPQBBQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825271547 (6h24m2.197850902s) [noise=true , address=77.90.31.18:4806     , piece_id=67PXFJMJB6XWNU6JMOKPO4BXKDD2Z225ZKTB7DZEA46OMSSXHHMQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825445860 (6h24m2.198025215s) [noise=true , address=45.91.116.7:4009     , piece_id=HH5I32ZYT5LVXHDLBVSAVX6T23MJ6RGNPNAWPIQAREJ4ELPFJGYA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825568244 (6h24m2.198147599s) [noise=true , address=77.90.31.15:4697     , piece_id=W62ARDAVLI64P6VYSPVFRTDKB5H2WXTSCF2VKP3UN7JKGBCUEZTQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825902985 (6h24m2.19848234s) [noise=true , address=45.91.116.5:4299     , piece_id=JQLK5LIMCMW6R2UZEJZSG6QAP2M65XBVE6JFEXY5KDWBVNDG2VCQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.826216495 (6h24m2.19879585s) [noise=true , address=77.90.31.14:4663     , piece_id=LNTFUWB6LUUFD2EB536ZHBSNVVXYZPOOB4DUZB2M6BXSSFEL3UMQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:58.633690556 (6h24m5.006269911s) [upload=5081]: Next returned nil segment
Jul 19 05:14:58.633708100 (6h24m5.006287445s) [upload=5081]: Waiting for error group managing segments...
Jul 19 05:14:58.915966948 (6h24m5.288546293s) [noise=true , address=45.91.116.7:4009     , piece_id=HH5I32ZYT5LVXHDLBVSAVX6T23MJ6RGNPNAWPIQAREJ4ELPFJGYA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.916093541 (6h24m5.288672896s) [noise=true , address=45.91.116.12:4227    , piece_id=QB7YKZFXWMRB3VQ3HSFMMMLLX5YFWOXG4Y4GJGGYT6HDV4FQ65VA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.923615462 (6h24m5.296194817s) [noise=true , address=45.91.116.14:4190    , piece_id=RUU2MICSAWOECAAYNOBS75SE2YKSUBMSSFKLPON7FWK77UNJEYGQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.928612934 (6h24m5.301192289s) [noise=true , address=45.91.116.7:4010     , piece_id=BH76RM4NXGEAI2J2424ALK4PFSXUTBCYOH777BUOIDW7BW2IJUJA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.990915468 (6h24m5.363494833s) [noise=true , address=45.91.116.4:4937     , piece_id=V2IOOA7DVCGZBH3D43ROYHT6ZECPY6GTC5M7NFO2RWPQB6EYGALA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.992136464 (6h24m5.364715819s) [noise=true , address=45.91.116.8:4047     , piece_id=6UOFOV4VCVT6DB7D7Q23REAX7VZPAW5PSG5PLA54LISOUWMPQBBQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.997711812 (6h24m5.370291157s) [noise=true , address=45.91.116.9:4262     , piece_id=FRIATDM7LPPHXYAMUISAYRTQWAKSTB4EYUANHGEMQHM6JQADDTRQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:59.010548391 (6h24m5.383127746s) [noise=true , address=45.91.116.10:4082    , piece_id=HZDMC4J5O5UHVDH5SOQBKAFPN6RJUHIWKEZ4OPVMW2HSN7NDZMZA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:59.039607621 (6h24m5.412186996s) [noise=true , address=45.91.116.5:4299     , piece_id=JQLK5LIMCMW6R2UZEJZSG6QAP2M65XBVE6JFEXY5KDWBVNDG2VCQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:15:19.998482215 (6h24m26.37106157s) [noise=true , address=77.90.31.14:4663     , piece_id=LNTFUWB6LUUFD2EB536ZHBSNVVXYZPOOB4DUZB2M6BXSSFEL3UMQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:15:21.170089451 (6h24m27.542668806s) [noise=true , address=77.90.31.13:4627     , piece_id=E7GSSBZ653K2AA4TP6A4BRT5BDZCBODNRAZM3P6SYJXJFQU2BACQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:15:24.941469148 (6h24m31.314048503s) [noise=true , address=77.90.31.15:4697     , piece_id=W62ARDAVLI64P6VYSPVFRTDKB5H2WXTSCF2VKP3UN7JKGBCUEZTQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: expected piece hash; context deadline exceeded; EOF
Jul 19 05:15:24.941530766 (6h24m31.314110121s) [noise=true , address=77.90.31.17:4772     , piece_id=B544E3F2UC3UVE2ITUQAWGVDMSPS2HFIVHXZ2OLWB3T25AHMFAVA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:44456->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:44456->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44456->77.90.31.17:4772: use of closed network connection
Jul 19 05:15:24.941543591 (6h24m31.314122946s) [noise=true , address=77.90.31.16:4734     , piece_id=YUW6MWSUDNLAC2VHLBT6H4T27YTNJ3RDK4BSGE7OZQCO3F2LBH4A, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 19 05:15:24.941614786 (6h24m31.314194141s) [noise=true , address=77.90.31.11:4555     , piece_id=YICA5IVHSCC3RPC5FRKD26BSMY6N5WJQA5LCABJSRJYL6BZJYL6A, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 188.166.225.170:37392->77.90.31.11:4555: use of closed network connection; write tcp 188.166.225.170:37392->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37392->77.90.31.11:4555: use of closed network connection
Jul 19 05:15:24.941641888 (6h24m31.314221243s) [noise=true , address=77.90.31.18:4806     , piece_id=67PXFJMJB6XWNU6JMOKPO4BXKDD2Z225ZKTB7DZEA46OMSSXHHMQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:47114->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:47114->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47114->77.90.31.18:4806: use of closed network connection
Jul 19 05:15:24.941663099 (6h24m31.314242454s) [seg_pos={0 0}, upload=5081]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jul 19 05:15:25.179949476 (6h24m31.552528831s) [upload=5081]: Done uploading segments...
Jul 19 05:15:25.179975797 (6h24m31.552555152s) [upload=5081]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 5.836103553s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
5.924553476s
FAIL (2025-07-19 06:02:59 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.924587221s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [XX.X........................................................]
duration:
5.868220903s
FAIL (2025-07-19 06:02:48 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
gment. successful: 13 optimal: 13 errs: <nil>
Jul 19 05:14:35.936262577 (6h23m42.308841932s) [upload=5075]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 05:14:35.936281884 (6h23m42.308861239s) [upload=5075]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 05:14:36.234171969 (6h23m42.606751314s) [upload=5075]: Done uploading segments...
Jul 19 05:14:36.234192037 (6h23m42.606771382s) [upload=5075]: Upload finished. err: <nil>
Jul 19 05:14:55.587986728 (6h24m1.960566093s) [upload=5081]: Starting upload
Jul 19 05:14:55.588051823 (6h24m1.960631178s) [upload=5081]: Done starting upload
Jul 19 05:14:55.588146724 (6h24m1.960726079s) [upload=5081]: Uploading segments...
Jul 19 05:14:55.588391873 (6h24m1.960971228s) [upload=5081]: Got next segment. Inline: false
Jul 19 05:14:55.588649837 (6h24m1.961229193s) [upload=5081]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 05:14:55.588655057 (6h24m1.961234402s) [upload=5081]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 05:14:55.823387692 (6h24m2.195967047s) [seg_pos={0 0}, upload=5081]: Begin upload segment...
Jul 19 05:14:55.823450572 (6h24m2.196029927s) [seg_pos={0 0}, upload=5081]: Done begin upload segment.
Jul 19 05:14:55.823481952 (6h24m2.196061307s) [noise=true , address=77.90.31.17:4772     , piece_id=B544E3F2UC3UVE2ITUQAWGVDMSPS2HFIVHXZ2OLWB3T25AHMFAVA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.823491401 (6h24m2.196070756s) [noise=true , address=45.91.116.10:4082    , piece_id=HZDMC4J5O5UHVDH5SOQBKAFPN6RJUHIWKEZ4OPVMW2HSN7NDZMZA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.823923789 (6h24m2.196503144s) [noise=true , address=45.91.116.9:4262     , piece_id=FRIATDM7LPPHXYAMUISAYRTQWAKSTB4EYUANHGEMQHM6JQADDTRQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.823949737 (6h24m2.196529092s) [noise=true , address=45.91.116.12:4227    , piece_id=QB7YKZFXWMRB3VQ3HSFMMMLLX5YFWOXG4Y4GJGGYT6HDV4FQ65VA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824310158 (6h24m2.196889513s) [noise=true , address=45.91.116.4:4937     , piece_id=V2IOOA7DVCGZBH3D43ROYHT6ZECPY6GTC5M7NFO2RWPQB6EYGALA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824403045 (6h24m2.19698239s) [noise=true , address=77.90.31.11:4555     , piece_id=YICA5IVHSCC3RPC5FRKD26BSMY6N5WJQA5LCABJSRJYL6BZJYL6A, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824651210 (6h24m2.197230565s) [noise=true , address=77.90.31.13:4627     , piece_id=E7GSSBZ653K2AA4TP6A4BRT5BDZCBODNRAZM3P6SYJXJFQU2BACQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824716334 (6h24m2.197295689s) [noise=true , address=77.90.31.16:4734     , piece_id=YUW6MWSUDNLAC2VHLBT6H4T27YTNJ3RDK4BSGE7OZQCO3F2LBH4A, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824960491 (6h24m2.197539856s) [noise=true , address=45.91.116.7:4010     , piece_id=BH76RM4NXGEAI2J2424ALK4PFSXUTBCYOH777BUOIDW7BW2IJUJA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824977494 (6h24m2.197556849s) [noise=true , address=45.91.116.14:4190    , piece_id=RUU2MICSAWOECAAYNOBS75SE2YKSUBMSSFKLPON7FWK77UNJEYGQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825213285 (6h24m2.19779264s) [noise=true , address=45.91.116.8:4047     , piece_id=6UOFOV4VCVT6DB7D7Q23REAX7VZPAW5PSG5PLA54LISOUWMPQBBQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825271547 (6h24m2.197850902s) [noise=true , address=77.90.31.18:4806     , piece_id=67PXFJMJB6XWNU6JMOKPO4BXKDD2Z225ZKTB7DZEA46OMSSXHHMQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825445860 (6h24m2.198025215s) [noise=true , address=45.91.116.7:4009     , piece_id=HH5I32ZYT5LVXHDLBVSAVX6T23MJ6RGNPNAWPIQAREJ4ELPFJGYA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825568244 (6h24m2.198147599s) [noise=true , address=77.90.31.15:4697     , piece_id=W62ARDAVLI64P6VYSPVFRTDKB5H2WXTSCF2VKP3UN7JKGBCUEZTQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825902985 (6h24m2.19848234s) [noise=true , address=45.91.116.5:4299     , piece_id=JQLK5LIMCMW6R2UZEJZSG6QAP2M65XBVE6JFEXY5KDWBVNDG2VCQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.826216495 (6h24m2.19879585s) [noise=true , address=77.90.31.14:4663     , piece_id=LNTFUWB6LUUFD2EB536ZHBSNVVXYZPOOB4DUZB2M6BXSSFEL3UMQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:58.633690556 (6h24m5.006269911s) [upload=5081]: Next returned nil segment
Jul 19 05:14:58.633708100 (6h24m5.006287445s) [upload=5081]: Waiting for error group managing segments...
Jul 19 05:14:58.915966948 (6h24m5.288546293s) [noise=true , address=45.91.116.7:4009     , piece_id=HH5I32ZYT5LVXHDLBVSAVX6T23MJ6RGNPNAWPIQAREJ4ELPFJGYA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.916093541 (6h24m5.288672896s) [noise=true , address=45.91.116.12:4227    , piece_id=QB7YKZFXWMRB3VQ3HSFMMMLLX5YFWOXG4Y4GJGGYT6HDV4FQ65VA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.923615462 (6h24m5.296194817s) [noise=true , address=45.91.116.14:4190    , piece_id=RUU2MICSAWOECAAYNOBS75SE2YKSUBMSSFKLPON7FWK77UNJEYGQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.928612934 (6h24m5.301192289s) [noise=true , address=45.91.116.7:4010     , piece_id=BH76RM4NXGEAI2J2424ALK4PFSXUTBCYOH777BUOIDW7BW2IJUJA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.990915468 (6h24m5.363494833s) [noise=true , address=45.91.116.4:4937     , piece_id=V2IOOA7DVCGZBH3D43ROYHT6ZECPY6GTC5M7NFO2RWPQB6EYGALA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.992136464 (6h24m5.364715819s) [noise=true , address=45.91.116.8:4047     , piece_id=6UOFOV4VCVT6DB7D7Q23REAX7VZPAW5PSG5PLA54LISOUWMPQBBQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.997711812 (6h24m5.370291157s) [noise=true , address=45.91.116.9:4262     , piece_id=FRIATDM7LPPHXYAMUISAYRTQWAKSTB4EYUANHGEMQHM6JQADDTRQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:59.010548391 (6h24m5.383127746s) [noise=true , address=45.91.116.10:4082    , piece_id=HZDMC4J5O5UHVDH5SOQBKAFPN6RJUHIWKEZ4OPVMW2HSN7NDZMZA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:59.039607621 (6h24m5.412186996s) [noise=true , address=45.91.116.5:4299     , piece_id=JQLK5LIMCMW6R2UZEJZSG6QAP2M65XBVE6JFEXY5KDWBVNDG2VCQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:15:19.998482215 (6h24m26.37106157s) [noise=true , address=77.90.31.14:4663     , piece_id=LNTFUWB6LUUFD2EB536ZHBSNVVXYZPOOB4DUZB2M6BXSSFEL3UMQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:15:21.170089451 (6h24m27.542668806s) [noise=true , address=77.90.31.13:4627     , piece_id=E7GSSBZ653K2AA4TP6A4BRT5BDZCBODNRAZM3P6SYJXJFQU2BACQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:15:24.941469148 (6h24m31.314048503s) [noise=true , address=77.90.31.15:4697     , piece_id=W62ARDAVLI64P6VYSPVFRTDKB5H2WXTSCF2VKP3UN7JKGBCUEZTQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: expected piece hash; context deadline exceeded; EOF
Jul 19 05:15:24.941530766 (6h24m31.314110121s) [noise=true , address=77.90.31.17:4772     , piece_id=B544E3F2UC3UVE2ITUQAWGVDMSPS2HFIVHXZ2OLWB3T25AHMFAVA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:44456->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:44456->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44456->77.90.31.17:4772: use of closed network connection
Jul 19 05:15:24.941543591 (6h24m31.314122946s) [noise=true , address=77.90.31.16:4734     , piece_id=YUW6MWSUDNLAC2VHLBT6H4T27YTNJ3RDK4BSGE7OZQCO3F2LBH4A, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 19 05:15:24.941614786 (6h24m31.314194141s) [noise=true , address=77.90.31.11:4555     , piece_id=YICA5IVHSCC3RPC5FRKD26BSMY6N5WJQA5LCABJSRJYL6BZJYL6A, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 188.166.225.170:37392->77.90.31.11:4555: use of closed network connection; write tcp 188.166.225.170:37392->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37392->77.90.31.11:4555: use of closed network connection
Jul 19 05:15:24.941641888 (6h24m31.314221243s) [noise=true , address=77.90.31.18:4806     , piece_id=67PXFJMJB6XWNU6JMOKPO4BXKDD2Z225ZKTB7DZEA46OMSSXHHMQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:47114->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:47114->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47114->77.90.31.18:4806: use of closed network connection
Jul 19 05:15:24.941663099 (6h24m31.314242454s) [seg_pos={0 0}, upload=5081]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jul 19 05:15:25.179949476 (6h24m31.552528831s) [upload=5081]: Done uploading segments...
Jul 19 05:15:25.179975797 (6h24m31.552555152s) [upload=5081]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 5.868242605s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
5.688182532s
FAIL (2025-07-19 06:02:28 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.68821304s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [.XX.X.......................................................]
duration:
5.969868907s
FAIL (2025-07-19 06:01:59 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
gment. successful: 13 optimal: 13 errs: <nil>
Jul 19 05:14:35.936262577 (6h23m42.308841932s) [upload=5075]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 05:14:35.936281884 (6h23m42.308861239s) [upload=5075]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 05:14:36.234171969 (6h23m42.606751314s) [upload=5075]: Done uploading segments...
Jul 19 05:14:36.234192037 (6h23m42.606771382s) [upload=5075]: Upload finished. err: <nil>
Jul 19 05:14:55.587986728 (6h24m1.960566093s) [upload=5081]: Starting upload
Jul 19 05:14:55.588051823 (6h24m1.960631178s) [upload=5081]: Done starting upload
Jul 19 05:14:55.588146724 (6h24m1.960726079s) [upload=5081]: Uploading segments...
Jul 19 05:14:55.588391873 (6h24m1.960971228s) [upload=5081]: Got next segment. Inline: false
Jul 19 05:14:55.588649837 (6h24m1.961229193s) [upload=5081]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 05:14:55.588655057 (6h24m1.961234402s) [upload=5081]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 05:14:55.823387692 (6h24m2.195967047s) [seg_pos={0 0}, upload=5081]: Begin upload segment...
Jul 19 05:14:55.823450572 (6h24m2.196029927s) [seg_pos={0 0}, upload=5081]: Done begin upload segment.
Jul 19 05:14:55.823481952 (6h24m2.196061307s) [noise=true , address=77.90.31.17:4772     , piece_id=B544E3F2UC3UVE2ITUQAWGVDMSPS2HFIVHXZ2OLWB3T25AHMFAVA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.823491401 (6h24m2.196070756s) [noise=true , address=45.91.116.10:4082    , piece_id=HZDMC4J5O5UHVDH5SOQBKAFPN6RJUHIWKEZ4OPVMW2HSN7NDZMZA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.823923789 (6h24m2.196503144s) [noise=true , address=45.91.116.9:4262     , piece_id=FRIATDM7LPPHXYAMUISAYRTQWAKSTB4EYUANHGEMQHM6JQADDTRQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.823949737 (6h24m2.196529092s) [noise=true , address=45.91.116.12:4227    , piece_id=QB7YKZFXWMRB3VQ3HSFMMMLLX5YFWOXG4Y4GJGGYT6HDV4FQ65VA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824310158 (6h24m2.196889513s) [noise=true , address=45.91.116.4:4937     , piece_id=V2IOOA7DVCGZBH3D43ROYHT6ZECPY6GTC5M7NFO2RWPQB6EYGALA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824403045 (6h24m2.19698239s) [noise=true , address=77.90.31.11:4555     , piece_id=YICA5IVHSCC3RPC5FRKD26BSMY6N5WJQA5LCABJSRJYL6BZJYL6A, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824651210 (6h24m2.197230565s) [noise=true , address=77.90.31.13:4627     , piece_id=E7GSSBZ653K2AA4TP6A4BRT5BDZCBODNRAZM3P6SYJXJFQU2BACQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824716334 (6h24m2.197295689s) [noise=true , address=77.90.31.16:4734     , piece_id=YUW6MWSUDNLAC2VHLBT6H4T27YTNJ3RDK4BSGE7OZQCO3F2LBH4A, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824960491 (6h24m2.197539856s) [noise=true , address=45.91.116.7:4010     , piece_id=BH76RM4NXGEAI2J2424ALK4PFSXUTBCYOH777BUOIDW7BW2IJUJA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824977494 (6h24m2.197556849s) [noise=true , address=45.91.116.14:4190    , piece_id=RUU2MICSAWOECAAYNOBS75SE2YKSUBMSSFKLPON7FWK77UNJEYGQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825213285 (6h24m2.19779264s) [noise=true , address=45.91.116.8:4047     , piece_id=6UOFOV4VCVT6DB7D7Q23REAX7VZPAW5PSG5PLA54LISOUWMPQBBQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825271547 (6h24m2.197850902s) [noise=true , address=77.90.31.18:4806     , piece_id=67PXFJMJB6XWNU6JMOKPO4BXKDD2Z225ZKTB7DZEA46OMSSXHHMQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825445860 (6h24m2.198025215s) [noise=true , address=45.91.116.7:4009     , piece_id=HH5I32ZYT5LVXHDLBVSAVX6T23MJ6RGNPNAWPIQAREJ4ELPFJGYA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825568244 (6h24m2.198147599s) [noise=true , address=77.90.31.15:4697     , piece_id=W62ARDAVLI64P6VYSPVFRTDKB5H2WXTSCF2VKP3UN7JKGBCUEZTQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825902985 (6h24m2.19848234s) [noise=true , address=45.91.116.5:4299     , piece_id=JQLK5LIMCMW6R2UZEJZSG6QAP2M65XBVE6JFEXY5KDWBVNDG2VCQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.826216495 (6h24m2.19879585s) [noise=true , address=77.90.31.14:4663     , piece_id=LNTFUWB6LUUFD2EB536ZHBSNVVXYZPOOB4DUZB2M6BXSSFEL3UMQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:58.633690556 (6h24m5.006269911s) [upload=5081]: Next returned nil segment
Jul 19 05:14:58.633708100 (6h24m5.006287445s) [upload=5081]: Waiting for error group managing segments...
Jul 19 05:14:58.915966948 (6h24m5.288546293s) [noise=true , address=45.91.116.7:4009     , piece_id=HH5I32ZYT5LVXHDLBVSAVX6T23MJ6RGNPNAWPIQAREJ4ELPFJGYA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.916093541 (6h24m5.288672896s) [noise=true , address=45.91.116.12:4227    , piece_id=QB7YKZFXWMRB3VQ3HSFMMMLLX5YFWOXG4Y4GJGGYT6HDV4FQ65VA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.923615462 (6h24m5.296194817s) [noise=true , address=45.91.116.14:4190    , piece_id=RUU2MICSAWOECAAYNOBS75SE2YKSUBMSSFKLPON7FWK77UNJEYGQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.928612934 (6h24m5.301192289s) [noise=true , address=45.91.116.7:4010     , piece_id=BH76RM4NXGEAI2J2424ALK4PFSXUTBCYOH777BUOIDW7BW2IJUJA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.990915468 (6h24m5.363494833s) [noise=true , address=45.91.116.4:4937     , piece_id=V2IOOA7DVCGZBH3D43ROYHT6ZECPY6GTC5M7NFO2RWPQB6EYGALA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.992136464 (6h24m5.364715819s) [noise=true , address=45.91.116.8:4047     , piece_id=6UOFOV4VCVT6DB7D7Q23REAX7VZPAW5PSG5PLA54LISOUWMPQBBQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.997711812 (6h24m5.370291157s) [noise=true , address=45.91.116.9:4262     , piece_id=FRIATDM7LPPHXYAMUISAYRTQWAKSTB4EYUANHGEMQHM6JQADDTRQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:59.010548391 (6h24m5.383127746s) [noise=true , address=45.91.116.10:4082    , piece_id=HZDMC4J5O5UHVDH5SOQBKAFPN6RJUHIWKEZ4OPVMW2HSN7NDZMZA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:59.039607621 (6h24m5.412186996s) [noise=true , address=45.91.116.5:4299     , piece_id=JQLK5LIMCMW6R2UZEJZSG6QAP2M65XBVE6JFEXY5KDWBVNDG2VCQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:15:19.998482215 (6h24m26.37106157s) [noise=true , address=77.90.31.14:4663     , piece_id=LNTFUWB6LUUFD2EB536ZHBSNVVXYZPOOB4DUZB2M6BXSSFEL3UMQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:15:21.170089451 (6h24m27.542668806s) [noise=true , address=77.90.31.13:4627     , piece_id=E7GSSBZ653K2AA4TP6A4BRT5BDZCBODNRAZM3P6SYJXJFQU2BACQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:15:24.941469148 (6h24m31.314048503s) [noise=true , address=77.90.31.15:4697     , piece_id=W62ARDAVLI64P6VYSPVFRTDKB5H2WXTSCF2VKP3UN7JKGBCUEZTQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: expected piece hash; context deadline exceeded; EOF
Jul 19 05:15:24.941530766 (6h24m31.314110121s) [noise=true , address=77.90.31.17:4772     , piece_id=B544E3F2UC3UVE2ITUQAWGVDMSPS2HFIVHXZ2OLWB3T25AHMFAVA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:44456->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:44456->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44456->77.90.31.17:4772: use of closed network connection
Jul 19 05:15:24.941543591 (6h24m31.314122946s) [noise=true , address=77.90.31.16:4734     , piece_id=YUW6MWSUDNLAC2VHLBT6H4T27YTNJ3RDK4BSGE7OZQCO3F2LBH4A, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 19 05:15:24.941614786 (6h24m31.314194141s) [noise=true , address=77.90.31.11:4555     , piece_id=YICA5IVHSCC3RPC5FRKD26BSMY6N5WJQA5LCABJSRJYL6BZJYL6A, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 188.166.225.170:37392->77.90.31.11:4555: use of closed network connection; write tcp 188.166.225.170:37392->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37392->77.90.31.11:4555: use of closed network connection
Jul 19 05:15:24.941641888 (6h24m31.314221243s) [noise=true , address=77.90.31.18:4806     , piece_id=67PXFJMJB6XWNU6JMOKPO4BXKDD2Z225ZKTB7DZEA46OMSSXHHMQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:47114->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:47114->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47114->77.90.31.18:4806: use of closed network connection
Jul 19 05:15:24.941663099 (6h24m31.314242454s) [seg_pos={0 0}, upload=5081]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jul 19 05:15:25.179949476 (6h24m31.552528831s) [upload=5081]: Done uploading segments...
Jul 19 05:15:25.179975797 (6h24m31.552555152s) [upload=5081]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 5.969892492s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
6.11323185s
FAIL (2025-07-19 06:01:15 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 6.113258871s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [..XX.X......................................................]
duration:
5.958378147s
FAIL (2025-07-19 06:00:57 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
gment. successful: 13 optimal: 13 errs: <nil>
Jul 19 05:14:35.936262577 (6h23m42.308841932s) [upload=5075]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 05:14:35.936281884 (6h23m42.308861239s) [upload=5075]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 05:14:36.234171969 (6h23m42.606751314s) [upload=5075]: Done uploading segments...
Jul 19 05:14:36.234192037 (6h23m42.606771382s) [upload=5075]: Upload finished. err: <nil>
Jul 19 05:14:55.587986728 (6h24m1.960566093s) [upload=5081]: Starting upload
Jul 19 05:14:55.588051823 (6h24m1.960631178s) [upload=5081]: Done starting upload
Jul 19 05:14:55.588146724 (6h24m1.960726079s) [upload=5081]: Uploading segments...
Jul 19 05:14:55.588391873 (6h24m1.960971228s) [upload=5081]: Got next segment. Inline: false
Jul 19 05:14:55.588649837 (6h24m1.961229193s) [upload=5081]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 05:14:55.588655057 (6h24m1.961234402s) [upload=5081]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 05:14:55.823387692 (6h24m2.195967047s) [seg_pos={0 0}, upload=5081]: Begin upload segment...
Jul 19 05:14:55.823450572 (6h24m2.196029927s) [seg_pos={0 0}, upload=5081]: Done begin upload segment.
Jul 19 05:14:55.823481952 (6h24m2.196061307s) [noise=true , address=77.90.31.17:4772     , piece_id=B544E3F2UC3UVE2ITUQAWGVDMSPS2HFIVHXZ2OLWB3T25AHMFAVA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.823491401 (6h24m2.196070756s) [noise=true , address=45.91.116.10:4082    , piece_id=HZDMC4J5O5UHVDH5SOQBKAFPN6RJUHIWKEZ4OPVMW2HSN7NDZMZA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.823923789 (6h24m2.196503144s) [noise=true , address=45.91.116.9:4262     , piece_id=FRIATDM7LPPHXYAMUISAYRTQWAKSTB4EYUANHGEMQHM6JQADDTRQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.823949737 (6h24m2.196529092s) [noise=true , address=45.91.116.12:4227    , piece_id=QB7YKZFXWMRB3VQ3HSFMMMLLX5YFWOXG4Y4GJGGYT6HDV4FQ65VA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824310158 (6h24m2.196889513s) [noise=true , address=45.91.116.4:4937     , piece_id=V2IOOA7DVCGZBH3D43ROYHT6ZECPY6GTC5M7NFO2RWPQB6EYGALA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824403045 (6h24m2.19698239s) [noise=true , address=77.90.31.11:4555     , piece_id=YICA5IVHSCC3RPC5FRKD26BSMY6N5WJQA5LCABJSRJYL6BZJYL6A, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824651210 (6h24m2.197230565s) [noise=true , address=77.90.31.13:4627     , piece_id=E7GSSBZ653K2AA4TP6A4BRT5BDZCBODNRAZM3P6SYJXJFQU2BACQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824716334 (6h24m2.197295689s) [noise=true , address=77.90.31.16:4734     , piece_id=YUW6MWSUDNLAC2VHLBT6H4T27YTNJ3RDK4BSGE7OZQCO3F2LBH4A, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824960491 (6h24m2.197539856s) [noise=true , address=45.91.116.7:4010     , piece_id=BH76RM4NXGEAI2J2424ALK4PFSXUTBCYOH777BUOIDW7BW2IJUJA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.824977494 (6h24m2.197556849s) [noise=true , address=45.91.116.14:4190    , piece_id=RUU2MICSAWOECAAYNOBS75SE2YKSUBMSSFKLPON7FWK77UNJEYGQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825213285 (6h24m2.19779264s) [noise=true , address=45.91.116.8:4047     , piece_id=6UOFOV4VCVT6DB7D7Q23REAX7VZPAW5PSG5PLA54LISOUWMPQBBQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825271547 (6h24m2.197850902s) [noise=true , address=77.90.31.18:4806     , piece_id=67PXFJMJB6XWNU6JMOKPO4BXKDD2Z225ZKTB7DZEA46OMSSXHHMQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825445860 (6h24m2.198025215s) [noise=true , address=45.91.116.7:4009     , piece_id=HH5I32ZYT5LVXHDLBVSAVX6T23MJ6RGNPNAWPIQAREJ4ELPFJGYA, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825568244 (6h24m2.198147599s) [noise=true , address=77.90.31.15:4697     , piece_id=W62ARDAVLI64P6VYSPVFRTDKB5H2WXTSCF2VKP3UN7JKGBCUEZTQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.825902985 (6h24m2.19848234s) [noise=true , address=45.91.116.5:4299     , piece_id=JQLK5LIMCMW6R2UZEJZSG6QAP2M65XBVE6JFEXY5KDWBVNDG2VCQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:55.826216495 (6h24m2.19879585s) [noise=true , address=77.90.31.14:4663     , piece_id=LNTFUWB6LUUFD2EB536ZHBSNVVXYZPOOB4DUZB2M6BXSSFEL3UMQ, seg_pos={0 0}, upload=5081]: Uploading piece...
Jul 19 05:14:58.633690556 (6h24m5.006269911s) [upload=5081]: Next returned nil segment
Jul 19 05:14:58.633708100 (6h24m5.006287445s) [upload=5081]: Waiting for error group managing segments...
Jul 19 05:14:58.915966948 (6h24m5.288546293s) [noise=true , address=45.91.116.7:4009     , piece_id=HH5I32ZYT5LVXHDLBVSAVX6T23MJ6RGNPNAWPIQAREJ4ELPFJGYA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.916093541 (6h24m5.288672896s) [noise=true , address=45.91.116.12:4227    , piece_id=QB7YKZFXWMRB3VQ3HSFMMMLLX5YFWOXG4Y4GJGGYT6HDV4FQ65VA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.923615462 (6h24m5.296194817s) [noise=true , address=45.91.116.14:4190    , piece_id=RUU2MICSAWOECAAYNOBS75SE2YKSUBMSSFKLPON7FWK77UNJEYGQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.928612934 (6h24m5.301192289s) [noise=true , address=45.91.116.7:4010     , piece_id=BH76RM4NXGEAI2J2424ALK4PFSXUTBCYOH777BUOIDW7BW2IJUJA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.990915468 (6h24m5.363494833s) [noise=true , address=45.91.116.4:4937     , piece_id=V2IOOA7DVCGZBH3D43ROYHT6ZECPY6GTC5M7NFO2RWPQB6EYGALA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.992136464 (6h24m5.364715819s) [noise=true , address=45.91.116.8:4047     , piece_id=6UOFOV4VCVT6DB7D7Q23REAX7VZPAW5PSG5PLA54LISOUWMPQBBQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:58.997711812 (6h24m5.370291157s) [noise=true , address=45.91.116.9:4262     , piece_id=FRIATDM7LPPHXYAMUISAYRTQWAKSTB4EYUANHGEMQHM6JQADDTRQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:59.010548391 (6h24m5.383127746s) [noise=true , address=45.91.116.10:4082    , piece_id=HZDMC4J5O5UHVDH5SOQBKAFPN6RJUHIWKEZ4OPVMW2HSN7NDZMZA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:14:59.039607621 (6h24m5.412186996s) [noise=true , address=45.91.116.5:4299     , piece_id=JQLK5LIMCMW6R2UZEJZSG6QAP2M65XBVE6JFEXY5KDWBVNDG2VCQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:15:19.998482215 (6h24m26.37106157s) [noise=true , address=77.90.31.14:4663     , piece_id=LNTFUWB6LUUFD2EB536ZHBSNVVXYZPOOB4DUZB2M6BXSSFEL3UMQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:15:21.170089451 (6h24m27.542668806s) [noise=true , address=77.90.31.13:4627     , piece_id=E7GSSBZ653K2AA4TP6A4BRT5BDZCBODNRAZM3P6SYJXJFQU2BACQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: <nil>
Jul 19 05:15:24.941469148 (6h24m31.314048503s) [noise=true , address=77.90.31.15:4697     , piece_id=W62ARDAVLI64P6VYSPVFRTDKB5H2WXTSCF2VKP3UN7JKGBCUEZTQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: expected piece hash; context deadline exceeded; EOF
Jul 19 05:15:24.941530766 (6h24m31.314110121s) [noise=true , address=77.90.31.17:4772     , piece_id=B544E3F2UC3UVE2ITUQAWGVDMSPS2HFIVHXZ2OLWB3T25AHMFAVA, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:44456->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:44456->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44456->77.90.31.17:4772: use of closed network connection
Jul 19 05:15:24.941543591 (6h24m31.314122946s) [noise=true , address=77.90.31.16:4734     , piece_id=YUW6MWSUDNLAC2VHLBT6H4T27YTNJ3RDK4BSGE7OZQCO3F2LBH4A, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 19 05:15:24.941614786 (6h24m31.314194141s) [noise=true , address=77.90.31.11:4555     , piece_id=YICA5IVHSCC3RPC5FRKD26BSMY6N5WJQA5LCABJSRJYL6BZJYL6A, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 188.166.225.170:37392->77.90.31.11:4555: use of closed network connection; write tcp 188.166.225.170:37392->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37392->77.90.31.11:4555: use of closed network connection
Jul 19 05:15:24.941641888 (6h24m31.314221243s) [noise=true , address=77.90.31.18:4806     , piece_id=67PXFJMJB6XWNU6JMOKPO4BXKDD2Z225ZKTB7DZEA46OMSSXHHMQ, seg_pos={0 0}, upload=5081]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:47114->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:47114->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47114->77.90.31.18:4806: use of closed network connection
Jul 19 05:15:24.941663099 (6h24m31.314242454s) [seg_pos={0 0}, upload=5081]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jul 19 05:15:25.179949476 (6h24m31.552528831s) [upload=5081]: Done uploading segments...
Jul 19 05:15:25.179975797 (6h24m31.552555152s) [upload=5081]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 5.958409628s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
5.849550849s
FAIL (2025-07-19 06:00:16 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.849580146s core uplink us1