Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.265956717s
FAIL (2025-10-12 03:36:05 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.265984762s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.040421842s
FAIL (2025-10-12 03:35:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 12 03:28:14.613396846 (445h57m0.075489329s) [upload=392347]: Starting upload Oct 12 03:28:14.613463453 (445h57m0.075555926s) [upload=392347]: Done starting upload Oct 12 03:28:14.613532714 (445h57m0.075625198s) [upload=392347]: Uploading segments... Oct 12 03:28:14.613596767 (445h57m0.07568925s) [upload=392347]: Got next segment. Inline: true Oct 12 03:28:14.613604080 (445h57m0.075696563s) [upload=392347]: Waiting for error group managing segments... Oct 12 03:28:14.613659116 (445h57m0.075751599s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 12 03:28:14.613665878 (445h57m0.075758361s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 12 03:28:14.613671218 (445h57m0.075763701s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 12 03:28:43.897881592 (445h57m29.359974065s) [upload=392347]: Done uploading segments... Oct 12 03:28:43.897925706 (445h57m29.360018179s) [upload=392347]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.040452261s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
5.681261857s
FAIL (2025-10-12 03:35:41 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.681286905s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
4.824652892s
FAIL (2025-10-12 03:35:04 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 4.824689703s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
5.878840326s
FAIL (2025-10-12 03:34:55 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.878875444s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.096358326s
FAIL (2025-10-12 03:34:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 12 03:28:14.613396846 (445h57m0.075489329s) [upload=392347]: Starting upload Oct 12 03:28:14.613463453 (445h57m0.075555926s) [upload=392347]: Done starting upload Oct 12 03:28:14.613532714 (445h57m0.075625198s) [upload=392347]: Uploading segments... Oct 12 03:28:14.613596767 (445h57m0.07568925s) [upload=392347]: Got next segment. Inline: true Oct 12 03:28:14.613604080 (445h57m0.075696563s) [upload=392347]: Waiting for error group managing segments... Oct 12 03:28:14.613659116 (445h57m0.075751599s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 12 03:28:14.613665878 (445h57m0.075758361s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 12 03:28:14.613671218 (445h57m0.075763701s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 12 03:28:43.897881592 (445h57m29.359974065s) [upload=392347]: Done uploading segments... Oct 12 03:28:43.897925706 (445h57m29.360018179s) [upload=392347]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.096412909s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
6.189364225s
FAIL (2025-10-12 03:34:24 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 6.189394794s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.086192195s
FAIL (2025-10-12 03:34:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 12 03:28:14.613396846 (445h57m0.075489329s) [upload=392347]: Starting upload Oct 12 03:28:14.613463453 (445h57m0.075555926s) [upload=392347]: Done starting upload Oct 12 03:28:14.613532714 (445h57m0.075625198s) [upload=392347]: Uploading segments... Oct 12 03:28:14.613596767 (445h57m0.07568925s) [upload=392347]: Got next segment. Inline: true Oct 12 03:28:14.613604080 (445h57m0.075696563s) [upload=392347]: Waiting for error group managing segments... Oct 12 03:28:14.613659116 (445h57m0.075751599s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 12 03:28:14.613665878 (445h57m0.075758361s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 12 03:28:14.613671218 (445h57m0.075763701s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 12 03:28:43.897881592 (445h57m29.359974065s) [upload=392347]: Done uploading segments... Oct 12 03:28:43.897925706 (445h57m29.360018179s) [upload=392347]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.08622567s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
5.010552047s
FAIL (2025-10-12 03:34:02 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.010587643s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.055518598s
FAIL (2025-10-12 03:33:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 12 03:28:14.613396846 (445h57m0.075489329s) [upload=392347]: Starting upload Oct 12 03:28:14.613463453 (445h57m0.075555926s) [upload=392347]: Done starting upload Oct 12 03:28:14.613532714 (445h57m0.075625198s) [upload=392347]: Uploading segments... Oct 12 03:28:14.613596767 (445h57m0.07568925s) [upload=392347]: Got next segment. Inline: true Oct 12 03:28:14.613604080 (445h57m0.075696563s) [upload=392347]: Waiting for error group managing segments... Oct 12 03:28:14.613659116 (445h57m0.075751599s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 12 03:28:14.613665878 (445h57m0.075758361s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 12 03:28:14.613671218 (445h57m0.075763701s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 12 03:28:43.897881592 (445h57m29.359974065s) [upload=392347]: Done uploading segments... Oct 12 03:28:43.897925706 (445h57m29.360018179s) [upload=392347]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.055554237s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
6.097776871s
FAIL (2025-10-12 03:33:29 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 6.097809964s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
5.243603284s
FAIL (2025-10-12 03:33:22 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.243633371s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.17015739s
FAIL (2025-10-12 03:33:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 12 03:28:14.613396846 (445h57m0.075489329s) [upload=392347]: Starting upload Oct 12 03:28:14.613463453 (445h57m0.075555926s) [upload=392347]: Done starting upload Oct 12 03:28:14.613532714 (445h57m0.075625198s) [upload=392347]: Uploading segments... Oct 12 03:28:14.613596767 (445h57m0.07568925s) [upload=392347]: Got next segment. Inline: true Oct 12 03:28:14.613604080 (445h57m0.075696563s) [upload=392347]: Waiting for error group managing segments... Oct 12 03:28:14.613659116 (445h57m0.075751599s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 12 03:28:14.613665878 (445h57m0.075758361s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 12 03:28:14.613671218 (445h57m0.075763701s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 12 03:28:43.897881592 (445h57m29.359974065s) [upload=392347]: Done uploading segments... Oct 12 03:28:43.897925706 (445h57m29.360018179s) [upload=392347]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.170191073s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
5.037639476s
FAIL (2025-10-12 03:32:48 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.038049216s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
6.213066522s
FAIL (2025-10-12 03:32:36 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 6.213094978s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.061973519s
FAIL (2025-10-12 03:32:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 12 03:28:14.613396846 (445h57m0.075489329s) [upload=392347]: Starting upload Oct 12 03:28:14.613463453 (445h57m0.075555926s) [upload=392347]: Done starting upload Oct 12 03:28:14.613532714 (445h57m0.075625198s) [upload=392347]: Uploading segments... Oct 12 03:28:14.613596767 (445h57m0.07568925s) [upload=392347]: Got next segment. Inline: true Oct 12 03:28:14.613604080 (445h57m0.075696563s) [upload=392347]: Waiting for error group managing segments... Oct 12 03:28:14.613659116 (445h57m0.075751599s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 12 03:28:14.613665878 (445h57m0.075758361s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 12 03:28:14.613671218 (445h57m0.075763701s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 12 03:28:43.897881592 (445h57m29.359974065s) [upload=392347]: Done uploading segments... Oct 12 03:28:43.897925706 (445h57m29.360018179s) [upload=392347]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.062008777s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
4.960468767s
FAIL (2025-10-12 03:31:46 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 4.960502s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
6.036524437s
FAIL (2025-10-12 03:31:44 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 6.036559173s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.096288041s
FAIL (2025-10-12 03:31:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 12 03:28:14.613396846 (445h57m0.075489329s) [upload=392347]: Starting upload Oct 12 03:28:14.613463453 (445h57m0.075555926s) [upload=392347]: Done starting upload Oct 12 03:28:14.613532714 (445h57m0.075625198s) [upload=392347]: Uploading segments... Oct 12 03:28:14.613596767 (445h57m0.07568925s) [upload=392347]: Got next segment. Inline: true Oct 12 03:28:14.613604080 (445h57m0.075696563s) [upload=392347]: Waiting for error group managing segments... Oct 12 03:28:14.613659116 (445h57m0.075751599s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 12 03:28:14.613665878 (445h57m0.075758361s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 12 03:28:14.613671218 (445h57m0.075763701s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 12 03:28:43.897881592 (445h57m29.359974065s) [upload=392347]: Done uploading segments... Oct 12 03:28:43.897925706 (445h57m29.360018179s) [upload=392347]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.096337256s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
6.030843299s
FAIL (2025-10-12 03:30:49 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 6.030878366s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
5.216928399s
FAIL (2025-10-12 03:30:42 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.216962964s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.103694704s
FAIL (2025-10-12 03:30:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 12 03:28:14.613396846 (445h57m0.075489329s) [upload=392347]: Starting upload Oct 12 03:28:14.613463453 (445h57m0.075555926s) [upload=392347]: Done starting upload Oct 12 03:28:14.613532714 (445h57m0.075625198s) [upload=392347]: Uploading segments... Oct 12 03:28:14.613596767 (445h57m0.07568925s) [upload=392347]: Got next segment. Inline: true Oct 12 03:28:14.613604080 (445h57m0.075696563s) [upload=392347]: Waiting for error group managing segments... Oct 12 03:28:14.613659116 (445h57m0.075751599s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 12 03:28:14.613665878 (445h57m0.075758361s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 12 03:28:14.613671218 (445h57m0.075763701s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 12 03:28:43.897881592 (445h57m29.359974065s) [upload=392347]: Done uploading segments... Oct 12 03:28:43.897925706 (445h57m29.360018179s) [upload=392347]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.1037296s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
6.165244628s
FAIL (2025-10-12 03:30:15 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 6.165281127s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
5.969473315s
FAIL (2025-10-12 03:29:43 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.969509535s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
4.974076418s
FAIL (2025-10-12 03:29:36 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 4.974110263s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.343454798s
FAIL (2025-10-12 03:29:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 12 03:28:14.613396846 (445h57m0.075489329s) [upload=392347]: Starting upload Oct 12 03:28:14.613463453 (445h57m0.075555926s) [upload=392347]: Done starting upload Oct 12 03:28:14.613532714 (445h57m0.075625198s) [upload=392347]: Uploading segments... Oct 12 03:28:14.613596767 (445h57m0.07568925s) [upload=392347]: Got next segment. Inline: true Oct 12 03:28:14.613604080 (445h57m0.075696563s) [upload=392347]: Waiting for error group managing segments... Oct 12 03:28:14.613659116 (445h57m0.075751599s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 12 03:28:14.613665878 (445h57m0.075758361s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 12 03:28:14.613671218 (445h57m0.075763701s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 12 03:28:43.897881592 (445h57m29.359974065s) [upload=392347]: Done uploading segments... Oct 12 03:28:43.897925706 (445h57m29.360018179s) [upload=392347]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.343485767s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
5.47240048s
FAIL (2025-10-12 03:29:16 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.472440846s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
43.250350916s
FAIL (2025-10-12 03:29:10 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 43.250383135s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.147295658s
FAIL (2025-10-12 03:29:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 12 03:28:14.613396846 (445h57m0.075489329s) [upload=392347]: Starting upload Oct 12 03:28:14.613463453 (445h57m0.075555926s) [upload=392347]: Done starting upload Oct 12 03:28:14.613532714 (445h57m0.075625198s) [upload=392347]: Uploading segments... Oct 12 03:28:14.613596767 (445h57m0.07568925s) [upload=392347]: Got next segment. Inline: true Oct 12 03:28:14.613604080 (445h57m0.075696563s) [upload=392347]: Waiting for error group managing segments... Oct 12 03:28:14.613659116 (445h57m0.075751599s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 12 03:28:14.613665878 (445h57m0.075758361s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 12 03:28:14.613671218 (445h57m0.075763701s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 12 03:28:43.897881592 (445h57m29.359974065s) [upload=392347]: Done uploading segments... Oct 12 03:28:43.897925706 (445h57m29.360018179s) [upload=392347]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.147325003s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
19.794049991s
FAIL (2025-10-12 03:29:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 12 03:28:14.613396846 (445h57m0.075489329s) [upload=392347]: Starting upload Oct 12 03:28:14.613463453 (445h57m0.075555926s) [upload=392347]: Done starting upload Oct 12 03:28:14.613532714 (445h57m0.075625198s) [upload=392347]: Uploading segments... Oct 12 03:28:14.613596767 (445h57m0.07568925s) [upload=392347]: Got next segment. Inline: true Oct 12 03:28:14.613604080 (445h57m0.075696563s) [upload=392347]: Waiting for error group managing segments... Oct 12 03:28:14.613659116 (445h57m0.075751599s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 12 03:28:14.613665878 (445h57m0.075758361s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 12 03:28:14.613671218 (445h57m0.075763701s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 12 03:28:43.897881592 (445h57m29.359974065s) [upload=392347]: Done uploading segments... Oct 12 03:28:43.897925706 (445h57m29.360018179s) [upload=392347]: Upload finished. err: metaclient: context deadline exceeded
Duration: 19.794072725s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001573561s
FAIL (2025-10-12 03:28:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 12 03:28:14.613396846 (445h57m0.075489329s) [upload=392347]: Starting upload Oct 12 03:28:14.613463453 (445h57m0.075555926s) [upload=392347]: Done starting upload Oct 12 03:28:14.613532714 (445h57m0.075625198s) [upload=392347]: Uploading segments... Oct 12 03:28:14.613596767 (445h57m0.07568925s) [upload=392347]: Got next segment. Inline: true Oct 12 03:28:14.613604080 (445h57m0.075696563s) [upload=392347]: Waiting for error group managing segments... Oct 12 03:28:14.613659116 (445h57m0.075751599s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 12 03:28:14.613665878 (445h57m0.075758361s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 12 03:28:14.613671218 (445h57m0.075763701s) [upload=392347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 12 03:28:43.897881592 (445h57m29.359974065s) [upload=392347]: Done uploading segments... Oct 12 03:28:43.897925706 (445h57m29.360018179s) [upload=392347]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.0015989s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
4.890833702s
FAIL (2025-10-12 03:28:01 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 4.890869559s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
5.06576062s
FAIL (2025-10-12 03:27:21 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.065793211s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
5.426567775s
FAIL (2025-10-12 03:26:46 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.426599004s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
5.156747912s
FAIL (2025-10-12 03:26:25 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 5.156780866s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.004742633s
FAIL (2025-10-12 03:25:39 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 30.00477174s
core
uplink
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
520.037104ms
FAIL (2025-10-11 13:25:48 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 520.074617ms
edge
authservice
http
bgp
ap1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
513.799539ms
FAIL (2025-10-11 13:25:04 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 513.841409ms
edge
authservice
http
bgp
ap1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
463.222289ms
FAIL (2025-10-11 13:23:50 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 463.255653ms
edge
authservice
http
bgp
ap1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
471.356375ms
FAIL (2025-10-11 13:22:49 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 471.387775ms
edge
authservice
http
bgp
ap1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
5.810719262s
FAIL (2025-10-11 13:21:44 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 5.810745591s
core
uplink
us-select-1
us1-placement-20
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
544.371865ms
FAIL (2025-10-11 13:21:36 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 544.406119ms
edge
authservice
http
bgp
ap1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
473.850068ms
FAIL (2025-10-11 13:20:50 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 473.886427ms
edge
authservice
http
bgp
ap1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
5.757002075s
FAIL (2025-10-11 13:20:39 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 5.757026822s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
5.813017128s
FAIL (2025-10-11 13:20:09 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 5.813045802s
core
uplink
us-select-1
us1-placement-20
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
487.2474ms
FAIL (2025-10-11 13:20:03 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 487.392826ms
edge
authservice
http
bgp
ap1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
5.601374202s
FAIL (2025-10-11 13:19:16 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 5.601405001s
core
uplink
us-select-1
us1-placement-20
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
5.54859889s
FAIL (2025-10-11 13:19:02 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 5.548636644s
edge
authservice
http
bgp
ap1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
5.649640021s
FAIL (2025-10-11 13:18:42 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 5.649667824s
core
uplink
us-select-1
us1-placement-20
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
453.382865ms
FAIL (2025-10-11 13:18:24 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 453.423513ms
edge
authservice
http
bgp
ap1
|