Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [............X...............................X...............] duration:
483.054616ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7fc0ad6d99ae5735
FAIL (2025-12-09 00:12:44 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 483.084112ms
core
satellite
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
6 out of 60 is failed (threshold=3) [...............X......X................X.XX.....X...........] duration:
5.684499553s trace:
https://jaeger.dev.storj.io/trace/3ddc3b2546ea0c66
FAIL (2025-12-09 00:12:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.684669517s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [X..........X.X...X....X..........X.........X................] duration:
3.503812563s trace:
https://jaeger.dev.storj.io/trace/424de39ee362be3f
FAIL (2025-12-09 00:11:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.503828313s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
6 out of 60 is failed (threshold=3) [................X......X................X.XX.....X..........] duration:
5.629531784s trace:
https://jaeger.dev.storj.io/trace/3ddc3b2546ea0c66
FAIL (2025-12-09 00:11:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.629551833s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [.............X...............................X..............] duration:
484.976305ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7fc0ad6d99ae5735
FAIL (2025-12-09 00:11:30 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 484.995061ms
core
satellite
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [.X..........X.X...X....X..........X.........X...............] duration:
3.435484739s trace:
https://jaeger.dev.storj.io/trace/424de39ee362be3f
FAIL (2025-12-09 00:11:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.435527712s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [..X..........X.X...X....X..........X.........X..............] duration:
3.487462425s trace:
https://jaeger.dev.storj.io/trace/424de39ee362be3f
FAIL (2025-12-09 00:11:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.487488967s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [X................X......X................X.XX.....X.........] duration:
5.712852713s trace:
https://jaeger.dev.storj.io/trace/3ddc3b2546ea0c66
FAIL (2025-12-09 00:10:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.712885334s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [.X................X......X................X.XX.....X........] duration:
5.87718876s trace:
https://jaeger.dev.storj.io/trace/3ddc3b2546ea0c66
FAIL (2025-12-09 00:10:28 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.877218547s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [..............X...............................X.............] duration:
487.314739ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7fc0ad6d99ae5735
FAIL (2025-12-09 00:10:21 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 487.344515ms
core
satellite
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [...X..........X.X...X....X..........X.........X.............] duration:
3.570242035s trace:
https://jaeger.dev.storj.io/trace/424de39ee362be3f
FAIL (2025-12-09 00:10:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.570274216s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [..X................X......X................X.XX.....X.......] duration:
5.85948018s trace:
https://jaeger.dev.storj.io/trace/3ddc3b2546ea0c66
FAIL (2025-12-09 00:10:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.859500088s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [...............X...............................X............] duration:
476.042033ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7fc0ad6d99ae5735
FAIL (2025-12-09 00:09:15 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 476.06174ms
core
satellite
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [....X..........X.X...X....X..........X.........X............] duration:
3.65517373s trace:
https://jaeger.dev.storj.io/trace/424de39ee362be3f
FAIL (2025-12-09 00:08:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.655211531s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [...X................X......X................X.XX.....X......] duration:
5.856885459s trace:
https://jaeger.dev.storj.io/trace/3ddc3b2546ea0c66
FAIL (2025-12-09 00:08:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.85691269s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [................X...............................X...........] duration:
483.711465ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7fc0ad6d99ae5735
FAIL (2025-12-09 00:08:30 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 483.736904ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
4.959145774s trace:
https://jaeger.dev.storj.io/trace/4b02f3035ab8e89a
FAIL (2025-12-09 00:08:13 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 4.959176323s
core
uplink
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [.....X..........X.X...X....X..........X.........X...........] duration:
3.518859031s trace:
https://jaeger.dev.storj.io/trace/424de39ee362be3f
FAIL (2025-12-09 00:07:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.518885069s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [....X................X......X................X.XX.....X.....] duration:
5.647947712s trace:
https://jaeger.dev.storj.io/trace/3ddc3b2546ea0c66
FAIL (2025-12-09 00:07:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.648048885s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [.................X...............................X..........] duration:
487.645957ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7fc0ad6d99ae5735
FAIL (2025-12-09 00:07:55 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 487.673932ms
core
satellite
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [.....X................X......X................X.XX.....X....] duration:
5.607526873s trace:
https://jaeger.dev.storj.io/trace/3ddc3b2546ea0c66
FAIL (2025-12-09 00:07:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.607623326s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
5.012669484s trace:
https://jaeger.dev.storj.io/trace/4b02f3035ab8e89a
FAIL (2025-12-09 00:07:29 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.012696365s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [..................X...............................X.........] duration:
483.704964ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7fc0ad6d99ae5735
FAIL (2025-12-09 00:07:29 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 483.732907ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
6.958648397s trace:
https://jaeger.dev.storj.io/trace/6a17c2831ae76153
FAIL (2025-12-09 00:07:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 23:22:58.638987633 (79h53m58.510070678s) [upload=69799]: Starting upload Dec 8 23:22:58.639070963 (79h53m58.510154008s) [upload=69799]: Done starting upload Dec 8 23:22:58.639157306 (79h53m58.510240352s) [upload=69799]: Uploading segments... Dec 8 23:22:58.639261395 (79h53m58.51034445s) [upload=69799]: Got next segment. Inline: true Dec 8 23:22:58.639269269 (79h53m58.510352315s) [upload=69799]: Waiting for error group managing segments... Dec 8 23:22:58.639355735 (79h53m58.51043878s) [upload=69799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Dec 8 23:22:58.639362948 (79h53m58.510446013s) [upload=69799]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Dec 8 23:22:58.639367427 (79h53m58.510450482s) [upload=69799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Dec 8 23:23:57.956567374 (79h54m57.827650409s) [upload=69799]: Done uploading segments... Dec 8 23:23:57.956606829 (79h54m57.827689864s) [upload=69799]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.958679456s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [......X..........X.X...X....X..........X.........X..........] duration:
3.393056991s trace:
https://jaeger.dev.storj.io/trace/424de39ee362be3f
FAIL (2025-12-09 00:06:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.393078001s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [......X................X......X................X.XX.....X...] duration:
5.827040545s trace:
https://jaeger.dev.storj.io/trace/3ddc3b2546ea0c66
FAIL (2025-12-09 00:06:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.827066134s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
5.167224571s trace:
https://jaeger.dev.storj.io/trace/4b02f3035ab8e89a
FAIL (2025-12-09 00:06:43 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.167255741s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [...................X...............................X........] duration:
483.119691ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7fc0ad6d99ae5735
FAIL (2025-12-09 00:06:33 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 483.147573ms
core
satellite
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [.......X..........X.X...X....X..........X.........X.........] duration:
3.51625349s trace:
https://jaeger.dev.storj.io/trace/424de39ee362be3f
FAIL (2025-12-09 00:06:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.516277465s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [.......X................X......X................X.XX.....X..] duration:
5.806110092s trace:
https://jaeger.dev.storj.io/trace/3ddc3b2546ea0c66
FAIL (2025-12-09 00:06:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.806256682s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.012116844s trace:
https://jaeger.dev.storj.io/trace/6a17c2831ae76153
FAIL (2025-12-09 00:06:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 23:22:58.638987633 (79h53m58.510070678s) [upload=69799]: Starting upload Dec 8 23:22:58.639070963 (79h53m58.510154008s) [upload=69799]: Done starting upload Dec 8 23:22:58.639157306 (79h53m58.510240352s) [upload=69799]: Uploading segments... Dec 8 23:22:58.639261395 (79h53m58.51034445s) [upload=69799]: Got next segment. Inline: true Dec 8 23:22:58.639269269 (79h53m58.510352315s) [upload=69799]: Waiting for error group managing segments... Dec 8 23:22:58.639355735 (79h53m58.51043878s) [upload=69799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Dec 8 23:22:58.639362948 (79h53m58.510446013s) [upload=69799]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Dec 8 23:22:58.639367427 (79h53m58.510450482s) [upload=69799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Dec 8 23:23:57.956567374 (79h54m57.827650409s) [upload=69799]: Done uploading segments... Dec 8 23:23:57.956606829 (79h54m57.827689864s) [upload=69799]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.012146621s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [....................X...............................X.......] duration:
482.460473ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7fc0ad6d99ae5735
FAIL (2025-12-09 00:05:45 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 482.513894ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
5.543259315s trace:
https://jaeger.dev.storj.io/trace/4b02f3035ab8e89a
FAIL (2025-12-09 00:05:44 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.5432936s
core
uplink
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [........X................X......X................X.XX.....X.] duration:
5.797942057s trace:
https://jaeger.dev.storj.io/trace/3ddc3b2546ea0c66
FAIL (2025-12-09 00:05:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.797956254s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [.........X................X......X................X.XX.....X] duration:
1m0.001500107s trace:
https://jaeger.dev.storj.io/trace/3ddc3b2546ea0c66
FAIL (2025-12-09 00:05:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.001583707s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [........X..........X.X...X....X..........X.........X........] duration:
3.622883254s trace:
https://jaeger.dev.storj.io/trace/424de39ee362be3f
FAIL (2025-12-09 00:05:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.622904534s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.085250567s trace:
https://jaeger.dev.storj.io/trace/6a17c2831ae76153
FAIL (2025-12-09 00:05:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 23:22:58.638987633 (79h53m58.510070678s) [upload=69799]: Starting upload Dec 8 23:22:58.639070963 (79h53m58.510154008s) [upload=69799]: Done starting upload Dec 8 23:22:58.639157306 (79h53m58.510240352s) [upload=69799]: Uploading segments... Dec 8 23:22:58.639261395 (79h53m58.51034445s) [upload=69799]: Got next segment. Inline: true Dec 8 23:22:58.639269269 (79h53m58.510352315s) [upload=69799]: Waiting for error group managing segments... Dec 8 23:22:58.639355735 (79h53m58.51043878s) [upload=69799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Dec 8 23:22:58.639362948 (79h53m58.510446013s) [upload=69799]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Dec 8 23:22:58.639367427 (79h53m58.510450482s) [upload=69799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Dec 8 23:23:57.956567374 (79h54m57.827650409s) [upload=69799]: Done uploading segments... Dec 8 23:23:57.956606829 (79h54m57.827689864s) [upload=69799]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.085281204s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [.....................X...............................X......] duration:
484.075781ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7fc0ad6d99ae5735
FAIL (2025-12-09 00:04:59 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 484.104446ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
5.020291927s trace:
https://jaeger.dev.storj.io/trace/4b02f3035ab8e89a
FAIL (2025-12-09 00:04:38 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.020322554s
core
uplink
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [.........X..........X.X...X....X..........X.........X.......] duration:
3.512399631s trace:
https://jaeger.dev.storj.io/trace/424de39ee362be3f
FAIL (2025-12-09 00:04:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.512427414s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
5.032196336s trace:
https://jaeger.dev.storj.io/trace/4b02f3035ab8e89a
FAIL (2025-12-09 00:04:22 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.032220383s
core
uplink
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [..........X..........X.X...X....X..........X.........X......] duration:
3.574713407s trace:
https://jaeger.dev.storj.io/trace/424de39ee362be3f
FAIL (2025-12-09 00:04:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.574739447s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.002762842s trace:
https://jaeger.dev.storj.io/trace/6a17c2831ae76153
FAIL (2025-12-09 00:03:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 23:22:58.638987633 (79h53m58.510070678s) [upload=69799]: Starting upload Dec 8 23:22:58.639070963 (79h53m58.510154008s) [upload=69799]: Done starting upload Dec 8 23:22:58.639157306 (79h53m58.510240352s) [upload=69799]: Uploading segments... Dec 8 23:22:58.639261395 (79h53m58.51034445s) [upload=69799]: Got next segment. Inline: true Dec 8 23:22:58.639269269 (79h53m58.510352315s) [upload=69799]: Waiting for error group managing segments... Dec 8 23:22:58.639355735 (79h53m58.51043878s) [upload=69799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Dec 8 23:22:58.639362948 (79h53m58.510446013s) [upload=69799]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Dec 8 23:22:58.639367427 (79h53m58.510450482s) [upload=69799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Dec 8 23:23:57.956567374 (79h54m57.827650409s) [upload=69799]: Done uploading segments... Dec 8 23:23:57.956606829 (79h54m57.827689864s) [upload=69799]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.002838055s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [......................X...............................X.....] duration:
484.038599ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7fc0ad6d99ae5735
FAIL (2025-12-09 00:03:44 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 484.089836ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
5.133459832s trace:
https://jaeger.dev.storj.io/trace/4b02f3035ab8e89a
FAIL (2025-12-09 00:03:28 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.133486993s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [.......................X...............................X....] duration:
485.786617ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7fc0ad6d99ae5735
FAIL (2025-12-09 00:03:19 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 485.816574ms
core
satellite
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [...........X..........X.X...X....X..........X.........X.....] duration:
3.523712063s trace:
https://jaeger.dev.storj.io/trace/424de39ee362be3f
FAIL (2025-12-09 00:03:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.523956578s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
6 out of 60 is failed (threshold=3) [..........X................X......X................X.XX.....] duration:
5.642153069s trace:
https://jaeger.dev.storj.io/trace/4b8279b5ad6b657
FAIL (2025-12-09 00:03:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.64218032s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [........................X...............................X...] duration:
485.86055ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7fc0ad6d99ae5735
FAIL (2025-12-09 00:02:55 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 485.888513ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.043120101s trace:
https://jaeger.dev.storj.io/trace/6a17c2831ae76153
FAIL (2025-12-09 00:02:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 23:22:58.638987633 (79h53m58.510070678s) [upload=69799]: Starting upload Dec 8 23:22:58.639070963 (79h53m58.510154008s) [upload=69799]: Done starting upload Dec 8 23:22:58.639157306 (79h53m58.510240352s) [upload=69799]: Uploading segments... Dec 8 23:22:58.639261395 (79h53m58.51034445s) [upload=69799]: Got next segment. Inline: true Dec 8 23:22:58.639269269 (79h53m58.510352315s) [upload=69799]: Waiting for error group managing segments... Dec 8 23:22:58.639355735 (79h53m58.51043878s) [upload=69799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Dec 8 23:22:58.639362948 (79h53m58.510446013s) [upload=69799]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Dec 8 23:22:58.639367427 (79h53m58.510450482s) [upload=69799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Dec 8 23:23:57.956567374 (79h54m57.827650409s) [upload=69799]: Done uploading segments... Dec 8 23:23:57.956606829 (79h54m57.827689864s) [upload=69799]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.043150108s
core
uplink
us-select-1
us1-placement-20
|