Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.947764268s trace:
https://jaeger.dev.storj.io/trace/7af423d6c79d8a0d
FAIL (2025-12-09 17:52:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 17:47:30.974333076 (98h18m30.845416121s) [upload=85663]: Starting upload Dec 9 17:47:30.974452103 (98h18m30.845535148s) [upload=85663]: Done starting upload Dec 9 17:47:30.974488442 (98h18m30.845571477s) [upload=85663]: Uploading segments... Dec 9 17:47:30.974578313 (98h18m30.845661368s) [upload=85663]: Got next segment. Inline: true Dec 9 17:47:30.974586618 (98h18m30.845669664s) [upload=85663]: Waiting for error group managing segments... Dec 9 17:47:30.974682862 (98h18m30.845765907s) [upload=85663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Dec 9 17:47:30.974690286 (98h18m30.845773331s) [upload=85663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Dec 9 17:47:30.974696949 (98h18m30.845779984s) [upload=85663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Dec 9 17:48:00.285334300 (98h19m0.156417345s) [upload=85663]: Done uploading segments... Dec 9 17:48:00.285375097 (98h19m0.156458142s) [upload=85663]: Upload finished. err: metaclient: context deadline exceeded
Duration: 1.947794685s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
690.022694ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/2156f88bf599b88f
FAIL (2025-12-09 17:52:20 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 690.055757ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [...................X....................X...................] duration:
467.91543ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/3a6ea2dab1326177
FAIL (2025-12-09 17:52:09 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 467.966287ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
5.081356071s trace:
https://jaeger.dev.storj.io/trace/4ad49e973284a474
FAIL (2025-12-09 17:52:07 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.08139243s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
5.824917671s trace:
https://jaeger.dev.storj.io/trace/3c39d1f5097bde09
FAIL (2025-12-09 17:52:01 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.824979679s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
5.814022815s trace:
https://jaeger.dev.storj.io/trace/3c39d1f5097bde09
FAIL (2025-12-09 17:51:26 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.814058313s
core
uplink
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
689.718745ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/2156f88bf599b88f
FAIL (2025-12-09 17:51:26 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 689.750416ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.023182513s trace:
https://jaeger.dev.storj.io/trace/7af423d6c79d8a0d
FAIL (2025-12-09 17:51:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 17:47:30.974333076 (98h18m30.845416121s) [upload=85663]: Starting upload Dec 9 17:47:30.974452103 (98h18m30.845535148s) [upload=85663]: Done starting upload Dec 9 17:47:30.974488442 (98h18m30.845571477s) [upload=85663]: Uploading segments... Dec 9 17:47:30.974578313 (98h18m30.845661368s) [upload=85663]: Got next segment. Inline: true Dec 9 17:47:30.974586618 (98h18m30.845669664s) [upload=85663]: Waiting for error group managing segments... Dec 9 17:47:30.974682862 (98h18m30.845765907s) [upload=85663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Dec 9 17:47:30.974690286 (98h18m30.845773331s) [upload=85663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Dec 9 17:47:30.974696949 (98h18m30.845779984s) [upload=85663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Dec 9 17:48:00.285334300 (98h19m0.156417345s) [upload=85663]: Done uploading segments... Dec 9 17:48:00.285375097 (98h19m0.156458142s) [upload=85663]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.023210575s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............X.............................................] duration:
3.577375027s trace:
https://jaeger.dev.storj.io/trace/5eaee7c2c5345982
FAIL (2025-12-09 17:51:22 UTC)
orbiter warning: context deadline exceeded
Duration: 3.577697412s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [....................X....................X..................] duration:
670.622783ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/3a6ea2dab1326177
FAIL (2025-12-09 17:51:16 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 670.656316ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
694.732383ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/2156f88bf599b88f
FAIL (2025-12-09 17:51:06 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 694.759605ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
5.039817402s trace:
https://jaeger.dev.storj.io/trace/4ad49e973284a474
FAIL (2025-12-09 17:51:05 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.039847198s
core
uplink
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............X............................................] duration:
3.622843763s trace:
https://jaeger.dev.storj.io/trace/5eaee7c2c5345982
FAIL (2025-12-09 17:50:45 UTC)
orbiter warning: context deadline exceeded
Duration: 3.622872007s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [.....................X....................X.................] duration:
469.588194ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/3a6ea2dab1326177
FAIL (2025-12-09 17:50:42 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 469.619755ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
5.753068949s trace:
https://jaeger.dev.storj.io/trace/3c39d1f5097bde09
FAIL (2025-12-09 17:50:36 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.753099967s
core
uplink
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
693.14525ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/2156f88bf599b88f
FAIL (2025-12-09 17:50:23 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 693.175367ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
4.805294724s trace:
https://jaeger.dev.storj.io/trace/4ad49e973284a474
FAIL (2025-12-09 17:50:14 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 4.805340981s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.961107488s trace:
https://jaeger.dev.storj.io/trace/7af423d6c79d8a0d
FAIL (2025-12-09 17:50:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 17:47:30.974333076 (98h18m30.845416121s) [upload=85663]: Starting upload Dec 9 17:47:30.974452103 (98h18m30.845535148s) [upload=85663]: Done starting upload Dec 9 17:47:30.974488442 (98h18m30.845571477s) [upload=85663]: Uploading segments... Dec 9 17:47:30.974578313 (98h18m30.845661368s) [upload=85663]: Got next segment. Inline: true Dec 9 17:47:30.974586618 (98h18m30.845669664s) [upload=85663]: Waiting for error group managing segments... Dec 9 17:47:30.974682862 (98h18m30.845765907s) [upload=85663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Dec 9 17:47:30.974690286 (98h18m30.845773331s) [upload=85663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Dec 9 17:47:30.974696949 (98h18m30.845779984s) [upload=85663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Dec 9 17:48:00.285334300 (98h19m0.156417345s) [upload=85663]: Done uploading segments... Dec 9 17:48:00.285375097 (98h19m0.156458142s) [upload=85663]: Upload finished. err: metaclient: context deadline exceeded
Duration: 1.961136883s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................X...........................................] duration:
3.732328928s trace:
https://jaeger.dev.storj.io/trace/5eaee7c2c5345982
FAIL (2025-12-09 17:50:07 UTC)
orbiter warning: context deadline exceeded
Duration: 3.73236807s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [......................X....................X................] duration:
473.098299ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/3a6ea2dab1326177
FAIL (2025-12-09 17:50:00 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 473.132552ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
5.663725974s trace:
https://jaeger.dev.storj.io/trace/3c39d1f5097bde09
FAIL (2025-12-09 17:49:40 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.66375616s
core
uplink
us1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [.......................X....................X...............] duration:
476.154598ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/3a6ea2dab1326177
FAIL (2025-12-09 17:49:40 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 476.183283ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
4.859795165s trace:
https://jaeger.dev.storj.io/trace/4ad49e973284a474
FAIL (2025-12-09 17:49:28 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 4.859825983s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
704.558234ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/2156f88bf599b88f
FAIL (2025-12-09 17:49:17 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 704.587771ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
1.974051796s trace:
https://jaeger.dev.storj.io/trace/7af423d6c79d8a0d
FAIL (2025-12-09 17:49:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 17:47:30.974333076 (98h18m30.845416121s) [upload=85663]: Starting upload Dec 9 17:47:30.974452103 (98h18m30.845535148s) [upload=85663]: Done starting upload Dec 9 17:47:30.974488442 (98h18m30.845571477s) [upload=85663]: Uploading segments... Dec 9 17:47:30.974578313 (98h18m30.845661368s) [upload=85663]: Got next segment. Inline: true Dec 9 17:47:30.974586618 (98h18m30.845669664s) [upload=85663]: Waiting for error group managing segments... Dec 9 17:47:30.974682862 (98h18m30.845765907s) [upload=85663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Dec 9 17:47:30.974690286 (98h18m30.845773331s) [upload=85663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Dec 9 17:47:30.974696949 (98h18m30.845779984s) [upload=85663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Dec 9 17:48:00.285334300 (98h19m0.156417345s) [upload=85663]: Done uploading segments... Dec 9 17:48:00.285375097 (98h19m0.156458142s) [upload=85663]: Upload finished. err: metaclient: context deadline exceeded
Duration: 1.974079668s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................X..........................................] duration:
3.538125987s trace:
https://jaeger.dev.storj.io/trace/5eaee7c2c5345982
FAIL (2025-12-09 17:48:55 UTC)
orbiter warning: context deadline exceeded
Duration: 3.538152497s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [........................X....................X..............] duration:
477.094139ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/3a6ea2dab1326177
FAIL (2025-12-09 17:48:45 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 477.127304ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
5.950149315s trace:
https://jaeger.dev.storj.io/trace/3c39d1f5097bde09
FAIL (2025-12-09 17:48:32 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.950185685s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
4.922060815s trace:
https://jaeger.dev.storj.io/trace/4ad49e973284a474
FAIL (2025-12-09 17:48:19 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 4.922115518s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
699.810583ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/2156f88bf599b88f
FAIL (2025-12-09 17:48:12 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 699.828076ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.014000409s trace:
https://jaeger.dev.storj.io/trace/7af423d6c79d8a0d
FAIL (2025-12-09 17:48:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 17:47:30.974333076 (98h18m30.845416121s) [upload=85663]: Starting upload Dec 9 17:47:30.974452103 (98h18m30.845535148s) [upload=85663]: Done starting upload Dec 9 17:47:30.974488442 (98h18m30.845571477s) [upload=85663]: Uploading segments... Dec 9 17:47:30.974578313 (98h18m30.845661368s) [upload=85663]: Got next segment. Inline: true Dec 9 17:47:30.974586618 (98h18m30.845669664s) [upload=85663]: Waiting for error group managing segments... Dec 9 17:47:30.974682862 (98h18m30.845765907s) [upload=85663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Dec 9 17:47:30.974690286 (98h18m30.845773331s) [upload=85663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Dec 9 17:47:30.974696949 (98h18m30.845779984s) [upload=85663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Dec 9 17:48:00.285334300 (98h19m0.156417345s) [upload=85663]: Done uploading segments... Dec 9 17:48:00.285375097 (98h19m0.156458142s) [upload=85663]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.014030515s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [.........................X....................X.............] duration:
480.335832ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/3a6ea2dab1326177
FAIL (2025-12-09 17:48:02 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 480.359096ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000787057s trace:
https://jaeger.dev.storj.io/trace/7af423d6c79d8a0d
FAIL (2025-12-09 17:48:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 9 17:47:30.974333076 (98h18m30.845416121s) [upload=85663]: Starting upload Dec 9 17:47:30.974452103 (98h18m30.845535148s) [upload=85663]: Done starting upload Dec 9 17:47:30.974488442 (98h18m30.845571477s) [upload=85663]: Uploading segments... Dec 9 17:47:30.974578313 (98h18m30.845661368s) [upload=85663]: Got next segment. Inline: true Dec 9 17:47:30.974586618 (98h18m30.845669664s) [upload=85663]: Waiting for error group managing segments... Dec 9 17:47:30.974682862 (98h18m30.845765907s) [upload=85663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Dec 9 17:47:30.974690286 (98h18m30.845773331s) [upload=85663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Dec 9 17:47:30.974696949 (98h18m30.845779984s) [upload=85663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Dec 9 17:48:00.285334300 (98h19m0.156417345s) [upload=85663]: Done uploading segments... Dec 9 17:48:00.285375097 (98h19m0.156458142s) [upload=85663]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.00080965s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................X.........................................] duration:
3.596869631s trace:
https://jaeger.dev.storj.io/trace/5eaee7c2c5345982
FAIL (2025-12-09 17:47:51 UTC)
orbiter warning: context deadline exceeded
Duration: 3.596904037s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
4.916735204s trace:
https://jaeger.dev.storj.io/trace/4ad49e973284a474
FAIL (2025-12-09 17:47:47 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 4.916764539s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
2 out of 60 is failed (threshold=3) [X.......................X...................................] duration:
5.864148391s trace:
https://jaeger.dev.storj.io/trace/3c39d1f5097bde09
FAIL (2025-12-09 17:47:34 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.864172276s
core
uplink
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
690.45148ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/2156f88bf599b88f
FAIL (2025-12-09 17:47:34 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 690.473664ms
core
satellite
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................X........................................] duration:
3.651761377s trace:
https://jaeger.dev.storj.io/trace/5eaee7c2c5345982
FAIL (2025-12-09 17:47:23 UTC)
orbiter warning: context deadline exceeded
Duration: 3.651785632s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [..........................X....................X............] duration:
475.45027ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/3a6ea2dab1326177
FAIL (2025-12-09 17:47:16 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 475.483523ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
4.859307328s trace:
https://jaeger.dev.storj.io/trace/4ad49e973284a474
FAIL (2025-12-09 17:47:13 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 4.859421695s
core
uplink
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................X.......................................] duration:
3.473440875s trace:
https://jaeger.dev.storj.io/trace/5eaee7c2c5345982
FAIL (2025-12-09 17:47:01 UTC)
orbiter warning: context deadline exceeded
Duration: 3.47346993s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
5.10166609s trace:
https://jaeger.dev.storj.io/trace/4ad49e973284a474
FAIL (2025-12-09 17:46:52 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.10169696s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X.......................X..................................] duration:
5.703247361s trace:
https://jaeger.dev.storj.io/trace/3c39d1f5097bde09
FAIL (2025-12-09 17:46:51 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.703276206s
core
uplink
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
692.279812ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/2156f88bf599b88f
FAIL (2025-12-09 17:46:50 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 692.310942ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [...........................X....................X...........] duration:
4.012804739s remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/3a6ea2dab1326177
FAIL (2025-12-09 17:46:32 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 4.012833614s
core
satellite
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................X......................................] duration:
3.403463732s trace:
https://jaeger.dev.storj.io/trace/5eaee7c2c5345982
FAIL (2025-12-09 17:46:17 UTC)
orbiter warning: context deadline exceeded
Duration: 3.403488267s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
686.215084ms remote:
"tcp:35.212.10.183:443" target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/2156f88bf599b88f
FAIL (2025-12-09 17:46:14 UTC)
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 686.245141ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
3 out of 60 is failed (threshold=3) [X.X.......................X.................................] duration:
5.959132981s trace:
https://jaeger.dev.storj.io/trace/3c39d1f5097bde09
FAIL (2025-12-09 17:46:10 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.959170312s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
5.059935834s trace:
https://jaeger.dev.storj.io/trace/4ad49e973284a474
FAIL (2025-12-09 17:46:06 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.059970099s
core
uplink
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................X.....................................] duration:
3.559018133s trace:
https://jaeger.dev.storj.io/trace/5eaee7c2c5345982
FAIL (2025-12-09 17:45:45 UTC)
orbiter warning: context deadline exceeded
Duration: 3.559051498s
core
uplink
us-select-1
us1-placement-20
|