Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 866712 reports (Page 11660 of 17335)
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration:
2.954349021s
trace:
https://jaeger.dev.storj.io/trace/2744e7e74333fadd
FAIL (2025-12-09 01:05:12 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout
Duration: 2.954376191s edge authservice http bgp eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
10 out of 60 is failed (threshold=6) [...............XX................X.........X.X...X.X.X....XX]
duration:
5.001549922s
trace:
https://jaeger.dev.storj.io/trace/24b38e2e3305fb54
FAIL (2025-12-09 01:05:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001572976s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
2 out of 60 is failed (threshold=3) [...............XX...........................................]
duration:
273.740576ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/45c08147c7083bce
FAIL (2025-12-09 01:05:06 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp 207.211.208.129:443: i/o timeout
Duration: 273.811301ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................]
duration:
47.927342ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/d6823dba42570ec
FAIL (2025-12-09 01:04:57 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp 207.211.208.129:443: i/o timeout
Duration: 47.955244ms edge gateway vhost bgp ap1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
2 out of 60 is failed (threshold=3) [..................X.....................................X...]
duration:
6.019143986s
trace:
https://jaeger.dev.storj.io/trace/4af262587d92cfcb
FAIL (2025-12-09 01:04:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.019169985s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)
antiblip:
1 out of 60 is failed (threshold=6) [.................X..........................................]
duration:
239.97513ms
target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
trace:
https://jaeger.dev.storj.io/trace/200ebca2a36ec82e
FAIL (2025-12-09 01:04:55 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 240.006942ms edge linksharing bgp eu1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................]
duration:
2.122074354s
trace:
https://jaeger.dev.storj.io/trace/39dda67c5a7ef46d
FAIL (2025-12-09 01:04:52 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout
Duration: 2.122100613s edge authservice http bgp us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..............................X..X..........................]
duration:
5.529601836s
trace:
https://jaeger.dev.storj.io/trace/44eba3f11f79732e
FAIL (2025-12-09 01:04:48 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 5.529627305s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................]
duration:
482.340547ms
remote:
"tcp:35.207.121.91:443"
target:
https://eu1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/6b1ae90bcdd087c7
FAIL (2025-12-09 01:04:47 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 482.362289ms core satellite eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................]
duration:
253.885876ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/64025b92da229a61
FAIL (2025-12-09 01:04:38 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp 207.211.208.129:443: i/o timeout
Duration: 253.909461ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)
antiblip:
1 out of 60 is failed (threshold=6) [..................X.........................................]
duration:
246.608709ms
target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
trace:
https://jaeger.dev.storj.io/trace/200ebca2a36ec82e
FAIL (2025-12-09 01:04:35 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 246.749809ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)
antiblip:
1 out of 60 is failed (threshold=6) [..................X.........................................]
duration:
27.732768ms
target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
trace:
https://jaeger.dev.storj.io/trace/af91489e18f8dd7
FAIL (2025-12-09 01:04:26 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 27.751163ms edge linksharing bgp ap1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
2 out of 60 is failed (threshold=3) [...................X.....................................X..]
duration:
5.606265538s
trace:
https://jaeger.dev.storj.io/trace/4af262587d92cfcb
FAIL (2025-12-09 01:04:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.606289774s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................]
duration:
1.158369655s
trace:
https://jaeger.dev.storj.io/trace/39dda67c5a7ef46d
FAIL (2025-12-09 01:04:20 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout
Duration: 1.158400795s edge authservice http bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
2 out of 60 is failed (threshold=3) [................XX..........................................]
duration:
268.079332ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/45c08147c7083bce
FAIL (2025-12-09 01:04:19 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp 207.211.208.129:443: i/o timeout
Duration: 268.098388ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................]
duration:
5.687639037s
trace:
https://jaeger.dev.storj.io/trace/16f5f0214b7e09da
FAIL (2025-12-09 01:04:16 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
A, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.056163163 (81h17m12.927246198s) [noise=true , address=77.90.31.10:4535     , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.057949975 (81h17m12.92903305s) [noise=true , address=45.91.116.12:4254    , piece_id=V6Z3FY3IX4ZMXDSQWYJD7XRSHH7TF5PO3O2WGAP37H5QWR23ZVAQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.059319273 (81h17m12.930402308s) [noise=true , address=45.91.116.4:4956     , piece_id=QQ6LRHTMTGEBHNUH3HX545OSX2D4W57ZJH2HE4ULX3TSRZKCSJWQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.059492453 (81h17m12.930575498s) [noise=true , address=145.79.227.33:4874   , piece_id=4FSL6J7KRQIXTAC2R7T5SDHYMSFGLFL3SUBLFOYYRZM47V3G73OQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.059829985 (81h17m12.93091303s) [noise=true , address=77.90.31.16:4738     , piece_id=TCG6E2SKWNQ3R23XJEJG45H4WKPYHFH57SM3JLFMNXDI455T5D5A, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.060311452 (81h17m12.931394507s) [noise=true , address=145.79.227.24:4584   , piece_id=I2P5HMRRE234SLOKTQTBRXC5BJDACGFSZ4C3QDIM3R7H7VOLAR6Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.060638766 (81h17m12.931721801s) [noise=true , address=45.91.116.13:4187    , piece_id=TZEUTEYC4MWHZPOILSHTWPLNAQWKVNEM4JYGOYM54TOIH6MES2WA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.061436635 (81h17m12.93251967s) [noise=true , address=45.91.116.5:4327     , piece_id=M55GD6NYM7XLFPX2PWUZBJTKBCIID63SDCRTAINR4K3QXHQ7VFWA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.062205830 (81h17m12.933288875s) [noise=true , address=5.231.73.4:4003      , piece_id=4K3ONY56R3TZYJZI5OJ4ADJXUALZPTHP236QDFDRNZUNI3LRIADA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.063000051 (81h17m12.934083086s) [noise=true , address=77.90.31.13:4639     , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.063836003 (81h17m12.934919058s) [noise=true , address=64.49.13.154:4934    , piece_id=6TISGSS4P6CP6FJL7DFWUXYT5X6KQJ4OYHSIZGSMQV4RZMFTGU4A, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.064692454 (81h17m12.935775499s) [noise=true , address=45.91.116.11:4147    , piece_id=Z5BCQU3TM45AVD4KSHQ74AFDEBMALRUD3PXQPQEV54CBLYL3TR3Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.064959161 (81h17m12.936042216s) [noise=true , address=145.79.227.30:4783   , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.066239960 (81h17m12.937323015s) [noise=true , address=45.91.116.8:4065     , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.066383043 (81h17m12.937466108s) [noise=true , address=77.90.31.10:4534     , piece_id=I267OI6FD4ZA354UR7JZNXZBIYR6HJ44IPX2AHV2CQRO5RYBHFHQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.067300530 (81h17m12.938383575s) [noise=true , address=64.49.13.155:4914    , piece_id=IWMWBIGHFIMSSDWLUNLPW635SUZYL5QUXBBDVT4Q7POXKUW4WJ5Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.067455816 (81h17m12.938538861s) [noise=true , address=45.91.116.6:4983     , piece_id=UWFWT4HF5IFO25OED2UEZSFHFV7TZBSTUETBC2LQ7EUQLG4SUD2Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:14.495330055 (81h17m14.36641309s) [upload=71023]: Next returned nil segment
Dec  9 00:46:14.495350613 (81h17m14.366433688s) [upload=71023]: Waiting for error group managing segments...
Dec  9 00:46:14.883721607 (81h17m14.754804652s) [noise=true , address=64.49.13.155:4914    , piece_id=IWMWBIGHFIMSSDWLUNLPW635SUZYL5QUXBBDVT4Q7POXKUW4WJ5Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:14.929183823 (81h17m14.800266868s) [noise=true , address=145.79.227.24:4584   , piece_id=I2P5HMRRE234SLOKTQTBRXC5BJDACGFSZ4C3QDIM3R7H7VOLAR6Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:14.941170366 (81h17m14.812253411s) [noise=true , address=145.79.227.33:4874   , piece_id=4FSL6J7KRQIXTAC2R7T5SDHYMSFGLFL3SUBLFOYYRZM47V3G73OQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:14.959305788 (81h17m14.830388833s) [noise=true , address=64.49.13.154:4934    , piece_id=6TISGSS4P6CP6FJL7DFWUXYT5X6KQJ4OYHSIZGSMQV4RZMFTGU4A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.028943597 (81h17m14.900026632s) [noise=true , address=5.231.73.4:4003      , piece_id=4K3ONY56R3TZYJZI5OJ4ADJXUALZPTHP236QDFDRNZUNI3LRIADA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.033566479 (81h17m14.904649514s) [noise=true , address=77.90.31.16:4738     , piece_id=TCG6E2SKWNQ3R23XJEJG45H4WKPYHFH57SM3JLFMNXDI455T5D5A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.059529566 (81h17m14.930612611s) [noise=true , address=77.90.31.17:4789     , piece_id=22ZFVENBTZP7MWLLHV5HSP7QESSI4P3W67O2YZ4EOUEP4GAGVD5A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.065748207 (81h17m14.936831242s) [noise=true , address=45.91.116.4:4956     , piece_id=QQ6LRHTMTGEBHNUH3HX545OSX2D4W57ZJH2HE4ULX3TSRZKCSJWQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.072515793 (81h17m14.943598828s) [noise=true , address=77.90.31.10:4534     , piece_id=I267OI6FD4ZA354UR7JZNXZBIYR6HJ44IPX2AHV2CQRO5RYBHFHQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.073404145 (81h17m14.94448718s) [noise=true , address=45.91.116.5:4327     , piece_id=M55GD6NYM7XLFPX2PWUZBJTKBCIID63SDCRTAINR4K3QXHQ7VFWA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.104276279 (81h17m14.975359324s) [noise=true , address=45.91.116.11:4147    , piece_id=Z5BCQU3TM45AVD4KSHQ74AFDEBMALRUD3PXQPQEV54CBLYL3TR3Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.104945043 (81h17m14.976028098s) [noise=true , address=45.91.116.13:4187    , piece_id=TZEUTEYC4MWHZPOILSHTWPLNAQWKVNEM4JYGOYM54TOIH6MES2WA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.112208182 (81h17m14.983291217s) [noise=true , address=45.91.116.6:4983     , piece_id=UWFWT4HF5IFO25OED2UEZSFHFV7TZBSTUETBC2LQ7EUQLG4SUD2Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.115153711 (81h17m14.986236756s) [noise=true , address=45.91.116.12:4254    , piece_id=V6Z3FY3IX4ZMXDSQWYJD7XRSHH7TF5PO3O2WGAP37H5QWR23ZVAQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.115171264 (81h17m14.986254309s) [seg_pos={0 0}, upload=71023]: Segment reached optimal threshold of 14 pieces.
Dec  9 00:46:15.115426842 (81h17m14.986509887s) [noise=true , address=145.79.227.30:4783   , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNMd8YrgaagKDoWivhbTmRc5TPM6BNiHscECBF2yhncKgkvz): protocol: expected piece hash; context canceled; EOF
Dec  9 00:46:15.115435798 (81h17m14.986518843s) [noise=true , address=145.79.227.30:4783   , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec  9 00:46:15.115498558 (81h17m14.986581613s) [noise=true , address=77.90.31.13:4639     , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N9N1pcaVn3nPh1WY7uktz8Z7fwJGqnTdVwZMAW5SVrqvRA8VV): protocol: expected piece hash; context canceled; EOF
Dec  9 00:46:15.115517804 (81h17m14.986600859s) [noise=true , address=77.90.31.13:4639     , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec  9 00:46:15.115593578 (81h17m14.986676623s) [noise=true , address=77.90.31.10:4535     , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz): protocol: expected piece hash; context canceled; EOF
Dec  9 00:46:15.115631711 (81h17m14.986714766s) [noise=true , address=77.90.31.10:4535     , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec  9 00:46:15.115853494 (81h17m14.986936539s) [noise=true , address=45.91.116.8:4065     , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EPCQmYb816aegE9vPSoJYByMUEvhP4DUiabis2gh9QjXQC3s): protocol: expected piece hash; context canceled; EOF
Dec  9 00:46:15.115862621 (81h17m14.986945676s) [noise=true , address=45.91.116.8:4065     , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec  9 00:46:15.115922986 (81h17m14.987006031s) [seg_pos={0 0}, upload=71023]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec  9 00:46:15.116025181 (81h17m14.987108226s) [upload=71023]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:46:15.116032685 (81h17m14.98711573s) [upload=71023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:47:25.980830692 (81h18m25.851913727s) [upload=71023]: Done uploading segments...
Dec  9 00:47:25.980980237 (81h18m25.852063282s) [upload=71023]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.687663783s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration:
249.131824ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/64025b92da229a61
FAIL (2025-12-09 01:04:11 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp 207.211.208.129:443: i/o timeout
Duration: 249.162431ms edge gateway vhost bgp eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
9 out of 60 is failed (threshold=6) [................XX................X.........X.X...X.X.X....X]
duration:
5.00101356s
trace:
https://jaeger.dev.storj.io/trace/486b085e536ef5ac
FAIL (2025-12-09 01:04:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001041053s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)
antiblip:
1 out of 60 is failed (threshold=6) [............X...............................................]
duration:
266.359158ms
target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt
trace:
https://jaeger.dev.storj.io/trace/dd0fa7a1ae6bdc0
FAIL (2025-12-09 01:04:04 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 266.393753ms edge linksharing bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration:
29.088418ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/d6823dba42570ec
FAIL (2025-12-09 01:04:03 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp 207.211.208.129:443: i/o timeout
Duration: 29.123305ms edge gateway vhost bgp ap1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration:
1.129481297s
trace:
https://jaeger.dev.storj.io/trace/2744e7e74333fadd
FAIL (2025-12-09 01:04:03 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout
Duration: 1.129512807s edge authservice http bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)
antiblip:
1 out of 60 is failed (threshold=6) [...................X........................................]
duration:
248.693337ms
target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
trace:
https://jaeger.dev.storj.io/trace/200ebca2a36ec82e
FAIL (2025-12-09 01:03:58 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 248.724327ms edge linksharing bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration:
5.736504212s
trace:
https://jaeger.dev.storj.io/trace/16f5f0214b7e09da
FAIL (2025-12-09 01:03:50 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
A, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.056163163 (81h17m12.927246198s) [noise=true , address=77.90.31.10:4535     , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.057949975 (81h17m12.92903305s) [noise=true , address=45.91.116.12:4254    , piece_id=V6Z3FY3IX4ZMXDSQWYJD7XRSHH7TF5PO3O2WGAP37H5QWR23ZVAQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.059319273 (81h17m12.930402308s) [noise=true , address=45.91.116.4:4956     , piece_id=QQ6LRHTMTGEBHNUH3HX545OSX2D4W57ZJH2HE4ULX3TSRZKCSJWQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.059492453 (81h17m12.930575498s) [noise=true , address=145.79.227.33:4874   , piece_id=4FSL6J7KRQIXTAC2R7T5SDHYMSFGLFL3SUBLFOYYRZM47V3G73OQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.059829985 (81h17m12.93091303s) [noise=true , address=77.90.31.16:4738     , piece_id=TCG6E2SKWNQ3R23XJEJG45H4WKPYHFH57SM3JLFMNXDI455T5D5A, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.060311452 (81h17m12.931394507s) [noise=true , address=145.79.227.24:4584   , piece_id=I2P5HMRRE234SLOKTQTBRXC5BJDACGFSZ4C3QDIM3R7H7VOLAR6Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.060638766 (81h17m12.931721801s) [noise=true , address=45.91.116.13:4187    , piece_id=TZEUTEYC4MWHZPOILSHTWPLNAQWKVNEM4JYGOYM54TOIH6MES2WA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.061436635 (81h17m12.93251967s) [noise=true , address=45.91.116.5:4327     , piece_id=M55GD6NYM7XLFPX2PWUZBJTKBCIID63SDCRTAINR4K3QXHQ7VFWA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.062205830 (81h17m12.933288875s) [noise=true , address=5.231.73.4:4003      , piece_id=4K3ONY56R3TZYJZI5OJ4ADJXUALZPTHP236QDFDRNZUNI3LRIADA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.063000051 (81h17m12.934083086s) [noise=true , address=77.90.31.13:4639     , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.063836003 (81h17m12.934919058s) [noise=true , address=64.49.13.154:4934    , piece_id=6TISGSS4P6CP6FJL7DFWUXYT5X6KQJ4OYHSIZGSMQV4RZMFTGU4A, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.064692454 (81h17m12.935775499s) [noise=true , address=45.91.116.11:4147    , piece_id=Z5BCQU3TM45AVD4KSHQ74AFDEBMALRUD3PXQPQEV54CBLYL3TR3Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.064959161 (81h17m12.936042216s) [noise=true , address=145.79.227.30:4783   , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.066239960 (81h17m12.937323015s) [noise=true , address=45.91.116.8:4065     , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.066383043 (81h17m12.937466108s) [noise=true , address=77.90.31.10:4534     , piece_id=I267OI6FD4ZA354UR7JZNXZBIYR6HJ44IPX2AHV2CQRO5RYBHFHQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.067300530 (81h17m12.938383575s) [noise=true , address=64.49.13.155:4914    , piece_id=IWMWBIGHFIMSSDWLUNLPW635SUZYL5QUXBBDVT4Q7POXKUW4WJ5Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.067455816 (81h17m12.938538861s) [noise=true , address=45.91.116.6:4983     , piece_id=UWFWT4HF5IFO25OED2UEZSFHFV7TZBSTUETBC2LQ7EUQLG4SUD2Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:14.495330055 (81h17m14.36641309s) [upload=71023]: Next returned nil segment
Dec  9 00:46:14.495350613 (81h17m14.366433688s) [upload=71023]: Waiting for error group managing segments...
Dec  9 00:46:14.883721607 (81h17m14.754804652s) [noise=true , address=64.49.13.155:4914    , piece_id=IWMWBIGHFIMSSDWLUNLPW635SUZYL5QUXBBDVT4Q7POXKUW4WJ5Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:14.929183823 (81h17m14.800266868s) [noise=true , address=145.79.227.24:4584   , piece_id=I2P5HMRRE234SLOKTQTBRXC5BJDACGFSZ4C3QDIM3R7H7VOLAR6Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:14.941170366 (81h17m14.812253411s) [noise=true , address=145.79.227.33:4874   , piece_id=4FSL6J7KRQIXTAC2R7T5SDHYMSFGLFL3SUBLFOYYRZM47V3G73OQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:14.959305788 (81h17m14.830388833s) [noise=true , address=64.49.13.154:4934    , piece_id=6TISGSS4P6CP6FJL7DFWUXYT5X6KQJ4OYHSIZGSMQV4RZMFTGU4A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.028943597 (81h17m14.900026632s) [noise=true , address=5.231.73.4:4003      , piece_id=4K3ONY56R3TZYJZI5OJ4ADJXUALZPTHP236QDFDRNZUNI3LRIADA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.033566479 (81h17m14.904649514s) [noise=true , address=77.90.31.16:4738     , piece_id=TCG6E2SKWNQ3R23XJEJG45H4WKPYHFH57SM3JLFMNXDI455T5D5A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.059529566 (81h17m14.930612611s) [noise=true , address=77.90.31.17:4789     , piece_id=22ZFVENBTZP7MWLLHV5HSP7QESSI4P3W67O2YZ4EOUEP4GAGVD5A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.065748207 (81h17m14.936831242s) [noise=true , address=45.91.116.4:4956     , piece_id=QQ6LRHTMTGEBHNUH3HX545OSX2D4W57ZJH2HE4ULX3TSRZKCSJWQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.072515793 (81h17m14.943598828s) [noise=true , address=77.90.31.10:4534     , piece_id=I267OI6FD4ZA354UR7JZNXZBIYR6HJ44IPX2AHV2CQRO5RYBHFHQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.073404145 (81h17m14.94448718s) [noise=true , address=45.91.116.5:4327     , piece_id=M55GD6NYM7XLFPX2PWUZBJTKBCIID63SDCRTAINR4K3QXHQ7VFWA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.104276279 (81h17m14.975359324s) [noise=true , address=45.91.116.11:4147    , piece_id=Z5BCQU3TM45AVD4KSHQ74AFDEBMALRUD3PXQPQEV54CBLYL3TR3Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.104945043 (81h17m14.976028098s) [noise=true , address=45.91.116.13:4187    , piece_id=TZEUTEYC4MWHZPOILSHTWPLNAQWKVNEM4JYGOYM54TOIH6MES2WA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.112208182 (81h17m14.983291217s) [noise=true , address=45.91.116.6:4983     , piece_id=UWFWT4HF5IFO25OED2UEZSFHFV7TZBSTUETBC2LQ7EUQLG4SUD2Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.115153711 (81h17m14.986236756s) [noise=true , address=45.91.116.12:4254    , piece_id=V6Z3FY3IX4ZMXDSQWYJD7XRSHH7TF5PO3O2WGAP37H5QWR23ZVAQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.115171264 (81h17m14.986254309s) [seg_pos={0 0}, upload=71023]: Segment reached optimal threshold of 14 pieces.
Dec  9 00:46:15.115426842 (81h17m14.986509887s) [noise=true , address=145.79.227.30:4783   , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNMd8YrgaagKDoWivhbTmRc5TPM6BNiHscECBF2yhncKgkvz): protocol: expected piece hash; context canceled; EOF
Dec  9 00:46:15.115435798 (81h17m14.986518843s) [noise=true , address=145.79.227.30:4783   , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec  9 00:46:15.115498558 (81h17m14.986581613s) [noise=true , address=77.90.31.13:4639     , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N9N1pcaVn3nPh1WY7uktz8Z7fwJGqnTdVwZMAW5SVrqvRA8VV): protocol: expected piece hash; context canceled; EOF
Dec  9 00:46:15.115517804 (81h17m14.986600859s) [noise=true , address=77.90.31.13:4639     , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec  9 00:46:15.115593578 (81h17m14.986676623s) [noise=true , address=77.90.31.10:4535     , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz): protocol: expected piece hash; context canceled; EOF
Dec  9 00:46:15.115631711 (81h17m14.986714766s) [noise=true , address=77.90.31.10:4535     , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec  9 00:46:15.115853494 (81h17m14.986936539s) [noise=true , address=45.91.116.8:4065     , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EPCQmYb816aegE9vPSoJYByMUEvhP4DUiabis2gh9QjXQC3s): protocol: expected piece hash; context canceled; EOF
Dec  9 00:46:15.115862621 (81h17m14.986945676s) [noise=true , address=45.91.116.8:4065     , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec  9 00:46:15.115922986 (81h17m14.987006031s) [seg_pos={0 0}, upload=71023]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec  9 00:46:15.116025181 (81h17m14.987108226s) [upload=71023]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:46:15.116032685 (81h17m14.98711573s) [upload=71023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:47:25.980830692 (81h18m25.851913727s) [upload=71023]: Done uploading segments...
Dec  9 00:47:25.980980237 (81h18m25.852063282s) [upload=71023]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.736534859s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................]
duration:
484.179347ms
remote:
"tcp:35.207.121.91:443"
target:
https://eu1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/6b1ae90bcdd087c7
FAIL (2025-12-09 01:03:46 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 484.203815ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [...............................X..X.........................]
duration:
5.388148291s
trace:
https://jaeger.dev.storj.io/trace/44eba3f11f79732e
FAIL (2025-12-09 01:03:39 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 5.388178288s core uplink eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
2 out of 60 is failed (threshold=3) [.................XX.........................................]
duration:
268.027403ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/45c08147c7083bce
FAIL (2025-12-09 01:03:38 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp 207.211.208.129:443: i/o timeout
Duration: 268.054134ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)
antiblip:
1 out of 60 is failed (threshold=6) [...................X........................................]
duration:
23.95272ms
target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
trace:
https://jaeger.dev.storj.io/trace/af91489e18f8dd7
FAIL (2025-12-09 01:03:37 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 23.9899ms edge linksharing bgp ap1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
2 out of 60 is failed (threshold=3) [....................X.....................................X.]
duration:
5.697002814s
trace:
https://jaeger.dev.storj.io/trace/4af262587d92cfcb
FAIL (2025-12-09 01:03:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.697015399s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration:
27.701126ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/d6823dba42570ec
FAIL (2025-12-09 01:03:25 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp 207.211.208.129:443: i/o timeout
Duration: 27.733959ms edge gateway vhost bgp ap1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
2 out of 60 is failed (threshold=3) [.....................X.....................................X]
duration:
1m0.000614797s
trace:
https://jaeger.dev.storj.io/trace/4af262587d92cfcb
FAIL (2025-12-09 01:03:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.000639204s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................]
duration:
1.159483456s
trace:
https://jaeger.dev.storj.io/trace/39dda67c5a7ef46d
FAIL (2025-12-09 01:03:23 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout
Duration: 1.159510168s edge authservice http bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
8 out of 60 is failed (threshold=6) [.................XX................X.........X.X...X.X.X....]
duration:
3.581835385s
trace:
https://jaeger.dev.storj.io/trace/df97ab9c1b2ebbd
FAIL (2025-12-09 01:03:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.581863109s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration:
5.727157762s
trace:
https://jaeger.dev.storj.io/trace/16f5f0214b7e09da
FAIL (2025-12-09 01:03:20 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
A, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.056163163 (81h17m12.927246198s) [noise=true , address=77.90.31.10:4535     , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.057949975 (81h17m12.92903305s) [noise=true , address=45.91.116.12:4254    , piece_id=V6Z3FY3IX4ZMXDSQWYJD7XRSHH7TF5PO3O2WGAP37H5QWR23ZVAQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.059319273 (81h17m12.930402308s) [noise=true , address=45.91.116.4:4956     , piece_id=QQ6LRHTMTGEBHNUH3HX545OSX2D4W57ZJH2HE4ULX3TSRZKCSJWQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.059492453 (81h17m12.930575498s) [noise=true , address=145.79.227.33:4874   , piece_id=4FSL6J7KRQIXTAC2R7T5SDHYMSFGLFL3SUBLFOYYRZM47V3G73OQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.059829985 (81h17m12.93091303s) [noise=true , address=77.90.31.16:4738     , piece_id=TCG6E2SKWNQ3R23XJEJG45H4WKPYHFH57SM3JLFMNXDI455T5D5A, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.060311452 (81h17m12.931394507s) [noise=true , address=145.79.227.24:4584   , piece_id=I2P5HMRRE234SLOKTQTBRXC5BJDACGFSZ4C3QDIM3R7H7VOLAR6Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.060638766 (81h17m12.931721801s) [noise=true , address=45.91.116.13:4187    , piece_id=TZEUTEYC4MWHZPOILSHTWPLNAQWKVNEM4JYGOYM54TOIH6MES2WA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.061436635 (81h17m12.93251967s) [noise=true , address=45.91.116.5:4327     , piece_id=M55GD6NYM7XLFPX2PWUZBJTKBCIID63SDCRTAINR4K3QXHQ7VFWA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.062205830 (81h17m12.933288875s) [noise=true , address=5.231.73.4:4003      , piece_id=4K3ONY56R3TZYJZI5OJ4ADJXUALZPTHP236QDFDRNZUNI3LRIADA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.063000051 (81h17m12.934083086s) [noise=true , address=77.90.31.13:4639     , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.063836003 (81h17m12.934919058s) [noise=true , address=64.49.13.154:4934    , piece_id=6TISGSS4P6CP6FJL7DFWUXYT5X6KQJ4OYHSIZGSMQV4RZMFTGU4A, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.064692454 (81h17m12.935775499s) [noise=true , address=45.91.116.11:4147    , piece_id=Z5BCQU3TM45AVD4KSHQ74AFDEBMALRUD3PXQPQEV54CBLYL3TR3Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.064959161 (81h17m12.936042216s) [noise=true , address=145.79.227.30:4783   , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.066239960 (81h17m12.937323015s) [noise=true , address=45.91.116.8:4065     , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.066383043 (81h17m12.937466108s) [noise=true , address=77.90.31.10:4534     , piece_id=I267OI6FD4ZA354UR7JZNXZBIYR6HJ44IPX2AHV2CQRO5RYBHFHQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.067300530 (81h17m12.938383575s) [noise=true , address=64.49.13.155:4914    , piece_id=IWMWBIGHFIMSSDWLUNLPW635SUZYL5QUXBBDVT4Q7POXKUW4WJ5Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:13.067455816 (81h17m12.938538861s) [noise=true , address=45.91.116.6:4983     , piece_id=UWFWT4HF5IFO25OED2UEZSFHFV7TZBSTUETBC2LQ7EUQLG4SUD2Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec  9 00:46:14.495330055 (81h17m14.36641309s) [upload=71023]: Next returned nil segment
Dec  9 00:46:14.495350613 (81h17m14.366433688s) [upload=71023]: Waiting for error group managing segments...
Dec  9 00:46:14.883721607 (81h17m14.754804652s) [noise=true , address=64.49.13.155:4914    , piece_id=IWMWBIGHFIMSSDWLUNLPW635SUZYL5QUXBBDVT4Q7POXKUW4WJ5Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:14.929183823 (81h17m14.800266868s) [noise=true , address=145.79.227.24:4584   , piece_id=I2P5HMRRE234SLOKTQTBRXC5BJDACGFSZ4C3QDIM3R7H7VOLAR6Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:14.941170366 (81h17m14.812253411s) [noise=true , address=145.79.227.33:4874   , piece_id=4FSL6J7KRQIXTAC2R7T5SDHYMSFGLFL3SUBLFOYYRZM47V3G73OQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:14.959305788 (81h17m14.830388833s) [noise=true , address=64.49.13.154:4934    , piece_id=6TISGSS4P6CP6FJL7DFWUXYT5X6KQJ4OYHSIZGSMQV4RZMFTGU4A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.028943597 (81h17m14.900026632s) [noise=true , address=5.231.73.4:4003      , piece_id=4K3ONY56R3TZYJZI5OJ4ADJXUALZPTHP236QDFDRNZUNI3LRIADA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.033566479 (81h17m14.904649514s) [noise=true , address=77.90.31.16:4738     , piece_id=TCG6E2SKWNQ3R23XJEJG45H4WKPYHFH57SM3JLFMNXDI455T5D5A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.059529566 (81h17m14.930612611s) [noise=true , address=77.90.31.17:4789     , piece_id=22ZFVENBTZP7MWLLHV5HSP7QESSI4P3W67O2YZ4EOUEP4GAGVD5A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.065748207 (81h17m14.936831242s) [noise=true , address=45.91.116.4:4956     , piece_id=QQ6LRHTMTGEBHNUH3HX545OSX2D4W57ZJH2HE4ULX3TSRZKCSJWQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.072515793 (81h17m14.943598828s) [noise=true , address=77.90.31.10:4534     , piece_id=I267OI6FD4ZA354UR7JZNXZBIYR6HJ44IPX2AHV2CQRO5RYBHFHQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.073404145 (81h17m14.94448718s) [noise=true , address=45.91.116.5:4327     , piece_id=M55GD6NYM7XLFPX2PWUZBJTKBCIID63SDCRTAINR4K3QXHQ7VFWA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.104276279 (81h17m14.975359324s) [noise=true , address=45.91.116.11:4147    , piece_id=Z5BCQU3TM45AVD4KSHQ74AFDEBMALRUD3PXQPQEV54CBLYL3TR3Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.104945043 (81h17m14.976028098s) [noise=true , address=45.91.116.13:4187    , piece_id=TZEUTEYC4MWHZPOILSHTWPLNAQWKVNEM4JYGOYM54TOIH6MES2WA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.112208182 (81h17m14.983291217s) [noise=true , address=45.91.116.6:4983     , piece_id=UWFWT4HF5IFO25OED2UEZSFHFV7TZBSTUETBC2LQ7EUQLG4SUD2Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.115153711 (81h17m14.986236756s) [noise=true , address=45.91.116.12:4254    , piece_id=V6Z3FY3IX4ZMXDSQWYJD7XRSHH7TF5PO3O2WGAP37H5QWR23ZVAQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec  9 00:46:15.115171264 (81h17m14.986254309s) [seg_pos={0 0}, upload=71023]: Segment reached optimal threshold of 14 pieces.
Dec  9 00:46:15.115426842 (81h17m14.986509887s) [noise=true , address=145.79.227.30:4783   , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNMd8YrgaagKDoWivhbTmRc5TPM6BNiHscECBF2yhncKgkvz): protocol: expected piece hash; context canceled; EOF
Dec  9 00:46:15.115435798 (81h17m14.986518843s) [noise=true , address=145.79.227.30:4783   , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec  9 00:46:15.115498558 (81h17m14.986581613s) [noise=true , address=77.90.31.13:4639     , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N9N1pcaVn3nPh1WY7uktz8Z7fwJGqnTdVwZMAW5SVrqvRA8VV): protocol: expected piece hash; context canceled; EOF
Dec  9 00:46:15.115517804 (81h17m14.986600859s) [noise=true , address=77.90.31.13:4639     , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec  9 00:46:15.115593578 (81h17m14.986676623s) [noise=true , address=77.90.31.10:4535     , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz): protocol: expected piece hash; context canceled; EOF
Dec  9 00:46:15.115631711 (81h17m14.986714766s) [noise=true , address=77.90.31.10:4535     , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec  9 00:46:15.115853494 (81h17m14.986936539s) [noise=true , address=45.91.116.8:4065     , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EPCQmYb816aegE9vPSoJYByMUEvhP4DUiabis2gh9QjXQC3s): protocol: expected piece hash; context canceled; EOF
Dec  9 00:46:15.115862621 (81h17m14.986945676s) [noise=true , address=45.91.116.8:4065     , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec  9 00:46:15.115922986 (81h17m14.987006031s) [seg_pos={0 0}, upload=71023]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec  9 00:46:15.116025181 (81h17m14.987108226s) [upload=71023]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:46:15.116032685 (81h17m14.98711573s) [upload=71023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:47:25.980830692 (81h18m25.851913727s) [upload=71023]: Done uploading segments...
Dec  9 00:47:25.980980237 (81h18m25.852063282s) [upload=71023]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.727185125s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
2 out of 60 is failed (threshold=3) [..................XX........................................]
duration:
273.759438ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/45c08147c7083bce
FAIL (2025-12-09 01:03:15 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp 207.211.208.129:443: i/o timeout
Duration: 273.785958ms edge gateway vhost bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................]
duration:
1.999316769s
trace:
https://jaeger.dev.storj.io/trace/2744e7e74333fadd
FAIL (2025-12-09 01:03:12 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout
Duration: 1.999342378s edge authservice http bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)
antiblip:
1 out of 60 is failed (threshold=6) [.............X..............................................]
duration:
267.739595ms
target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt
trace:
https://jaeger.dev.storj.io/trace/dd0fa7a1ae6bdc0
FAIL (2025-12-09 01:03:10 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 267.7681ms edge linksharing bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................]
duration:
25.059085ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/d6823dba42570ec
FAIL (2025-12-09 01:03:07 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp 207.211.208.129:443: i/o timeout
Duration: 25.086869ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration:
248.494621ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/64025b92da229a61
FAIL (2025-12-09 01:03:00 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp 207.211.208.129:443: i/o timeout
Duration: 248.524198ms edge gateway vhost bgp eu1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration:
1.162566416s
trace:
https://jaeger.dev.storj.io/trace/39dda67c5a7ef46d
FAIL (2025-12-09 01:02:57 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout
Duration: 1.16259503s edge authservice http bgp us1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)
antiblip:
1 out of 60 is failed (threshold=6) [....................X.......................................]
duration:
248.69391ms
target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
trace:
https://jaeger.dev.storj.io/trace/200ebca2a36ec82e
FAIL (2025-12-09 01:02:45 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 248.721873ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)
antiblip:
1 out of 60 is failed (threshold=6) [..............X.............................................]
duration:
265.768583ms
target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt
trace:
https://jaeger.dev.storj.io/trace/dd0fa7a1ae6bdc0
FAIL (2025-12-09 01:02:42 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 265.793139ms edge linksharing bgp us1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................]
duration:
472.595781ms
remote:
"tcp:35.207.121.91:443"
target:
https://eu1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/6b1ae90bcdd087c7
FAIL (2025-12-09 01:02:41 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 472.62689ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [................................X..X........................]
duration:
5.855099336s
trace:
https://jaeger.dev.storj.io/trace/44eba3f11f79732e
FAIL (2025-12-09 01:02:38 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 5.855132439s core uplink eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)
antiblip:
1 out of 60 is failed (threshold=6) [....................X.......................................]
duration:
27.042733ms
target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
trace:
https://jaeger.dev.storj.io/trace/af91489e18f8dd7
FAIL (2025-12-09 01:02:37 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 27.061218ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................]
duration:
250.508595ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/64025b92da229a61
FAIL (2025-12-09 01:02:36 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp 207.211.208.129:443: i/o timeout
Duration: 250.542259ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration:
24.420451ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/d6823dba42570ec
FAIL (2025-12-09 01:02:24 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp 207.211.208.129:443: i/o timeout
Duration: 24.451058ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
2 out of 60 is failed (threshold=3) [...................XX.......................................]
duration:
268.899615ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/45c08147c7083bce
FAIL (2025-12-09 01:02:21 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp 207.211.208.129:443: i/o timeout
Duration: 268.936635ms edge gateway vhost bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
8 out of 60 is failed (threshold=6) [..................XX................X.........X.X...X.X.X...]
duration:
3.404825547s
trace:
https://jaeger.dev.storj.io/trace/df97ab9c1b2ebbd
FAIL (2025-12-09 01:02:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.404855284s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration:
1.094676174s
trace:
https://jaeger.dev.storj.io/trace/2744e7e74333fadd
FAIL (2025-12-09 01:02:13 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout
Duration: 1.094699038s edge authservice http bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)
antiblip:
1 out of 60 is failed (threshold=6) [...............X............................................]
duration:
270.480744ms
target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt
trace:
https://jaeger.dev.storj.io/trace/dd0fa7a1ae6bdc0
FAIL (2025-12-09 01:02:11 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 270.513718ms edge linksharing bgp us1