Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
5.882586826s trace:
https://jaeger.dev.storj.io/trace/29b49b34e5929e2f
FAIL (2025-12-09 00:50:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.882626742s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
484.885983ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/6b1ae90bcdd087c7
FAIL (2025-12-09 00:50:48 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 484.917434ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X......................................X..X......] duration:
5.402498476s trace:
https://jaeger.dev.storj.io/trace/44eba3f11f79732e
FAIL (2025-12-09 00:50:44 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.40252241s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [....................................X.......................] duration:
244.874177ms target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/200ebca2a36ec82e
FAIL (2025-12-09 00:50:34 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 244.902651ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
484.806223ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/6b1ae90bcdd087c7
FAIL (2025-12-09 00:50:28 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 484.829777ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.................................X..........................] duration:
23.230244ms target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/af91489e18f8dd7
FAIL (2025-12-09 00:50:28 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 23.253689ms
edge
linksharing
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X......................................X..X.....] duration:
4.89359093s trace:
https://jaeger.dev.storj.io/trace/44eba3f11f79732e
FAIL (2025-12-09 00:50:23 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 4.893619396s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
579.927426ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/64025b92da229a61
FAIL (2025-12-09 00:50:22 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp 207.211.208.129:443: i/o timeout
Duration: 579.95588ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
23.137458ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/d6823dba42570ec
FAIL (2025-12-09 00:50:21 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp 207.211.208.129:443: i/o timeout
Duration: 23.166542ms
edge
gateway
vhost
bgp
ap1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [X......................................X....................] duration:
5.75478437s trace:
https://jaeger.dev.storj.io/trace/29b49b34e5929e2f
FAIL (2025-12-09 00:50:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.754948361s
core
uplink
us-select-1
us1-placement-20
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
1.174279239s trace:
https://jaeger.dev.storj.io/trace/39dda67c5a7ef46d
FAIL (2025-12-09 00:50:21 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout
Duration: 1.174345595s
edge
authservice
http
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X............................................X.....] duration:
6.03724158s trace:
https://jaeger.dev.storj.io/trace/16f5f0214b7e09da
FAIL (2025-12-09 00:50:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
A, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.056163163 (81h17m12.927246198s) [noise=true , address=77.90.31.10:4535 , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.057949975 (81h17m12.92903305s) [noise=true , address=45.91.116.12:4254 , piece_id=V6Z3FY3IX4ZMXDSQWYJD7XRSHH7TF5PO3O2WGAP37H5QWR23ZVAQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.059319273 (81h17m12.930402308s) [noise=true , address=45.91.116.4:4956 , piece_id=QQ6LRHTMTGEBHNUH3HX545OSX2D4W57ZJH2HE4ULX3TSRZKCSJWQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.059492453 (81h17m12.930575498s) [noise=true , address=145.79.227.33:4874 , piece_id=4FSL6J7KRQIXTAC2R7T5SDHYMSFGLFL3SUBLFOYYRZM47V3G73OQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.059829985 (81h17m12.93091303s) [noise=true , address=77.90.31.16:4738 , piece_id=TCG6E2SKWNQ3R23XJEJG45H4WKPYHFH57SM3JLFMNXDI455T5D5A, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.060311452 (81h17m12.931394507s) [noise=true , address=145.79.227.24:4584 , piece_id=I2P5HMRRE234SLOKTQTBRXC5BJDACGFSZ4C3QDIM3R7H7VOLAR6Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.060638766 (81h17m12.931721801s) [noise=true , address=45.91.116.13:4187 , piece_id=TZEUTEYC4MWHZPOILSHTWPLNAQWKVNEM4JYGOYM54TOIH6MES2WA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.061436635 (81h17m12.93251967s) [noise=true , address=45.91.116.5:4327 , piece_id=M55GD6NYM7XLFPX2PWUZBJTKBCIID63SDCRTAINR4K3QXHQ7VFWA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.062205830 (81h17m12.933288875s) [noise=true , address=5.231.73.4:4003 , piece_id=4K3ONY56R3TZYJZI5OJ4ADJXUALZPTHP236QDFDRNZUNI3LRIADA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.063000051 (81h17m12.934083086s) [noise=true , address=77.90.31.13:4639 , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.063836003 (81h17m12.934919058s) [noise=true , address=64.49.13.154:4934 , piece_id=6TISGSS4P6CP6FJL7DFWUXYT5X6KQJ4OYHSIZGSMQV4RZMFTGU4A, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.064692454 (81h17m12.935775499s) [noise=true , address=45.91.116.11:4147 , piece_id=Z5BCQU3TM45AVD4KSHQ74AFDEBMALRUD3PXQPQEV54CBLYL3TR3Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.064959161 (81h17m12.936042216s) [noise=true , address=145.79.227.30:4783 , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.066239960 (81h17m12.937323015s) [noise=true , address=45.91.116.8:4065 , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.066383043 (81h17m12.937466108s) [noise=true , address=77.90.31.10:4534 , piece_id=I267OI6FD4ZA354UR7JZNXZBIYR6HJ44IPX2AHV2CQRO5RYBHFHQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.067300530 (81h17m12.938383575s) [noise=true , address=64.49.13.155:4914 , piece_id=IWMWBIGHFIMSSDWLUNLPW635SUZYL5QUXBBDVT4Q7POXKUW4WJ5Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.067455816 (81h17m12.938538861s) [noise=true , address=45.91.116.6:4983 , piece_id=UWFWT4HF5IFO25OED2UEZSFHFV7TZBSTUETBC2LQ7EUQLG4SUD2Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:14.495330055 (81h17m14.36641309s) [upload=71023]: Next returned nil segment
Dec 9 00:46:14.495350613 (81h17m14.366433688s) [upload=71023]: Waiting for error group managing segments...
Dec 9 00:46:14.883721607 (81h17m14.754804652s) [noise=true , address=64.49.13.155:4914 , piece_id=IWMWBIGHFIMSSDWLUNLPW635SUZYL5QUXBBDVT4Q7POXKUW4WJ5Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:14.929183823 (81h17m14.800266868s) [noise=true , address=145.79.227.24:4584 , piece_id=I2P5HMRRE234SLOKTQTBRXC5BJDACGFSZ4C3QDIM3R7H7VOLAR6Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:14.941170366 (81h17m14.812253411s) [noise=true , address=145.79.227.33:4874 , piece_id=4FSL6J7KRQIXTAC2R7T5SDHYMSFGLFL3SUBLFOYYRZM47V3G73OQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:14.959305788 (81h17m14.830388833s) [noise=true , address=64.49.13.154:4934 , piece_id=6TISGSS4P6CP6FJL7DFWUXYT5X6KQJ4OYHSIZGSMQV4RZMFTGU4A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.028943597 (81h17m14.900026632s) [noise=true , address=5.231.73.4:4003 , piece_id=4K3ONY56R3TZYJZI5OJ4ADJXUALZPTHP236QDFDRNZUNI3LRIADA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.033566479 (81h17m14.904649514s) [noise=true , address=77.90.31.16:4738 , piece_id=TCG6E2SKWNQ3R23XJEJG45H4WKPYHFH57SM3JLFMNXDI455T5D5A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.059529566 (81h17m14.930612611s) [noise=true , address=77.90.31.17:4789 , piece_id=22ZFVENBTZP7MWLLHV5HSP7QESSI4P3W67O2YZ4EOUEP4GAGVD5A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.065748207 (81h17m14.936831242s) [noise=true , address=45.91.116.4:4956 , piece_id=QQ6LRHTMTGEBHNUH3HX545OSX2D4W57ZJH2HE4ULX3TSRZKCSJWQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.072515793 (81h17m14.943598828s) [noise=true , address=77.90.31.10:4534 , piece_id=I267OI6FD4ZA354UR7JZNXZBIYR6HJ44IPX2AHV2CQRO5RYBHFHQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.073404145 (81h17m14.94448718s) [noise=true , address=45.91.116.5:4327 , piece_id=M55GD6NYM7XLFPX2PWUZBJTKBCIID63SDCRTAINR4K3QXHQ7VFWA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.104276279 (81h17m14.975359324s) [noise=true , address=45.91.116.11:4147 , piece_id=Z5BCQU3TM45AVD4KSHQ74AFDEBMALRUD3PXQPQEV54CBLYL3TR3Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.104945043 (81h17m14.976028098s) [noise=true , address=45.91.116.13:4187 , piece_id=TZEUTEYC4MWHZPOILSHTWPLNAQWKVNEM4JYGOYM54TOIH6MES2WA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.112208182 (81h17m14.983291217s) [noise=true , address=45.91.116.6:4983 , piece_id=UWFWT4HF5IFO25OED2UEZSFHFV7TZBSTUETBC2LQ7EUQLG4SUD2Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.115153711 (81h17m14.986236756s) [noise=true , address=45.91.116.12:4254 , piece_id=V6Z3FY3IX4ZMXDSQWYJD7XRSHH7TF5PO3O2WGAP37H5QWR23ZVAQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.115171264 (81h17m14.986254309s) [seg_pos={0 0}, upload=71023]: Segment reached optimal threshold of 14 pieces.
Dec 9 00:46:15.115426842 (81h17m14.986509887s) [noise=true , address=145.79.227.30:4783 , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNMd8YrgaagKDoWivhbTmRc5TPM6BNiHscECBF2yhncKgkvz): protocol: expected piece hash; context canceled; EOF
Dec 9 00:46:15.115435798 (81h17m14.986518843s) [noise=true , address=145.79.227.30:4783 , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec 9 00:46:15.115498558 (81h17m14.986581613s) [noise=true , address=77.90.31.13:4639 , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N9N1pcaVn3nPh1WY7uktz8Z7fwJGqnTdVwZMAW5SVrqvRA8VV): protocol: expected piece hash; context canceled; EOF
Dec 9 00:46:15.115517804 (81h17m14.986600859s) [noise=true , address=77.90.31.13:4639 , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec 9 00:46:15.115593578 (81h17m14.986676623s) [noise=true , address=77.90.31.10:4535 , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz): protocol: expected piece hash; context canceled; EOF
Dec 9 00:46:15.115631711 (81h17m14.986714766s) [noise=true , address=77.90.31.10:4535 , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec 9 00:46:15.115853494 (81h17m14.986936539s) [noise=true , address=45.91.116.8:4065 , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EPCQmYb816aegE9vPSoJYByMUEvhP4DUiabis2gh9QjXQC3s): protocol: expected piece hash; context canceled; EOF
Dec 9 00:46:15.115862621 (81h17m14.986945676s) [noise=true , address=45.91.116.8:4065 , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec 9 00:46:15.115922986 (81h17m14.987006031s) [seg_pos={0 0}, upload=71023]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 9 00:46:15.116025181 (81h17m14.987108226s) [upload=71023]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 9 00:46:15.116032685 (81h17m14.98711573s) [upload=71023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 9 00:47:25.980830692 (81h18m25.851913727s) [upload=71023]: Done uploading segments...
Dec 9 00:47:25.980980237 (81h18m25.852063282s) [upload=71023]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.037267138s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.................................X..........................] duration:
269.698526ms target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/dd0fa7a1ae6bdc0
FAIL (2025-12-09 00:50:18 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 269.725256ms
edge
linksharing
bgp
us1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.....................................X......................] duration:
236.298888ms target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/200ebca2a36ec82e
FAIL (2025-12-09 00:50:16 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 236.339164ms
edge
linksharing
bgp
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [...................................XX................X......] duration:
3.685311321s trace:
https://jaeger.dev.storj.io/trace/62f2415ef8c56bc5
FAIL (2025-12-09 00:50:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.68533116s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X......................................X..X....] duration:
4.862157238s trace:
https://jaeger.dev.storj.io/trace/44eba3f11f79732e
FAIL (2025-12-09 00:50:03 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 4.862190109s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..................................X.........................] duration:
61.082561ms target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/af91489e18f8dd7
FAIL (2025-12-09 00:50:02 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 61.101667ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
2 out of 60 is failed (threshold=3) [..................................XX........................] duration:
268.90822ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/45c08147c7083bce
FAIL (2025-12-09 00:49:59 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp 207.211.208.129:443: i/o timeout
Duration: 268.92382ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
26.383078ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/d6823dba42570ec
FAIL (2025-12-09 00:49:57 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp 207.211.208.129:443: i/o timeout
Duration: 26.406322ms
edge
gateway
vhost
bgp
ap1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
1.085480274s trace:
https://jaeger.dev.storj.io/trace/2744e7e74333fadd
FAIL (2025-12-09 00:49:57 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout
Duration: 1.085512114s
edge
authservice
http
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..................................X.........................] duration:
275.471218ms target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/dd0fa7a1ae6bdc0
FAIL (2025-12-09 00:49:56 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 275.494602ms
edge
linksharing
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
239.339637ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/64025b92da229a61
FAIL (2025-12-09 00:49:49 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp 207.211.208.129:443: i/o timeout
Duration: 239.365326ms
edge
gateway
vhost
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
1.188684789s trace:
https://jaeger.dev.storj.io/trace/39dda67c5a7ef46d
FAIL (2025-12-09 00:49:49 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout
Duration: 1.188806702s
edge
authservice
http
bgp
us1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...................................X........................] duration:
19.055926ms target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/af91489e18f8dd7
FAIL (2025-12-09 00:49:42 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 19.082706ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [......................................X.....................] duration:
517.475179ms target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/200ebca2a36ec82e
FAIL (2025-12-09 00:49:34 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 517.501358ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
485.923418ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/6b1ae90bcdd087c7
FAIL (2025-12-09 00:49:33 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 485.95129ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X............................................X....] duration:
5.725143667s trace:
https://jaeger.dev.storj.io/trace/16f5f0214b7e09da
FAIL (2025-12-09 00:49:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
A, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.056163163 (81h17m12.927246198s) [noise=true , address=77.90.31.10:4535 , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.057949975 (81h17m12.92903305s) [noise=true , address=45.91.116.12:4254 , piece_id=V6Z3FY3IX4ZMXDSQWYJD7XRSHH7TF5PO3O2WGAP37H5QWR23ZVAQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.059319273 (81h17m12.930402308s) [noise=true , address=45.91.116.4:4956 , piece_id=QQ6LRHTMTGEBHNUH3HX545OSX2D4W57ZJH2HE4ULX3TSRZKCSJWQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.059492453 (81h17m12.930575498s) [noise=true , address=145.79.227.33:4874 , piece_id=4FSL6J7KRQIXTAC2R7T5SDHYMSFGLFL3SUBLFOYYRZM47V3G73OQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.059829985 (81h17m12.93091303s) [noise=true , address=77.90.31.16:4738 , piece_id=TCG6E2SKWNQ3R23XJEJG45H4WKPYHFH57SM3JLFMNXDI455T5D5A, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.060311452 (81h17m12.931394507s) [noise=true , address=145.79.227.24:4584 , piece_id=I2P5HMRRE234SLOKTQTBRXC5BJDACGFSZ4C3QDIM3R7H7VOLAR6Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.060638766 (81h17m12.931721801s) [noise=true , address=45.91.116.13:4187 , piece_id=TZEUTEYC4MWHZPOILSHTWPLNAQWKVNEM4JYGOYM54TOIH6MES2WA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.061436635 (81h17m12.93251967s) [noise=true , address=45.91.116.5:4327 , piece_id=M55GD6NYM7XLFPX2PWUZBJTKBCIID63SDCRTAINR4K3QXHQ7VFWA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.062205830 (81h17m12.933288875s) [noise=true , address=5.231.73.4:4003 , piece_id=4K3ONY56R3TZYJZI5OJ4ADJXUALZPTHP236QDFDRNZUNI3LRIADA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.063000051 (81h17m12.934083086s) [noise=true , address=77.90.31.13:4639 , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.063836003 (81h17m12.934919058s) [noise=true , address=64.49.13.154:4934 , piece_id=6TISGSS4P6CP6FJL7DFWUXYT5X6KQJ4OYHSIZGSMQV4RZMFTGU4A, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.064692454 (81h17m12.935775499s) [noise=true , address=45.91.116.11:4147 , piece_id=Z5BCQU3TM45AVD4KSHQ74AFDEBMALRUD3PXQPQEV54CBLYL3TR3Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.064959161 (81h17m12.936042216s) [noise=true , address=145.79.227.30:4783 , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.066239960 (81h17m12.937323015s) [noise=true , address=45.91.116.8:4065 , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.066383043 (81h17m12.937466108s) [noise=true , address=77.90.31.10:4534 , piece_id=I267OI6FD4ZA354UR7JZNXZBIYR6HJ44IPX2AHV2CQRO5RYBHFHQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.067300530 (81h17m12.938383575s) [noise=true , address=64.49.13.155:4914 , piece_id=IWMWBIGHFIMSSDWLUNLPW635SUZYL5QUXBBDVT4Q7POXKUW4WJ5Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.067455816 (81h17m12.938538861s) [noise=true , address=45.91.116.6:4983 , piece_id=UWFWT4HF5IFO25OED2UEZSFHFV7TZBSTUETBC2LQ7EUQLG4SUD2Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:14.495330055 (81h17m14.36641309s) [upload=71023]: Next returned nil segment
Dec 9 00:46:14.495350613 (81h17m14.366433688s) [upload=71023]: Waiting for error group managing segments...
Dec 9 00:46:14.883721607 (81h17m14.754804652s) [noise=true , address=64.49.13.155:4914 , piece_id=IWMWBIGHFIMSSDWLUNLPW635SUZYL5QUXBBDVT4Q7POXKUW4WJ5Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:14.929183823 (81h17m14.800266868s) [noise=true , address=145.79.227.24:4584 , piece_id=I2P5HMRRE234SLOKTQTBRXC5BJDACGFSZ4C3QDIM3R7H7VOLAR6Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:14.941170366 (81h17m14.812253411s) [noise=true , address=145.79.227.33:4874 , piece_id=4FSL6J7KRQIXTAC2R7T5SDHYMSFGLFL3SUBLFOYYRZM47V3G73OQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:14.959305788 (81h17m14.830388833s) [noise=true , address=64.49.13.154:4934 , piece_id=6TISGSS4P6CP6FJL7DFWUXYT5X6KQJ4OYHSIZGSMQV4RZMFTGU4A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.028943597 (81h17m14.900026632s) [noise=true , address=5.231.73.4:4003 , piece_id=4K3ONY56R3TZYJZI5OJ4ADJXUALZPTHP236QDFDRNZUNI3LRIADA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.033566479 (81h17m14.904649514s) [noise=true , address=77.90.31.16:4738 , piece_id=TCG6E2SKWNQ3R23XJEJG45H4WKPYHFH57SM3JLFMNXDI455T5D5A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.059529566 (81h17m14.930612611s) [noise=true , address=77.90.31.17:4789 , piece_id=22ZFVENBTZP7MWLLHV5HSP7QESSI4P3W67O2YZ4EOUEP4GAGVD5A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.065748207 (81h17m14.936831242s) [noise=true , address=45.91.116.4:4956 , piece_id=QQ6LRHTMTGEBHNUH3HX545OSX2D4W57ZJH2HE4ULX3TSRZKCSJWQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.072515793 (81h17m14.943598828s) [noise=true , address=77.90.31.10:4534 , piece_id=I267OI6FD4ZA354UR7JZNXZBIYR6HJ44IPX2AHV2CQRO5RYBHFHQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.073404145 (81h17m14.94448718s) [noise=true , address=45.91.116.5:4327 , piece_id=M55GD6NYM7XLFPX2PWUZBJTKBCIID63SDCRTAINR4K3QXHQ7VFWA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.104276279 (81h17m14.975359324s) [noise=true , address=45.91.116.11:4147 , piece_id=Z5BCQU3TM45AVD4KSHQ74AFDEBMALRUD3PXQPQEV54CBLYL3TR3Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.104945043 (81h17m14.976028098s) [noise=true , address=45.91.116.13:4187 , piece_id=TZEUTEYC4MWHZPOILSHTWPLNAQWKVNEM4JYGOYM54TOIH6MES2WA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.112208182 (81h17m14.983291217s) [noise=true , address=45.91.116.6:4983 , piece_id=UWFWT4HF5IFO25OED2UEZSFHFV7TZBSTUETBC2LQ7EUQLG4SUD2Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.115153711 (81h17m14.986236756s) [noise=true , address=45.91.116.12:4254 , piece_id=V6Z3FY3IX4ZMXDSQWYJD7XRSHH7TF5PO3O2WGAP37H5QWR23ZVAQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.115171264 (81h17m14.986254309s) [seg_pos={0 0}, upload=71023]: Segment reached optimal threshold of 14 pieces.
Dec 9 00:46:15.115426842 (81h17m14.986509887s) [noise=true , address=145.79.227.30:4783 , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNMd8YrgaagKDoWivhbTmRc5TPM6BNiHscECBF2yhncKgkvz): protocol: expected piece hash; context canceled; EOF
Dec 9 00:46:15.115435798 (81h17m14.986518843s) [noise=true , address=145.79.227.30:4783 , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec 9 00:46:15.115498558 (81h17m14.986581613s) [noise=true , address=77.90.31.13:4639 , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N9N1pcaVn3nPh1WY7uktz8Z7fwJGqnTdVwZMAW5SVrqvRA8VV): protocol: expected piece hash; context canceled; EOF
Dec 9 00:46:15.115517804 (81h17m14.986600859s) [noise=true , address=77.90.31.13:4639 , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec 9 00:46:15.115593578 (81h17m14.986676623s) [noise=true , address=77.90.31.10:4535 , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz): protocol: expected piece hash; context canceled; EOF
Dec 9 00:46:15.115631711 (81h17m14.986714766s) [noise=true , address=77.90.31.10:4535 , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec 9 00:46:15.115853494 (81h17m14.986936539s) [noise=true , address=45.91.116.8:4065 , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EPCQmYb816aegE9vPSoJYByMUEvhP4DUiabis2gh9QjXQC3s): protocol: expected piece hash; context canceled; EOF
Dec 9 00:46:15.115862621 (81h17m14.986945676s) [noise=true , address=45.91.116.8:4065 , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec 9 00:46:15.115922986 (81h17m14.987006031s) [seg_pos={0 0}, upload=71023]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 9 00:46:15.116025181 (81h17m14.987108226s) [upload=71023]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 9 00:46:15.116032685 (81h17m14.98711573s) [upload=71023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 9 00:47:25.980830692 (81h18m25.851913727s) [upload=71023]: Done uploading segments...
Dec 9 00:47:25.980980237 (81h18m25.852063282s) [upload=71023]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.725169226s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X......................................X..X...] duration:
5.119249226s trace:
https://jaeger.dev.storj.io/trace/44eba3f11f79732e
FAIL (2025-12-09 00:49:20 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.119276818s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [....................................X.......................] duration:
21.465294ms target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/af91489e18f8dd7
FAIL (2025-12-09 00:49:16 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 21.493047ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...................................X........................] duration:
276.959531ms target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/dd0fa7a1ae6bdc0
FAIL (2025-12-09 00:49:12 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 276.982837ms
edge
linksharing
bgp
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [....................................XX................X.....] duration:
3.47473439s trace:
https://jaeger.dev.storj.io/trace/62f2415ef8c56bc5
FAIL (2025-12-09 00:49:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.474768505s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
2 out of 60 is failed (threshold=3) [...................................XX.......................] duration:
275.760588ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/45c08147c7083bce
FAIL (2025-12-09 00:49:08 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp 207.211.208.129:443: i/o timeout
Duration: 275.782791ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
24.946932ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/d6823dba42570ec
FAIL (2025-12-09 00:49:08 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp 207.211.208.129:443: i/o timeout
Duration: 24.972151ms
edge
gateway
vhost
bgp
ap1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.X......................................X...................] duration:
5.869404756s trace:
https://jaeger.dev.storj.io/trace/29b49b34e5929e2f
FAIL (2025-12-09 00:49:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.869451155s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
233.443411ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/64025b92da229a61
FAIL (2025-12-09 00:48:56 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp 207.211.208.129:443: i/o timeout
Duration: 233.47467ms
edge
gateway
vhost
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
1.108040913s trace:
https://jaeger.dev.storj.io/trace/2744e7e74333fadd
FAIL (2025-12-09 00:48:54 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout
Duration: 1.108085146s
edge
authservice
http
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X............................................X...] duration:
5.855255836s trace:
https://jaeger.dev.storj.io/trace/16f5f0214b7e09da
FAIL (2025-12-09 00:48:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
A, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.056163163 (81h17m12.927246198s) [noise=true , address=77.90.31.10:4535 , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.057949975 (81h17m12.92903305s) [noise=true , address=45.91.116.12:4254 , piece_id=V6Z3FY3IX4ZMXDSQWYJD7XRSHH7TF5PO3O2WGAP37H5QWR23ZVAQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.059319273 (81h17m12.930402308s) [noise=true , address=45.91.116.4:4956 , piece_id=QQ6LRHTMTGEBHNUH3HX545OSX2D4W57ZJH2HE4ULX3TSRZKCSJWQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.059492453 (81h17m12.930575498s) [noise=true , address=145.79.227.33:4874 , piece_id=4FSL6J7KRQIXTAC2R7T5SDHYMSFGLFL3SUBLFOYYRZM47V3G73OQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.059829985 (81h17m12.93091303s) [noise=true , address=77.90.31.16:4738 , piece_id=TCG6E2SKWNQ3R23XJEJG45H4WKPYHFH57SM3JLFMNXDI455T5D5A, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.060311452 (81h17m12.931394507s) [noise=true , address=145.79.227.24:4584 , piece_id=I2P5HMRRE234SLOKTQTBRXC5BJDACGFSZ4C3QDIM3R7H7VOLAR6Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.060638766 (81h17m12.931721801s) [noise=true , address=45.91.116.13:4187 , piece_id=TZEUTEYC4MWHZPOILSHTWPLNAQWKVNEM4JYGOYM54TOIH6MES2WA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.061436635 (81h17m12.93251967s) [noise=true , address=45.91.116.5:4327 , piece_id=M55GD6NYM7XLFPX2PWUZBJTKBCIID63SDCRTAINR4K3QXHQ7VFWA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.062205830 (81h17m12.933288875s) [noise=true , address=5.231.73.4:4003 , piece_id=4K3ONY56R3TZYJZI5OJ4ADJXUALZPTHP236QDFDRNZUNI3LRIADA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.063000051 (81h17m12.934083086s) [noise=true , address=77.90.31.13:4639 , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.063836003 (81h17m12.934919058s) [noise=true , address=64.49.13.154:4934 , piece_id=6TISGSS4P6CP6FJL7DFWUXYT5X6KQJ4OYHSIZGSMQV4RZMFTGU4A, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.064692454 (81h17m12.935775499s) [noise=true , address=45.91.116.11:4147 , piece_id=Z5BCQU3TM45AVD4KSHQ74AFDEBMALRUD3PXQPQEV54CBLYL3TR3Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.064959161 (81h17m12.936042216s) [noise=true , address=145.79.227.30:4783 , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.066239960 (81h17m12.937323015s) [noise=true , address=45.91.116.8:4065 , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.066383043 (81h17m12.937466108s) [noise=true , address=77.90.31.10:4534 , piece_id=I267OI6FD4ZA354UR7JZNXZBIYR6HJ44IPX2AHV2CQRO5RYBHFHQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.067300530 (81h17m12.938383575s) [noise=true , address=64.49.13.155:4914 , piece_id=IWMWBIGHFIMSSDWLUNLPW635SUZYL5QUXBBDVT4Q7POXKUW4WJ5Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.067455816 (81h17m12.938538861s) [noise=true , address=45.91.116.6:4983 , piece_id=UWFWT4HF5IFO25OED2UEZSFHFV7TZBSTUETBC2LQ7EUQLG4SUD2Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:14.495330055 (81h17m14.36641309s) [upload=71023]: Next returned nil segment
Dec 9 00:46:14.495350613 (81h17m14.366433688s) [upload=71023]: Waiting for error group managing segments...
Dec 9 00:46:14.883721607 (81h17m14.754804652s) [noise=true , address=64.49.13.155:4914 , piece_id=IWMWBIGHFIMSSDWLUNLPW635SUZYL5QUXBBDVT4Q7POXKUW4WJ5Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:14.929183823 (81h17m14.800266868s) [noise=true , address=145.79.227.24:4584 , piece_id=I2P5HMRRE234SLOKTQTBRXC5BJDACGFSZ4C3QDIM3R7H7VOLAR6Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:14.941170366 (81h17m14.812253411s) [noise=true , address=145.79.227.33:4874 , piece_id=4FSL6J7KRQIXTAC2R7T5SDHYMSFGLFL3SUBLFOYYRZM47V3G73OQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:14.959305788 (81h17m14.830388833s) [noise=true , address=64.49.13.154:4934 , piece_id=6TISGSS4P6CP6FJL7DFWUXYT5X6KQJ4OYHSIZGSMQV4RZMFTGU4A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.028943597 (81h17m14.900026632s) [noise=true , address=5.231.73.4:4003 , piece_id=4K3ONY56R3TZYJZI5OJ4ADJXUALZPTHP236QDFDRNZUNI3LRIADA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.033566479 (81h17m14.904649514s) [noise=true , address=77.90.31.16:4738 , piece_id=TCG6E2SKWNQ3R23XJEJG45H4WKPYHFH57SM3JLFMNXDI455T5D5A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.059529566 (81h17m14.930612611s) [noise=true , address=77.90.31.17:4789 , piece_id=22ZFVENBTZP7MWLLHV5HSP7QESSI4P3W67O2YZ4EOUEP4GAGVD5A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.065748207 (81h17m14.936831242s) [noise=true , address=45.91.116.4:4956 , piece_id=QQ6LRHTMTGEBHNUH3HX545OSX2D4W57ZJH2HE4ULX3TSRZKCSJWQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.072515793 (81h17m14.943598828s) [noise=true , address=77.90.31.10:4534 , piece_id=I267OI6FD4ZA354UR7JZNXZBIYR6HJ44IPX2AHV2CQRO5RYBHFHQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.073404145 (81h17m14.94448718s) [noise=true , address=45.91.116.5:4327 , piece_id=M55GD6NYM7XLFPX2PWUZBJTKBCIID63SDCRTAINR4K3QXHQ7VFWA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.104276279 (81h17m14.975359324s) [noise=true , address=45.91.116.11:4147 , piece_id=Z5BCQU3TM45AVD4KSHQ74AFDEBMALRUD3PXQPQEV54CBLYL3TR3Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.104945043 (81h17m14.976028098s) [noise=true , address=45.91.116.13:4187 , piece_id=TZEUTEYC4MWHZPOILSHTWPLNAQWKVNEM4JYGOYM54TOIH6MES2WA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.112208182 (81h17m14.983291217s) [noise=true , address=45.91.116.6:4983 , piece_id=UWFWT4HF5IFO25OED2UEZSFHFV7TZBSTUETBC2LQ7EUQLG4SUD2Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.115153711 (81h17m14.986236756s) [noise=true , address=45.91.116.12:4254 , piece_id=V6Z3FY3IX4ZMXDSQWYJD7XRSHH7TF5PO3O2WGAP37H5QWR23ZVAQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.115171264 (81h17m14.986254309s) [seg_pos={0 0}, upload=71023]: Segment reached optimal threshold of 14 pieces.
Dec 9 00:46:15.115426842 (81h17m14.986509887s) [noise=true , address=145.79.227.30:4783 , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNMd8YrgaagKDoWivhbTmRc5TPM6BNiHscECBF2yhncKgkvz): protocol: expected piece hash; context canceled; EOF
Dec 9 00:46:15.115435798 (81h17m14.986518843s) [noise=true , address=145.79.227.30:4783 , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec 9 00:46:15.115498558 (81h17m14.986581613s) [noise=true , address=77.90.31.13:4639 , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N9N1pcaVn3nPh1WY7uktz8Z7fwJGqnTdVwZMAW5SVrqvRA8VV): protocol: expected piece hash; context canceled; EOF
Dec 9 00:46:15.115517804 (81h17m14.986600859s) [noise=true , address=77.90.31.13:4639 , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec 9 00:46:15.115593578 (81h17m14.986676623s) [noise=true , address=77.90.31.10:4535 , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz): protocol: expected piece hash; context canceled; EOF
Dec 9 00:46:15.115631711 (81h17m14.986714766s) [noise=true , address=77.90.31.10:4535 , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec 9 00:46:15.115853494 (81h17m14.986936539s) [noise=true , address=45.91.116.8:4065 , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EPCQmYb816aegE9vPSoJYByMUEvhP4DUiabis2gh9QjXQC3s): protocol: expected piece hash; context canceled; EOF
Dec 9 00:46:15.115862621 (81h17m14.986945676s) [noise=true , address=45.91.116.8:4065 , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec 9 00:46:15.115922986 (81h17m14.987006031s) [seg_pos={0 0}, upload=71023]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 9 00:46:15.116025181 (81h17m14.987108226s) [upload=71023]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 9 00:46:15.116032685 (81h17m14.98711573s) [upload=71023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 9 00:47:25.980830692 (81h18m25.851913727s) [upload=71023]: Done uploading segments...
Dec 9 00:47:25.980980237 (81h18m25.852063282s) [upload=71023]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.855275623s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.......................................X....................] duration:
241.069644ms target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/200ebca2a36ec82e
FAIL (2025-12-09 00:48:51 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 241.097746ms
edge
linksharing
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
1.195760683s trace:
https://jaeger.dev.storj.io/trace/39dda67c5a7ef46d
FAIL (2025-12-09 00:48:49 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout
Duration: 1.195799536s
edge
authservice
http
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X......................................X..X..] duration:
4.952083891s trace:
https://jaeger.dev.storj.io/trace/44eba3f11f79732e
FAIL (2025-12-09 00:48:48 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 4.95209934s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [....................................X.......................] duration:
265.84138ms target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/dd0fa7a1ae6bdc0
FAIL (2025-12-09 00:48:43 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 265.868342ms
edge
linksharing
bgp
us1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.....................................X......................] duration:
21.877969ms target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/af91489e18f8dd7
FAIL (2025-12-09 00:48:43 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 21.900061ms
edge
linksharing
bgp
ap1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..X......................................X..................] duration:
5.709677011s trace:
https://jaeger.dev.storj.io/trace/29b49b34e5929e2f
FAIL (2025-12-09 00:48:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.709700927s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
478.305723ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/6b1ae90bcdd087c7
FAIL (2025-12-09 00:48:21 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 478.336071ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
26.648865ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/d6823dba42570ec
FAIL (2025-12-09 00:48:21 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp 207.211.208.129:443: i/o timeout
Duration: 26.676978ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
242.500937ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/64025b92da229a61
FAIL (2025-12-09 00:48:06 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp 207.211.208.129:443: i/o timeout
Duration: 242.588383ms
edge
gateway
vhost
bgp
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...X......................................X.................] duration:
5.960418671s trace:
https://jaeger.dev.storj.io/trace/29b49b34e5929e2f
FAIL (2025-12-09 00:48:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.960450351s
core
uplink
us-select-1
us1-placement-20
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
1.128892776s trace:
https://jaeger.dev.storj.io/trace/2744e7e74333fadd
FAIL (2025-12-09 00:48:05 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout
Duration: 1.12891584s
edge
authservice
http
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X............................................X..] duration:
5.83868967s trace:
https://jaeger.dev.storj.io/trace/16f5f0214b7e09da
FAIL (2025-12-09 00:48:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
A, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.056163163 (81h17m12.927246198s) [noise=true , address=77.90.31.10:4535 , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.057949975 (81h17m12.92903305s) [noise=true , address=45.91.116.12:4254 , piece_id=V6Z3FY3IX4ZMXDSQWYJD7XRSHH7TF5PO3O2WGAP37H5QWR23ZVAQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.059319273 (81h17m12.930402308s) [noise=true , address=45.91.116.4:4956 , piece_id=QQ6LRHTMTGEBHNUH3HX545OSX2D4W57ZJH2HE4ULX3TSRZKCSJWQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.059492453 (81h17m12.930575498s) [noise=true , address=145.79.227.33:4874 , piece_id=4FSL6J7KRQIXTAC2R7T5SDHYMSFGLFL3SUBLFOYYRZM47V3G73OQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.059829985 (81h17m12.93091303s) [noise=true , address=77.90.31.16:4738 , piece_id=TCG6E2SKWNQ3R23XJEJG45H4WKPYHFH57SM3JLFMNXDI455T5D5A, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.060311452 (81h17m12.931394507s) [noise=true , address=145.79.227.24:4584 , piece_id=I2P5HMRRE234SLOKTQTBRXC5BJDACGFSZ4C3QDIM3R7H7VOLAR6Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.060638766 (81h17m12.931721801s) [noise=true , address=45.91.116.13:4187 , piece_id=TZEUTEYC4MWHZPOILSHTWPLNAQWKVNEM4JYGOYM54TOIH6MES2WA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.061436635 (81h17m12.93251967s) [noise=true , address=45.91.116.5:4327 , piece_id=M55GD6NYM7XLFPX2PWUZBJTKBCIID63SDCRTAINR4K3QXHQ7VFWA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.062205830 (81h17m12.933288875s) [noise=true , address=5.231.73.4:4003 , piece_id=4K3ONY56R3TZYJZI5OJ4ADJXUALZPTHP236QDFDRNZUNI3LRIADA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.063000051 (81h17m12.934083086s) [noise=true , address=77.90.31.13:4639 , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.063836003 (81h17m12.934919058s) [noise=true , address=64.49.13.154:4934 , piece_id=6TISGSS4P6CP6FJL7DFWUXYT5X6KQJ4OYHSIZGSMQV4RZMFTGU4A, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.064692454 (81h17m12.935775499s) [noise=true , address=45.91.116.11:4147 , piece_id=Z5BCQU3TM45AVD4KSHQ74AFDEBMALRUD3PXQPQEV54CBLYL3TR3Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.064959161 (81h17m12.936042216s) [noise=true , address=145.79.227.30:4783 , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.066239960 (81h17m12.937323015s) [noise=true , address=45.91.116.8:4065 , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.066383043 (81h17m12.937466108s) [noise=true , address=77.90.31.10:4534 , piece_id=I267OI6FD4ZA354UR7JZNXZBIYR6HJ44IPX2AHV2CQRO5RYBHFHQ, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.067300530 (81h17m12.938383575s) [noise=true , address=64.49.13.155:4914 , piece_id=IWMWBIGHFIMSSDWLUNLPW635SUZYL5QUXBBDVT4Q7POXKUW4WJ5Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:13.067455816 (81h17m12.938538861s) [noise=true , address=45.91.116.6:4983 , piece_id=UWFWT4HF5IFO25OED2UEZSFHFV7TZBSTUETBC2LQ7EUQLG4SUD2Q, seg_pos={0 0}, upload=71023]: Uploading piece...
Dec 9 00:46:14.495330055 (81h17m14.36641309s) [upload=71023]: Next returned nil segment
Dec 9 00:46:14.495350613 (81h17m14.366433688s) [upload=71023]: Waiting for error group managing segments...
Dec 9 00:46:14.883721607 (81h17m14.754804652s) [noise=true , address=64.49.13.155:4914 , piece_id=IWMWBIGHFIMSSDWLUNLPW635SUZYL5QUXBBDVT4Q7POXKUW4WJ5Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:14.929183823 (81h17m14.800266868s) [noise=true , address=145.79.227.24:4584 , piece_id=I2P5HMRRE234SLOKTQTBRXC5BJDACGFSZ4C3QDIM3R7H7VOLAR6Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:14.941170366 (81h17m14.812253411s) [noise=true , address=145.79.227.33:4874 , piece_id=4FSL6J7KRQIXTAC2R7T5SDHYMSFGLFL3SUBLFOYYRZM47V3G73OQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:14.959305788 (81h17m14.830388833s) [noise=true , address=64.49.13.154:4934 , piece_id=6TISGSS4P6CP6FJL7DFWUXYT5X6KQJ4OYHSIZGSMQV4RZMFTGU4A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.028943597 (81h17m14.900026632s) [noise=true , address=5.231.73.4:4003 , piece_id=4K3ONY56R3TZYJZI5OJ4ADJXUALZPTHP236QDFDRNZUNI3LRIADA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.033566479 (81h17m14.904649514s) [noise=true , address=77.90.31.16:4738 , piece_id=TCG6E2SKWNQ3R23XJEJG45H4WKPYHFH57SM3JLFMNXDI455T5D5A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.059529566 (81h17m14.930612611s) [noise=true , address=77.90.31.17:4789 , piece_id=22ZFVENBTZP7MWLLHV5HSP7QESSI4P3W67O2YZ4EOUEP4GAGVD5A, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.065748207 (81h17m14.936831242s) [noise=true , address=45.91.116.4:4956 , piece_id=QQ6LRHTMTGEBHNUH3HX545OSX2D4W57ZJH2HE4ULX3TSRZKCSJWQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.072515793 (81h17m14.943598828s) [noise=true , address=77.90.31.10:4534 , piece_id=I267OI6FD4ZA354UR7JZNXZBIYR6HJ44IPX2AHV2CQRO5RYBHFHQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.073404145 (81h17m14.94448718s) [noise=true , address=45.91.116.5:4327 , piece_id=M55GD6NYM7XLFPX2PWUZBJTKBCIID63SDCRTAINR4K3QXHQ7VFWA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.104276279 (81h17m14.975359324s) [noise=true , address=45.91.116.11:4147 , piece_id=Z5BCQU3TM45AVD4KSHQ74AFDEBMALRUD3PXQPQEV54CBLYL3TR3Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.104945043 (81h17m14.976028098s) [noise=true , address=45.91.116.13:4187 , piece_id=TZEUTEYC4MWHZPOILSHTWPLNAQWKVNEM4JYGOYM54TOIH6MES2WA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.112208182 (81h17m14.983291217s) [noise=true , address=45.91.116.6:4983 , piece_id=UWFWT4HF5IFO25OED2UEZSFHFV7TZBSTUETBC2LQ7EUQLG4SUD2Q, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.115153711 (81h17m14.986236756s) [noise=true , address=45.91.116.12:4254 , piece_id=V6Z3FY3IX4ZMXDSQWYJD7XRSHH7TF5PO3O2WGAP37H5QWR23ZVAQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: <nil>
Dec 9 00:46:15.115171264 (81h17m14.986254309s) [seg_pos={0 0}, upload=71023]: Segment reached optimal threshold of 14 pieces.
Dec 9 00:46:15.115426842 (81h17m14.986509887s) [noise=true , address=145.79.227.30:4783 , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNMd8YrgaagKDoWivhbTmRc5TPM6BNiHscECBF2yhncKgkvz): protocol: expected piece hash; context canceled; EOF
Dec 9 00:46:15.115435798 (81h17m14.986518843s) [noise=true , address=145.79.227.30:4783 , piece_id=36FPQMRRBG3OZW3R3DGEOLYTJZK5M4RBGVUU5K25N2IY6UVFHLGQ, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec 9 00:46:15.115498558 (81h17m14.986581613s) [noise=true , address=77.90.31.13:4639 , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N9N1pcaVn3nPh1WY7uktz8Z7fwJGqnTdVwZMAW5SVrqvRA8VV): protocol: expected piece hash; context canceled; EOF
Dec 9 00:46:15.115517804 (81h17m14.986600859s) [noise=true , address=77.90.31.13:4639 , piece_id=7NXF7N5A43FAF2K5FPKP224XVCUNDA2CHAKEYDSBVAMJDYHYXACQ, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec 9 00:46:15.115593578 (81h17m14.986676623s) [noise=true , address=77.90.31.10:4535 , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz): protocol: expected piece hash; context canceled; EOF
Dec 9 00:46:15.115631711 (81h17m14.986714766s) [noise=true , address=77.90.31.10:4535 , piece_id=3PGFYM3GJWZ5XSV7ESR4EPIOYKZ7QA4Q4DUKHMFKUTJMUDIFW5AA, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec 9 00:46:15.115853494 (81h17m14.986936539s) [noise=true , address=45.91.116.8:4065 , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EPCQmYb816aegE9vPSoJYByMUEvhP4DUiabis2gh9QjXQC3s): protocol: expected piece hash; context canceled; EOF
Dec 9 00:46:15.115862621 (81h17m14.986945676s) [noise=true , address=45.91.116.8:4065 , piece_id=CADF7N2FM2G2JBFQPZOOGNXO47RWIIPHWBW6BEZI65IVAHUV2IQA, seg_pos={0 0}, upload=71023]: Long tail cancellation due to optimal threshold
Dec 9 00:46:15.115922986 (81h17m14.987006031s) [seg_pos={0 0}, upload=71023]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 9 00:46:15.116025181 (81h17m14.987108226s) [upload=71023]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 9 00:46:15.116032685 (81h17m14.98711573s) [upload=71023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 9 00:47:25.980830692 (81h18m25.851913727s) [upload=71023]: Done uploading segments...
Dec 9 00:47:25.980980237 (81h18m25.852063282s) [upload=71023]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.838720209s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.....................................X......................] duration:
276.717111ms target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/dd0fa7a1ae6bdc0
FAIL (2025-12-09 00:47:59 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": dial tcp 207.211.208.129:443: i/o timeout
Duration: 276.744632ms
edge
linksharing
bgp
us1
|