Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [....................................XX......................] duration:
692.918338ms target:
https://us1.storj.io/login
FAIL (2025-07-15 00:24:55 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:49333->127.0.0.1:53: i/o timeout
Duration: 692.940991ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
1.491458099s
FAIL (2025-07-15 00:24:49 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.491481373s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
470.229374ms target:
https://eu1.storj.io/login
FAIL (2025-07-15 00:24:44 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp: lookup eu1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:54006->127.0.0.1:53: i/o timeout
Duration: 470.256215ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.220328005s
FAIL (2025-07-15 00:24:42 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 5.220356238s
core
uplink
eu1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [....................................XX......................] duration:
729.174321ms
FAIL (2025-07-15 00:24:41 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35613->127.0.0.1:53: i/o timeout
Duration: 729.207295ms
edge
authservice
http
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.....X......................................................] duration:
177.059469ms target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-15 00:24:38 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:59707->127.0.0.1:53: i/o timeout
Duration: 177.083935ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
12.016659ms target:
https://ap1.storj.io/login
FAIL (2025-07-15 00:24:32 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:44805->127.0.0.1:53: i/o timeout
Duration: 12.040885ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.020236762s
FAIL (2025-07-15 00:24:31 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.020267331s
core
uplink
us1
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
13.944618ms target:
https://www.apple.com/robots.txt
FAIL (2025-07-15 00:24:25 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": dial tcp: lookup www.apple.com on 127.0.0.1:53: read udp 127.0.0.1:42083->127.0.0.1:53: i/o timeout
Duration: 13.964946ms
core
website
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.298706076s
FAIL (2025-07-15 00:24:23 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35613->127.0.0.1:53: i/o timeout
Duration: 2.29872901s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
6.254626795s
FAIL (2025-07-15 00:24:17 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55866->127.0.0.1:53: i/o timeout
Duration: 6.25464556s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
4.827568365s
FAIL (2025-07-15 00:24:13 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 4.827593893s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.042143684s
FAIL (2025-07-15 00:24:12 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.042169904s
core
uplink
us1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.......X....................................................] duration:
22.739114ms target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-07-15 00:24:10 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35519->127.0.0.1:53: i/o timeout
Duration: 22.760484ms
edge
linksharing
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
6.043382678s
FAIL (2025-07-15 00:24:08 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
:24.394249943 (518h55m59.164891278s) [noise=true , address=77.90.31.13:4626 , piece_id=U2XNN4FE47U4RFLZJUVMRZ4SISZ3TBN7HCRQYUBWLTXNTN5BN3IA, seg_pos={0 0}, upload=415122]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 15 00:06:24.394277596 (518h55m59.164918931s) [seg_pos={0 0}, upload=415122]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:06:24.394343541 (518h55m59.164984876s) [upload=415122]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:06:24.394347679 (518h55m59.164989014s) [upload=415122]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:06:24.692495788 (518h55m59.463137113s) [upload=415122]: Done uploading segments...
Jul 15 00:06:24.692517119 (518h55m59.463158444s) [upload=415122]: Upload finished. err: <nil>
Jul 15 00:07:17.316804141 (518h56m52.087445506s) [upload=415135]: Starting upload
Jul 15 00:07:17.316952264 (518h56m52.087593649s) [upload=415135]: Done starting upload
Jul 15 00:07:17.317069828 (518h56m52.087711223s) [upload=415135]: Uploading segments...
Jul 15 00:07:17.317453613 (518h56m52.088094948s) [upload=415135]: Got next segment. Inline: false
Jul 15 00:07:17.317540489 (518h56m52.088181864s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 15 00:07:17.317549487 (518h56m52.088190852s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 15 00:07:17.797147854 (518h56m52.567789189s) [seg_pos={0 0}, upload=415135]: Begin upload segment...
Jul 15 00:07:17.797188221 (518h56m52.567829556s) [seg_pos={0 0}, upload=415135]: Done begin upload segment.
Jul 15 00:07:17.797209151 (518h56m52.567850486s) [noise=true , address=77.90.31.19:4841 , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797261231 (518h56m52.567902566s) [noise=true , address=45.91.116.14:4191 , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797616330 (518h56m52.568257665s) [noise=true , address=104.36.82.15:4258 , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797784692 (518h56m52.568426027s) [noise=true , address=104.36.82.11:4115 , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798110125 (518h56m52.56875146s) [noise=true , address=104.36.82.5:4840 , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798170290 (518h56m52.568811625s) [noise=true , address=77.90.31.11:4553 , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798434274 (518h56m52.569075599s) [noise=true , address=77.90.31.15:4699 , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798508597 (518h56m52.569149932s) [noise=true , address=104.36.82.11:4114 , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798767944 (518h56m52.569409279s) [noise=true , address=104.36.82.10:4078 , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798923441 (518h56m52.569564776s) [noise=true , address=45.91.116.9:4261 , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.799033120 (518h56m52.569674445s) [noise=true , address=45.91.116.4:4940 , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.799206051 (518h56m52.569847386s) [noise=true , address=45.91.116.13:4153 , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800112335 (518h56m52.57075366s) [noise=true , address=104.36.82.13:4186 , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800481873 (518h56m52.571123208s) [noise=true , address=77.90.31.18:4807 , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800771777 (518h56m52.571413112s) [noise=true , address=77.90.31.14:4662 , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.801715763 (518h56m52.572357098s) [noise=true , address=104.36.82.2:4731 , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:19.582805950 (518h56m54.353447285s) [upload=415135]: Next returned nil segment
Jul 15 00:07:19.582822982 (518h56m54.353464317s) [upload=415135]: Waiting for error group managing segments...
Jul 15 00:07:19.871591866 (518h56m54.642233202s) [noise=true , address=77.90.31.15:4699 , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.919348672 (518h56m54.689990007s) [noise=true , address=104.36.82.13:4186 , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.935048428 (518h56m54.705689763s) [noise=true , address=104.36.82.15:4258 , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.935763055 (518h56m54.70640439s) [noise=true , address=104.36.82.2:4731 , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.950670895 (518h56m54.72131223s) [noise=true , address=104.36.82.10:4078 , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.955816180 (518h56m54.726457515s) [noise=true , address=104.36.82.11:4115 , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.970279219 (518h56m54.740920554s) [noise=true , address=45.91.116.9:4261 , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.992903232 (518h56m54.763544567s) [noise=true , address=77.90.31.18:4807 , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.003524783 (518h56m54.774166118s) [noise=true , address=104.36.82.11:4114 , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.066078626 (518h56m54.836719951s) [noise=true , address=77.90.31.14:4662 , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.079716798 (518h56m54.850358133s) [noise=true , address=45.91.116.13:4153 , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.100603427 (518h56m54.871244762s) [noise=true , address=104.36.82.5:4840 , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.115262171 (518h56m54.885903506s) [noise=true , address=77.90.31.19:4841 , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.115289974 (518h56m54.885931309s) [seg_pos={0 0}, upload=415135]: Segment reached optimal threshold of 13 pieces.
Jul 15 00:07:20.115432396 (518h56m54.886073732s) [noise=true , address=77.90.31.11:4553 , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115492132 (518h56m54.886133467s) [noise=true , address=45.91.116.4:4940 , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115522189 (518h56m54.886163524s) [noise=true , address=45.91.116.14:4191 , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115548169 (518h56m54.886189504s) [seg_pos={0 0}, upload=415135]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:07:20.115654933 (518h56m54.886296268s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:07:20.115661405 (518h56m54.88630275s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:07:20.424646666 (518h56m55.195288241s) [upload=415135]: Done uploading segments...
Jul 15 00:07:20.424667025 (518h56m55.19530836s) [upload=415135]: Upload finished. err: <nil>
Duration: 6.04340926s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
17.023809ms target:
https://ap1.storj.io/login
FAIL (2025-07-15 00:24:04 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:44805->127.0.0.1:53: i/o timeout
Duration: 17.040551ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
484.23521ms target:
https://eu1.storj.io/login
FAIL (2025-07-15 00:24:03 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp: lookup eu1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:54006->127.0.0.1:53: i/o timeout
Duration: 484.26629ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [......X.....................................................] duration:
182.964517ms target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-15 00:24:03 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:59707->127.0.0.1:53: i/o timeout
Duration: 182.988503ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [.....................................XX.....................] duration:
700.750062ms target:
https://us1.storj.io/login
FAIL (2025-07-15 00:24:02 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:49333->127.0.0.1:53: i/o timeout
Duration: 700.777284ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
14.543033ms target:
https://www.apple.com/robots.txt
FAIL (2025-07-15 00:24:00 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": dial tcp: lookup www.apple.com on 127.0.0.1:53: read udp 127.0.0.1:42083->127.0.0.1:53: i/o timeout
Duration: 14.564584ms
core
website
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [.....................................XX.....................] duration:
740.919149ms
FAIL (2025-07-15 00:23:59 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35613->127.0.0.1:53: i/o timeout
Duration: 740.943687ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
1.50455854s
FAIL (2025-07-15 00:23:53 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.504586044s
core
uplink
eu1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.250915983s
FAIL (2025-07-15 00:23:48 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35613->127.0.0.1:53: i/o timeout
Duration: 2.250935982s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.......X....................................................] duration:
176.417921ms target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-15 00:23:33 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:59707->127.0.0.1:53: i/o timeout
Duration: 176.451305ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [........X...................................................] duration:
23.247074ms target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-07-15 00:23:27 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35519->127.0.0.1:53: i/o timeout
Duration: 23.273915ms
edge
linksharing
bgp
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.453616506s
FAIL (2025-07-15 00:23:24 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35613->127.0.0.1:53: i/o timeout
Duration: 2.453630792s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
6.255745337s
FAIL (2025-07-15 00:23:23 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55866->127.0.0.1:53: i/o timeout
Duration: 6.255765524s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.039678456s
FAIL (2025-07-15 00:23:22 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.039710889s
core
uplink
us1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
490.734292ms target:
https://eu1.storj.io/login
FAIL (2025-07-15 00:23:11 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp: lookup eu1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:54006->127.0.0.1:53: i/o timeout
Duration: 490.756427ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.138607121s
FAIL (2025-07-15 00:23:06 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 5.138637951s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
1.459122824s
FAIL (2025-07-15 00:23:03 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.45914716s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
6.006699265s
FAIL (2025-07-15 00:23:02 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
:24.394249943 (518h55m59.164891278s) [noise=true , address=77.90.31.13:4626 , piece_id=U2XNN4FE47U4RFLZJUVMRZ4SISZ3TBN7HCRQYUBWLTXNTN5BN3IA, seg_pos={0 0}, upload=415122]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 15 00:06:24.394277596 (518h55m59.164918931s) [seg_pos={0 0}, upload=415122]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:06:24.394343541 (518h55m59.164984876s) [upload=415122]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:06:24.394347679 (518h55m59.164989014s) [upload=415122]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:06:24.692495788 (518h55m59.463137113s) [upload=415122]: Done uploading segments...
Jul 15 00:06:24.692517119 (518h55m59.463158444s) [upload=415122]: Upload finished. err: <nil>
Jul 15 00:07:17.316804141 (518h56m52.087445506s) [upload=415135]: Starting upload
Jul 15 00:07:17.316952264 (518h56m52.087593649s) [upload=415135]: Done starting upload
Jul 15 00:07:17.317069828 (518h56m52.087711223s) [upload=415135]: Uploading segments...
Jul 15 00:07:17.317453613 (518h56m52.088094948s) [upload=415135]: Got next segment. Inline: false
Jul 15 00:07:17.317540489 (518h56m52.088181864s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 15 00:07:17.317549487 (518h56m52.088190852s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 15 00:07:17.797147854 (518h56m52.567789189s) [seg_pos={0 0}, upload=415135]: Begin upload segment...
Jul 15 00:07:17.797188221 (518h56m52.567829556s) [seg_pos={0 0}, upload=415135]: Done begin upload segment.
Jul 15 00:07:17.797209151 (518h56m52.567850486s) [noise=true , address=77.90.31.19:4841 , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797261231 (518h56m52.567902566s) [noise=true , address=45.91.116.14:4191 , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797616330 (518h56m52.568257665s) [noise=true , address=104.36.82.15:4258 , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797784692 (518h56m52.568426027s) [noise=true , address=104.36.82.11:4115 , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798110125 (518h56m52.56875146s) [noise=true , address=104.36.82.5:4840 , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798170290 (518h56m52.568811625s) [noise=true , address=77.90.31.11:4553 , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798434274 (518h56m52.569075599s) [noise=true , address=77.90.31.15:4699 , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798508597 (518h56m52.569149932s) [noise=true , address=104.36.82.11:4114 , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798767944 (518h56m52.569409279s) [noise=true , address=104.36.82.10:4078 , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798923441 (518h56m52.569564776s) [noise=true , address=45.91.116.9:4261 , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.799033120 (518h56m52.569674445s) [noise=true , address=45.91.116.4:4940 , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.799206051 (518h56m52.569847386s) [noise=true , address=45.91.116.13:4153 , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800112335 (518h56m52.57075366s) [noise=true , address=104.36.82.13:4186 , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800481873 (518h56m52.571123208s) [noise=true , address=77.90.31.18:4807 , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800771777 (518h56m52.571413112s) [noise=true , address=77.90.31.14:4662 , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.801715763 (518h56m52.572357098s) [noise=true , address=104.36.82.2:4731 , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:19.582805950 (518h56m54.353447285s) [upload=415135]: Next returned nil segment
Jul 15 00:07:19.582822982 (518h56m54.353464317s) [upload=415135]: Waiting for error group managing segments...
Jul 15 00:07:19.871591866 (518h56m54.642233202s) [noise=true , address=77.90.31.15:4699 , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.919348672 (518h56m54.689990007s) [noise=true , address=104.36.82.13:4186 , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.935048428 (518h56m54.705689763s) [noise=true , address=104.36.82.15:4258 , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.935763055 (518h56m54.70640439s) [noise=true , address=104.36.82.2:4731 , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.950670895 (518h56m54.72131223s) [noise=true , address=104.36.82.10:4078 , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.955816180 (518h56m54.726457515s) [noise=true , address=104.36.82.11:4115 , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.970279219 (518h56m54.740920554s) [noise=true , address=45.91.116.9:4261 , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.992903232 (518h56m54.763544567s) [noise=true , address=77.90.31.18:4807 , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.003524783 (518h56m54.774166118s) [noise=true , address=104.36.82.11:4114 , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.066078626 (518h56m54.836719951s) [noise=true , address=77.90.31.14:4662 , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.079716798 (518h56m54.850358133s) [noise=true , address=45.91.116.13:4153 , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.100603427 (518h56m54.871244762s) [noise=true , address=104.36.82.5:4840 , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.115262171 (518h56m54.885903506s) [noise=true , address=77.90.31.19:4841 , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.115289974 (518h56m54.885931309s) [seg_pos={0 0}, upload=415135]: Segment reached optimal threshold of 13 pieces.
Jul 15 00:07:20.115432396 (518h56m54.886073732s) [noise=true , address=77.90.31.11:4553 , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115492132 (518h56m54.886133467s) [noise=true , address=45.91.116.4:4940 , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115522189 (518h56m54.886163524s) [noise=true , address=45.91.116.14:4191 , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115548169 (518h56m54.886189504s) [seg_pos={0 0}, upload=415135]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:07:20.115654933 (518h56m54.886296268s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:07:20.115661405 (518h56m54.88630275s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:07:20.424646666 (518h56m55.195288241s) [upload=415135]: Done uploading segments...
Jul 15 00:07:20.424667025 (518h56m55.19530836s) [upload=415135]: Upload finished. err: <nil>
Duration: 6.006727619s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [........X...................................................] duration:
174.56167ms target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-15 00:23:01 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:59707->127.0.0.1:53: i/o timeout
Duration: 174.586198ms
edge
linksharing
bgp
eu1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.31746558s
FAIL (2025-07-15 00:23:01 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35613->127.0.0.1:53: i/o timeout
Duration: 2.317484225s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [......................................XX....................] duration:
918.939708ms target:
https://us1.storj.io/login
FAIL (2025-07-15 00:23:00 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:49333->127.0.0.1:53: i/o timeout
Duration: 918.967181ms
core
satellite
us1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [......................................XX....................] duration:
770.042977ms
FAIL (2025-07-15 00:22:56 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35613->127.0.0.1:53: i/o timeout
Duration: 770.069849ms
edge
authservice
http
us-select-1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
12.637768ms target:
https://ap1.storj.io/login
FAIL (2025-07-15 00:22:55 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:44805->127.0.0.1:53: i/o timeout
Duration: 12.665801ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.........X..................................................] duration:
28.415493ms target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-07-15 00:22:50 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35519->127.0.0.1:53: i/o timeout
Duration: 28.447124ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
17.335105ms target:
https://www.apple.com/robots.txt
FAIL (2025-07-15 00:22:49 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": dial tcp: lookup www.apple.com on 127.0.0.1:53: read udp 127.0.0.1:42083->127.0.0.1:53: i/o timeout
Duration: 17.361476ms
core
website
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
6.300647943s
FAIL (2025-07-15 00:22:49 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55866->127.0.0.1:53: i/o timeout
Duration: 6.300687057s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.15952982s
FAIL (2025-07-15 00:22:44 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.159558847s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.280213143s
FAIL (2025-07-15 00:22:42 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35613->127.0.0.1:53: i/o timeout
Duration: 2.280234695s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.........X..................................................] duration:
184.695079ms target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-15 00:22:41 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:59707->127.0.0.1:53: i/o timeout
Duration: 184.717984ms
edge
linksharing
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [.......................................XX...................] duration:
814.541611ms
FAIL (2025-07-15 00:22:35 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35613->127.0.0.1:53: i/o timeout
Duration: 814.565719ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
4.876188261s
FAIL (2025-07-15 00:22:32 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 4.87621922s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.021058494s
FAIL (2025-07-15 00:22:28 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.021086188s
core
uplink
us1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..........X.................................................] duration:
17.480353ms target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-07-15 00:22:20 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35519->127.0.0.1:53: i/o timeout
Duration: 17.510219ms
edge
linksharing
bgp
ap1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [........................................XX..................] duration:
745.362903ms
FAIL (2025-07-15 00:22:15 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35613->127.0.0.1:53: i/o timeout
Duration: 745.386679ms
edge
authservice
http
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [.......................................XX...................] duration:
702.827506ms target:
https://us1.storj.io/login
FAIL (2025-07-15 00:22:08 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:49333->127.0.0.1:53: i/o timeout
Duration: 702.853667ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..........X.................................................] duration:
176.037424ms target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-15 00:22:03 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:59707->127.0.0.1:53: i/o timeout
Duration: 176.059576ms
edge
linksharing
bgp
eu1
|