Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 241341 reports (Page 4383 of 4827)
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
1.163166274s
FAIL (2025-07-15 00:33:42 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:38982->127.0.0.1:53: i/o timeout
Duration: 1.163203924s edge authservice http bgp us1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration:
476.454374ms
target:
https://eu1.storj.io/login
FAIL (2025-07-15 00:33:41 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp: lookup eu1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:54006->127.0.0.1:53: i/o timeout
Duration: 476.48281ms core satellite eu1
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)
antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration:
16.502671ms
target:
https://www.apple.com/robots.txt
FAIL (2025-07-15 00:33:40 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": dial tcp: lookup www.apple.com on 127.0.0.1:53: read udp 127.0.0.1:42083->127.0.0.1:53: i/o timeout
Duration: 16.586212ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
5.630954376s
FAIL (2025-07-15 00:33:40 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33925->127.0.0.1:53: i/o timeout
Duration: 5.630978513s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration:
1.449474392s
FAIL (2025-07-15 00:33:39 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.449497205s core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................]
duration:
2.320232546s
FAIL (2025-07-15 00:33:39 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35613->127.0.0.1:53: i/o timeout
Duration: 2.32025544s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................]
duration:
2.026028069s
FAIL (2025-07-15 00:33:25 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.026052777s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration:
4.801378791s
FAIL (2025-07-15 00:33:23 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 4.801401896s core uplink eu1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................]
duration:
11.875ms
target:
https://ap1.storj.io/login
FAIL (2025-07-15 00:33:23 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:44805->127.0.0.1:53: i/o timeout
Duration: 11.894968ms core satellite ap1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
2 out of 60 is failed (threshold=3) [..........................XX................................]
duration:
737.379962ms
FAIL (2025-07-15 00:33:22 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35613->127.0.0.1:53: i/o timeout
Duration: 737.402164ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration:
1.62440643s
FAIL (2025-07-15 00:33:19 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.624433512s core uplink eu1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip:
2 out of 60 is failed (threshold=3) [....................................................XX......]
duration:
943.022377ms
FAIL (2025-07-15 00:33:17 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55317->127.0.0.1:53: i/o timeout
Duration: 943.045732ms edge authservice http bgp eu1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
485.408265ms
FAIL (2025-07-15 00:33:14 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55317->127.0.0.1:53: i/o timeout
Duration: 485.433221ms edge authservice http bgp ap1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
2 out of 60 is failed (threshold=3) [........................XX..................................]
duration:
696.666126ms
target:
https://us1.storj.io/login
FAIL (2025-07-15 00:33:13 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:49333->127.0.0.1:53: i/o timeout
Duration: 696.693368ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................]
duration:
6.100522516s
FAIL (2025-07-15 00:33:05 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
:24.394249943 (518h55m59.164891278s) [noise=true , address=77.90.31.13:4626     , piece_id=U2XNN4FE47U4RFLZJUVMRZ4SISZ3TBN7HCRQYUBWLTXNTN5BN3IA, seg_pos={0 0}, upload=415122]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 15 00:06:24.394277596 (518h55m59.164918931s) [seg_pos={0 0}, upload=415122]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:06:24.394343541 (518h55m59.164984876s) [upload=415122]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:06:24.394347679 (518h55m59.164989014s) [upload=415122]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:06:24.692495788 (518h55m59.463137113s) [upload=415122]: Done uploading segments...
Jul 15 00:06:24.692517119 (518h55m59.463158444s) [upload=415122]: Upload finished. err: <nil>
Jul 15 00:07:17.316804141 (518h56m52.087445506s) [upload=415135]: Starting upload
Jul 15 00:07:17.316952264 (518h56m52.087593649s) [upload=415135]: Done starting upload
Jul 15 00:07:17.317069828 (518h56m52.087711223s) [upload=415135]: Uploading segments...
Jul 15 00:07:17.317453613 (518h56m52.088094948s) [upload=415135]: Got next segment. Inline: false
Jul 15 00:07:17.317540489 (518h56m52.088181864s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 15 00:07:17.317549487 (518h56m52.088190852s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 15 00:07:17.797147854 (518h56m52.567789189s) [seg_pos={0 0}, upload=415135]: Begin upload segment...
Jul 15 00:07:17.797188221 (518h56m52.567829556s) [seg_pos={0 0}, upload=415135]: Done begin upload segment.
Jul 15 00:07:17.797209151 (518h56m52.567850486s) [noise=true , address=77.90.31.19:4841     , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797261231 (518h56m52.567902566s) [noise=true , address=45.91.116.14:4191    , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797616330 (518h56m52.568257665s) [noise=true , address=104.36.82.15:4258    , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797784692 (518h56m52.568426027s) [noise=true , address=104.36.82.11:4115    , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798110125 (518h56m52.56875146s) [noise=true , address=104.36.82.5:4840     , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798170290 (518h56m52.568811625s) [noise=true , address=77.90.31.11:4553     , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798434274 (518h56m52.569075599s) [noise=true , address=77.90.31.15:4699     , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798508597 (518h56m52.569149932s) [noise=true , address=104.36.82.11:4114    , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798767944 (518h56m52.569409279s) [noise=true , address=104.36.82.10:4078    , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798923441 (518h56m52.569564776s) [noise=true , address=45.91.116.9:4261     , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.799033120 (518h56m52.569674445s) [noise=true , address=45.91.116.4:4940     , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.799206051 (518h56m52.569847386s) [noise=true , address=45.91.116.13:4153    , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800112335 (518h56m52.57075366s) [noise=true , address=104.36.82.13:4186    , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800481873 (518h56m52.571123208s) [noise=true , address=77.90.31.18:4807     , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800771777 (518h56m52.571413112s) [noise=true , address=77.90.31.14:4662     , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.801715763 (518h56m52.572357098s) [noise=true , address=104.36.82.2:4731     , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:19.582805950 (518h56m54.353447285s) [upload=415135]: Next returned nil segment
Jul 15 00:07:19.582822982 (518h56m54.353464317s) [upload=415135]: Waiting for error group managing segments...
Jul 15 00:07:19.871591866 (518h56m54.642233202s) [noise=true , address=77.90.31.15:4699     , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.919348672 (518h56m54.689990007s) [noise=true , address=104.36.82.13:4186    , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.935048428 (518h56m54.705689763s) [noise=true , address=104.36.82.15:4258    , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.935763055 (518h56m54.70640439s) [noise=true , address=104.36.82.2:4731     , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.950670895 (518h56m54.72131223s) [noise=true , address=104.36.82.10:4078    , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.955816180 (518h56m54.726457515s) [noise=true , address=104.36.82.11:4115    , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.970279219 (518h56m54.740920554s) [noise=true , address=45.91.116.9:4261     , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.992903232 (518h56m54.763544567s) [noise=true , address=77.90.31.18:4807     , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.003524783 (518h56m54.774166118s) [noise=true , address=104.36.82.11:4114    , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.066078626 (518h56m54.836719951s) [noise=true , address=77.90.31.14:4662     , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.079716798 (518h56m54.850358133s) [noise=true , address=45.91.116.13:4153    , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.100603427 (518h56m54.871244762s) [noise=true , address=104.36.82.5:4840     , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.115262171 (518h56m54.885903506s) [noise=true , address=77.90.31.19:4841     , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.115289974 (518h56m54.885931309s) [seg_pos={0 0}, upload=415135]: Segment reached optimal threshold of 13 pieces.
Jul 15 00:07:20.115432396 (518h56m54.886073732s) [noise=true , address=77.90.31.11:4553     , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115492132 (518h56m54.886133467s) [noise=true , address=45.91.116.4:4940     , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115522189 (518h56m54.886163524s) [noise=true , address=45.91.116.14:4191    , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115548169 (518h56m54.886189504s) [seg_pos={0 0}, upload=415135]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:07:20.115654933 (518h56m54.886296268s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:07:20.115661405 (518h56m54.88630275s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:07:20.424646666 (518h56m55.195288241s) [upload=415135]: Done uploading segments...
Jul 15 00:07:20.424667025 (518h56m55.19530836s) [upload=415135]: Upload finished. err: <nil>
Duration: 6.100550049s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................]
duration:
2.073185789s
FAIL (2025-07-15 00:32:59 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.073212921s core uplink us1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration:
480.564337ms
target:
https://eu1.storj.io/login
FAIL (2025-07-15 00:32:58 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp: lookup eu1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:54006->127.0.0.1:53: i/o timeout
Duration: 480.584827ms core satellite eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................]
duration:
2.382697289s
FAIL (2025-07-15 00:32:58 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35613->127.0.0.1:53: i/o timeout
Duration: 2.382718288s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
1.198830453s
FAIL (2025-07-15 00:32:50 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:38982->127.0.0.1:53: i/o timeout
Duration: 1.19886467s edge authservice http bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration:
6.38118831s
FAIL (2025-07-15 00:32:48 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55866->127.0.0.1:53: i/o timeout
Duration: 6.381208389s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
2 out of 60 is failed (threshold=3) [.........................XX.................................]
duration:
712.645832ms
target:
https://us1.storj.io/login
FAIL (2025-07-15 00:32:43 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:49333->127.0.0.1:53: i/o timeout
Duration: 712.670279ms core satellite us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
526.122219ms
FAIL (2025-07-15 00:32:43 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55317->127.0.0.1:53: i/o timeout
Duration: 526.150554ms edge authservice http bgp ap1
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)
antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration:
15.209939ms
target:
https://www.apple.com/robots.txt
FAIL (2025-07-15 00:32:42 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": dial tcp: lookup www.apple.com on 127.0.0.1:53: read udp 127.0.0.1:42083->127.0.0.1:53: i/o timeout
Duration: 15.230297ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
5.618664573s
FAIL (2025-07-15 00:32:40 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33925->127.0.0.1:53: i/o timeout
Duration: 5.618682697s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................]
duration:
1.432588965s
FAIL (2025-07-15 00:32:36 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.432611799s core uplink eu1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration:
11.095778ms
target:
https://ap1.storj.io/login
FAIL (2025-07-15 00:32:36 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:44805->127.0.0.1:53: i/o timeout
Duration: 11.115716ms core satellite ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................]
duration:
4.947170822s
FAIL (2025-07-15 00:32:24 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 4.947200978s core uplink eu1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
1.164027791s
FAIL (2025-07-15 00:32:24 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:38982->127.0.0.1:53: i/o timeout
Duration: 1.16406375s edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
2 out of 60 is failed (threshold=3) [...........................XX...............................]
duration:
754.410625ms
FAIL (2025-07-15 00:32:21 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35613->127.0.0.1:53: i/o timeout
Duration: 754.437666ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration:
5.98493416s
FAIL (2025-07-15 00:32:19 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
:24.394249943 (518h55m59.164891278s) [noise=true , address=77.90.31.13:4626     , piece_id=U2XNN4FE47U4RFLZJUVMRZ4SISZ3TBN7HCRQYUBWLTXNTN5BN3IA, seg_pos={0 0}, upload=415122]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 15 00:06:24.394277596 (518h55m59.164918931s) [seg_pos={0 0}, upload=415122]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:06:24.394343541 (518h55m59.164984876s) [upload=415122]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:06:24.394347679 (518h55m59.164989014s) [upload=415122]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:06:24.692495788 (518h55m59.463137113s) [upload=415122]: Done uploading segments...
Jul 15 00:06:24.692517119 (518h55m59.463158444s) [upload=415122]: Upload finished. err: <nil>
Jul 15 00:07:17.316804141 (518h56m52.087445506s) [upload=415135]: Starting upload
Jul 15 00:07:17.316952264 (518h56m52.087593649s) [upload=415135]: Done starting upload
Jul 15 00:07:17.317069828 (518h56m52.087711223s) [upload=415135]: Uploading segments...
Jul 15 00:07:17.317453613 (518h56m52.088094948s) [upload=415135]: Got next segment. Inline: false
Jul 15 00:07:17.317540489 (518h56m52.088181864s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 15 00:07:17.317549487 (518h56m52.088190852s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 15 00:07:17.797147854 (518h56m52.567789189s) [seg_pos={0 0}, upload=415135]: Begin upload segment...
Jul 15 00:07:17.797188221 (518h56m52.567829556s) [seg_pos={0 0}, upload=415135]: Done begin upload segment.
Jul 15 00:07:17.797209151 (518h56m52.567850486s) [noise=true , address=77.90.31.19:4841     , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797261231 (518h56m52.567902566s) [noise=true , address=45.91.116.14:4191    , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797616330 (518h56m52.568257665s) [noise=true , address=104.36.82.15:4258    , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797784692 (518h56m52.568426027s) [noise=true , address=104.36.82.11:4115    , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798110125 (518h56m52.56875146s) [noise=true , address=104.36.82.5:4840     , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798170290 (518h56m52.568811625s) [noise=true , address=77.90.31.11:4553     , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798434274 (518h56m52.569075599s) [noise=true , address=77.90.31.15:4699     , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798508597 (518h56m52.569149932s) [noise=true , address=104.36.82.11:4114    , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798767944 (518h56m52.569409279s) [noise=true , address=104.36.82.10:4078    , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798923441 (518h56m52.569564776s) [noise=true , address=45.91.116.9:4261     , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.799033120 (518h56m52.569674445s) [noise=true , address=45.91.116.4:4940     , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.799206051 (518h56m52.569847386s) [noise=true , address=45.91.116.13:4153    , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800112335 (518h56m52.57075366s) [noise=true , address=104.36.82.13:4186    , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800481873 (518h56m52.571123208s) [noise=true , address=77.90.31.18:4807     , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800771777 (518h56m52.571413112s) [noise=true , address=77.90.31.14:4662     , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.801715763 (518h56m52.572357098s) [noise=true , address=104.36.82.2:4731     , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:19.582805950 (518h56m54.353447285s) [upload=415135]: Next returned nil segment
Jul 15 00:07:19.582822982 (518h56m54.353464317s) [upload=415135]: Waiting for error group managing segments...
Jul 15 00:07:19.871591866 (518h56m54.642233202s) [noise=true , address=77.90.31.15:4699     , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.919348672 (518h56m54.689990007s) [noise=true , address=104.36.82.13:4186    , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.935048428 (518h56m54.705689763s) [noise=true , address=104.36.82.15:4258    , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.935763055 (518h56m54.70640439s) [noise=true , address=104.36.82.2:4731     , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.950670895 (518h56m54.72131223s) [noise=true , address=104.36.82.10:4078    , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.955816180 (518h56m54.726457515s) [noise=true , address=104.36.82.11:4115    , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.970279219 (518h56m54.740920554s) [noise=true , address=45.91.116.9:4261     , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.992903232 (518h56m54.763544567s) [noise=true , address=77.90.31.18:4807     , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.003524783 (518h56m54.774166118s) [noise=true , address=104.36.82.11:4114    , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.066078626 (518h56m54.836719951s) [noise=true , address=77.90.31.14:4662     , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.079716798 (518h56m54.850358133s) [noise=true , address=45.91.116.13:4153    , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.100603427 (518h56m54.871244762s) [noise=true , address=104.36.82.5:4840     , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.115262171 (518h56m54.885903506s) [noise=true , address=77.90.31.19:4841     , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.115289974 (518h56m54.885931309s) [seg_pos={0 0}, upload=415135]: Segment reached optimal threshold of 13 pieces.
Jul 15 00:07:20.115432396 (518h56m54.886073732s) [noise=true , address=77.90.31.11:4553     , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115492132 (518h56m54.886133467s) [noise=true , address=45.91.116.4:4940     , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115522189 (518h56m54.886163524s) [noise=true , address=45.91.116.14:4191    , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115548169 (518h56m54.886189504s) [seg_pos={0 0}, upload=415135]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:07:20.115654933 (518h56m54.886296268s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:07:20.115661405 (518h56m54.88630275s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:07:20.424646666 (518h56m55.195288241s) [upload=415135]: Done uploading segments...
Jul 15 00:07:20.424667025 (518h56m55.19530836s) [upload=415135]: Upload finished. err: <nil>
Duration: 5.984961403s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
2 out of 60 is failed (threshold=3) [..........................XX................................]
duration:
694.899711ms
target:
https://us1.storj.io/login
FAIL (2025-07-15 00:32:18 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:49333->127.0.0.1:53: i/o timeout
Duration: 694.917945ms core satellite us1
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)
antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................]
duration:
17.089134ms
target:
https://www.apple.com/robots.txt
FAIL (2025-07-15 00:32:17 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": dial tcp: lookup www.apple.com on 127.0.0.1:53: read udp 127.0.0.1:42083->127.0.0.1:53: i/o timeout
Duration: 17.114362ms core website
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration:
12.59731ms
target:
https://ap1.storj.io/login
FAIL (2025-07-15 00:32:16 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:44805->127.0.0.1:53: i/o timeout
Duration: 12.631255ms core satellite ap1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip:
2 out of 60 is failed (threshold=3) [.....................................................XX.....]
duration:
956.11203ms
FAIL (2025-07-15 00:32:13 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55317->127.0.0.1:53: i/o timeout
Duration: 956.137728ms edge authservice http bgp eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................]
duration:
486.765493ms
target:
https://eu1.storj.io/login
FAIL (2025-07-15 00:32:10 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp: lookup eu1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:54006->127.0.0.1:53: i/o timeout
Duration: 486.790772ms core satellite eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration:
2.428693999s
FAIL (2025-07-15 00:32:02 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35613->127.0.0.1:53: i/o timeout
Duration: 2.428716732s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................]
duration:
2.04961641s
FAIL (2025-07-15 00:31:57 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.049641909s core uplink us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip:
2 out of 60 is failed (threshold=3) [......................................................XX....]
duration:
938.19887ms
FAIL (2025-07-15 00:31:57 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55317->127.0.0.1:53: i/o timeout
Duration: 938.228438ms edge authservice http bgp eu1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
1.154344924s
FAIL (2025-07-15 00:31:56 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:38982->127.0.0.1:53: i/o timeout
Duration: 1.154371436s edge authservice http bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration:
6.297166183s
FAIL (2025-07-15 00:31:51 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55866->127.0.0.1:53: i/o timeout
Duration: 6.297187946s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration:
6.201487307s
FAIL (2025-07-15 00:31:49 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
:24.394249943 (518h55m59.164891278s) [noise=true , address=77.90.31.13:4626     , piece_id=U2XNN4FE47U4RFLZJUVMRZ4SISZ3TBN7HCRQYUBWLTXNTN5BN3IA, seg_pos={0 0}, upload=415122]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 15 00:06:24.394277596 (518h55m59.164918931s) [seg_pos={0 0}, upload=415122]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:06:24.394343541 (518h55m59.164984876s) [upload=415122]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:06:24.394347679 (518h55m59.164989014s) [upload=415122]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:06:24.692495788 (518h55m59.463137113s) [upload=415122]: Done uploading segments...
Jul 15 00:06:24.692517119 (518h55m59.463158444s) [upload=415122]: Upload finished. err: <nil>
Jul 15 00:07:17.316804141 (518h56m52.087445506s) [upload=415135]: Starting upload
Jul 15 00:07:17.316952264 (518h56m52.087593649s) [upload=415135]: Done starting upload
Jul 15 00:07:17.317069828 (518h56m52.087711223s) [upload=415135]: Uploading segments...
Jul 15 00:07:17.317453613 (518h56m52.088094948s) [upload=415135]: Got next segment. Inline: false
Jul 15 00:07:17.317540489 (518h56m52.088181864s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 15 00:07:17.317549487 (518h56m52.088190852s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 15 00:07:17.797147854 (518h56m52.567789189s) [seg_pos={0 0}, upload=415135]: Begin upload segment...
Jul 15 00:07:17.797188221 (518h56m52.567829556s) [seg_pos={0 0}, upload=415135]: Done begin upload segment.
Jul 15 00:07:17.797209151 (518h56m52.567850486s) [noise=true , address=77.90.31.19:4841     , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797261231 (518h56m52.567902566s) [noise=true , address=45.91.116.14:4191    , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797616330 (518h56m52.568257665s) [noise=true , address=104.36.82.15:4258    , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797784692 (518h56m52.568426027s) [noise=true , address=104.36.82.11:4115    , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798110125 (518h56m52.56875146s) [noise=true , address=104.36.82.5:4840     , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798170290 (518h56m52.568811625s) [noise=true , address=77.90.31.11:4553     , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798434274 (518h56m52.569075599s) [noise=true , address=77.90.31.15:4699     , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798508597 (518h56m52.569149932s) [noise=true , address=104.36.82.11:4114    , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798767944 (518h56m52.569409279s) [noise=true , address=104.36.82.10:4078    , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798923441 (518h56m52.569564776s) [noise=true , address=45.91.116.9:4261     , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.799033120 (518h56m52.569674445s) [noise=true , address=45.91.116.4:4940     , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.799206051 (518h56m52.569847386s) [noise=true , address=45.91.116.13:4153    , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800112335 (518h56m52.57075366s) [noise=true , address=104.36.82.13:4186    , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800481873 (518h56m52.571123208s) [noise=true , address=77.90.31.18:4807     , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800771777 (518h56m52.571413112s) [noise=true , address=77.90.31.14:4662     , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.801715763 (518h56m52.572357098s) [noise=true , address=104.36.82.2:4731     , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:19.582805950 (518h56m54.353447285s) [upload=415135]: Next returned nil segment
Jul 15 00:07:19.582822982 (518h56m54.353464317s) [upload=415135]: Waiting for error group managing segments...
Jul 15 00:07:19.871591866 (518h56m54.642233202s) [noise=true , address=77.90.31.15:4699     , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.919348672 (518h56m54.689990007s) [noise=true , address=104.36.82.13:4186    , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.935048428 (518h56m54.705689763s) [noise=true , address=104.36.82.15:4258    , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.935763055 (518h56m54.70640439s) [noise=true , address=104.36.82.2:4731     , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.950670895 (518h56m54.72131223s) [noise=true , address=104.36.82.10:4078    , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.955816180 (518h56m54.726457515s) [noise=true , address=104.36.82.11:4115    , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.970279219 (518h56m54.740920554s) [noise=true , address=45.91.116.9:4261     , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.992903232 (518h56m54.763544567s) [noise=true , address=77.90.31.18:4807     , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.003524783 (518h56m54.774166118s) [noise=true , address=104.36.82.11:4114    , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.066078626 (518h56m54.836719951s) [noise=true , address=77.90.31.14:4662     , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.079716798 (518h56m54.850358133s) [noise=true , address=45.91.116.13:4153    , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.100603427 (518h56m54.871244762s) [noise=true , address=104.36.82.5:4840     , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.115262171 (518h56m54.885903506s) [noise=true , address=77.90.31.19:4841     , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.115289974 (518h56m54.885931309s) [seg_pos={0 0}, upload=415135]: Segment reached optimal threshold of 13 pieces.
Jul 15 00:07:20.115432396 (518h56m54.886073732s) [noise=true , address=77.90.31.11:4553     , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115492132 (518h56m54.886133467s) [noise=true , address=45.91.116.4:4940     , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115522189 (518h56m54.886163524s) [noise=true , address=45.91.116.14:4191    , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115548169 (518h56m54.886189504s) [seg_pos={0 0}, upload=415135]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:07:20.115654933 (518h56m54.886296268s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:07:20.115661405 (518h56m54.88630275s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:07:20.424646666 (518h56m55.195288241s) [upload=415135]: Done uploading segments...
Jul 15 00:07:20.424667025 (518h56m55.19530836s) [upload=415135]: Upload finished. err: <nil>
Duration: 6.201559526s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................]
duration:
1.496248527s
FAIL (2025-07-15 00:31:48 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.496275107s core uplink eu1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
2 out of 60 is failed (threshold=3) [...........................XX...............................]
duration:
695.788632ms
target:
https://us1.storj.io/login
FAIL (2025-07-15 00:31:47 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:49333->127.0.0.1:53: i/o timeout
Duration: 695.814382ms core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
5.624102989s
FAIL (2025-07-15 00:31:46 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33925->127.0.0.1:53: i/o timeout
Duration: 5.624192329s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)
antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................]
duration:
13.444602ms
target:
https://www.apple.com/robots.txt
FAIL (2025-07-15 00:31:41 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": dial tcp: lookup www.apple.com on 127.0.0.1:53: read udp 127.0.0.1:42083->127.0.0.1:53: i/o timeout
Duration: 13.473187ms core website
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
2.412773589s
FAIL (2025-07-15 00:31:41 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55317->127.0.0.1:53: i/o timeout
Duration: 2.412807263s edge authservice http bgp ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................]
duration:
11.77685ms
target:
https://ap1.storj.io/login
FAIL (2025-07-15 00:31:39 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:44805->127.0.0.1:53: i/o timeout
Duration: 11.799846ms core satellite ap1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip:
2 out of 60 is failed (threshold=3) [.......................................................XX...]
duration:
990.348126ms
FAIL (2025-07-15 00:31:39 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55317->127.0.0.1:53: i/o timeout
Duration: 990.377794ms edge authservice http bgp eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................]
duration:
4.922507537s
FAIL (2025-07-15 00:31:28 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 4.922533608s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................]
duration:
6.862563539s
FAIL (2025-07-15 00:31:17 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
:24.394249943 (518h55m59.164891278s) [noise=true , address=77.90.31.13:4626     , piece_id=U2XNN4FE47U4RFLZJUVMRZ4SISZ3TBN7HCRQYUBWLTXNTN5BN3IA, seg_pos={0 0}, upload=415122]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 15 00:06:24.394277596 (518h55m59.164918931s) [seg_pos={0 0}, upload=415122]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:06:24.394343541 (518h55m59.164984876s) [upload=415122]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:06:24.394347679 (518h55m59.164989014s) [upload=415122]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:06:24.692495788 (518h55m59.463137113s) [upload=415122]: Done uploading segments...
Jul 15 00:06:24.692517119 (518h55m59.463158444s) [upload=415122]: Upload finished. err: <nil>
Jul 15 00:07:17.316804141 (518h56m52.087445506s) [upload=415135]: Starting upload
Jul 15 00:07:17.316952264 (518h56m52.087593649s) [upload=415135]: Done starting upload
Jul 15 00:07:17.317069828 (518h56m52.087711223s) [upload=415135]: Uploading segments...
Jul 15 00:07:17.317453613 (518h56m52.088094948s) [upload=415135]: Got next segment. Inline: false
Jul 15 00:07:17.317540489 (518h56m52.088181864s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 15 00:07:17.317549487 (518h56m52.088190852s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 15 00:07:17.797147854 (518h56m52.567789189s) [seg_pos={0 0}, upload=415135]: Begin upload segment...
Jul 15 00:07:17.797188221 (518h56m52.567829556s) [seg_pos={0 0}, upload=415135]: Done begin upload segment.
Jul 15 00:07:17.797209151 (518h56m52.567850486s) [noise=true , address=77.90.31.19:4841     , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797261231 (518h56m52.567902566s) [noise=true , address=45.91.116.14:4191    , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797616330 (518h56m52.568257665s) [noise=true , address=104.36.82.15:4258    , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797784692 (518h56m52.568426027s) [noise=true , address=104.36.82.11:4115    , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798110125 (518h56m52.56875146s) [noise=true , address=104.36.82.5:4840     , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798170290 (518h56m52.568811625s) [noise=true , address=77.90.31.11:4553     , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798434274 (518h56m52.569075599s) [noise=true , address=77.90.31.15:4699     , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798508597 (518h56m52.569149932s) [noise=true , address=104.36.82.11:4114    , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798767944 (518h56m52.569409279s) [noise=true , address=104.36.82.10:4078    , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798923441 (518h56m52.569564776s) [noise=true , address=45.91.116.9:4261     , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.799033120 (518h56m52.569674445s) [noise=true , address=45.91.116.4:4940     , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.799206051 (518h56m52.569847386s) [noise=true , address=45.91.116.13:4153    , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800112335 (518h56m52.57075366s) [noise=true , address=104.36.82.13:4186    , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800481873 (518h56m52.571123208s) [noise=true , address=77.90.31.18:4807     , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800771777 (518h56m52.571413112s) [noise=true , address=77.90.31.14:4662     , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.801715763 (518h56m52.572357098s) [noise=true , address=104.36.82.2:4731     , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:19.582805950 (518h56m54.353447285s) [upload=415135]: Next returned nil segment
Jul 15 00:07:19.582822982 (518h56m54.353464317s) [upload=415135]: Waiting for error group managing segments...
Jul 15 00:07:19.871591866 (518h56m54.642233202s) [noise=true , address=77.90.31.15:4699     , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.919348672 (518h56m54.689990007s) [noise=true , address=104.36.82.13:4186    , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.935048428 (518h56m54.705689763s) [noise=true , address=104.36.82.15:4258    , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.935763055 (518h56m54.70640439s) [noise=true , address=104.36.82.2:4731     , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.950670895 (518h56m54.72131223s) [noise=true , address=104.36.82.10:4078    , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.955816180 (518h56m54.726457515s) [noise=true , address=104.36.82.11:4115    , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.970279219 (518h56m54.740920554s) [noise=true , address=45.91.116.9:4261     , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.992903232 (518h56m54.763544567s) [noise=true , address=77.90.31.18:4807     , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.003524783 (518h56m54.774166118s) [noise=true , address=104.36.82.11:4114    , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.066078626 (518h56m54.836719951s) [noise=true , address=77.90.31.14:4662     , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.079716798 (518h56m54.850358133s) [noise=true , address=45.91.116.13:4153    , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.100603427 (518h56m54.871244762s) [noise=true , address=104.36.82.5:4840     , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.115262171 (518h56m54.885903506s) [noise=true , address=77.90.31.19:4841     , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.115289974 (518h56m54.885931309s) [seg_pos={0 0}, upload=415135]: Segment reached optimal threshold of 13 pieces.
Jul 15 00:07:20.115432396 (518h56m54.886073732s) [noise=true , address=77.90.31.11:4553     , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115492132 (518h56m54.886133467s) [noise=true , address=45.91.116.4:4940     , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115522189 (518h56m54.886163524s) [noise=true , address=45.91.116.14:4191    , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115548169 (518h56m54.886189504s) [seg_pos={0 0}, upload=415135]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:07:20.115654933 (518h56m54.886296268s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:07:20.115661405 (518h56m54.88630275s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:07:20.424646666 (518h56m55.195288241s) [upload=415135]: Done uploading segments...
Jul 15 00:07:20.424667025 (518h56m55.19530836s) [upload=415135]: Upload finished. err: <nil>
Duration: 6.862587265s core uplink us-select-1