Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 412663 reports (Page 7810 of 8254)
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip: 
2 out of 60 is failed (threshold=3) [...........................XX...............................]
duration: 
754.410625ms
FAIL (2025-07-15 00:32:21 UTC) 
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35613->127.0.0.1:53: i/o timeout
Duration: 754.437666ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration: 
5.98493416s
FAIL (2025-07-15 00:32:19 UTC) 
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
:24.394249943 (518h55m59.164891278s) [noise=true , address=77.90.31.13:4626     , piece_id=U2XNN4FE47U4RFLZJUVMRZ4SISZ3TBN7HCRQYUBWLTXNTN5BN3IA, seg_pos={0 0}, upload=415122]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 15 00:06:24.394277596 (518h55m59.164918931s) [seg_pos={0 0}, upload=415122]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:06:24.394343541 (518h55m59.164984876s) [upload=415122]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:06:24.394347679 (518h55m59.164989014s) [upload=415122]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:06:24.692495788 (518h55m59.463137113s) [upload=415122]: Done uploading segments...
Jul 15 00:06:24.692517119 (518h55m59.463158444s) [upload=415122]: Upload finished. err: <nil>
Jul 15 00:07:17.316804141 (518h56m52.087445506s) [upload=415135]: Starting upload
Jul 15 00:07:17.316952264 (518h56m52.087593649s) [upload=415135]: Done starting upload
Jul 15 00:07:17.317069828 (518h56m52.087711223s) [upload=415135]: Uploading segments...
Jul 15 00:07:17.317453613 (518h56m52.088094948s) [upload=415135]: Got next segment. Inline: false
Jul 15 00:07:17.317540489 (518h56m52.088181864s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 15 00:07:17.317549487 (518h56m52.088190852s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 15 00:07:17.797147854 (518h56m52.567789189s) [seg_pos={0 0}, upload=415135]: Begin upload segment...
Jul 15 00:07:17.797188221 (518h56m52.567829556s) [seg_pos={0 0}, upload=415135]: Done begin upload segment.
Jul 15 00:07:17.797209151 (518h56m52.567850486s) [noise=true , address=77.90.31.19:4841     , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797261231 (518h56m52.567902566s) [noise=true , address=45.91.116.14:4191    , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797616330 (518h56m52.568257665s) [noise=true , address=104.36.82.15:4258    , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797784692 (518h56m52.568426027s) [noise=true , address=104.36.82.11:4115    , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798110125 (518h56m52.56875146s) [noise=true , address=104.36.82.5:4840     , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798170290 (518h56m52.568811625s) [noise=true , address=77.90.31.11:4553     , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798434274 (518h56m52.569075599s) [noise=true , address=77.90.31.15:4699     , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798508597 (518h56m52.569149932s) [noise=true , address=104.36.82.11:4114    , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798767944 (518h56m52.569409279s) [noise=true , address=104.36.82.10:4078    , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798923441 (518h56m52.569564776s) [noise=true , address=45.91.116.9:4261     , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.799033120 (518h56m52.569674445s) [noise=true , address=45.91.116.4:4940     , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.799206051 (518h56m52.569847386s) [noise=true , address=45.91.116.13:4153    , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800112335 (518h56m52.57075366s) [noise=true , address=104.36.82.13:4186    , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800481873 (518h56m52.571123208s) [noise=true , address=77.90.31.18:4807     , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800771777 (518h56m52.571413112s) [noise=true , address=77.90.31.14:4662     , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.801715763 (518h56m52.572357098s) [noise=true , address=104.36.82.2:4731     , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:19.582805950 (518h56m54.353447285s) [upload=415135]: Next returned nil segment
Jul 15 00:07:19.582822982 (518h56m54.353464317s) [upload=415135]: Waiting for error group managing segments...
Jul 15 00:07:19.871591866 (518h56m54.642233202s) [noise=true , address=77.90.31.15:4699     , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.919348672 (518h56m54.689990007s) [noise=true , address=104.36.82.13:4186    , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.935048428 (518h56m54.705689763s) [noise=true , address=104.36.82.15:4258    , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.935763055 (518h56m54.70640439s) [noise=true , address=104.36.82.2:4731     , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.950670895 (518h56m54.72131223s) [noise=true , address=104.36.82.10:4078    , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.955816180 (518h56m54.726457515s) [noise=true , address=104.36.82.11:4115    , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.970279219 (518h56m54.740920554s) [noise=true , address=45.91.116.9:4261     , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.992903232 (518h56m54.763544567s) [noise=true , address=77.90.31.18:4807     , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.003524783 (518h56m54.774166118s) [noise=true , address=104.36.82.11:4114    , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.066078626 (518h56m54.836719951s) [noise=true , address=77.90.31.14:4662     , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.079716798 (518h56m54.850358133s) [noise=true , address=45.91.116.13:4153    , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.100603427 (518h56m54.871244762s) [noise=true , address=104.36.82.5:4840     , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.115262171 (518h56m54.885903506s) [noise=true , address=77.90.31.19:4841     , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.115289974 (518h56m54.885931309s) [seg_pos={0 0}, upload=415135]: Segment reached optimal threshold of 13 pieces.
Jul 15 00:07:20.115432396 (518h56m54.886073732s) [noise=true , address=77.90.31.11:4553     , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115492132 (518h56m54.886133467s) [noise=true , address=45.91.116.4:4940     , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115522189 (518h56m54.886163524s) [noise=true , address=45.91.116.14:4191    , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115548169 (518h56m54.886189504s) [seg_pos={0 0}, upload=415135]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:07:20.115654933 (518h56m54.886296268s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:07:20.115661405 (518h56m54.88630275s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:07:20.424646666 (518h56m55.195288241s) [upload=415135]: Done uploading segments...
Jul 15 00:07:20.424667025 (518h56m55.19530836s) [upload=415135]: Upload finished. err: <nil>
Duration: 5.984961403s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip: 
2 out of 60 is failed (threshold=3) [..........................XX................................]
duration: 
694.899711ms
target: 
https://us1.storj.io/login
FAIL (2025-07-15 00:32:18 UTC) 
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:49333->127.0.0.1:53: i/o timeout
Duration: 694.917945ms core satellite us1
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)
antiblip: 
1 out of 60 is failed (threshold=3) [...............................X............................]
duration: 
17.089134ms
target: 
https://www.apple.com/robots.txt
FAIL (2025-07-15 00:32:17 UTC) 
orbiter warning: Get "https://www.apple.com/robots.txt": dial tcp: lookup www.apple.com on 127.0.0.1:53: read udp 127.0.0.1:42083->127.0.0.1:53: i/o timeout
Duration: 17.114362ms core website
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)
antiblip: 
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration: 
12.59731ms
target: 
https://ap1.storj.io/login
FAIL (2025-07-15 00:32:16 UTC) 
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:44805->127.0.0.1:53: i/o timeout
Duration: 12.631255ms core satellite ap1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip: 
2 out of 60 is failed (threshold=3) [.....................................................XX.....]
duration: 
956.11203ms
FAIL (2025-07-15 00:32:13 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55317->127.0.0.1:53: i/o timeout
Duration: 956.137728ms edge authservice http bgp eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip: 
1 out of 60 is failed (threshold=3) [...............................X............................]
duration: 
486.765493ms
target: 
https://eu1.storj.io/login
FAIL (2025-07-15 00:32:10 UTC) 
orbiter warning: Get "https://eu1.storj.io/login": dial tcp: lookup eu1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:54006->127.0.0.1:53: i/o timeout
Duration: 486.790772ms core satellite eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration: 
2.428693999s
FAIL (2025-07-15 00:32:02 UTC) 
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35613->127.0.0.1:53: i/o timeout
Duration: 2.428716732s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [...........................X................................]
duration: 
2.04961641s
FAIL (2025-07-15 00:31:57 UTC) 
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.049641909s core uplink us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip: 
2 out of 60 is failed (threshold=3) [......................................................XX....]
duration: 
938.19887ms
FAIL (2025-07-15 00:31:57 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55317->127.0.0.1:53: i/o timeout
Duration: 938.228438ms edge authservice http bgp eu1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip: 
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration: 
1.154344924s
FAIL (2025-07-15 00:31:56 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:38982->127.0.0.1:53: i/o timeout
Duration: 1.154371436s edge authservice http bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration: 
6.297166183s
FAIL (2025-07-15 00:31:51 UTC) 
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55866->127.0.0.1:53: i/o timeout
Duration: 6.297187946s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration: 
6.201487307s
FAIL (2025-07-15 00:31:49 UTC) 
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
:24.394249943 (518h55m59.164891278s) [noise=true , address=77.90.31.13:4626     , piece_id=U2XNN4FE47U4RFLZJUVMRZ4SISZ3TBN7HCRQYUBWLTXNTN5BN3IA, seg_pos={0 0}, upload=415122]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 15 00:06:24.394277596 (518h55m59.164918931s) [seg_pos={0 0}, upload=415122]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:06:24.394343541 (518h55m59.164984876s) [upload=415122]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:06:24.394347679 (518h55m59.164989014s) [upload=415122]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:06:24.692495788 (518h55m59.463137113s) [upload=415122]: Done uploading segments...
Jul 15 00:06:24.692517119 (518h55m59.463158444s) [upload=415122]: Upload finished. err: <nil>
Jul 15 00:07:17.316804141 (518h56m52.087445506s) [upload=415135]: Starting upload
Jul 15 00:07:17.316952264 (518h56m52.087593649s) [upload=415135]: Done starting upload
Jul 15 00:07:17.317069828 (518h56m52.087711223s) [upload=415135]: Uploading segments...
Jul 15 00:07:17.317453613 (518h56m52.088094948s) [upload=415135]: Got next segment. Inline: false
Jul 15 00:07:17.317540489 (518h56m52.088181864s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 15 00:07:17.317549487 (518h56m52.088190852s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 15 00:07:17.797147854 (518h56m52.567789189s) [seg_pos={0 0}, upload=415135]: Begin upload segment...
Jul 15 00:07:17.797188221 (518h56m52.567829556s) [seg_pos={0 0}, upload=415135]: Done begin upload segment.
Jul 15 00:07:17.797209151 (518h56m52.567850486s) [noise=true , address=77.90.31.19:4841     , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797261231 (518h56m52.567902566s) [noise=true , address=45.91.116.14:4191    , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797616330 (518h56m52.568257665s) [noise=true , address=104.36.82.15:4258    , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797784692 (518h56m52.568426027s) [noise=true , address=104.36.82.11:4115    , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798110125 (518h56m52.56875146s) [noise=true , address=104.36.82.5:4840     , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798170290 (518h56m52.568811625s) [noise=true , address=77.90.31.11:4553     , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798434274 (518h56m52.569075599s) [noise=true , address=77.90.31.15:4699     , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798508597 (518h56m52.569149932s) [noise=true , address=104.36.82.11:4114    , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798767944 (518h56m52.569409279s) [noise=true , address=104.36.82.10:4078    , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798923441 (518h56m52.569564776s) [noise=true , address=45.91.116.9:4261     , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.799033120 (518h56m52.569674445s) [noise=true , address=45.91.116.4:4940     , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.799206051 (518h56m52.569847386s) [noise=true , address=45.91.116.13:4153    , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800112335 (518h56m52.57075366s) [noise=true , address=104.36.82.13:4186    , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800481873 (518h56m52.571123208s) [noise=true , address=77.90.31.18:4807     , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800771777 (518h56m52.571413112s) [noise=true , address=77.90.31.14:4662     , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.801715763 (518h56m52.572357098s) [noise=true , address=104.36.82.2:4731     , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:19.582805950 (518h56m54.353447285s) [upload=415135]: Next returned nil segment
Jul 15 00:07:19.582822982 (518h56m54.353464317s) [upload=415135]: Waiting for error group managing segments...
Jul 15 00:07:19.871591866 (518h56m54.642233202s) [noise=true , address=77.90.31.15:4699     , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.919348672 (518h56m54.689990007s) [noise=true , address=104.36.82.13:4186    , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.935048428 (518h56m54.705689763s) [noise=true , address=104.36.82.15:4258    , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.935763055 (518h56m54.70640439s) [noise=true , address=104.36.82.2:4731     , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.950670895 (518h56m54.72131223s) [noise=true , address=104.36.82.10:4078    , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.955816180 (518h56m54.726457515s) [noise=true , address=104.36.82.11:4115    , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.970279219 (518h56m54.740920554s) [noise=true , address=45.91.116.9:4261     , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.992903232 (518h56m54.763544567s) [noise=true , address=77.90.31.18:4807     , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.003524783 (518h56m54.774166118s) [noise=true , address=104.36.82.11:4114    , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.066078626 (518h56m54.836719951s) [noise=true , address=77.90.31.14:4662     , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.079716798 (518h56m54.850358133s) [noise=true , address=45.91.116.13:4153    , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.100603427 (518h56m54.871244762s) [noise=true , address=104.36.82.5:4840     , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.115262171 (518h56m54.885903506s) [noise=true , address=77.90.31.19:4841     , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.115289974 (518h56m54.885931309s) [seg_pos={0 0}, upload=415135]: Segment reached optimal threshold of 13 pieces.
Jul 15 00:07:20.115432396 (518h56m54.886073732s) [noise=true , address=77.90.31.11:4553     , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115492132 (518h56m54.886133467s) [noise=true , address=45.91.116.4:4940     , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115522189 (518h56m54.886163524s) [noise=true , address=45.91.116.14:4191    , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115548169 (518h56m54.886189504s) [seg_pos={0 0}, upload=415135]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:07:20.115654933 (518h56m54.886296268s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:07:20.115661405 (518h56m54.88630275s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:07:20.424646666 (518h56m55.195288241s) [upload=415135]: Done uploading segments...
Jul 15 00:07:20.424667025 (518h56m55.19530836s) [upload=415135]: Upload finished. err: <nil>
Duration: 6.201559526s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [................................X...........................]
duration: 
1.496248527s
FAIL (2025-07-15 00:31:48 UTC) 
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.496275107s core uplink eu1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip: 
2 out of 60 is failed (threshold=3) [...........................XX...............................]
duration: 
695.788632ms
target: 
https://us1.storj.io/login
FAIL (2025-07-15 00:31:47 UTC) 
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:49333->127.0.0.1:53: i/o timeout
Duration: 695.814382ms core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration: 
5.624102989s
FAIL (2025-07-15 00:31:46 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33925->127.0.0.1:53: i/o timeout
Duration: 5.624192329s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)
antiblip: 
1 out of 60 is failed (threshold=3) [................................X...........................]
duration: 
13.444602ms
target: 
https://www.apple.com/robots.txt
FAIL (2025-07-15 00:31:41 UTC) 
orbiter warning: Get "https://www.apple.com/robots.txt": dial tcp: lookup www.apple.com on 127.0.0.1:53: read udp 127.0.0.1:42083->127.0.0.1:53: i/o timeout
Duration: 13.473187ms core website
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)
antiblip: 
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration: 
2.412773589s
FAIL (2025-07-15 00:31:41 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55317->127.0.0.1:53: i/o timeout
Duration: 2.412807263s edge authservice http bgp ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)
antiblip: 
1 out of 60 is failed (threshold=3) [......................................X.....................]
duration: 
11.77685ms
target: 
https://ap1.storj.io/login
FAIL (2025-07-15 00:31:39 UTC) 
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:44805->127.0.0.1:53: i/o timeout
Duration: 11.799846ms core satellite ap1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip: 
2 out of 60 is failed (threshold=3) [.......................................................XX...]
duration: 
990.348126ms
FAIL (2025-07-15 00:31:39 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55317->127.0.0.1:53: i/o timeout
Duration: 990.377794ms edge authservice http bgp eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [................................X...........................]
duration: 
4.922507537s
FAIL (2025-07-15 00:31:28 UTC) 
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 4.922533608s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...............................X............................]
duration: 
6.862563539s
FAIL (2025-07-15 00:31:17 UTC) 
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
:24.394249943 (518h55m59.164891278s) [noise=true , address=77.90.31.13:4626     , piece_id=U2XNN4FE47U4RFLZJUVMRZ4SISZ3TBN7HCRQYUBWLTXNTN5BN3IA, seg_pos={0 0}, upload=415122]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 15 00:06:24.394277596 (518h55m59.164918931s) [seg_pos={0 0}, upload=415122]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:06:24.394343541 (518h55m59.164984876s) [upload=415122]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:06:24.394347679 (518h55m59.164989014s) [upload=415122]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:06:24.692495788 (518h55m59.463137113s) [upload=415122]: Done uploading segments...
Jul 15 00:06:24.692517119 (518h55m59.463158444s) [upload=415122]: Upload finished. err: <nil>
Jul 15 00:07:17.316804141 (518h56m52.087445506s) [upload=415135]: Starting upload
Jul 15 00:07:17.316952264 (518h56m52.087593649s) [upload=415135]: Done starting upload
Jul 15 00:07:17.317069828 (518h56m52.087711223s) [upload=415135]: Uploading segments...
Jul 15 00:07:17.317453613 (518h56m52.088094948s) [upload=415135]: Got next segment. Inline: false
Jul 15 00:07:17.317540489 (518h56m52.088181864s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 15 00:07:17.317549487 (518h56m52.088190852s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 15 00:07:17.797147854 (518h56m52.567789189s) [seg_pos={0 0}, upload=415135]: Begin upload segment...
Jul 15 00:07:17.797188221 (518h56m52.567829556s) [seg_pos={0 0}, upload=415135]: Done begin upload segment.
Jul 15 00:07:17.797209151 (518h56m52.567850486s) [noise=true , address=77.90.31.19:4841     , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797261231 (518h56m52.567902566s) [noise=true , address=45.91.116.14:4191    , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797616330 (518h56m52.568257665s) [noise=true , address=104.36.82.15:4258    , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797784692 (518h56m52.568426027s) [noise=true , address=104.36.82.11:4115    , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798110125 (518h56m52.56875146s) [noise=true , address=104.36.82.5:4840     , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798170290 (518h56m52.568811625s) [noise=true , address=77.90.31.11:4553     , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798434274 (518h56m52.569075599s) [noise=true , address=77.90.31.15:4699     , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798508597 (518h56m52.569149932s) [noise=true , address=104.36.82.11:4114    , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798767944 (518h56m52.569409279s) [noise=true , address=104.36.82.10:4078    , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798923441 (518h56m52.569564776s) [noise=true , address=45.91.116.9:4261     , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.799033120 (518h56m52.569674445s) [noise=true , address=45.91.116.4:4940     , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.799206051 (518h56m52.569847386s) [noise=true , address=45.91.116.13:4153    , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800112335 (518h56m52.57075366s) [noise=true , address=104.36.82.13:4186    , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800481873 (518h56m52.571123208s) [noise=true , address=77.90.31.18:4807     , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800771777 (518h56m52.571413112s) [noise=true , address=77.90.31.14:4662     , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.801715763 (518h56m52.572357098s) [noise=true , address=104.36.82.2:4731     , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:19.582805950 (518h56m54.353447285s) [upload=415135]: Next returned nil segment
Jul 15 00:07:19.582822982 (518h56m54.353464317s) [upload=415135]: Waiting for error group managing segments...
Jul 15 00:07:19.871591866 (518h56m54.642233202s) [noise=true , address=77.90.31.15:4699     , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.919348672 (518h56m54.689990007s) [noise=true , address=104.36.82.13:4186    , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.935048428 (518h56m54.705689763s) [noise=true , address=104.36.82.15:4258    , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.935763055 (518h56m54.70640439s) [noise=true , address=104.36.82.2:4731     , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.950670895 (518h56m54.72131223s) [noise=true , address=104.36.82.10:4078    , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.955816180 (518h56m54.726457515s) [noise=true , address=104.36.82.11:4115    , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.970279219 (518h56m54.740920554s) [noise=true , address=45.91.116.9:4261     , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.992903232 (518h56m54.763544567s) [noise=true , address=77.90.31.18:4807     , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.003524783 (518h56m54.774166118s) [noise=true , address=104.36.82.11:4114    , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.066078626 (518h56m54.836719951s) [noise=true , address=77.90.31.14:4662     , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.079716798 (518h56m54.850358133s) [noise=true , address=45.91.116.13:4153    , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.100603427 (518h56m54.871244762s) [noise=true , address=104.36.82.5:4840     , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.115262171 (518h56m54.885903506s) [noise=true , address=77.90.31.19:4841     , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.115289974 (518h56m54.885931309s) [seg_pos={0 0}, upload=415135]: Segment reached optimal threshold of 13 pieces.
Jul 15 00:07:20.115432396 (518h56m54.886073732s) [noise=true , address=77.90.31.11:4553     , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115492132 (518h56m54.886133467s) [noise=true , address=45.91.116.4:4940     , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115522189 (518h56m54.886163524s) [noise=true , address=45.91.116.14:4191    , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115548169 (518h56m54.886189504s) [seg_pos={0 0}, upload=415135]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:07:20.115654933 (518h56m54.886296268s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:07:20.115661405 (518h56m54.88630275s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:07:20.424646666 (518h56m55.195288241s) [upload=415135]: Done uploading segments...
Jul 15 00:07:20.424667025 (518h56m55.19530836s) [upload=415135]: Upload finished. err: <nil>
Duration: 6.862587265s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [.................................X..........................]
duration: 
1.400417087s
FAIL (2025-07-15 00:31:11 UTC) 
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.400441465s core uplink eu1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip: 
2 out of 60 is failed (threshold=3) [............................XX..............................]
duration: 
750.290382ms
FAIL (2025-07-15 00:31:10 UTC) 
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35613->127.0.0.1:53: i/o timeout
Duration: 750.334236ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)
antiblip: 
1 out of 60 is failed (threshold=3) [.......................................X....................]
duration: 
14.035802ms
target: 
https://ap1.storj.io/login
FAIL (2025-07-15 00:31:06 UTC) 
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:44805->127.0.0.1:53: i/o timeout
Duration: 14.059828ms core satellite ap1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip: 
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration: 
1.147011376s
FAIL (2025-07-15 00:31:04 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:38982->127.0.0.1:53: i/o timeout
Duration: 1.147049058s edge authservice http bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
1 out of 60 is failed (threshold=3) [........................................................X...]
duration: 
5.70394801s
FAIL (2025-07-15 00:31:03 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33925->127.0.0.1:53: i/o timeout
Duration: 5.703968399s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip: 
1 out of 60 is failed (threshold=3) [................................X...........................]
duration: 
477.527378ms
target: 
https://eu1.storj.io/login
FAIL (2025-07-15 00:31:00 UTC) 
orbiter warning: Get "https://eu1.storj.io/login": dial tcp: lookup eu1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:54006->127.0.0.1:53: i/o timeout
Duration: 477.546424ms core satellite eu1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip: 
2 out of 60 is failed (threshold=3) [............................XX..............................]
duration: 
746.33779ms
target: 
https://us1.storj.io/login
FAIL (2025-07-15 00:30:59 UTC) 
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:49333->127.0.0.1:53: i/o timeout
Duration: 746.364622ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...............................X............................]
duration: 
5.967133644s
FAIL (2025-07-15 00:30:56 UTC) 
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55866->127.0.0.1:53: i/o timeout
Duration: 5.96715781s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip: 
2 out of 60 is failed (threshold=3) [.............................XX.............................]
duration: 
717.741353ms
FAIL (2025-07-15 00:30:54 UTC) 
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35613->127.0.0.1:53: i/o timeout
Duration: 717.773713ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [............................X...............................]
duration: 
2.260850403s
FAIL (2025-07-15 00:30:49 UTC) 
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.260877095s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration: 
2.330784091s
FAIL (2025-07-15 00:30:48 UTC) 
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35613->127.0.0.1:53: i/o timeout
Duration: 2.330823757s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip: 
1 out of 60 is failed (threshold=3) [........................................................X...]
duration: 
1.146893391s
FAIL (2025-07-15 00:30:47 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:38982->127.0.0.1:53: i/o timeout
Duration: 1.146932125s edge authservice http bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [................................X...........................]
duration: 
6.311349992s
FAIL (2025-07-15 00:30:38 UTC) 
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55866->127.0.0.1:53: i/o timeout
Duration: 6.311374247s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip: 
2 out of 60 is failed (threshold=3) [.............................XX.............................]
duration: 
699.102693ms
target: 
https://us1.storj.io/login
FAIL (2025-07-15 00:30:36 UTC) 
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:49333->127.0.0.1:53: i/o timeout
Duration: 699.134324ms core satellite us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip: 
2 out of 60 is failed (threshold=3) [........................................................XX..]
duration: 
939.911956ms
FAIL (2025-07-15 00:30:36 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55317->127.0.0.1:53: i/o timeout
Duration: 939.937134ms edge authservice http bgp eu1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)
antiblip: 
1 out of 60 is failed (threshold=3) [........................................................X...]
duration: 
469.663894ms
FAIL (2025-07-15 00:30:33 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55317->127.0.0.1:53: i/o timeout
Duration: 469.688902ms edge authservice http bgp ap1
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)
antiblip: 
1 out of 60 is failed (threshold=3) [.................................X..........................]
duration: 
12.748099ms
target: 
https://www.apple.com/robots.txt
FAIL (2025-07-15 00:30:30 UTC) 
orbiter warning: Get "https://www.apple.com/robots.txt": dial tcp: lookup www.apple.com on 127.0.0.1:53: read udp 127.0.0.1:42083->127.0.0.1:53: i/o timeout
Duration: 12.786532ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [..................................X.........................]
duration: 
1.41914332s
FAIL (2025-07-15 00:30:29 UTC) 
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.419167617s core uplink eu1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip: 
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration: 
1.149567464s
FAIL (2025-07-15 00:30:29 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:38982->127.0.0.1:53: i/o timeout
Duration: 1.149591841s edge authservice http bgp us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.................................X..........................]
duration: 
4.760736784s
FAIL (2025-07-15 00:30:28 UTC) 
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 4.760757464s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration: 
5.653207686s
FAIL (2025-07-15 00:30:25 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33925->127.0.0.1:53: i/o timeout
Duration: 5.653230311s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip: 
1 out of 60 is failed (threshold=3) [.................................X..........................]
duration: 
474.123835ms
target: 
https://eu1.storj.io/login
FAIL (2025-07-15 00:30:14 UTC) 
orbiter warning: Get "https://eu1.storj.io/login": dial tcp: lookup eu1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:54006->127.0.0.1:53: i/o timeout
Duration: 474.150756ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [................................X...........................]
duration: 
6.019024126s
FAIL (2025-07-15 00:30:12 UTC) 
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
:24.394249943 (518h55m59.164891278s) [noise=true , address=77.90.31.13:4626     , piece_id=U2XNN4FE47U4RFLZJUVMRZ4SISZ3TBN7HCRQYUBWLTXNTN5BN3IA, seg_pos={0 0}, upload=415122]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 15 00:06:24.394277596 (518h55m59.164918931s) [seg_pos={0 0}, upload=415122]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:06:24.394343541 (518h55m59.164984876s) [upload=415122]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:06:24.394347679 (518h55m59.164989014s) [upload=415122]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:06:24.692495788 (518h55m59.463137113s) [upload=415122]: Done uploading segments...
Jul 15 00:06:24.692517119 (518h55m59.463158444s) [upload=415122]: Upload finished. err: <nil>
Jul 15 00:07:17.316804141 (518h56m52.087445506s) [upload=415135]: Starting upload
Jul 15 00:07:17.316952264 (518h56m52.087593649s) [upload=415135]: Done starting upload
Jul 15 00:07:17.317069828 (518h56m52.087711223s) [upload=415135]: Uploading segments...
Jul 15 00:07:17.317453613 (518h56m52.088094948s) [upload=415135]: Got next segment. Inline: false
Jul 15 00:07:17.317540489 (518h56m52.088181864s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 15 00:07:17.317549487 (518h56m52.088190852s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 15 00:07:17.797147854 (518h56m52.567789189s) [seg_pos={0 0}, upload=415135]: Begin upload segment...
Jul 15 00:07:17.797188221 (518h56m52.567829556s) [seg_pos={0 0}, upload=415135]: Done begin upload segment.
Jul 15 00:07:17.797209151 (518h56m52.567850486s) [noise=true , address=77.90.31.19:4841     , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797261231 (518h56m52.567902566s) [noise=true , address=45.91.116.14:4191    , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797616330 (518h56m52.568257665s) [noise=true , address=104.36.82.15:4258    , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.797784692 (518h56m52.568426027s) [noise=true , address=104.36.82.11:4115    , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798110125 (518h56m52.56875146s) [noise=true , address=104.36.82.5:4840     , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798170290 (518h56m52.568811625s) [noise=true , address=77.90.31.11:4553     , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798434274 (518h56m52.569075599s) [noise=true , address=77.90.31.15:4699     , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798508597 (518h56m52.569149932s) [noise=true , address=104.36.82.11:4114    , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798767944 (518h56m52.569409279s) [noise=true , address=104.36.82.10:4078    , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.798923441 (518h56m52.569564776s) [noise=true , address=45.91.116.9:4261     , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.799033120 (518h56m52.569674445s) [noise=true , address=45.91.116.4:4940     , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.799206051 (518h56m52.569847386s) [noise=true , address=45.91.116.13:4153    , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800112335 (518h56m52.57075366s) [noise=true , address=104.36.82.13:4186    , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800481873 (518h56m52.571123208s) [noise=true , address=77.90.31.18:4807     , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.800771777 (518h56m52.571413112s) [noise=true , address=77.90.31.14:4662     , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:17.801715763 (518h56m52.572357098s) [noise=true , address=104.36.82.2:4731     , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Uploading piece...
Jul 15 00:07:19.582805950 (518h56m54.353447285s) [upload=415135]: Next returned nil segment
Jul 15 00:07:19.582822982 (518h56m54.353464317s) [upload=415135]: Waiting for error group managing segments...
Jul 15 00:07:19.871591866 (518h56m54.642233202s) [noise=true , address=77.90.31.15:4699     , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.919348672 (518h56m54.689990007s) [noise=true , address=104.36.82.13:4186    , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.935048428 (518h56m54.705689763s) [noise=true , address=104.36.82.15:4258    , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.935763055 (518h56m54.70640439s) [noise=true , address=104.36.82.2:4731     , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.950670895 (518h56m54.72131223s) [noise=true , address=104.36.82.10:4078    , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.955816180 (518h56m54.726457515s) [noise=true , address=104.36.82.11:4115    , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.970279219 (518h56m54.740920554s) [noise=true , address=45.91.116.9:4261     , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:19.992903232 (518h56m54.763544567s) [noise=true , address=77.90.31.18:4807     , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.003524783 (518h56m54.774166118s) [noise=true , address=104.36.82.11:4114    , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.066078626 (518h56m54.836719951s) [noise=true , address=77.90.31.14:4662     , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.079716798 (518h56m54.850358133s) [noise=true , address=45.91.116.13:4153    , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.100603427 (518h56m54.871244762s) [noise=true , address=104.36.82.5:4840     , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.115262171 (518h56m54.885903506s) [noise=true , address=77.90.31.19:4841     , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil>
Jul 15 00:07:20.115289974 (518h56m54.885931309s) [seg_pos={0 0}, upload=415135]: Segment reached optimal threshold of 13 pieces.
Jul 15 00:07:20.115432396 (518h56m54.886073732s) [noise=true , address=77.90.31.11:4553     , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115492132 (518h56m54.886133467s) [noise=true , address=45.91.116.4:4940     , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115522189 (518h56m54.886163524s) [noise=true , address=45.91.116.14:4191    , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF
Jul 15 00:07:20.115548169 (518h56m54.886189504s) [seg_pos={0 0}, upload=415135]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:07:20.115654933 (518h56m54.886296268s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:07:20.115661405 (518h56m54.88630275s) [upload=415135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:07:20.424646666 (518h56m55.195288241s) [upload=415135]: Done uploading segments...
Jul 15 00:07:20.424667025 (518h56m55.19530836s) [upload=415135]: Upload finished. err: <nil>
Duration: 6.019056018s core uplink us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)
antiblip: 
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration: 
464.356338ms
FAIL (2025-07-15 00:30:05 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55317->127.0.0.1:53: i/o timeout
Duration: 464.383209ms edge authservice http bgp ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [...................................X........................]
duration: 
1.426469894s
FAIL (2025-07-15 00:30:01 UTC) 
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.42649946s core uplink eu1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip: 
2 out of 60 is failed (threshold=3) [..............................XX............................]
duration: 
714.865786ms
target: 
https://us1.storj.io/login
FAIL (2025-07-15 00:29:59 UTC) 
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:49333->127.0.0.1:53: i/o timeout
Duration: 714.885164ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [...............................X............................]
duration: 
2.350063185s
FAIL (2025-07-15 00:29:59 UTC) 
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:35613->127.0.0.1:53: i/o timeout
Duration: 2.350107331s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration: 
2.031848496s
FAIL (2025-07-15 00:29:57 UTC) 
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.03188161s core uplink us1