Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 4.869407511s FAIL (2025-07-15 00:37:05 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 4.869434984s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 471.724686ms target: https://eu1.storj.io/login FAIL (2025-07-15 00:37:04 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp: lookup eu1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:54006->127.0.0.1:53: i/o timeout Duration: 471.764593ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 6.017024624s FAIL (2025-07-15 00:36:56 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== :24.394249943 (518h55m59.164891278s) [noise=true , address=77.90.31.13:4626 , piece_id=U2XNN4FE47U4RFLZJUVMRZ4SISZ3TBN7HCRQYUBWLTXNTN5BN3IA, seg_pos={0 0}, upload=415122]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF Jul 15 00:06:24.394277596 (518h55m59.164918931s) [seg_pos={0 0}, upload=415122]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 15 00:06:24.394343541 (518h55m59.164984876s) [upload=415122]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:06:24.394347679 (518h55m59.164989014s) [upload=415122]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:06:24.692495788 (518h55m59.463137113s) [upload=415122]: Done uploading segments... Jul 15 00:06:24.692517119 (518h55m59.463158444s) [upload=415122]: Upload finished. err: <nil> Jul 15 00:07:17.316804141 (518h56m52.087445506s) [upload=415135]: Starting upload Jul 15 00:07:17.316952264 (518h56m52.087593649s) [upload=415135]: Done starting upload Jul 15 00:07:17.317069828 (518h56m52.087711223s) [upload=415135]: Uploading segments... Jul 15 00:07:17.317453613 (518h56m52.088094948s) [upload=415135]: Got next segment. Inline: false Jul 15 00:07:17.317540489 (518h56m52.088181864s) [upload=415135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 15 00:07:17.317549487 (518h56m52.088190852s) [upload=415135]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 15 00:07:17.797147854 (518h56m52.567789189s) [seg_pos={0 0}, upload=415135]: Begin upload segment... Jul 15 00:07:17.797188221 (518h56m52.567829556s) [seg_pos={0 0}, upload=415135]: Done begin upload segment. Jul 15 00:07:17.797209151 (518h56m52.567850486s) [noise=true , address=77.90.31.19:4841 , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.797261231 (518h56m52.567902566s) [noise=true , address=45.91.116.14:4191 , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.797616330 (518h56m52.568257665s) [noise=true , address=104.36.82.15:4258 , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.797784692 (518h56m52.568426027s) [noise=true , address=104.36.82.11:4115 , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798110125 (518h56m52.56875146s) [noise=true , address=104.36.82.5:4840 , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798170290 (518h56m52.568811625s) [noise=true , address=77.90.31.11:4553 , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798434274 (518h56m52.569075599s) [noise=true , address=77.90.31.15:4699 , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798508597 (518h56m52.569149932s) [noise=true , address=104.36.82.11:4114 , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798767944 (518h56m52.569409279s) [noise=true , address=104.36.82.10:4078 , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798923441 (518h56m52.569564776s) [noise=true , address=45.91.116.9:4261 , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.799033120 (518h56m52.569674445s) [noise=true , address=45.91.116.4:4940 , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.799206051 (518h56m52.569847386s) [noise=true , address=45.91.116.13:4153 , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.800112335 (518h56m52.57075366s) [noise=true , address=104.36.82.13:4186 , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.800481873 (518h56m52.571123208s) [noise=true , address=77.90.31.18:4807 , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.800771777 (518h56m52.571413112s) [noise=true , address=77.90.31.14:4662 , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.801715763 (518h56m52.572357098s) [noise=true , address=104.36.82.2:4731 , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:19.582805950 (518h56m54.353447285s) [upload=415135]: Next returned nil segment Jul 15 00:07:19.582822982 (518h56m54.353464317s) [upload=415135]: Waiting for error group managing segments... Jul 15 00:07:19.871591866 (518h56m54.642233202s) [noise=true , address=77.90.31.15:4699 , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.919348672 (518h56m54.689990007s) [noise=true , address=104.36.82.13:4186 , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.935048428 (518h56m54.705689763s) [noise=true , address=104.36.82.15:4258 , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.935763055 (518h56m54.70640439s) [noise=true , address=104.36.82.2:4731 , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.950670895 (518h56m54.72131223s) [noise=true , address=104.36.82.10:4078 , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.955816180 (518h56m54.726457515s) [noise=true , address=104.36.82.11:4115 , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.970279219 (518h56m54.740920554s) [noise=true , address=45.91.116.9:4261 , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.992903232 (518h56m54.763544567s) [noise=true , address=77.90.31.18:4807 , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.003524783 (518h56m54.774166118s) [noise=true , address=104.36.82.11:4114 , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.066078626 (518h56m54.836719951s) [noise=true , address=77.90.31.14:4662 , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.079716798 (518h56m54.850358133s) [noise=true , address=45.91.116.13:4153 , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.100603427 (518h56m54.871244762s) [noise=true , address=104.36.82.5:4840 , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.115262171 (518h56m54.885903506s) [noise=true , address=77.90.31.19:4841 , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.115289974 (518h56m54.885931309s) [seg_pos={0 0}, upload=415135]: Segment reached optimal threshold of 13 pieces. Jul 15 00:07:20.115432396 (518h56m54.886073732s) [noise=true , address=77.90.31.11:4553 , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF Jul 15 00:07:20.115492132 (518h56m54.886133467s) [noise=true , address=45.91.116.4:4940 , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF Jul 15 00:07:20.115522189 (518h56m54.886163524s) [noise=true , address=45.91.116.14:4191 , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF Jul 15 00:07:20.115548169 (518h56m54.886189504s) [seg_pos={0 0}, upload=415135]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 15 00:07:20.115654933 (518h56m54.886296268s) [upload=415135]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:07:20.115661405 (518h56m54.88630275s) [upload=415135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:07:20.424646666 (518h56m55.195288241s) [upload=415135]: Done uploading segments... Jul 15 00:07:20.424667025 (518h56m55.19530836s) [upload=415135]: Upload finished. err: <nil> Duration: 6.017079278s core uplink us-select-1
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 11.705253ms target: https://www.apple.com/robots.txt FAIL (2025-07-15 00:36:52 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": dial tcp: lookup www.apple.com on 127.0.0.1:53: read udp 127.0.0.1:42083->127.0.0.1:53: i/o timeout Duration: 11.731524ms core website
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................X.................................XX..] duration: 2.355146691s FAIL (2025-07-15 00:36:50 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55583->127.0.0.1:53: i/o timeout Duration: 2.355192718s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 1.151191632s FAIL (2025-07-15 00:36:50 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:38982->127.0.0.1:53: i/o timeout Duration: 1.151216982s edge authservice http bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......................X...............................XXX..] duration: 6.16391373s FAIL (2025-07-15 00:36:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.163937405s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1) antiblip: 2 out of 60 is failed (threshold=3) [.................................................XX.........] duration: 938.040845ms FAIL (2025-07-15 00:36:44 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55317->127.0.0.1:53: i/o timeout Duration: 938.063638ms edge authservice http bgp eu1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 3 out of 60 is failed (threshold=3) [......................XX.................................X..] duration: 734.821729ms FAIL (2025-07-15 00:36:41 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34613->127.0.0.1:53: i/o timeout Duration: 734.866875ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 529.873223ms FAIL (2025-07-15 00:36:35 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55317->127.0.0.1:53: i/o timeout Duration: 529.899272ms edge authservice http bgp ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 13.160848ms target: https://ap1.storj.io/login FAIL (2025-07-15 00:36:30 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:44805->127.0.0.1:53: i/o timeout Duration: 13.186558ms core satellite ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 4.839757104s FAIL (2025-07-15 00:36:28 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 4.839784637s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 1.454884151s FAIL (2025-07-15 00:36:21 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.454916633s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.02152341s FAIL (2025-07-15 00:36:17 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 2.021543208s core uplink us1
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 22.164044ms target: https://www.apple.com/robots.txt FAIL (2025-07-15 00:36:16 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": dial tcp: lookup www.apple.com on 127.0.0.1:53: read udp 127.0.0.1:42083->127.0.0.1:53: i/o timeout Duration: 22.190874ms core website
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [........................X...............................XXX.] duration: 6.239582448s FAIL (2025-07-15 00:36:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.239604929s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.617499794s FAIL (2025-07-15 00:36:14 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33925->127.0.0.1:53: i/o timeout Duration: 5.617521196s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................X.................................XX.] duration: 16.542522464s FAIL (2025-07-15 00:36:10 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55583->127.0.0.1:53: i/o timeout Duration: 16.542547091s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [.....................XX.....................................] duration: 698.571188ms target: https://us1.storj.io/login FAIL (2025-07-15 00:36:06 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:49333->127.0.0.1:53: i/o timeout Duration: 698.596907ms core satellite us1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 472.524357ms target: https://eu1.storj.io/login FAIL (2025-07-15 00:35:59 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp: lookup eu1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:54006->127.0.0.1:53: i/o timeout Duration: 472.564704ms core satellite eu1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 1.178783993s FAIL (2025-07-15 00:35:56 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:38982->127.0.0.1:53: i/o timeout Duration: 1.178812156s edge authservice http bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.030652276s FAIL (2025-07-15 00:35:55 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 2.030673206s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........................X...............................XXX] duration: 30.000369521s FAIL (2025-07-15 00:35:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000388949s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 3 out of 60 is failed (threshold=3) [.......................XX.................................X.] duration: 784.700492ms FAIL (2025-07-15 00:35:51 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34613->127.0.0.1:53: i/o timeout Duration: 784.72034ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.234413926s FAIL (2025-07-15 00:35:50 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 5.234439485s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.00955834s FAIL (2025-07-15 00:35:44 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== :24.394249943 (518h55m59.164891278s) [noise=true , address=77.90.31.13:4626 , piece_id=U2XNN4FE47U4RFLZJUVMRZ4SISZ3TBN7HCRQYUBWLTXNTN5BN3IA, seg_pos={0 0}, upload=415122]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF Jul 15 00:06:24.394277596 (518h55m59.164918931s) [seg_pos={0 0}, upload=415122]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 15 00:06:24.394343541 (518h55m59.164984876s) [upload=415122]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:06:24.394347679 (518h55m59.164989014s) [upload=415122]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:06:24.692495788 (518h55m59.463137113s) [upload=415122]: Done uploading segments... Jul 15 00:06:24.692517119 (518h55m59.463158444s) [upload=415122]: Upload finished. err: <nil> Jul 15 00:07:17.316804141 (518h56m52.087445506s) [upload=415135]: Starting upload Jul 15 00:07:17.316952264 (518h56m52.087593649s) [upload=415135]: Done starting upload Jul 15 00:07:17.317069828 (518h56m52.087711223s) [upload=415135]: Uploading segments... Jul 15 00:07:17.317453613 (518h56m52.088094948s) [upload=415135]: Got next segment. Inline: false Jul 15 00:07:17.317540489 (518h56m52.088181864s) [upload=415135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 15 00:07:17.317549487 (518h56m52.088190852s) [upload=415135]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 15 00:07:17.797147854 (518h56m52.567789189s) [seg_pos={0 0}, upload=415135]: Begin upload segment... Jul 15 00:07:17.797188221 (518h56m52.567829556s) [seg_pos={0 0}, upload=415135]: Done begin upload segment. Jul 15 00:07:17.797209151 (518h56m52.567850486s) [noise=true , address=77.90.31.19:4841 , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.797261231 (518h56m52.567902566s) [noise=true , address=45.91.116.14:4191 , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.797616330 (518h56m52.568257665s) [noise=true , address=104.36.82.15:4258 , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.797784692 (518h56m52.568426027s) [noise=true , address=104.36.82.11:4115 , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798110125 (518h56m52.56875146s) [noise=true , address=104.36.82.5:4840 , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798170290 (518h56m52.568811625s) [noise=true , address=77.90.31.11:4553 , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798434274 (518h56m52.569075599s) [noise=true , address=77.90.31.15:4699 , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798508597 (518h56m52.569149932s) [noise=true , address=104.36.82.11:4114 , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798767944 (518h56m52.569409279s) [noise=true , address=104.36.82.10:4078 , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798923441 (518h56m52.569564776s) [noise=true , address=45.91.116.9:4261 , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.799033120 (518h56m52.569674445s) [noise=true , address=45.91.116.4:4940 , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.799206051 (518h56m52.569847386s) [noise=true , address=45.91.116.13:4153 , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.800112335 (518h56m52.57075366s) [noise=true , address=104.36.82.13:4186 , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.800481873 (518h56m52.571123208s) [noise=true , address=77.90.31.18:4807 , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.800771777 (518h56m52.571413112s) [noise=true , address=77.90.31.14:4662 , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.801715763 (518h56m52.572357098s) [noise=true , address=104.36.82.2:4731 , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:19.582805950 (518h56m54.353447285s) [upload=415135]: Next returned nil segment Jul 15 00:07:19.582822982 (518h56m54.353464317s) [upload=415135]: Waiting for error group managing segments... Jul 15 00:07:19.871591866 (518h56m54.642233202s) [noise=true , address=77.90.31.15:4699 , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.919348672 (518h56m54.689990007s) [noise=true , address=104.36.82.13:4186 , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.935048428 (518h56m54.705689763s) [noise=true , address=104.36.82.15:4258 , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.935763055 (518h56m54.70640439s) [noise=true , address=104.36.82.2:4731 , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.950670895 (518h56m54.72131223s) [noise=true , address=104.36.82.10:4078 , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.955816180 (518h56m54.726457515s) [noise=true , address=104.36.82.11:4115 , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.970279219 (518h56m54.740920554s) [noise=true , address=45.91.116.9:4261 , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.992903232 (518h56m54.763544567s) [noise=true , address=77.90.31.18:4807 , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.003524783 (518h56m54.774166118s) [noise=true , address=104.36.82.11:4114 , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.066078626 (518h56m54.836719951s) [noise=true , address=77.90.31.14:4662 , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.079716798 (518h56m54.850358133s) [noise=true , address=45.91.116.13:4153 , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.100603427 (518h56m54.871244762s) [noise=true , address=104.36.82.5:4840 , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.115262171 (518h56m54.885903506s) [noise=true , address=77.90.31.19:4841 , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.115289974 (518h56m54.885931309s) [seg_pos={0 0}, upload=415135]: Segment reached optimal threshold of 13 pieces. Jul 15 00:07:20.115432396 (518h56m54.886073732s) [noise=true , address=77.90.31.11:4553 , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF Jul 15 00:07:20.115492132 (518h56m54.886133467s) [noise=true , address=45.91.116.4:4940 , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF Jul 15 00:07:20.115522189 (518h56m54.886163524s) [noise=true , address=45.91.116.14:4191 , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF Jul 15 00:07:20.115548169 (518h56m54.886189504s) [seg_pos={0 0}, upload=415135]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 15 00:07:20.115654933 (518h56m54.886296268s) [upload=415135]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:07:20.115661405 (518h56m54.88630275s) [upload=415135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:07:20.424646666 (518h56m55.195288241s) [upload=415135]: Done uploading segments... Jul 15 00:07:20.424667025 (518h56m55.19530836s) [upload=415135]: Upload finished. err: <nil> Duration: 6.009652861s core uplink us-select-1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 16.070876ms target: https://ap1.storj.io/login FAIL (2025-07-15 00:35:44 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:44805->127.0.0.1:53: i/o timeout Duration: 16.095573ms core satellite ap1
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 200.416657ms target: https://www.apple.com/robots.txt FAIL (2025-07-15 00:35:38 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": dial tcp: lookup www.apple.com on 127.0.0.1:53: read udp 127.0.0.1:42083->127.0.0.1:53: i/o timeout Duration: 200.458395ms core website
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1) antiblip: 2 out of 60 is failed (threshold=3) [..................................................XX........] duration: 937.901449ms FAIL (2025-07-15 00:35:32 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55317->127.0.0.1:53: i/o timeout Duration: 937.931186ms edge authservice http bgp eu1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 469.993224ms FAIL (2025-07-15 00:35:29 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55317->127.0.0.1:53: i/o timeout Duration: 470.018954ms edge authservice http bgp ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 15.530562ms target: https://ap1.storj.io/login FAIL (2025-07-15 00:35:20 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:44805->127.0.0.1:53: i/o timeout Duration: 15.559428ms core satellite ap1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [......................XX....................................] duration: 692.792221ms target: https://us1.storj.io/login FAIL (2025-07-15 00:35:19 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:49333->127.0.0.1:53: i/o timeout Duration: 692.816648ms core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.561526962s FAIL (2025-07-15 00:35:18 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33925->127.0.0.1:53: i/o timeout Duration: 5.561545647s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.153405488s FAIL (2025-07-15 00:35:17 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 5.153434263s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 1.470438599s FAIL (2025-07-15 00:35:17 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.470468725s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 6.005011231s FAIL (2025-07-15 00:35:13 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== :24.394249943 (518h55m59.164891278s) [noise=true , address=77.90.31.13:4626 , piece_id=U2XNN4FE47U4RFLZJUVMRZ4SISZ3TBN7HCRQYUBWLTXNTN5BN3IA, seg_pos={0 0}, upload=415122]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF Jul 15 00:06:24.394277596 (518h55m59.164918931s) [seg_pos={0 0}, upload=415122]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 15 00:06:24.394343541 (518h55m59.164984876s) [upload=415122]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:06:24.394347679 (518h55m59.164989014s) [upload=415122]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:06:24.692495788 (518h55m59.463137113s) [upload=415122]: Done uploading segments... Jul 15 00:06:24.692517119 (518h55m59.463158444s) [upload=415122]: Upload finished. err: <nil> Jul 15 00:07:17.316804141 (518h56m52.087445506s) [upload=415135]: Starting upload Jul 15 00:07:17.316952264 (518h56m52.087593649s) [upload=415135]: Done starting upload Jul 15 00:07:17.317069828 (518h56m52.087711223s) [upload=415135]: Uploading segments... Jul 15 00:07:17.317453613 (518h56m52.088094948s) [upload=415135]: Got next segment. Inline: false Jul 15 00:07:17.317540489 (518h56m52.088181864s) [upload=415135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 15 00:07:17.317549487 (518h56m52.088190852s) [upload=415135]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 15 00:07:17.797147854 (518h56m52.567789189s) [seg_pos={0 0}, upload=415135]: Begin upload segment... Jul 15 00:07:17.797188221 (518h56m52.567829556s) [seg_pos={0 0}, upload=415135]: Done begin upload segment. Jul 15 00:07:17.797209151 (518h56m52.567850486s) [noise=true , address=77.90.31.19:4841 , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.797261231 (518h56m52.567902566s) [noise=true , address=45.91.116.14:4191 , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.797616330 (518h56m52.568257665s) [noise=true , address=104.36.82.15:4258 , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.797784692 (518h56m52.568426027s) [noise=true , address=104.36.82.11:4115 , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798110125 (518h56m52.56875146s) [noise=true , address=104.36.82.5:4840 , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798170290 (518h56m52.568811625s) [noise=true , address=77.90.31.11:4553 , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798434274 (518h56m52.569075599s) [noise=true , address=77.90.31.15:4699 , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798508597 (518h56m52.569149932s) [noise=true , address=104.36.82.11:4114 , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798767944 (518h56m52.569409279s) [noise=true , address=104.36.82.10:4078 , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798923441 (518h56m52.569564776s) [noise=true , address=45.91.116.9:4261 , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.799033120 (518h56m52.569674445s) [noise=true , address=45.91.116.4:4940 , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.799206051 (518h56m52.569847386s) [noise=true , address=45.91.116.13:4153 , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.800112335 (518h56m52.57075366s) [noise=true , address=104.36.82.13:4186 , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.800481873 (518h56m52.571123208s) [noise=true , address=77.90.31.18:4807 , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.800771777 (518h56m52.571413112s) [noise=true , address=77.90.31.14:4662 , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.801715763 (518h56m52.572357098s) [noise=true , address=104.36.82.2:4731 , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:19.582805950 (518h56m54.353447285s) [upload=415135]: Next returned nil segment Jul 15 00:07:19.582822982 (518h56m54.353464317s) [upload=415135]: Waiting for error group managing segments... Jul 15 00:07:19.871591866 (518h56m54.642233202s) [noise=true , address=77.90.31.15:4699 , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.919348672 (518h56m54.689990007s) [noise=true , address=104.36.82.13:4186 , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.935048428 (518h56m54.705689763s) [noise=true , address=104.36.82.15:4258 , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.935763055 (518h56m54.70640439s) [noise=true , address=104.36.82.2:4731 , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.950670895 (518h56m54.72131223s) [noise=true , address=104.36.82.10:4078 , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.955816180 (518h56m54.726457515s) [noise=true , address=104.36.82.11:4115 , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.970279219 (518h56m54.740920554s) [noise=true , address=45.91.116.9:4261 , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.992903232 (518h56m54.763544567s) [noise=true , address=77.90.31.18:4807 , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.003524783 (518h56m54.774166118s) [noise=true , address=104.36.82.11:4114 , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.066078626 (518h56m54.836719951s) [noise=true , address=77.90.31.14:4662 , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.079716798 (518h56m54.850358133s) [noise=true , address=45.91.116.13:4153 , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.100603427 (518h56m54.871244762s) [noise=true , address=104.36.82.5:4840 , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.115262171 (518h56m54.885903506s) [noise=true , address=77.90.31.19:4841 , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.115289974 (518h56m54.885931309s) [seg_pos={0 0}, upload=415135]: Segment reached optimal threshold of 13 pieces. Jul 15 00:07:20.115432396 (518h56m54.886073732s) [noise=true , address=77.90.31.11:4553 , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF Jul 15 00:07:20.115492132 (518h56m54.886133467s) [noise=true , address=45.91.116.4:4940 , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF Jul 15 00:07:20.115522189 (518h56m54.886163524s) [noise=true , address=45.91.116.14:4191 , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF Jul 15 00:07:20.115548169 (518h56m54.886189504s) [seg_pos={0 0}, upload=415135]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 15 00:07:20.115654933 (518h56m54.886296268s) [upload=415135]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:07:20.115661405 (518h56m54.88630275s) [upload=415135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:07:20.424646666 (518h56m55.195288241s) [upload=415135]: Done uploading segments... Jul 15 00:07:20.424667025 (518h56m55.19530836s) [upload=415135]: Upload finished. err: <nil> Duration: 6.00503737s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........................X...............................XX] duration: 3.547260233s FAIL (2025-07-15 00:35:11 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55583->127.0.0.1:53: i/o timeout Duration: 3.547289028s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................X.................................XX] duration: 10.002118063s FAIL (2025-07-15 00:35:11 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55583->127.0.0.1:53: i/o timeout Duration: 10.002142331s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 479.382617ms FAIL (2025-07-15 00:35:06 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55317->127.0.0.1:53: i/o timeout Duration: 479.412573ms edge authservice http bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.053674762s FAIL (2025-07-15 00:35:05 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 2.053752521s core uplink us1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 476.077042ms target: https://eu1.storj.io/login FAIL (2025-07-15 00:35:03 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp: lookup eu1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:54006->127.0.0.1:53: i/o timeout Duration: 476.104054ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 6.658722652s FAIL (2025-07-15 00:34:58 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== :24.394249943 (518h55m59.164891278s) [noise=true , address=77.90.31.13:4626 , piece_id=U2XNN4FE47U4RFLZJUVMRZ4SISZ3TBN7HCRQYUBWLTXNTN5BN3IA, seg_pos={0 0}, upload=415122]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF Jul 15 00:06:24.394277596 (518h55m59.164918931s) [seg_pos={0 0}, upload=415122]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 15 00:06:24.394343541 (518h55m59.164984876s) [upload=415122]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:06:24.394347679 (518h55m59.164989014s) [upload=415122]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:06:24.692495788 (518h55m59.463137113s) [upload=415122]: Done uploading segments... Jul 15 00:06:24.692517119 (518h55m59.463158444s) [upload=415122]: Upload finished. err: <nil> Jul 15 00:07:17.316804141 (518h56m52.087445506s) [upload=415135]: Starting upload Jul 15 00:07:17.316952264 (518h56m52.087593649s) [upload=415135]: Done starting upload Jul 15 00:07:17.317069828 (518h56m52.087711223s) [upload=415135]: Uploading segments... Jul 15 00:07:17.317453613 (518h56m52.088094948s) [upload=415135]: Got next segment. Inline: false Jul 15 00:07:17.317540489 (518h56m52.088181864s) [upload=415135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 15 00:07:17.317549487 (518h56m52.088190852s) [upload=415135]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 15 00:07:17.797147854 (518h56m52.567789189s) [seg_pos={0 0}, upload=415135]: Begin upload segment... Jul 15 00:07:17.797188221 (518h56m52.567829556s) [seg_pos={0 0}, upload=415135]: Done begin upload segment. Jul 15 00:07:17.797209151 (518h56m52.567850486s) [noise=true , address=77.90.31.19:4841 , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.797261231 (518h56m52.567902566s) [noise=true , address=45.91.116.14:4191 , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.797616330 (518h56m52.568257665s) [noise=true , address=104.36.82.15:4258 , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.797784692 (518h56m52.568426027s) [noise=true , address=104.36.82.11:4115 , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798110125 (518h56m52.56875146s) [noise=true , address=104.36.82.5:4840 , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798170290 (518h56m52.568811625s) [noise=true , address=77.90.31.11:4553 , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798434274 (518h56m52.569075599s) [noise=true , address=77.90.31.15:4699 , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798508597 (518h56m52.569149932s) [noise=true , address=104.36.82.11:4114 , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798767944 (518h56m52.569409279s) [noise=true , address=104.36.82.10:4078 , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798923441 (518h56m52.569564776s) [noise=true , address=45.91.116.9:4261 , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.799033120 (518h56m52.569674445s) [noise=true , address=45.91.116.4:4940 , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.799206051 (518h56m52.569847386s) [noise=true , address=45.91.116.13:4153 , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.800112335 (518h56m52.57075366s) [noise=true , address=104.36.82.13:4186 , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.800481873 (518h56m52.571123208s) [noise=true , address=77.90.31.18:4807 , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.800771777 (518h56m52.571413112s) [noise=true , address=77.90.31.14:4662 , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.801715763 (518h56m52.572357098s) [noise=true , address=104.36.82.2:4731 , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:19.582805950 (518h56m54.353447285s) [upload=415135]: Next returned nil segment Jul 15 00:07:19.582822982 (518h56m54.353464317s) [upload=415135]: Waiting for error group managing segments... Jul 15 00:07:19.871591866 (518h56m54.642233202s) [noise=true , address=77.90.31.15:4699 , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.919348672 (518h56m54.689990007s) [noise=true , address=104.36.82.13:4186 , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.935048428 (518h56m54.705689763s) [noise=true , address=104.36.82.15:4258 , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.935763055 (518h56m54.70640439s) [noise=true , address=104.36.82.2:4731 , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.950670895 (518h56m54.72131223s) [noise=true , address=104.36.82.10:4078 , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.955816180 (518h56m54.726457515s) [noise=true , address=104.36.82.11:4115 , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.970279219 (518h56m54.740920554s) [noise=true , address=45.91.116.9:4261 , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.992903232 (518h56m54.763544567s) [noise=true , address=77.90.31.18:4807 , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.003524783 (518h56m54.774166118s) [noise=true , address=104.36.82.11:4114 , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.066078626 (518h56m54.836719951s) [noise=true , address=77.90.31.14:4662 , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.079716798 (518h56m54.850358133s) [noise=true , address=45.91.116.13:4153 , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.100603427 (518h56m54.871244762s) [noise=true , address=104.36.82.5:4840 , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.115262171 (518h56m54.885903506s) [noise=true , address=77.90.31.19:4841 , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.115289974 (518h56m54.885931309s) [seg_pos={0 0}, upload=415135]: Segment reached optimal threshold of 13 pieces. Jul 15 00:07:20.115432396 (518h56m54.886073732s) [noise=true , address=77.90.31.11:4553 , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF Jul 15 00:07:20.115492132 (518h56m54.886133467s) [noise=true , address=45.91.116.4:4940 , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF Jul 15 00:07:20.115522189 (518h56m54.886163524s) [noise=true , address=45.91.116.14:4191 , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF Jul 15 00:07:20.115548169 (518h56m54.886189504s) [seg_pos={0 0}, upload=415135]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 15 00:07:20.115654933 (518h56m54.886296268s) [upload=415135]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:07:20.115661405 (518h56m54.88630275s) [upload=415135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:07:20.424646666 (518h56m55.195288241s) [upload=415135]: Done uploading segments... Jul 15 00:07:20.424667025 (518h56m55.19530836s) [upload=415135]: Upload finished. err: <nil> Duration: 6.658762067s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................X...............................X] duration: 10.002096441s FAIL (2025-07-15 00:34:54 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50626->127.0.0.1:53: i/o timeout Duration: 10.00212734s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 1.212710084s FAIL (2025-07-15 00:34:51 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:38982->127.0.0.1:53: i/o timeout Duration: 1.21272833s edge authservice http bgp us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.017281953s FAIL (2025-07-15 00:34:50 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 5.017310687s core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................X.................................X] duration: 10.00196626s FAIL (2025-07-15 00:34:44 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34613->127.0.0.1:53: i/o timeout Duration: 10.001990126s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 3 out of 60 is failed (threshold=3) [........................XX.................................X] duration: 4.071522851s FAIL (2025-07-15 00:34:44 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34613->127.0.0.1:53: i/o timeout Duration: 4.071553919s edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.001740371s FAIL (2025-07-15 00:34:38 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== :24.394249943 (518h55m59.164891278s) [noise=true , address=77.90.31.13:4626 , piece_id=U2XNN4FE47U4RFLZJUVMRZ4SISZ3TBN7HCRQYUBWLTXNTN5BN3IA, seg_pos={0 0}, upload=415122]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF Jul 15 00:06:24.394277596 (518h55m59.164918931s) [seg_pos={0 0}, upload=415122]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 15 00:06:24.394343541 (518h55m59.164984876s) [upload=415122]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:06:24.394347679 (518h55m59.164989014s) [upload=415122]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:06:24.692495788 (518h55m59.463137113s) [upload=415122]: Done uploading segments... Jul 15 00:06:24.692517119 (518h55m59.463158444s) [upload=415122]: Upload finished. err: <nil> Jul 15 00:07:17.316804141 (518h56m52.087445506s) [upload=415135]: Starting upload Jul 15 00:07:17.316952264 (518h56m52.087593649s) [upload=415135]: Done starting upload Jul 15 00:07:17.317069828 (518h56m52.087711223s) [upload=415135]: Uploading segments... Jul 15 00:07:17.317453613 (518h56m52.088094948s) [upload=415135]: Got next segment. Inline: false Jul 15 00:07:17.317540489 (518h56m52.088181864s) [upload=415135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 15 00:07:17.317549487 (518h56m52.088190852s) [upload=415135]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 15 00:07:17.797147854 (518h56m52.567789189s) [seg_pos={0 0}, upload=415135]: Begin upload segment... Jul 15 00:07:17.797188221 (518h56m52.567829556s) [seg_pos={0 0}, upload=415135]: Done begin upload segment. Jul 15 00:07:17.797209151 (518h56m52.567850486s) [noise=true , address=77.90.31.19:4841 , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.797261231 (518h56m52.567902566s) [noise=true , address=45.91.116.14:4191 , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.797616330 (518h56m52.568257665s) [noise=true , address=104.36.82.15:4258 , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.797784692 (518h56m52.568426027s) [noise=true , address=104.36.82.11:4115 , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798110125 (518h56m52.56875146s) [noise=true , address=104.36.82.5:4840 , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798170290 (518h56m52.568811625s) [noise=true , address=77.90.31.11:4553 , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798434274 (518h56m52.569075599s) [noise=true , address=77.90.31.15:4699 , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798508597 (518h56m52.569149932s) [noise=true , address=104.36.82.11:4114 , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798767944 (518h56m52.569409279s) [noise=true , address=104.36.82.10:4078 , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.798923441 (518h56m52.569564776s) [noise=true , address=45.91.116.9:4261 , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.799033120 (518h56m52.569674445s) [noise=true , address=45.91.116.4:4940 , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.799206051 (518h56m52.569847386s) [noise=true , address=45.91.116.13:4153 , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.800112335 (518h56m52.57075366s) [noise=true , address=104.36.82.13:4186 , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.800481873 (518h56m52.571123208s) [noise=true , address=77.90.31.18:4807 , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.800771777 (518h56m52.571413112s) [noise=true , address=77.90.31.14:4662 , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:17.801715763 (518h56m52.572357098s) [noise=true , address=104.36.82.2:4731 , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Uploading piece... Jul 15 00:07:19.582805950 (518h56m54.353447285s) [upload=415135]: Next returned nil segment Jul 15 00:07:19.582822982 (518h56m54.353464317s) [upload=415135]: Waiting for error group managing segments... Jul 15 00:07:19.871591866 (518h56m54.642233202s) [noise=true , address=77.90.31.15:4699 , piece_id=4UAFWW7SVPET6XXGMLMG5XVIXFMRXXQEMKD4EHZ5R4T32XJMNOXA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.919348672 (518h56m54.689990007s) [noise=true , address=104.36.82.13:4186 , piece_id=QQ7OOHOSPEW6IREKEBQ633XMG5RFZHWAIWMPJ5STNBGPSMFGDJKQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.935048428 (518h56m54.705689763s) [noise=true , address=104.36.82.15:4258 , piece_id=ZBIBWKQFUB5RK4NTMGPGUWYFKKZYIXECV2BPOW2FPOY3S3WL54LA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.935763055 (518h56m54.70640439s) [noise=true , address=104.36.82.2:4731 , piece_id=BHVS6XNC373DLXVC4CQQRYUAB5WEC6D4FUUC6ERKB6YCUF4Z7XYA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.950670895 (518h56m54.72131223s) [noise=true , address=104.36.82.10:4078 , piece_id=5WGUKEULR2KWOWRK3OLNOLSWVINHCZ4LX3W2SMU5NOH76I4NBGMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.955816180 (518h56m54.726457515s) [noise=true , address=104.36.82.11:4115 , piece_id=EGA4BRNGRXJWMKKOVLMHD7XUVSIVEI2KZBFQ4UV2YVV2YMHGUB7Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.970279219 (518h56m54.740920554s) [noise=true , address=45.91.116.9:4261 , piece_id=GC7NY5EI3CUTISSLUTBLXTP2G5UII6BT2VSUOCC6TGQ5IDKL3YRQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:19.992903232 (518h56m54.763544567s) [noise=true , address=77.90.31.18:4807 , piece_id=HYB3K3ZTYDY7EUNEEZ4T35EQRP2PLN6KA4ACAC23IP7XWPZ32M3Q, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.003524783 (518h56m54.774166118s) [noise=true , address=104.36.82.11:4114 , piece_id=ARGJAWTQBOXKZNRWROXTO4NE7QHOQWZ4WKO7UZEUGGFM3MOFLZXQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.066078626 (518h56m54.836719951s) [noise=true , address=77.90.31.14:4662 , piece_id=MNJOCVUEDZYF73GAJ3H5NT7RAAZY2BEWT5DDO45HYWKEKAS4CVMQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.079716798 (518h56m54.850358133s) [noise=true , address=45.91.116.13:4153 , piece_id=JBS4MKXI4JFHDGNONREXDJQZVDN7MDJ7HGGFXS4WEGNL4MNQFZDQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.100603427 (518h56m54.871244762s) [noise=true , address=104.36.82.5:4840 , piece_id=QE7U6DJU46SF4RTXLCFJ4LMHOHS2U4AY2Z2XWT4WCVOC2ZKCLKVA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.115262171 (518h56m54.885903506s) [noise=true , address=77.90.31.19:4841 , piece_id=Y4BDTE4Z25BQ47FOITVX4CSPYSRITECV3F7AVDXR43O3GXXQLCJA, seg_pos={0 0}, upload=415135]: Done uploading piece. err: <nil> Jul 15 00:07:20.115289974 (518h56m54.885931309s) [seg_pos={0 0}, upload=415135]: Segment reached optimal threshold of 13 pieces. Jul 15 00:07:20.115432396 (518h56m54.886073732s) [noise=true , address=77.90.31.11:4553 , piece_id=MWPZCUS4U74QA6DQJ7HRRI6JNFAOJ3UM4WCTDX4CNLMD5QOA4TNQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF Jul 15 00:07:20.115492132 (518h56m54.886133467s) [noise=true , address=45.91.116.4:4940 , piece_id=UNS4DYLCZVOK2OZCNHF5I4BTNBLY3M4UYE2ZGRF345V3LAYBCGTQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF Jul 15 00:07:20.115522189 (518h56m54.886163524s) [noise=true , address=45.91.116.14:4191 , piece_id=EJVA3YY3FY27ZUQGIMGRR7EXPTPA3GKR4GP5QC6XRCLFC6JM6THQ, seg_pos={0 0}, upload=415135]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF Jul 15 00:07:20.115548169 (518h56m54.886189504s) [seg_pos={0 0}, upload=415135]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 15 00:07:20.115654933 (518h56m54.886296268s) [upload=415135]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:07:20.115661405 (518h56m54.88630275s) [upload=415135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:07:20.424646666 (518h56m55.195288241s) [upload=415135]: Done uploading segments... Jul 15 00:07:20.424667025 (518h56m55.19530836s) [upload=415135]: Upload finished. err: <nil> Duration: 6.001769497s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 1.56319913s FAIL (2025-07-15 00:34:38 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.563230479s core uplink eu1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 479.613768ms FAIL (2025-07-15 00:34:37 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:55317->127.0.0.1:53: i/o timeout Duration: 479.643036ms edge authservice http bgp ap1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)