Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 4.989373464s FAIL (2025-09-16 13:05:50 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== JFA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422604190 (238h59m45.46217732s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422896808 (238h59m45.462469928s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423232478 (238h59m45.462805608s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423565571 (238h59m45.463138691s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423935696 (238h59m45.463508826s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424280403 (238h59m45.463853533s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424633305 (238h59m45.464206435s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424994342 (238h59m45.464567472s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425341152 (238h59m45.464914282s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425707831 (238h59m45.465280951s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.426034432 (238h59m45.465607562s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429082236 (238h59m45.468655366s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429521483 (238h59m45.469094613s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:10.278696743 (238h59m46.318269863s) [upload=210063]: Next returned nil segment Sep 16 12:28:10.278720237 (238h59m46.318293367s) [upload=210063]: Waiting for error group managing segments... Sep 16 12:28:10.652409183 (238h59m46.691982303s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.662938092 (238h59m46.702511222s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.670032272 (238h59m46.709605402s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.701595607 (238h59m46.741168737s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.704157255 (238h59m46.743730385s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.707972140 (238h59m46.74754527s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.708523660 (238h59m46.74809678s) [noise=true , address=89.149.201.147:4007 , piece_id=BOQVD3EW5UAYWKEZ5FWC2QCDGIROAEOQN2OEYQ4QACNVDEIFF2IA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.754549157 (238h59m46.794122277s) [noise=true , address=89.149.201.147:4010 , piece_id=OALYBM6QEAOKMQPP2R3Y7LBVOEJYPMTBHJTGE2DSRO3KLRGBZC3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.138412786 (238h59m47.177985916s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.163219826 (238h59m47.202792956s) [noise=true , address=81.171.14.70:4039 , piece_id=IMLIU4QCGFNXWATVWK4L7FZPWOVPCRXNH4F3HSMF5VLQZJUEBO3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.169643348 (238h59m47.209216478s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.231770296 (238h59m47.271343416s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.258046263 (238h59m47.297619383s) [noise=true , address=185.167.204.205:4034 , piece_id=FUHHRFVDRYETJRWVBQZRALI4UGKDQ6DXV7TDKXBRASOMGOEN6YOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.263155884 (238h59m47.302729004s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.269762875 (238h59m47.309336005s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.281404505 (238h59m47.320977635s) [noise=true , address=185.167.204.205:4027 , piece_id=3O5SOEMEXYDYR5OE6SZJ2AVVLNYG4V4IMZOFUL7XDJEZUHDUV5TA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.289386705 (238h59m47.328959825s) [noise=true , address=185.167.204.206:4063 , piece_id=ERJLEJ5EILBCN4WUPZBVYSB2CGDWORVZ3GASSXBVNGR25GWVFYOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.298140815 (238h59m47.337713945s) [noise=true , address=185.167.204.206:4043 , piece_id=LDZTOC67YHM344PUCLVJ7RMKQAYJAQJ4GMKYZNN5LLU5KIUQCW7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.311391579 (238h59m47.350964709s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.317381906 (238h59m47.356955036s) [noise=true , address=185.167.204.206:4065 , piece_id=UXYM6MEGCQFRRRSMGI5XKJJJ6GYW7IJXG5QDGMICLP3FNJDSFRSQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.318355050 (238h59m47.35792818s) [noise=true , address=185.167.204.205:4018 , piece_id=VZP55ZA5Y5IA2PUH75QDVB56UHRJJ2XNC75L5WCRUSHGHQGZ463A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.330083334 (238h59m47.369656464s) [noise=true , address=185.167.204.206:4052 , piece_id=CDKZXVC22A62STE3NYD4R2TWT3AF45U2A7MHEIQJPTNMUKBVFJFA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.331429858 (238h59m47.371002988s) [noise=true , address=185.167.204.205:4035 , piece_id=M6LWKXSTJHGHXHY4VEJ2IGLI2UX4IIZV5KD4A6YY3BMIQ6ZRBMAQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.341689555 (238h59m47.381262686s) [noise=true , address=185.167.204.205:4014 , piece_id=MDSUAX4XNI5INUUQCMAP26PQFV62U3TZ2OITZR3BSNDQLHWEOKIA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.346694947 (238h59m47.386268077s) [noise=true , address=185.167.204.205:4023 , piece_id=YNW6TYPAVMYIHD5BT6QZGJJAGDM2XSZ4QYX4C2TH5QRGNTNP4KUQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363156895 (238h59m47.402730015s) [noise=true , address=185.167.204.206:4059 , piece_id=IX3H3WSLKDNPCCA5NMFUGMO2P6CA274AEUXLGVA3WRGJM3SN2OZQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363183276 (238h59m47.402756406s) [seg_pos={0 0}, upload=210063]: Segment reached optimal threshold of 26 pieces. Sep 16 12:28:11.363333942 (238h59m47.402907072s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363361435 (238h59m47.402934565s) [noise=true , address=185.167.204.206:4066 , piece_id=XXWYU36QFNZ2HCZF2WGAG4LKIBE3GCCKNVBDV6N5RQMCDJJXJULQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: expected piece hash; context canceled; EOF Sep 16 12:28:11.363393326 (238h59m47.402966456s) [seg_pos={0 0}, upload=210063]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil> Sep 16 12:28:11.363496222 (238h59m47.403069362s) [upload=210063]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 16 12:28:11.363503285 (238h59m47.403076405s) [upload=210063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 16 12:28:11.633947931 (238h59m47.673521071s) [upload=210063]: Done uploading segments... Sep 16 12:28:11.633974231 (238h59m47.673547372s) [upload=210063]: Upload finished. err: <nil> Duration: 4.989407158s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 4.952842689s FAIL (2025-09-16 13:05:25 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== JFA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422604190 (238h59m45.46217732s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422896808 (238h59m45.462469928s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423232478 (238h59m45.462805608s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423565571 (238h59m45.463138691s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423935696 (238h59m45.463508826s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424280403 (238h59m45.463853533s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424633305 (238h59m45.464206435s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424994342 (238h59m45.464567472s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425341152 (238h59m45.464914282s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425707831 (238h59m45.465280951s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.426034432 (238h59m45.465607562s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429082236 (238h59m45.468655366s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429521483 (238h59m45.469094613s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:10.278696743 (238h59m46.318269863s) [upload=210063]: Next returned nil segment Sep 16 12:28:10.278720237 (238h59m46.318293367s) [upload=210063]: Waiting for error group managing segments... Sep 16 12:28:10.652409183 (238h59m46.691982303s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.662938092 (238h59m46.702511222s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.670032272 (238h59m46.709605402s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.701595607 (238h59m46.741168737s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.704157255 (238h59m46.743730385s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.707972140 (238h59m46.74754527s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.708523660 (238h59m46.74809678s) [noise=true , address=89.149.201.147:4007 , piece_id=BOQVD3EW5UAYWKEZ5FWC2QCDGIROAEOQN2OEYQ4QACNVDEIFF2IA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.754549157 (238h59m46.794122277s) [noise=true , address=89.149.201.147:4010 , piece_id=OALYBM6QEAOKMQPP2R3Y7LBVOEJYPMTBHJTGE2DSRO3KLRGBZC3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.138412786 (238h59m47.177985916s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.163219826 (238h59m47.202792956s) [noise=true , address=81.171.14.70:4039 , piece_id=IMLIU4QCGFNXWATVWK4L7FZPWOVPCRXNH4F3HSMF5VLQZJUEBO3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.169643348 (238h59m47.209216478s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.231770296 (238h59m47.271343416s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.258046263 (238h59m47.297619383s) [noise=true , address=185.167.204.205:4034 , piece_id=FUHHRFVDRYETJRWVBQZRALI4UGKDQ6DXV7TDKXBRASOMGOEN6YOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.263155884 (238h59m47.302729004s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.269762875 (238h59m47.309336005s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.281404505 (238h59m47.320977635s) [noise=true , address=185.167.204.205:4027 , piece_id=3O5SOEMEXYDYR5OE6SZJ2AVVLNYG4V4IMZOFUL7XDJEZUHDUV5TA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.289386705 (238h59m47.328959825s) [noise=true , address=185.167.204.206:4063 , piece_id=ERJLEJ5EILBCN4WUPZBVYSB2CGDWORVZ3GASSXBVNGR25GWVFYOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.298140815 (238h59m47.337713945s) [noise=true , address=185.167.204.206:4043 , piece_id=LDZTOC67YHM344PUCLVJ7RMKQAYJAQJ4GMKYZNN5LLU5KIUQCW7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.311391579 (238h59m47.350964709s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.317381906 (238h59m47.356955036s) [noise=true , address=185.167.204.206:4065 , piece_id=UXYM6MEGCQFRRRSMGI5XKJJJ6GYW7IJXG5QDGMICLP3FNJDSFRSQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.318355050 (238h59m47.35792818s) [noise=true , address=185.167.204.205:4018 , piece_id=VZP55ZA5Y5IA2PUH75QDVB56UHRJJ2XNC75L5WCRUSHGHQGZ463A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.330083334 (238h59m47.369656464s) [noise=true , address=185.167.204.206:4052 , piece_id=CDKZXVC22A62STE3NYD4R2TWT3AF45U2A7MHEIQJPTNMUKBVFJFA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.331429858 (238h59m47.371002988s) [noise=true , address=185.167.204.205:4035 , piece_id=M6LWKXSTJHGHXHY4VEJ2IGLI2UX4IIZV5KD4A6YY3BMIQ6ZRBMAQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.341689555 (238h59m47.381262686s) [noise=true , address=185.167.204.205:4014 , piece_id=MDSUAX4XNI5INUUQCMAP26PQFV62U3TZ2OITZR3BSNDQLHWEOKIA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.346694947 (238h59m47.386268077s) [noise=true , address=185.167.204.205:4023 , piece_id=YNW6TYPAVMYIHD5BT6QZGJJAGDM2XSZ4QYX4C2TH5QRGNTNP4KUQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363156895 (238h59m47.402730015s) [noise=true , address=185.167.204.206:4059 , piece_id=IX3H3WSLKDNPCCA5NMFUGMO2P6CA274AEUXLGVA3WRGJM3SN2OZQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363183276 (238h59m47.402756406s) [seg_pos={0 0}, upload=210063]: Segment reached optimal threshold of 26 pieces. Sep 16 12:28:11.363333942 (238h59m47.402907072s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363361435 (238h59m47.402934565s) [noise=true , address=185.167.204.206:4066 , piece_id=XXWYU36QFNZ2HCZF2WGAG4LKIBE3GCCKNVBDV6N5RQMCDJJXJULQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: expected piece hash; context canceled; EOF Sep 16 12:28:11.363393326 (238h59m47.402966456s) [seg_pos={0 0}, upload=210063]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil> Sep 16 12:28:11.363496222 (238h59m47.403069362s) [upload=210063]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 16 12:28:11.363503285 (238h59m47.403076405s) [upload=210063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 16 12:28:11.633947931 (238h59m47.673521071s) [upload=210063]: Done uploading segments... Sep 16 12:28:11.633974231 (238h59m47.673547372s) [upload=210063]: Upload finished. err: <nil> Duration: 4.952886672s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 30 out of 60 is failed (threshold=3) [..X......X.X.......XXXX.XX.XXXXXX..XX.XXX..XX.X.X.XX.XXX.X..] duration: 7.224373858s FAIL (2025-09-16 13:05:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== atch item: pb.BatchRequestItem_ObjectBegin Sep 16 13:04:06.509551176 (239h35m42.549124306s) [upload=210558]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 16 13:04:06.761625668 (239h35m42.801198798s) [seg_pos={0 0}, upload=210558]: Begin upload segment... Sep 16 13:04:06.761684651 (239h35m42.801257781s) [seg_pos={0 0}, upload=210558]: Done begin upload segment. Sep 16 13:04:06.761715560 (239h35m42.80128869s) [noise=true , address=145.79.227.11:4729 , piece_id=7SJYO7D2FE6IDNRNN2DKISMIEETI2WZYDNCP5EJWI32WIRZTEMDA, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.761899790 (239h35m42.80147293s) [noise=true , address=45.91.116.6:4973 , piece_id=EZSBXOCXG6QVUN7UWP3W35DZFNBDCM2AY6RWV7NGAGBVICE7MA5Q, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.762388541 (239h35m42.801961671s) [noise=true , address=45.91.116.6:4975 , piece_id=ZM5SYEDOWXE6ZD6AWUH2377MHC645CLOFX5XRW5UJO37FOWWZNPA, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.762511886 (239h35m42.802085016s) [noise=true , address=145.79.227.14:4837 , piece_id=YW5YUH7OU7HSUB7FAAEW6LVZUBP3IIQKZ7YTJ3B33KQPMWMHNPDA, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.762712298 (239h35m42.802285418s) [noise=true , address=45.91.116.11:4117 , piece_id=BZ655HXADDLDNP6D2DMY7SNWSGNQ6AK7WDTDUHA2C6J6GKHPVUOA, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.762966832 (239h35m42.802539962s) [noise=true , address=77.90.31.15:4699 , piece_id=CPHA7H3U4GLPAZCKTGSBA6CHUZXUI7UZ2IS7566RFMEKOPVIBUJA, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.763029732 (239h35m42.802602862s) [noise=true , address=145.79.227.15:4876 , piece_id=NUYZ2WIPZBPQBPPLUHYAZRS3LVXEGD56AOCBY7SDBIQKRWVBN37Q, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.763282674 (239h35m42.802855804s) [noise=true , address=45.91.116.14:4190 , piece_id=K6NGZWHBJSNDP3RPPMWJCX4JWF46CRV7M333XJ3MGPVW6IIEHPWA, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.763358418 (239h35m42.802931548s) [noise=true , address=77.90.31.10:4520 , piece_id=5FYAEJCR7LQHNF3YEFNLXBYQ53JXKDP6LGPETAM2GXRMPG7YT7PQ, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.763545034 (239h35m42.803118154s) [noise=true , address=45.91.116.5:4299 , piece_id=BGM23T2RSD7CLTI7EP3SN7SF6C4XF3MH3CXGLOCQAIOQRY6NCG7Q, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.763765263 (239h35m42.803338393s) [noise=true , address=145.79.227.13:4802 , piece_id=HEYHF32JTCVLKLXP2RM6MLHCNW6GZYIZ35UAJO5G55TF7JEYXREQ, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.763796572 (239h35m42.803369702s) [noise=true , address=45.91.116.5:4297 , piece_id=FN6KYJURDH76VITYP5FY2BVY5HJCD46SIOYZRLLOCVUAXMWSPS2Q, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.764052189 (239h35m42.803625319s) [noise=true , address=145.79.227.3:4149 , piece_id=DPPGMUQAIDAJ3S2PEZH4BZGUE5B246VAG2E67KW7CUAKL3ZKED4Q, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.764127062 (239h35m42.803700192s) [noise=true , address=145.79.227.6:4257 , piece_id=WXC4PN5BEXVPSXKRB3WYQD7WTDCNNBRDMYTJM4C2A7FSMJ6SJDUQ, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.764304931 (239h35m42.803878051s) [noise=true , address=45.91.116.9:4261 , piece_id=2UINBKUVA2IZ73AZBNDTHFCN6TEA6DY3NMIHGVZJUZECSMO5UHNQ, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.764786668 (239h35m42.804359798s) [noise=true , address=45.91.116.10:4083 , piece_id=PEZ5PJA5AWCVHMI3O53DHLLCIS2CJA5XRXC56PQ6JXBWFLOZZV2Q, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:08.494930252 (239h35m44.534503382s) [upload=210558]: Next returned nil segment Sep 16 13:04:08.494954587 (239h35m44.534527717s) [upload=210558]: Waiting for error group managing segments... Sep 16 13:04:08.914029269 (239h35m44.953602399s) [noise=true , address=45.91.116.11:4117 , piece_id=BZ655HXADDLDNP6D2DMY7SNWSGNQ6AK7WDTDUHA2C6J6GKHPVUOA, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:08.923086587 (239h35m44.962659717s) [noise=true , address=45.91.116.14:4190 , piece_id=K6NGZWHBJSNDP3RPPMWJCX4JWF46CRV7M333XJ3MGPVW6IIEHPWA, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:08.931995211 (239h35m44.971568341s) [noise=true , address=45.91.116.6:4975 , piece_id=ZM5SYEDOWXE6ZD6AWUH2377MHC645CLOFX5XRW5UJO37FOWWZNPA, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:08.937017555 (239h35m44.976590675s) [noise=true , address=77.90.31.10:4520 , piece_id=5FYAEJCR7LQHNF3YEFNLXBYQ53JXKDP6LGPETAM2GXRMPG7YT7PQ, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:08.949355419 (239h35m44.988928549s) [noise=true , address=45.91.116.5:4299 , piece_id=BGM23T2RSD7CLTI7EP3SN7SF6C4XF3MH3CXGLOCQAIOQRY6NCG7Q, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:08.986188829 (239h35m45.025761959s) [noise=true , address=45.91.116.5:4297 , piece_id=FN6KYJURDH76VITYP5FY2BVY5HJCD46SIOYZRLLOCVUAXMWSPS2Q, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:08.986715071 (239h35m45.026288201s) [noise=true , address=77.90.31.15:4699 , piece_id=CPHA7H3U4GLPAZCKTGSBA6CHUZXUI7UZ2IS7566RFMEKOPVIBUJA, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:09.004119053 (239h35m45.043692183s) [noise=true , address=45.91.116.9:4261 , piece_id=2UINBKUVA2IZ73AZBNDTHFCN6TEA6DY3NMIHGVZJUZECSMO5UHNQ, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:09.029578384 (239h35m45.069151504s) [noise=true , address=45.91.116.6:4973 , piece_id=EZSBXOCXG6QVUN7UWP3W35DZFNBDCM2AY6RWV7NGAGBVICE7MA5Q, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:09.077914638 (239h35m45.117487768s) [noise=true , address=45.91.116.10:4083 , piece_id=PEZ5PJA5AWCVHMI3O53DHLLCIS2CJA5XRXC56PQ6JXBWFLOZZV2Q, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:35.824179296 (239h36m11.863752426s) [noise=true , address=145.79.227.15:4876 , piece_id=NUYZ2WIPZBPQBPPLUHYAZRS3LVXEGD56AOCBY7SDBIQKRWVBN37Q, seg_pos={0 0}, upload=210558]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:04:35.824555582 (239h36m11.864128712s) [noise=true , address=145.79.227.3:4149 , piece_id=DPPGMUQAIDAJ3S2PEZH4BZGUE5B246VAG2E67KW7CUAKL3ZKED4Q, seg_pos={0 0}, upload=210558]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:33204->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:33204->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33204->145.79.227.3:4149: use of closed network connection Sep 16 13:04:35.824652837 (239h36m11.864225967s) [noise=true , address=145.79.227.14:4837 , piece_id=YW5YUH7OU7HSUB7FAAEW6LVZUBP3IIQKZ7YTJ3B33KQPMWMHNPDA, seg_pos={0 0}, upload=210558]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: write tcp 188.166.225.170:45652->145.79.227.14:4837: use of closed network connection; write tcp 188.166.225.170:45652->145.79.227.14:4837: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45652->145.79.227.14:4837: use of closed network connection Sep 16 13:04:35.824695728 (239h36m11.864268859s) [noise=true , address=145.79.227.6:4257 , piece_id=WXC4PN5BEXVPSXKRB3WYQD7WTDCNNBRDMYTJM4C2A7FSMJ6SJDUQ, seg_pos={0 0}, upload=210558]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:36256->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:36256->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36256->145.79.227.6:4257: use of closed network connection Sep 16 13:04:35.824719785 (239h36m11.864292915s) [noise=true , address=145.79.227.13:4802 , piece_id=HEYHF32JTCVLKLXP2RM6MLHCNW6GZYIZ35UAJO5G55TF7JEYXREQ, seg_pos={0 0}, upload=210558]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:49476->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:49476->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49476->145.79.227.13:4802: use of closed network connection Sep 16 13:04:35.824803154 (239h36m11.864376284s) [noise=true , address=145.79.227.11:4729 , piece_id=7SJYO7D2FE6IDNRNN2DKISMIEETI2WZYDNCP5EJWI32WIRZTEMDA, seg_pos={0 0}, upload=210558]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:35482->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:35482->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35482->145.79.227.11:4729: use of closed network connection Sep 16 13:04:35.824858930 (239h36m11.86443206s) [seg_pos={0 0}, upload=210558]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 16 13:04:36.062009463 (239h36m12.101582603s) [upload=210558]: Done uploading segments... Sep 16 13:04:36.062043648 (239h36m12.101616778s) [upload=210558]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 7.224434524s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 34 out of 60 is failed (threshold=3) [......................X.X..XXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 1m0.240069116s FAIL (2025-09-16 13:05:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== d segment. Sep 16 13:04:05.069780306 (239h35m41.109353436s) [noise=true , address=145.79.227.7:4309 , piece_id=EXS5X3GI227RQ4M53FUJJ2AQHYA23TG7RMOULSU2NVEHPDWDR66A, seg_pos={0 0}, upload=210556]: Uploading piece... Sep 16 13:04:05.069895505 (239h35m41.109468635s) [noise=true , address=145.79.227.46:4615 , piece_id=YR36CSUZG3RGCX4SXZ6P25FHENTS5MNHTIQNUTR2BYDCRA32TATA, seg_pos={0 0}, upload=210556]: Uploading piece... Sep 16 13:04:05.070300717 (239h35m41.109873847s) [noise=true , address=145.79.227.4:4192 , piece_id=72PSMWGQYB57ORFGBLKBOVBLIZXYK3SLJ4NR547P44MM6UOT5F5Q, seg_pos={0 0}, upload=210556]: Uploading piece... Sep 16 13:04:05.070394947 (239h35m41.109968077s) [noise=true , address=145.79.227.29:4946 , piece_id=PQ5AHS6BJ3XCG6VFTK4XQM62CBSSJ3XRAD4NZN72XDOPIGHBQF5Q, seg_pos={0 0}, upload=210556]: Uploading piece... Sep 16 13:04:05.070651294 (239h35m41.110224414s) [noise=true , address=145.79.227.11:4757 , piece_id=2DYPFIZKCLZCCLEDMIBZ5ID3AC5SEGAI5D5SDDXDTCIYMCIWX2LA, seg_pos={0 0}, upload=210556]: Uploading piece... Sep 16 13:04:05.070890580 (239h35m41.11046371s) [noise=true , address=145.79.227.26:4679 , piece_id=LVNZ7I2C7QC5YPUNJ3XXFSWETKCN6QYG7FYGTXSVUIJOZSVJVDOQ, seg_pos={0 0}, upload=210556]: Uploading piece... Sep 16 13:04:05.071019616 (239h35m41.110592746s) [noise=true , address=145.79.227.52:4464 , piece_id=DI3M6L75J2VDQWW27S6VQOWGXRSJFEEVSKIATDTOAI6S2XHO6H7A, seg_pos={0 0}, upload=210556]: Uploading piece... Sep 16 13:04:05.071257529 (239h35m41.110830659s) [noise=true , address=145.79.227.23:4576 , piece_id=CWOYDCC6H2ZJKGYNWGTSHN73E6UUNOMEKE367EVXBHR5GXR7LQNA, seg_pos={0 0}, upload=210556]: Uploading piece... Sep 16 13:04:05.071357961 (239h35m41.110931091s) [noise=true , address=145.79.227.51:4430 , piece_id=FYXMSNOZWSVDPW4KDYA6XMSZNIBIXZGCZD6Y5XZSIQWQKPZVOKFA, seg_pos={0 0}, upload=210556]: Uploading piece... Sep 16 13:04:05.071623235 (239h35m41.111196365s) [noise=true , address=145.79.227.35:4499 , piece_id=F6XPLKTFICVAPWIWCS3WNQEPAGK5DFIM5QY3OZX7WXBMUO4T2OAQ, seg_pos={0 0}, upload=210556]: Uploading piece... Sep 16 13:04:05.071721512 (239h35m41.111294642s) [noise=true , address=77.90.31.15:4716 , piece_id=3GQYREFUJORBW2GB76K7U4JSCZ66HMN63R4WKUO7OR32F4MXPY6Q, seg_pos={0 0}, upload=210556]: Uploading piece... Sep 16 13:04:05.071895724 (239h35m41.111468854s) [noise=true , address=145.79.227.6:4286 , piece_id=RUJHUYA5OJC3MIFH6FQ3JOQQQPGOQEUCREFO5DCWBT2JKS6WVB7A, seg_pos={0 0}, upload=210556]: Uploading piece... Sep 16 13:04:05.072052764 (239h35m41.111625894s) [noise=true , address=145.79.227.50:4375 , piece_id=3EW6KHWCLGIGJ35APVQOWW46SAH5VPURD5KSS62WT3RMCQ5VAZBA, seg_pos={0 0}, upload=210556]: Uploading piece... Sep 16 13:04:05.072172501 (239h35m41.111745621s) [noise=true , address=145.79.227.14:4862 , piece_id=KKKLSKV6WWOJ3WJNU4ULUM7M3LTGA2XVJTW42B533H4NUDCJPUKA, seg_pos={0 0}, upload=210556]: Uploading piece... Sep 16 13:04:05.072463145 (239h35m41.112036275s) [noise=true , address=145.79.227.13:4832 , piece_id=TYOO24IFA46TVTH2K5GOCDKP4YFCHG5FJPJNBPYOO4ABWZNTFQPQ, seg_pos={0 0}, upload=210556]: Uploading piece... Sep 16 13:04:05.072627768 (239h35m41.112200898s) [noise=true , address=145.79.227.48:4304 , piece_id=YQLTO7UOQO7KXIY7NI3VKJAIKTLSHTNPWG7L4DPAL4NYQSZYLRWA, seg_pos={0 0}, upload=210556]: Uploading piece... Sep 16 13:04:05.072815105 (239h35m41.112388245s) [noise=true , address=145.79.227.36:4542 , piece_id=VHGDRIDJ5U54VYW5RLDYCRONU6SIGAJSPEZCVK2PG5QDDS5QBLRA, seg_pos={0 0}, upload=210556]: Uploading piece... Sep 16 13:04:05.073167176 (239h35m41.112740306s) [noise=true , address=77.90.31.11:4567 , piece_id=WTTZBCMR2VEVPAT26O76VWOVAFUUZQ24KJWZ3AZLW33MSGCV3ZDQ, seg_pos={0 0}, upload=210556]: Uploading piece... Sep 16 13:04:06.718709375 (239h35m42.758282505s) [upload=210556]: Next returned nil segment Sep 16 13:04:06.718734803 (239h35m42.758307934s) [upload=210556]: Waiting for error group managing segments... Sep 16 13:04:07.136901887 (239h35m43.176475017s) [noise=true , address=77.90.31.11:4567 , piece_id=WTTZBCMR2VEVPAT26O76VWOVAFUUZQ24KJWZ3AZLW33MSGCV3ZDQ, seg_pos={0 0}, upload=210556]: Done uploading piece. err: <nil> Sep 16 13:04:07.189403624 (239h35m43.228976754s) [noise=true , address=77.90.31.15:4716 , piece_id=3GQYREFUJORBW2GB76K7U4JSCZ66HMN63R4WKUO7OR32F4MXPY6Q, seg_pos={0 0}, upload=210556]: Done uploading piece. err: <nil> Sep 16 13:04:31.262392712 (239h36m7.301965842s) [noise=true , address=145.79.227.50:4375 , piece_id=3EW6KHWCLGIGJ35APVQOWW46SAH5VPURD5KSS62WT3RMCQ5VAZBA, seg_pos={0 0}, upload=210556]: Done uploading piece. err: <nil> Sep 16 13:04:34.403896402 (239h36m10.443469533s) [noise=true , address=145.79.227.29:4946 , piece_id=PQ5AHS6BJ3XCG6VFTK4XQM62CBSSJ3XRAD4NZN72XDOPIGHBQF5Q, seg_pos={0 0}, upload=210556]: Done uploading piece. err: <nil> Sep 16 13:04:34.938822855 (239h36m10.978395975s) [noise=true , address=145.79.227.48:4304 , piece_id=YQLTO7UOQO7KXIY7NI3VKJAIKTLSHTNPWG7L4DPAL4NYQSZYLRWA, seg_pos={0 0}, upload=210556]: Done uploading piece. err: <nil> Sep 16 13:04:37.496830027 (239h36m13.536403157s) [noise=true , address=145.79.227.7:4309 , piece_id=EXS5X3GI227RQ4M53FUJJ2AQHYA23TG7RMOULSU2NVEHPDWDR66A, seg_pos={0 0}, upload=210556]: Done uploading piece. err: <nil> Sep 16 13:04:39.604988450 (239h36m15.64456158s) [noise=true , address=145.79.227.51:4430 , piece_id=FYXMSNOZWSVDPW4KDYA6XMSZNIBIXZGCZD6Y5XZSIQWQKPZVOKFA, seg_pos={0 0}, upload=210556]: Done uploading piece. err: <nil> Sep 16 13:04:45.698447896 (239h36m21.738021026s) [noise=true , address=145.79.227.13:4832 , piece_id=TYOO24IFA46TVTH2K5GOCDKP4YFCHG5FJPJNBPYOO4ABWZNTFQPQ, seg_pos={0 0}, upload=210556]: Done uploading piece. err: <nil> Sep 16 13:04:47.826702471 (239h36m23.866275601s) [noise=true , address=145.79.227.11:4757 , piece_id=2DYPFIZKCLZCCLEDMIBZ5ID3AC5SEGAI5D5SDDXDTCIYMCIWX2LA, seg_pos={0 0}, upload=210556]: Done uploading piece. err: <nil> Sep 16 13:04:49.460276690 (239h36m25.49984982s) [noise=true , address=145.79.227.14:4862 , piece_id=KKKLSKV6WWOJ3WJNU4ULUM7M3LTGA2XVJTW42B533H4NUDCJPUKA, seg_pos={0 0}, upload=210556]: Done uploading piece. err: <nil> Sep 16 13:04:59.139180143 (239h36m35.178753273s) [noise=true , address=145.79.227.46:4615 , piece_id=YR36CSUZG3RGCX4SXZ6P25FHENTS5MNHTIQNUTR2BYDCRA32TATA, seg_pos={0 0}, upload=210556]: Done uploading piece. err: <nil> Sep 16 13:05:03.911851858 (239h36m39.951424988s) [noise=true , address=145.79.227.35:4499 , piece_id=F6XPLKTFICVAPWIWCS3WNQEPAGK5DFIM5QY3OZX7WXBMUO4T2OAQ, seg_pos={0 0}, upload=210556]: Done uploading piece. err: ecclient: upload failed (node:1JR5bVTizvQCY5utaGUDgLHvCJfrbbpixmKNrq5vjiRB8VaSoc, address:145.79.227.35:4499): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:05:03.912012485 (239h36m39.951585615s) [noise=true , address=145.79.227.6:4286 , piece_id=RUJHUYA5OJC3MIFH6FQ3JOQQQPGOQEUCREFO5DCWBT2JKS6WVB7A, seg_pos={0 0}, upload=210556]: Done uploading piece. err: ecclient: upload failed (node:1cYgDBE6AN1EWzUQFPpF2g1pk25JoL7HcHTsFCUUHGB8ioLEGo, address:145.79.227.6:4286): protocol: expected piece hash; write tcp 188.166.225.170:35188->145.79.227.6:4286: use of closed network connection; write tcp 188.166.225.170:35188->145.79.227.6:4286: use of closed network connection; EOF Sep 16 13:05:03.912150257 (239h36m39.951723397s) [noise=true , address=145.79.227.4:4192 , piece_id=72PSMWGQYB57ORFGBLKBOVBLIZXYK3SLJ4NR547P44MM6UOT5F5Q, seg_pos={0 0}, upload=210556]: Done uploading piece. err: ecclient: upload failed (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3, address:145.79.227.4:4192): protocol: write tcp 188.166.225.170:60946->145.79.227.4:4192: use of closed network connection; write tcp 188.166.225.170:60946->145.79.227.4:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60946->145.79.227.4:4192: use of closed network connection Sep 16 13:05:03.912327855 (239h36m39.951900985s) [noise=true , address=145.79.227.36:4542 , piece_id=VHGDRIDJ5U54VYW5RLDYCRONU6SIGAJSPEZCVK2PG5QDDS5QBLRA, seg_pos={0 0}, upload=210556]: Done uploading piece. err: ecclient: upload failed (node:129FwaCA1FbzJbmRNzhQeVgygicJYHWkSS9fLnJbAG7KZPpokLU, address:145.79.227.36:4542): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:05:03.912649036 (239h36m39.952222177s) [noise=true , address=145.79.227.23:4576 , piece_id=CWOYDCC6H2ZJKGYNWGTSHN73E6UUNOMEKE367EVXBHR5GXR7LQNA, seg_pos={0 0}, upload=210556]: Done uploading piece. err: ecclient: upload failed (node:122bMTJLxntv7VEY56zSPLZm5wZHAH3rnE8UZHNCjRhd7P9oKus, address:145.79.227.23:4576): protocol: expected piece hash; write tcp 188.166.225.170:39544->145.79.227.23:4576: use of closed network connection; write tcp 188.166.225.170:39544->145.79.227.23:4576: use of closed network connection; EOF Sep 16 13:05:03.912807980 (239h36m39.95238112s) [noise=true , address=145.79.227.26:4679 , piece_id=LVNZ7I2C7QC5YPUNJ3XXFSWETKCN6QYG7FYGTXSVUIJOZSVJVDOQ, seg_pos={0 0}, upload=210556]: Done uploading piece. err: ecclient: upload failed (node:1VHQihNGcx6bTvwitH9PCSqyuKWuchdYhYzZXwSuoruQFByGoj, address:145.79.227.26:4679): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:05:03.913010836 (239h36m39.952583976s) [noise=true , address=145.79.227.52:4464 , piece_id=DI3M6L75J2VDQWW27S6VQOWGXRSJFEEVSKIATDTOAI6S2XHO6H7A, seg_pos={0 0}, upload=210556]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:145.79.227.52:4464): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:05:03.913044089 (239h36m39.952617229s) [seg_pos={0 0}, upload=210556]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 16 13:05:04.148618551 (239h36m40.188191691s) [upload=210556]: Done uploading segments... Sep 16 13:05:04.148694465 (239h36m40.188267595s) [upload=210556]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 1m0.240093662s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 30 out of 60 is failed (threshold=3) [...X......X.X.......XXXX.XX.XXXXXX..XX.XXX..XX.X.X.XX.XXX.X.] duration: 6.927245853s FAIL (2025-09-16 13:04:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== atch item: pb.BatchRequestItem_ObjectBegin Sep 16 13:04:06.509551176 (239h35m42.549124306s) [upload=210558]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 16 13:04:06.761625668 (239h35m42.801198798s) [seg_pos={0 0}, upload=210558]: Begin upload segment... Sep 16 13:04:06.761684651 (239h35m42.801257781s) [seg_pos={0 0}, upload=210558]: Done begin upload segment. Sep 16 13:04:06.761715560 (239h35m42.80128869s) [noise=true , address=145.79.227.11:4729 , piece_id=7SJYO7D2FE6IDNRNN2DKISMIEETI2WZYDNCP5EJWI32WIRZTEMDA, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.761899790 (239h35m42.80147293s) [noise=true , address=45.91.116.6:4973 , piece_id=EZSBXOCXG6QVUN7UWP3W35DZFNBDCM2AY6RWV7NGAGBVICE7MA5Q, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.762388541 (239h35m42.801961671s) [noise=true , address=45.91.116.6:4975 , piece_id=ZM5SYEDOWXE6ZD6AWUH2377MHC645CLOFX5XRW5UJO37FOWWZNPA, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.762511886 (239h35m42.802085016s) [noise=true , address=145.79.227.14:4837 , piece_id=YW5YUH7OU7HSUB7FAAEW6LVZUBP3IIQKZ7YTJ3B33KQPMWMHNPDA, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.762712298 (239h35m42.802285418s) [noise=true , address=45.91.116.11:4117 , piece_id=BZ655HXADDLDNP6D2DMY7SNWSGNQ6AK7WDTDUHA2C6J6GKHPVUOA, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.762966832 (239h35m42.802539962s) [noise=true , address=77.90.31.15:4699 , piece_id=CPHA7H3U4GLPAZCKTGSBA6CHUZXUI7UZ2IS7566RFMEKOPVIBUJA, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.763029732 (239h35m42.802602862s) [noise=true , address=145.79.227.15:4876 , piece_id=NUYZ2WIPZBPQBPPLUHYAZRS3LVXEGD56AOCBY7SDBIQKRWVBN37Q, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.763282674 (239h35m42.802855804s) [noise=true , address=45.91.116.14:4190 , piece_id=K6NGZWHBJSNDP3RPPMWJCX4JWF46CRV7M333XJ3MGPVW6IIEHPWA, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.763358418 (239h35m42.802931548s) [noise=true , address=77.90.31.10:4520 , piece_id=5FYAEJCR7LQHNF3YEFNLXBYQ53JXKDP6LGPETAM2GXRMPG7YT7PQ, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.763545034 (239h35m42.803118154s) [noise=true , address=45.91.116.5:4299 , piece_id=BGM23T2RSD7CLTI7EP3SN7SF6C4XF3MH3CXGLOCQAIOQRY6NCG7Q, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.763765263 (239h35m42.803338393s) [noise=true , address=145.79.227.13:4802 , piece_id=HEYHF32JTCVLKLXP2RM6MLHCNW6GZYIZ35UAJO5G55TF7JEYXREQ, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.763796572 (239h35m42.803369702s) [noise=true , address=45.91.116.5:4297 , piece_id=FN6KYJURDH76VITYP5FY2BVY5HJCD46SIOYZRLLOCVUAXMWSPS2Q, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.764052189 (239h35m42.803625319s) [noise=true , address=145.79.227.3:4149 , piece_id=DPPGMUQAIDAJ3S2PEZH4BZGUE5B246VAG2E67KW7CUAKL3ZKED4Q, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.764127062 (239h35m42.803700192s) [noise=true , address=145.79.227.6:4257 , piece_id=WXC4PN5BEXVPSXKRB3WYQD7WTDCNNBRDMYTJM4C2A7FSMJ6SJDUQ, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.764304931 (239h35m42.803878051s) [noise=true , address=45.91.116.9:4261 , piece_id=2UINBKUVA2IZ73AZBNDTHFCN6TEA6DY3NMIHGVZJUZECSMO5UHNQ, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.764786668 (239h35m42.804359798s) [noise=true , address=45.91.116.10:4083 , piece_id=PEZ5PJA5AWCVHMI3O53DHLLCIS2CJA5XRXC56PQ6JXBWFLOZZV2Q, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:08.494930252 (239h35m44.534503382s) [upload=210558]: Next returned nil segment Sep 16 13:04:08.494954587 (239h35m44.534527717s) [upload=210558]: Waiting for error group managing segments... Sep 16 13:04:08.914029269 (239h35m44.953602399s) [noise=true , address=45.91.116.11:4117 , piece_id=BZ655HXADDLDNP6D2DMY7SNWSGNQ6AK7WDTDUHA2C6J6GKHPVUOA, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:08.923086587 (239h35m44.962659717s) [noise=true , address=45.91.116.14:4190 , piece_id=K6NGZWHBJSNDP3RPPMWJCX4JWF46CRV7M333XJ3MGPVW6IIEHPWA, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:08.931995211 (239h35m44.971568341s) [noise=true , address=45.91.116.6:4975 , piece_id=ZM5SYEDOWXE6ZD6AWUH2377MHC645CLOFX5XRW5UJO37FOWWZNPA, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:08.937017555 (239h35m44.976590675s) [noise=true , address=77.90.31.10:4520 , piece_id=5FYAEJCR7LQHNF3YEFNLXBYQ53JXKDP6LGPETAM2GXRMPG7YT7PQ, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:08.949355419 (239h35m44.988928549s) [noise=true , address=45.91.116.5:4299 , piece_id=BGM23T2RSD7CLTI7EP3SN7SF6C4XF3MH3CXGLOCQAIOQRY6NCG7Q, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:08.986188829 (239h35m45.025761959s) [noise=true , address=45.91.116.5:4297 , piece_id=FN6KYJURDH76VITYP5FY2BVY5HJCD46SIOYZRLLOCVUAXMWSPS2Q, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:08.986715071 (239h35m45.026288201s) [noise=true , address=77.90.31.15:4699 , piece_id=CPHA7H3U4GLPAZCKTGSBA6CHUZXUI7UZ2IS7566RFMEKOPVIBUJA, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:09.004119053 (239h35m45.043692183s) [noise=true , address=45.91.116.9:4261 , piece_id=2UINBKUVA2IZ73AZBNDTHFCN6TEA6DY3NMIHGVZJUZECSMO5UHNQ, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:09.029578384 (239h35m45.069151504s) [noise=true , address=45.91.116.6:4973 , piece_id=EZSBXOCXG6QVUN7UWP3W35DZFNBDCM2AY6RWV7NGAGBVICE7MA5Q, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:09.077914638 (239h35m45.117487768s) [noise=true , address=45.91.116.10:4083 , piece_id=PEZ5PJA5AWCVHMI3O53DHLLCIS2CJA5XRXC56PQ6JXBWFLOZZV2Q, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:35.824179296 (239h36m11.863752426s) [noise=true , address=145.79.227.15:4876 , piece_id=NUYZ2WIPZBPQBPPLUHYAZRS3LVXEGD56AOCBY7SDBIQKRWVBN37Q, seg_pos={0 0}, upload=210558]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:04:35.824555582 (239h36m11.864128712s) [noise=true , address=145.79.227.3:4149 , piece_id=DPPGMUQAIDAJ3S2PEZH4BZGUE5B246VAG2E67KW7CUAKL3ZKED4Q, seg_pos={0 0}, upload=210558]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:33204->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:33204->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33204->145.79.227.3:4149: use of closed network connection Sep 16 13:04:35.824652837 (239h36m11.864225967s) [noise=true , address=145.79.227.14:4837 , piece_id=YW5YUH7OU7HSUB7FAAEW6LVZUBP3IIQKZ7YTJ3B33KQPMWMHNPDA, seg_pos={0 0}, upload=210558]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: write tcp 188.166.225.170:45652->145.79.227.14:4837: use of closed network connection; write tcp 188.166.225.170:45652->145.79.227.14:4837: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45652->145.79.227.14:4837: use of closed network connection Sep 16 13:04:35.824695728 (239h36m11.864268859s) [noise=true , address=145.79.227.6:4257 , piece_id=WXC4PN5BEXVPSXKRB3WYQD7WTDCNNBRDMYTJM4C2A7FSMJ6SJDUQ, seg_pos={0 0}, upload=210558]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:36256->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:36256->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36256->145.79.227.6:4257: use of closed network connection Sep 16 13:04:35.824719785 (239h36m11.864292915s) [noise=true , address=145.79.227.13:4802 , piece_id=HEYHF32JTCVLKLXP2RM6MLHCNW6GZYIZ35UAJO5G55TF7JEYXREQ, seg_pos={0 0}, upload=210558]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:49476->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:49476->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49476->145.79.227.13:4802: use of closed network connection Sep 16 13:04:35.824803154 (239h36m11.864376284s) [noise=true , address=145.79.227.11:4729 , piece_id=7SJYO7D2FE6IDNRNN2DKISMIEETI2WZYDNCP5EJWI32WIRZTEMDA, seg_pos={0 0}, upload=210558]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:35482->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:35482->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35482->145.79.227.11:4729: use of closed network connection Sep 16 13:04:35.824858930 (239h36m11.86443206s) [seg_pos={0 0}, upload=210558]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 16 13:04:36.062009463 (239h36m12.101582603s) [upload=210558]: Done uploading segments... Sep 16 13:04:36.062043648 (239h36m12.101616778s) [upload=210558]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.927338239s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 30 out of 60 is failed (threshold=3) [....X......X.X.......XXXX.XX.XXXXXX..XX.XXX..XX.X.X.XX.XXX.X] duration: 30.239806067s FAIL (2025-09-16 13:04:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== atch item: pb.BatchRequestItem_ObjectBegin Sep 16 13:04:06.509551176 (239h35m42.549124306s) [upload=210558]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 16 13:04:06.761625668 (239h35m42.801198798s) [seg_pos={0 0}, upload=210558]: Begin upload segment... Sep 16 13:04:06.761684651 (239h35m42.801257781s) [seg_pos={0 0}, upload=210558]: Done begin upload segment. Sep 16 13:04:06.761715560 (239h35m42.80128869s) [noise=true , address=145.79.227.11:4729 , piece_id=7SJYO7D2FE6IDNRNN2DKISMIEETI2WZYDNCP5EJWI32WIRZTEMDA, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.761899790 (239h35m42.80147293s) [noise=true , address=45.91.116.6:4973 , piece_id=EZSBXOCXG6QVUN7UWP3W35DZFNBDCM2AY6RWV7NGAGBVICE7MA5Q, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.762388541 (239h35m42.801961671s) [noise=true , address=45.91.116.6:4975 , piece_id=ZM5SYEDOWXE6ZD6AWUH2377MHC645CLOFX5XRW5UJO37FOWWZNPA, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.762511886 (239h35m42.802085016s) [noise=true , address=145.79.227.14:4837 , piece_id=YW5YUH7OU7HSUB7FAAEW6LVZUBP3IIQKZ7YTJ3B33KQPMWMHNPDA, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.762712298 (239h35m42.802285418s) [noise=true , address=45.91.116.11:4117 , piece_id=BZ655HXADDLDNP6D2DMY7SNWSGNQ6AK7WDTDUHA2C6J6GKHPVUOA, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.762966832 (239h35m42.802539962s) [noise=true , address=77.90.31.15:4699 , piece_id=CPHA7H3U4GLPAZCKTGSBA6CHUZXUI7UZ2IS7566RFMEKOPVIBUJA, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.763029732 (239h35m42.802602862s) [noise=true , address=145.79.227.15:4876 , piece_id=NUYZ2WIPZBPQBPPLUHYAZRS3LVXEGD56AOCBY7SDBIQKRWVBN37Q, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.763282674 (239h35m42.802855804s) [noise=true , address=45.91.116.14:4190 , piece_id=K6NGZWHBJSNDP3RPPMWJCX4JWF46CRV7M333XJ3MGPVW6IIEHPWA, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.763358418 (239h35m42.802931548s) [noise=true , address=77.90.31.10:4520 , piece_id=5FYAEJCR7LQHNF3YEFNLXBYQ53JXKDP6LGPETAM2GXRMPG7YT7PQ, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.763545034 (239h35m42.803118154s) [noise=true , address=45.91.116.5:4299 , piece_id=BGM23T2RSD7CLTI7EP3SN7SF6C4XF3MH3CXGLOCQAIOQRY6NCG7Q, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.763765263 (239h35m42.803338393s) [noise=true , address=145.79.227.13:4802 , piece_id=HEYHF32JTCVLKLXP2RM6MLHCNW6GZYIZ35UAJO5G55TF7JEYXREQ, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.763796572 (239h35m42.803369702s) [noise=true , address=45.91.116.5:4297 , piece_id=FN6KYJURDH76VITYP5FY2BVY5HJCD46SIOYZRLLOCVUAXMWSPS2Q, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.764052189 (239h35m42.803625319s) [noise=true , address=145.79.227.3:4149 , piece_id=DPPGMUQAIDAJ3S2PEZH4BZGUE5B246VAG2E67KW7CUAKL3ZKED4Q, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.764127062 (239h35m42.803700192s) [noise=true , address=145.79.227.6:4257 , piece_id=WXC4PN5BEXVPSXKRB3WYQD7WTDCNNBRDMYTJM4C2A7FSMJ6SJDUQ, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.764304931 (239h35m42.803878051s) [noise=true , address=45.91.116.9:4261 , piece_id=2UINBKUVA2IZ73AZBNDTHFCN6TEA6DY3NMIHGVZJUZECSMO5UHNQ, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:06.764786668 (239h35m42.804359798s) [noise=true , address=45.91.116.10:4083 , piece_id=PEZ5PJA5AWCVHMI3O53DHLLCIS2CJA5XRXC56PQ6JXBWFLOZZV2Q, seg_pos={0 0}, upload=210558]: Uploading piece... Sep 16 13:04:08.494930252 (239h35m44.534503382s) [upload=210558]: Next returned nil segment Sep 16 13:04:08.494954587 (239h35m44.534527717s) [upload=210558]: Waiting for error group managing segments... Sep 16 13:04:08.914029269 (239h35m44.953602399s) [noise=true , address=45.91.116.11:4117 , piece_id=BZ655HXADDLDNP6D2DMY7SNWSGNQ6AK7WDTDUHA2C6J6GKHPVUOA, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:08.923086587 (239h35m44.962659717s) [noise=true , address=45.91.116.14:4190 , piece_id=K6NGZWHBJSNDP3RPPMWJCX4JWF46CRV7M333XJ3MGPVW6IIEHPWA, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:08.931995211 (239h35m44.971568341s) [noise=true , address=45.91.116.6:4975 , piece_id=ZM5SYEDOWXE6ZD6AWUH2377MHC645CLOFX5XRW5UJO37FOWWZNPA, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:08.937017555 (239h35m44.976590675s) [noise=true , address=77.90.31.10:4520 , piece_id=5FYAEJCR7LQHNF3YEFNLXBYQ53JXKDP6LGPETAM2GXRMPG7YT7PQ, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:08.949355419 (239h35m44.988928549s) [noise=true , address=45.91.116.5:4299 , piece_id=BGM23T2RSD7CLTI7EP3SN7SF6C4XF3MH3CXGLOCQAIOQRY6NCG7Q, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:08.986188829 (239h35m45.025761959s) [noise=true , address=45.91.116.5:4297 , piece_id=FN6KYJURDH76VITYP5FY2BVY5HJCD46SIOYZRLLOCVUAXMWSPS2Q, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:08.986715071 (239h35m45.026288201s) [noise=true , address=77.90.31.15:4699 , piece_id=CPHA7H3U4GLPAZCKTGSBA6CHUZXUI7UZ2IS7566RFMEKOPVIBUJA, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:09.004119053 (239h35m45.043692183s) [noise=true , address=45.91.116.9:4261 , piece_id=2UINBKUVA2IZ73AZBNDTHFCN6TEA6DY3NMIHGVZJUZECSMO5UHNQ, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:09.029578384 (239h35m45.069151504s) [noise=true , address=45.91.116.6:4973 , piece_id=EZSBXOCXG6QVUN7UWP3W35DZFNBDCM2AY6RWV7NGAGBVICE7MA5Q, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:09.077914638 (239h35m45.117487768s) [noise=true , address=45.91.116.10:4083 , piece_id=PEZ5PJA5AWCVHMI3O53DHLLCIS2CJA5XRXC56PQ6JXBWFLOZZV2Q, seg_pos={0 0}, upload=210558]: Done uploading piece. err: <nil> Sep 16 13:04:35.824179296 (239h36m11.863752426s) [noise=true , address=145.79.227.15:4876 , piece_id=NUYZ2WIPZBPQBPPLUHYAZRS3LVXEGD56AOCBY7SDBIQKRWVBN37Q, seg_pos={0 0}, upload=210558]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:04:35.824555582 (239h36m11.864128712s) [noise=true , address=145.79.227.3:4149 , piece_id=DPPGMUQAIDAJ3S2PEZH4BZGUE5B246VAG2E67KW7CUAKL3ZKED4Q, seg_pos={0 0}, upload=210558]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:33204->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:33204->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33204->145.79.227.3:4149: use of closed network connection Sep 16 13:04:35.824652837 (239h36m11.864225967s) [noise=true , address=145.79.227.14:4837 , piece_id=YW5YUH7OU7HSUB7FAAEW6LVZUBP3IIQKZ7YTJ3B33KQPMWMHNPDA, seg_pos={0 0}, upload=210558]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: write tcp 188.166.225.170:45652->145.79.227.14:4837: use of closed network connection; write tcp 188.166.225.170:45652->145.79.227.14:4837: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45652->145.79.227.14:4837: use of closed network connection Sep 16 13:04:35.824695728 (239h36m11.864268859s) [noise=true , address=145.79.227.6:4257 , piece_id=WXC4PN5BEXVPSXKRB3WYQD7WTDCNNBRDMYTJM4C2A7FSMJ6SJDUQ, seg_pos={0 0}, upload=210558]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:36256->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:36256->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36256->145.79.227.6:4257: use of closed network connection Sep 16 13:04:35.824719785 (239h36m11.864292915s) [noise=true , address=145.79.227.13:4802 , piece_id=HEYHF32JTCVLKLXP2RM6MLHCNW6GZYIZ35UAJO5G55TF7JEYXREQ, seg_pos={0 0}, upload=210558]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:49476->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:49476->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49476->145.79.227.13:4802: use of closed network connection Sep 16 13:04:35.824803154 (239h36m11.864376284s) [noise=true , address=145.79.227.11:4729 , piece_id=7SJYO7D2FE6IDNRNN2DKISMIEETI2WZYDNCP5EJWI32WIRZTEMDA, seg_pos={0 0}, upload=210558]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:35482->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:35482->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35482->145.79.227.11:4729: use of closed network connection Sep 16 13:04:35.824858930 (239h36m11.86443206s) [seg_pos={0 0}, upload=210558]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 16 13:04:36.062009463 (239h36m12.101582603s) [upload=210558]: Done uploading segments... Sep 16 13:04:36.062043648 (239h36m12.101616778s) [upload=210558]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 30.239838459s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.20833338s FAIL (2025-09-16 13:04:16 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== JFA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422604190 (238h59m45.46217732s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422896808 (238h59m45.462469928s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423232478 (238h59m45.462805608s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423565571 (238h59m45.463138691s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423935696 (238h59m45.463508826s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424280403 (238h59m45.463853533s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424633305 (238h59m45.464206435s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424994342 (238h59m45.464567472s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425341152 (238h59m45.464914282s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425707831 (238h59m45.465280951s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.426034432 (238h59m45.465607562s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429082236 (238h59m45.468655366s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429521483 (238h59m45.469094613s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:10.278696743 (238h59m46.318269863s) [upload=210063]: Next returned nil segment Sep 16 12:28:10.278720237 (238h59m46.318293367s) [upload=210063]: Waiting for error group managing segments... Sep 16 12:28:10.652409183 (238h59m46.691982303s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.662938092 (238h59m46.702511222s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.670032272 (238h59m46.709605402s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.701595607 (238h59m46.741168737s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.704157255 (238h59m46.743730385s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.707972140 (238h59m46.74754527s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.708523660 (238h59m46.74809678s) [noise=true , address=89.149.201.147:4007 , piece_id=BOQVD3EW5UAYWKEZ5FWC2QCDGIROAEOQN2OEYQ4QACNVDEIFF2IA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.754549157 (238h59m46.794122277s) [noise=true , address=89.149.201.147:4010 , piece_id=OALYBM6QEAOKMQPP2R3Y7LBVOEJYPMTBHJTGE2DSRO3KLRGBZC3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.138412786 (238h59m47.177985916s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.163219826 (238h59m47.202792956s) [noise=true , address=81.171.14.70:4039 , piece_id=IMLIU4QCGFNXWATVWK4L7FZPWOVPCRXNH4F3HSMF5VLQZJUEBO3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.169643348 (238h59m47.209216478s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.231770296 (238h59m47.271343416s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.258046263 (238h59m47.297619383s) [noise=true , address=185.167.204.205:4034 , piece_id=FUHHRFVDRYETJRWVBQZRALI4UGKDQ6DXV7TDKXBRASOMGOEN6YOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.263155884 (238h59m47.302729004s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.269762875 (238h59m47.309336005s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.281404505 (238h59m47.320977635s) [noise=true , address=185.167.204.205:4027 , piece_id=3O5SOEMEXYDYR5OE6SZJ2AVVLNYG4V4IMZOFUL7XDJEZUHDUV5TA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.289386705 (238h59m47.328959825s) [noise=true , address=185.167.204.206:4063 , piece_id=ERJLEJ5EILBCN4WUPZBVYSB2CGDWORVZ3GASSXBVNGR25GWVFYOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.298140815 (238h59m47.337713945s) [noise=true , address=185.167.204.206:4043 , piece_id=LDZTOC67YHM344PUCLVJ7RMKQAYJAQJ4GMKYZNN5LLU5KIUQCW7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.311391579 (238h59m47.350964709s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.317381906 (238h59m47.356955036s) [noise=true , address=185.167.204.206:4065 , piece_id=UXYM6MEGCQFRRRSMGI5XKJJJ6GYW7IJXG5QDGMICLP3FNJDSFRSQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.318355050 (238h59m47.35792818s) [noise=true , address=185.167.204.205:4018 , piece_id=VZP55ZA5Y5IA2PUH75QDVB56UHRJJ2XNC75L5WCRUSHGHQGZ463A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.330083334 (238h59m47.369656464s) [noise=true , address=185.167.204.206:4052 , piece_id=CDKZXVC22A62STE3NYD4R2TWT3AF45U2A7MHEIQJPTNMUKBVFJFA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.331429858 (238h59m47.371002988s) [noise=true , address=185.167.204.205:4035 , piece_id=M6LWKXSTJHGHXHY4VEJ2IGLI2UX4IIZV5KD4A6YY3BMIQ6ZRBMAQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.341689555 (238h59m47.381262686s) [noise=true , address=185.167.204.205:4014 , piece_id=MDSUAX4XNI5INUUQCMAP26PQFV62U3TZ2OITZR3BSNDQLHWEOKIA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.346694947 (238h59m47.386268077s) [noise=true , address=185.167.204.205:4023 , piece_id=YNW6TYPAVMYIHD5BT6QZGJJAGDM2XSZ4QYX4C2TH5QRGNTNP4KUQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363156895 (238h59m47.402730015s) [noise=true , address=185.167.204.206:4059 , piece_id=IX3H3WSLKDNPCCA5NMFUGMO2P6CA274AEUXLGVA3WRGJM3SN2OZQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363183276 (238h59m47.402756406s) [seg_pos={0 0}, upload=210063]: Segment reached optimal threshold of 26 pieces. Sep 16 12:28:11.363333942 (238h59m47.402907072s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363361435 (238h59m47.402934565s) [noise=true , address=185.167.204.206:4066 , piece_id=XXWYU36QFNZ2HCZF2WGAG4LKIBE3GCCKNVBDV6N5RQMCDJJXJULQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: expected piece hash; context canceled; EOF Sep 16 12:28:11.363393326 (238h59m47.402966456s) [seg_pos={0 0}, upload=210063]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil> Sep 16 12:28:11.363496222 (238h59m47.403069362s) [upload=210063]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 16 12:28:11.363503285 (238h59m47.403076405s) [upload=210063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 16 12:28:11.633947931 (238h59m47.673521071s) [upload=210063]: Done uploading segments... Sep 16 12:28:11.633974231 (238h59m47.673547372s) [upload=210063]: Upload finished. err: <nil> Duration: 5.208373798s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 33 out of 60 is failed (threshold=3) [.......................X.X..XXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 1m0.241480803s FAIL (2025-09-16 13:04:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== W4W3TTIVEEMDKVLNDUKBH45HBSIQJ3U2IKA4N3ASHUO7JBUDJWQ, seg_pos={0 0}, upload=210542]: Uploading piece... Sep 16 13:03:04.703224599 (239h34m40.742797729s) [noise=true , address=145.79.227.52:4466 , piece_id=SRNEEFTLTRY4UIX2CBLM6YGLVVLRHKODVQY4LMUWAKWSVRGA3YVQ, seg_pos={0 0}, upload=210542]: Uploading piece... Sep 16 13:03:04.703591437 (239h34m40.743164577s) [noise=true , address=145.79.227.46:4604 , piece_id=JSZSSD3CUV4BU24K32QJWVFR2VWA5X2YXP7ZE2M3AJNC3SVMBE4Q, seg_pos={0 0}, upload=210542]: Uploading piece... Sep 16 13:03:04.703862273 (239h34m40.743435413s) [noise=true , address=145.79.227.8:4334 , piece_id=SFHBXCSJWTSPMHGPTGGX2FSZHRUB6SFV3QUVMH4J6H4XMYRQYTFA, seg_pos={0 0}, upload=210542]: Uploading piece... Sep 16 13:03:04.703942435 (239h34m40.743515565s) [noise=true , address=145.79.227.22:4537 , piece_id=L6U2UNKXLWMTRRCIWGJVVBQJP5DUHDEO7GNFJDOUXFEH42BIZV2Q, seg_pos={0 0}, upload=210542]: Uploading piece... Sep 16 13:03:04.704269198 (239h34m40.743842328s) [noise=true , address=145.79.227.12:4770 , piece_id=O3EAMZHOMV433ZXBFIKPL3EAOCGQMS55GEMAJTNDPRTLGNXKJ5BQ, seg_pos={0 0}, upload=210542]: Uploading piece... Sep 16 13:03:04.704280209 (239h34m40.743853339s) [noise=true , address=145.79.227.11:4752 , piece_id=BJPPVELB7EXYQKRORJKS3CQDOPVVNXTZ6LPQNL5XEXQDMB4B76OQ, seg_pos={0 0}, upload=210542]: Uploading piece... Sep 16 13:03:04.704721219 (239h34m40.744294349s) [noise=true , address=145.79.227.27:4699 , piece_id=X7TR6RVIJRTC5OP36R2KQ7EBJXMM7PQS7J3FGSTSKX7FLWCKJXKQ, seg_pos={0 0}, upload=210542]: Uploading piece... Sep 16 13:03:04.704868579 (239h34m40.744441709s) [noise=true , address=145.79.227.49:4353 , piece_id=HXRT6JZVNMZ3S5E7UM5VE3S6IN6CCGF3DDEWWD5U7K5QESJRKPSQ, seg_pos={0 0}, upload=210542]: Uploading piece... Sep 16 13:03:04.704998587 (239h34m40.744571717s) [noise=true , address=77.90.31.13:4645 , piece_id=BNEVVT366GMRTKNZBVUHJNU2C4Y7GAOQ33YI4OSGL6ED7KESUOEQ, seg_pos={0 0}, upload=210542]: Uploading piece... Sep 16 13:03:04.705263310 (239h34m40.74483644s) [noise=true , address=145.79.227.26:4681 , piece_id=DS56URVX3WD3ORUQHLN7H4FIHBTZ4A4IZCYABULKXAHAJS4S3PQA, seg_pos={0 0}, upload=210542]: Uploading piece... Sep 16 13:03:04.705287106 (239h34m40.744860236s) [noise=true , address=145.79.227.36:4527 , piece_id=XMF2JBHWIUES443ASSYXEJXUSIWIWLMZ7GBRWCH5QIDRJEH3SUVQ, seg_pos={0 0}, upload=210542]: Uploading piece... Sep 16 13:03:04.705602096 (239h34m40.745175216s) [noise=true , address=145.79.227.2:4144 , piece_id=DDLNR7BC24RQPTI5RMAFMUYVH462DBD3WRTXFPVHEGMOCFXPOT7A, seg_pos={0 0}, upload=210542]: Uploading piece... Sep 16 13:03:04.705675926 (239h34m40.745249056s) [noise=true , address=145.79.227.5:4251 , piece_id=77BIX5JL6JUCSJYMEJUJRP76CDGBDMQX6X752YU5FM5GYQ3MCENQ, seg_pos={0 0}, upload=210542]: Uploading piece... Sep 16 13:03:04.705922405 (239h34m40.745495536s) [noise=true , address=145.79.227.35:4492 , piece_id=W2XOWIHIEGUP2W64I6MC4VIFTR73C4RVGY6FBUKP3E7LIYHAQHVA, seg_pos={0 0}, upload=210542]: Uploading piece... Sep 16 13:03:04.706142926 (239h34m40.745716046s) [noise=true , address=77.90.31.11:4559 , piece_id=N3LSSKM6NS4STKRHDC7Y77UGMSQ7JQ2BJ2XEFBGQ5J6T7TGCELIQ, seg_pos={0 0}, upload=210542]: Uploading piece... Sep 16 13:03:04.706548067 (239h34m40.746121197s) [noise=true , address=145.79.227.33:4881 , piece_id=EDBUXNQVEIAQPRRRYFMT43ACJFS5WH7OU4S6EF5D634KK74R3B3A, seg_pos={0 0}, upload=210542]: Uploading piece... Sep 16 13:03:04.706925516 (239h34m40.746498646s) [noise=true , address=77.90.31.18:4830 , piece_id=5QT7IQU4Y4VEO5SRS4H5POREZ7CMO2LZC4RLL54RRUI7OAW54KWA, seg_pos={0 0}, upload=210542]: Uploading piece... Sep 16 13:03:06.367374503 (239h34m42.406947633s) [upload=210542]: Next returned nil segment Sep 16 13:03:06.367400682 (239h34m42.406973812s) [upload=210542]: Waiting for error group managing segments... Sep 16 13:03:06.790863730 (239h34m42.83043686s) [noise=true , address=77.90.31.13:4645 , piece_id=BNEVVT366GMRTKNZBVUHJNU2C4Y7GAOQ33YI4OSGL6ED7KESUOEQ, seg_pos={0 0}, upload=210542]: Done uploading piece. err: <nil> Sep 16 13:03:06.798109628 (239h34m42.837682758s) [noise=true , address=77.90.31.18:4830 , piece_id=5QT7IQU4Y4VEO5SRS4H5POREZ7CMO2LZC4RLL54RRUI7OAW54KWA, seg_pos={0 0}, upload=210542]: Done uploading piece. err: <nil> Sep 16 13:03:06.929018552 (239h34m42.968591682s) [noise=true , address=77.90.31.11:4559 , piece_id=N3LSSKM6NS4STKRHDC7Y77UGMSQ7JQ2BJ2XEFBGQ5J6T7TGCELIQ, seg_pos={0 0}, upload=210542]: Done uploading piece. err: <nil> Sep 16 13:03:27.146835747 (239h35m3.186408868s) [noise=true , address=145.79.227.11:4752 , piece_id=BJPPVELB7EXYQKRORJKS3CQDOPVVNXTZ6LPQNL5XEXQDMB4B76OQ, seg_pos={0 0}, upload=210542]: Done uploading piece. err: <nil> Sep 16 13:03:28.058636452 (239h35m4.098209582s) [noise=true , address=145.79.227.12:4770 , piece_id=O3EAMZHOMV433ZXBFIKPL3EAOCGQMS55GEMAJTNDPRTLGNXKJ5BQ, seg_pos={0 0}, upload=210542]: Done uploading piece. err: <nil> Sep 16 13:03:31.508625707 (239h35m7.548198837s) [noise=true , address=145.79.227.36:4527 , piece_id=XMF2JBHWIUES443ASSYXEJXUSIWIWLMZ7GBRWCH5QIDRJEH3SUVQ, seg_pos={0 0}, upload=210542]: Done uploading piece. err: <nil> Sep 16 13:03:33.376131271 (239h35m9.415704401s) [noise=true , address=145.79.227.5:4251 , piece_id=77BIX5JL6JUCSJYMEJUJRP76CDGBDMQX6X752YU5FM5GYQ3MCENQ, seg_pos={0 0}, upload=210542]: Done uploading piece. err: <nil> Sep 16 13:03:35.998276205 (239h35m12.037849325s) [noise=true , address=145.79.227.8:4334 , piece_id=SFHBXCSJWTSPMHGPTGGX2FSZHRUB6SFV3QUVMH4J6H4XMYRQYTFA, seg_pos={0 0}, upload=210542]: Done uploading piece. err: <nil> Sep 16 13:03:37.850451956 (239h35m13.890025076s) [noise=true , address=145.79.227.46:4604 , piece_id=JSZSSD3CUV4BU24K32QJWVFR2VWA5X2YXP7ZE2M3AJNC3SVMBE4Q, seg_pos={0 0}, upload=210542]: Done uploading piece. err: <nil> Sep 16 13:04:02.273252353 (239h35m38.312825483s) [noise=true , address=145.79.227.27:4699 , piece_id=X7TR6RVIJRTC5OP36R2KQ7EBJXMM7PQS7J3FGSTSKX7FLWCKJXKQ, seg_pos={0 0}, upload=210542]: Done uploading piece. err: <nil> Sep 16 13:04:03.451259651 (239h35m39.490832781s) [noise=true , address=145.79.227.22:4537 , piece_id=L6U2UNKXLWMTRRCIWGJVVBQJP5DUHDEO7GNFJDOUXFEH42BIZV2Q, seg_pos={0 0}, upload=210542]: Done uploading piece. err: ecclient: upload failed (node:12U3QSKhAmoaakTJRReBtoRpzbvzYdibd1xjsEVuU8LD29Fcu1y, address:145.79.227.22:4537): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:04:03.451350464 (239h35m39.490923595s) [noise=true , address=145.79.227.26:4681 , piece_id=DS56URVX3WD3ORUQHLN7H4FIHBTZ4A4IZCYABULKXAHAJS4S3PQA, seg_pos={0 0}, upload=210542]: Done uploading piece. err: ecclient: upload failed (node:12YDoKEKcndBYDziWRgqHB1Ms2GnhKUG7qbj6qxZFrus8r1kXy2, address:145.79.227.26:4681): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:04:03.451431579 (239h35m39.491004709s) [noise=true , address=145.79.227.35:4492 , piece_id=W2XOWIHIEGUP2W64I6MC4VIFTR73C4RVGY6FBUKP3E7LIYHAQHVA, seg_pos={0 0}, upload=210542]: Done uploading piece. err: ecclient: upload failed (node:1roa5GGYmqCX2AxSrqFgqyV2CtBEYZavuGTseiwDy4pjkT6bip, address:145.79.227.35:4492): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:04:03.451495531 (239h35m39.491068671s) [noise=true , address=145.79.227.33:4881 , piece_id=EDBUXNQVEIAQPRRRYFMT43ACJFS5WH7OU4S6EF5D634KK74R3B3A, seg_pos={0 0}, upload=210542]: Done uploading piece. err: ecclient: upload failed (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp, address:145.79.227.33:4881): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:04:03.451552049 (239h35m39.491125179s) [noise=true , address=145.79.227.49:4353 , piece_id=HXRT6JZVNMZ3S5E7UM5VE3S6IN6CCGF3DDEWWD5U7K5QESJRKPSQ, seg_pos={0 0}, upload=210542]: Done uploading piece. err: ecclient: upload failed (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ, address:145.79.227.49:4353): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:04:03.451614947 (239h35m39.491188068s) [noise=true , address=145.79.227.52:4466 , piece_id=SRNEEFTLTRY4UIX2CBLM6YGLVVLRHKODVQY4LMUWAKWSVRGA3YVQ, seg_pos={0 0}, upload=210542]: Done uploading piece. err: ecclient: upload failed (node:12rkNnk9RUhKBJ3EsakqMRb3wYwrhRLhB4ZYbrdfKPDk8erRJpP, address:145.79.227.52:4466): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:04:03.451803146 (239h35m39.491376277s) [noise=true , address=145.79.227.2:4144 , piece_id=DDLNR7BC24RQPTI5RMAFMUYVH462DBD3WRTXFPVHEGMOCFXPOT7A, seg_pos={0 0}, upload=210542]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:145.79.227.2:4144): protocol: write tcp 188.166.225.170:42066->145.79.227.2:4144: use of closed network connection; write tcp 188.166.225.170:42066->145.79.227.2:4144: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42066->145.79.227.2:4144: use of closed network connection Sep 16 13:04:03.451903438 (239h35m39.491476568s) [noise=true , address=145.79.227.23:4578 , piece_id=WW4W3TTIVEEMDKVLNDUKBH45HBSIQJ3U2IKA4N3ASHUO7JBUDJWQ, seg_pos={0 0}, upload=210542]: Done uploading piece. err: ecclient: upload failed (node:1poqPvwwjWwAAhkJ5WCDavg9oKxbJrf9xktnYA9DB6o9BV1G49, address:145.79.227.23:4578): protocol: write tcp 188.166.225.170:54168->145.79.227.23:4578: use of closed network connection; write tcp 188.166.225.170:54168->145.79.227.23:4578: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54168->145.79.227.23:4578: use of closed network connection Sep 16 13:04:03.451925028 (239h35m39.491498158s) [seg_pos={0 0}, upload=210542]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Sep 16 13:04:03.690762123 (239h35m39.730335263s) [upload=210542]: Done uploading segments... Sep 16 13:04:03.690800817 (239h35m39.730373947s) [upload=210542]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 1m0.241502705s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 4.937338145s FAIL (2025-09-16 13:03:22 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== JFA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422604190 (238h59m45.46217732s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422896808 (238h59m45.462469928s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423232478 (238h59m45.462805608s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423565571 (238h59m45.463138691s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423935696 (238h59m45.463508826s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424280403 (238h59m45.463853533s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424633305 (238h59m45.464206435s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424994342 (238h59m45.464567472s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425341152 (238h59m45.464914282s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425707831 (238h59m45.465280951s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.426034432 (238h59m45.465607562s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429082236 (238h59m45.468655366s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429521483 (238h59m45.469094613s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:10.278696743 (238h59m46.318269863s) [upload=210063]: Next returned nil segment Sep 16 12:28:10.278720237 (238h59m46.318293367s) [upload=210063]: Waiting for error group managing segments... Sep 16 12:28:10.652409183 (238h59m46.691982303s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.662938092 (238h59m46.702511222s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.670032272 (238h59m46.709605402s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.701595607 (238h59m46.741168737s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.704157255 (238h59m46.743730385s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.707972140 (238h59m46.74754527s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.708523660 (238h59m46.74809678s) [noise=true , address=89.149.201.147:4007 , piece_id=BOQVD3EW5UAYWKEZ5FWC2QCDGIROAEOQN2OEYQ4QACNVDEIFF2IA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.754549157 (238h59m46.794122277s) [noise=true , address=89.149.201.147:4010 , piece_id=OALYBM6QEAOKMQPP2R3Y7LBVOEJYPMTBHJTGE2DSRO3KLRGBZC3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.138412786 (238h59m47.177985916s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.163219826 (238h59m47.202792956s) [noise=true , address=81.171.14.70:4039 , piece_id=IMLIU4QCGFNXWATVWK4L7FZPWOVPCRXNH4F3HSMF5VLQZJUEBO3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.169643348 (238h59m47.209216478s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.231770296 (238h59m47.271343416s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.258046263 (238h59m47.297619383s) [noise=true , address=185.167.204.205:4034 , piece_id=FUHHRFVDRYETJRWVBQZRALI4UGKDQ6DXV7TDKXBRASOMGOEN6YOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.263155884 (238h59m47.302729004s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.269762875 (238h59m47.309336005s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.281404505 (238h59m47.320977635s) [noise=true , address=185.167.204.205:4027 , piece_id=3O5SOEMEXYDYR5OE6SZJ2AVVLNYG4V4IMZOFUL7XDJEZUHDUV5TA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.289386705 (238h59m47.328959825s) [noise=true , address=185.167.204.206:4063 , piece_id=ERJLEJ5EILBCN4WUPZBVYSB2CGDWORVZ3GASSXBVNGR25GWVFYOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.298140815 (238h59m47.337713945s) [noise=true , address=185.167.204.206:4043 , piece_id=LDZTOC67YHM344PUCLVJ7RMKQAYJAQJ4GMKYZNN5LLU5KIUQCW7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.311391579 (238h59m47.350964709s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.317381906 (238h59m47.356955036s) [noise=true , address=185.167.204.206:4065 , piece_id=UXYM6MEGCQFRRRSMGI5XKJJJ6GYW7IJXG5QDGMICLP3FNJDSFRSQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.318355050 (238h59m47.35792818s) [noise=true , address=185.167.204.205:4018 , piece_id=VZP55ZA5Y5IA2PUH75QDVB56UHRJJ2XNC75L5WCRUSHGHQGZ463A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.330083334 (238h59m47.369656464s) [noise=true , address=185.167.204.206:4052 , piece_id=CDKZXVC22A62STE3NYD4R2TWT3AF45U2A7MHEIQJPTNMUKBVFJFA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.331429858 (238h59m47.371002988s) [noise=true , address=185.167.204.205:4035 , piece_id=M6LWKXSTJHGHXHY4VEJ2IGLI2UX4IIZV5KD4A6YY3BMIQ6ZRBMAQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.341689555 (238h59m47.381262686s) [noise=true , address=185.167.204.205:4014 , piece_id=MDSUAX4XNI5INUUQCMAP26PQFV62U3TZ2OITZR3BSNDQLHWEOKIA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.346694947 (238h59m47.386268077s) [noise=true , address=185.167.204.205:4023 , piece_id=YNW6TYPAVMYIHD5BT6QZGJJAGDM2XSZ4QYX4C2TH5QRGNTNP4KUQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363156895 (238h59m47.402730015s) [noise=true , address=185.167.204.206:4059 , piece_id=IX3H3WSLKDNPCCA5NMFUGMO2P6CA274AEUXLGVA3WRGJM3SN2OZQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363183276 (238h59m47.402756406s) [seg_pos={0 0}, upload=210063]: Segment reached optimal threshold of 26 pieces. Sep 16 12:28:11.363333942 (238h59m47.402907072s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363361435 (238h59m47.402934565s) [noise=true , address=185.167.204.206:4066 , piece_id=XXWYU36QFNZ2HCZF2WGAG4LKIBE3GCCKNVBDV6N5RQMCDJJXJULQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: expected piece hash; context canceled; EOF Sep 16 12:28:11.363393326 (238h59m47.402966456s) [seg_pos={0 0}, upload=210063]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil> Sep 16 12:28:11.363496222 (238h59m47.403069362s) [upload=210063]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 16 12:28:11.363503285 (238h59m47.403076405s) [upload=210063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 16 12:28:11.633947931 (238h59m47.673521071s) [upload=210063]: Done uploading segments... Sep 16 12:28:11.633974231 (238h59m47.673547372s) [upload=210063]: Upload finished. err: <nil> Duration: 4.937445359s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 29 out of 60 is failed (threshold=3) [.....X......X.X.......XXXX.XX.XXXXXX..XX.XXX..XX.X.X.XX.XXX.] duration: 7.208667109s FAIL (2025-09-16 13:03:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 16 13:02:37.228025764 (239h34m13.267598894s) [upload=210535]: Starting upload Sep 16 13:02:37.228139841 (239h34m13.267712971s) [upload=210535]: Done starting upload Sep 16 13:02:37.228200356 (239h34m13.267773496s) [upload=210535]: Uploading segments... Sep 16 13:02:37.228420846 (239h34m13.267993976s) [upload=210535]: Got next segment. Inline: false Sep 16 13:02:37.228487262 (239h34m13.268060392s) [upload=210535]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 16 13:02:37.228494105 (239h34m13.268067235s) [upload=210535]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 16 13:02:37.540222193 (239h34m13.579795323s) [seg_pos={0 0}, upload=210535]: Begin upload segment... Sep 16 13:02:37.540286755 (239h34m13.579859885s) [seg_pos={0 0}, upload=210535]: Done begin upload segment. Sep 16 13:02:37.540312024 (239h34m13.579885154s) [noise=true , address=77.90.31.12:4590 , piece_id=IPKZ52GXFSV4MM5JFWWSQUXBVW2LKEC5PNX3WHTOWUS2AAKWWVNQ, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.540321131 (239h34m13.579894271s) [noise=true , address=45.91.116.9:4263 , piece_id=R7GSGT6R6XDBP6NHGZWRFP2JUMDMIYOZKKPDUKLXJO47PSSN35WA, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.540743486 (239h34m13.580316616s) [noise=true , address=145.79.227.15:4876 , piece_id=UCOJY4BPPE244VKAHQC5W2FRZ3D4S2CTVAUFAMGBIYF27O6AXE4Q, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.541034810 (239h34m13.58060794s) [noise=true , address=77.90.31.11:4554 , piece_id=6KEUBREZHHYIPDAHA4FL2L3AIF4OK5DP3FSAXEBJRHLI2OTRXJMA, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.541548288 (239h34m13.581121418s) [noise=true , address=45.91.116.4:4940 , piece_id=W27QLN4GDRBMBMYVDZ43UUPYLQHHJBZVFLOEABQT2WJGYQNORUYQ, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.542007502 (239h34m13.581580632s) [noise=true , address=45.91.116.5:4299 , piece_id=AN27MZ2Y3EKRHH74WTUK3NJFH4XNUDMFUTD7SUVQWXMUOHLKXZ6A, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.542134304 (239h34m13.581707434s) [noise=true , address=145.79.227.17:4971 , piece_id=FCVCEU2YITTRAVWRM7OAK27NSRR5RRL56HZAT3JTLKUFRLNOESSQ, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.542519177 (239h34m13.582092307s) [noise=true , address=45.91.116.7:4010 , piece_id=3TXVQQWGJWMLCHSIRMBYXD3ELJW3B7BOBIZMIO6WBEBTEKQYL5QQ, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.542893349 (239h34m13.582466469s) [noise=true , address=45.91.116.14:4189 , piece_id=3YNRDCYE3IJTDFSJ4VA763ZGM5BBOBZG4GJJHKJP2QZXPZMREGPA, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.543417497 (239h34m13.582990627s) [noise=true , address=77.90.31.16:4734 , piece_id=CXLMVWXVIM6AT45VRSNPWYCVROMPKERP3XFGA7M7FI4GOG5N4PJQ, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.543793353 (239h34m13.583366483s) [noise=true , address=45.91.116.11:4119 , piece_id=EAJFIAQNUPS6KJBYTBUJNB6XJP7TTDEYIYPQNNEL65NSB67EN77Q, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.543976411 (239h34m13.583549541s) [noise=true , address=145.79.227.13:4803 , piece_id=WRRVWKY4NFX4GZFLK3NRIHKKJFMR75IWRFXLNWUOHY6XFSK6VCFA, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.544467868 (239h34m13.584040998s) [noise=true , address=45.91.116.10:4082 , piece_id=XL2FCNOIJ3452K3Y6N4BR7QESGCSH5R534GHQ2PYMOFMR6KDUN6A, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.544808275 (239h34m13.584381405s) [noise=true , address=45.91.116.5:4297 , piece_id=T43VZSZDEXFFMEP2N3WUK5N7NR53AH4YIM3ZWAKZ3MSBBVUP7OUQ, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.545194941 (239h34m13.584768071s) [noise=true , address=145.79.227.19:4079 , piece_id=CSELLEMP26KKP7KM7VBFW46PRI72GEBMWXXYLFQBAN6ZNSRJM2GA, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.545417716 (239h34m13.584990856s) [noise=true , address=77.90.31.17:4772 , piece_id=EOWQSI5Y2HCP7PDDP4OANHWXGPJL3Q4AN5SZG37IA33RM2XBJK6Q, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:39.369469824 (239h34m15.409042994s) [upload=210535]: Next returned nil segment Sep 16 13:02:39.369495022 (239h34m15.409068142s) [upload=210535]: Waiting for error group managing segments... Sep 16 13:02:39.670395912 (239h34m15.709969042s) [noise=true , address=45.91.116.4:4940 , piece_id=W27QLN4GDRBMBMYVDZ43UUPYLQHHJBZVFLOEABQT2WJGYQNORUYQ, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:02:39.687262921 (239h34m15.726836051s) [noise=true , address=45.91.116.7:4010 , piece_id=3TXVQQWGJWMLCHSIRMBYXD3ELJW3B7BOBIZMIO6WBEBTEKQYL5QQ, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:02:39.713526964 (239h34m15.753100094s) [noise=true , address=45.91.116.14:4189 , piece_id=3YNRDCYE3IJTDFSJ4VA763ZGM5BBOBZG4GJJHKJP2QZXPZMREGPA, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:02:39.716302510 (239h34m15.75587563s) [noise=true , address=45.91.116.10:4082 , piece_id=XL2FCNOIJ3452K3Y6N4BR7QESGCSH5R534GHQ2PYMOFMR6KDUN6A, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:02:39.717302704 (239h34m15.756875834s) [noise=true , address=77.90.31.11:4554 , piece_id=6KEUBREZHHYIPDAHA4FL2L3AIF4OK5DP3FSAXEBJRHLI2OTRXJMA, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:02:39.731740868 (239h34m15.771313988s) [noise=true , address=77.90.31.17:4772 , piece_id=EOWQSI5Y2HCP7PDDP4OANHWXGPJL3Q4AN5SZG37IA33RM2XBJK6Q, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:02:39.753780446 (239h34m15.793353576s) [noise=true , address=45.91.116.11:4119 , piece_id=EAJFIAQNUPS6KJBYTBUJNB6XJP7TTDEYIYPQNNEL65NSB67EN77Q, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:02:39.776264412 (239h34m15.815837542s) [noise=true , address=45.91.116.5:4299 , piece_id=AN27MZ2Y3EKRHH74WTUK3NJFH4XNUDMFUTD7SUVQWXMUOHLKXZ6A, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:02:39.870211440 (239h34m15.909784571s) [noise=true , address=45.91.116.5:4297 , piece_id=T43VZSZDEXFFMEP2N3WUK5N7NR53AH4YIM3ZWAKZ3MSBBVUP7OUQ, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:02:39.871146912 (239h34m15.910720042s) [noise=true , address=77.90.31.16:4734 , piece_id=CXLMVWXVIM6AT45VRSNPWYCVROMPKERP3XFGA7M7FI4GOG5N4PJQ, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:02:39.922331911 (239h34m15.961905031s) [noise=true , address=45.91.116.9:4263 , piece_id=R7GSGT6R6XDBP6NHGZWRFP2JUMDMIYOZKKPDUKLXJO47PSSN35WA, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:02:40.095191999 (239h34m16.134765119s) [noise=true , address=77.90.31.12:4590 , piece_id=IPKZ52GXFSV4MM5JFWWSQUXBVW2LKEC5PNX3WHTOWUS2AAKWWVNQ, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:03:06.474668626 (239h34m42.514241756s) [noise=true , address=145.79.227.17:4971 , piece_id=FCVCEU2YITTRAVWRM7OAK27NSRR5RRL56HZAT3JTLKUFRLNOESSQ, seg_pos={0 0}, upload=210535]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:03:06.474888936 (239h34m42.514462066s) [noise=true , address=145.79.227.13:4803 , piece_id=WRRVWKY4NFX4GZFLK3NRIHKKJFMR75IWRFXLNWUOHY6XFSK6VCFA, seg_pos={0 0}, upload=210535]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:32772->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:32772->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32772->145.79.227.13:4803: use of closed network connection Sep 16 13:03:06.475006049 (239h34m42.514579179s) [noise=true , address=145.79.227.15:4876 , piece_id=UCOJY4BPPE244VKAHQC5W2FRZ3D4S2CTVAUFAMGBIYF27O6AXE4Q, seg_pos={0 0}, upload=210535]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: write tcp 188.166.225.170:51098->145.79.227.15:4876: use of closed network connection; write tcp 188.166.225.170:51098->145.79.227.15:4876: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51098->145.79.227.15:4876: use of closed network connection Sep 16 13:03:06.475016328 (239h34m42.514589458s) [noise=true , address=145.79.227.19:4079 , piece_id=CSELLEMP26KKP7KM7VBFW46PRI72GEBMWXXYLFQBAN6ZNSRJM2GA, seg_pos={0 0}, upload=210535]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:42270->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:42270->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42270->145.79.227.19:4079: use of closed network connection Sep 16 13:03:06.475046265 (239h34m42.514619395s) [seg_pos={0 0}, upload=210535]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 16 13:03:06.731221437 (239h34m42.770794567s) [upload=210535]: Done uploading segments... Sep 16 13:03:06.731251985 (239h34m42.770825115s) [upload=210535]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 7.208689682s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 29 out of 60 is failed (threshold=3) [......X......X.X.......XXXX.XX.XXXXXX..XX.XXX..XX.X.X.XX.XXX] duration: 30.25844206s FAIL (2025-09-16 13:03:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 16 13:02:37.228025764 (239h34m13.267598894s) [upload=210535]: Starting upload Sep 16 13:02:37.228139841 (239h34m13.267712971s) [upload=210535]: Done starting upload Sep 16 13:02:37.228200356 (239h34m13.267773496s) [upload=210535]: Uploading segments... Sep 16 13:02:37.228420846 (239h34m13.267993976s) [upload=210535]: Got next segment. Inline: false Sep 16 13:02:37.228487262 (239h34m13.268060392s) [upload=210535]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 16 13:02:37.228494105 (239h34m13.268067235s) [upload=210535]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 16 13:02:37.540222193 (239h34m13.579795323s) [seg_pos={0 0}, upload=210535]: Begin upload segment... Sep 16 13:02:37.540286755 (239h34m13.579859885s) [seg_pos={0 0}, upload=210535]: Done begin upload segment. Sep 16 13:02:37.540312024 (239h34m13.579885154s) [noise=true , address=77.90.31.12:4590 , piece_id=IPKZ52GXFSV4MM5JFWWSQUXBVW2LKEC5PNX3WHTOWUS2AAKWWVNQ, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.540321131 (239h34m13.579894271s) [noise=true , address=45.91.116.9:4263 , piece_id=R7GSGT6R6XDBP6NHGZWRFP2JUMDMIYOZKKPDUKLXJO47PSSN35WA, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.540743486 (239h34m13.580316616s) [noise=true , address=145.79.227.15:4876 , piece_id=UCOJY4BPPE244VKAHQC5W2FRZ3D4S2CTVAUFAMGBIYF27O6AXE4Q, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.541034810 (239h34m13.58060794s) [noise=true , address=77.90.31.11:4554 , piece_id=6KEUBREZHHYIPDAHA4FL2L3AIF4OK5DP3FSAXEBJRHLI2OTRXJMA, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.541548288 (239h34m13.581121418s) [noise=true , address=45.91.116.4:4940 , piece_id=W27QLN4GDRBMBMYVDZ43UUPYLQHHJBZVFLOEABQT2WJGYQNORUYQ, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.542007502 (239h34m13.581580632s) [noise=true , address=45.91.116.5:4299 , piece_id=AN27MZ2Y3EKRHH74WTUK3NJFH4XNUDMFUTD7SUVQWXMUOHLKXZ6A, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.542134304 (239h34m13.581707434s) [noise=true , address=145.79.227.17:4971 , piece_id=FCVCEU2YITTRAVWRM7OAK27NSRR5RRL56HZAT3JTLKUFRLNOESSQ, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.542519177 (239h34m13.582092307s) [noise=true , address=45.91.116.7:4010 , piece_id=3TXVQQWGJWMLCHSIRMBYXD3ELJW3B7BOBIZMIO6WBEBTEKQYL5QQ, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.542893349 (239h34m13.582466469s) [noise=true , address=45.91.116.14:4189 , piece_id=3YNRDCYE3IJTDFSJ4VA763ZGM5BBOBZG4GJJHKJP2QZXPZMREGPA, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.543417497 (239h34m13.582990627s) [noise=true , address=77.90.31.16:4734 , piece_id=CXLMVWXVIM6AT45VRSNPWYCVROMPKERP3XFGA7M7FI4GOG5N4PJQ, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.543793353 (239h34m13.583366483s) [noise=true , address=45.91.116.11:4119 , piece_id=EAJFIAQNUPS6KJBYTBUJNB6XJP7TTDEYIYPQNNEL65NSB67EN77Q, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.543976411 (239h34m13.583549541s) [noise=true , address=145.79.227.13:4803 , piece_id=WRRVWKY4NFX4GZFLK3NRIHKKJFMR75IWRFXLNWUOHY6XFSK6VCFA, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.544467868 (239h34m13.584040998s) [noise=true , address=45.91.116.10:4082 , piece_id=XL2FCNOIJ3452K3Y6N4BR7QESGCSH5R534GHQ2PYMOFMR6KDUN6A, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.544808275 (239h34m13.584381405s) [noise=true , address=45.91.116.5:4297 , piece_id=T43VZSZDEXFFMEP2N3WUK5N7NR53AH4YIM3ZWAKZ3MSBBVUP7OUQ, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.545194941 (239h34m13.584768071s) [noise=true , address=145.79.227.19:4079 , piece_id=CSELLEMP26KKP7KM7VBFW46PRI72GEBMWXXYLFQBAN6ZNSRJM2GA, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:37.545417716 (239h34m13.584990856s) [noise=true , address=77.90.31.17:4772 , piece_id=EOWQSI5Y2HCP7PDDP4OANHWXGPJL3Q4AN5SZG37IA33RM2XBJK6Q, seg_pos={0 0}, upload=210535]: Uploading piece... Sep 16 13:02:39.369469824 (239h34m15.409042994s) [upload=210535]: Next returned nil segment Sep 16 13:02:39.369495022 (239h34m15.409068142s) [upload=210535]: Waiting for error group managing segments... Sep 16 13:02:39.670395912 (239h34m15.709969042s) [noise=true , address=45.91.116.4:4940 , piece_id=W27QLN4GDRBMBMYVDZ43UUPYLQHHJBZVFLOEABQT2WJGYQNORUYQ, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:02:39.687262921 (239h34m15.726836051s) [noise=true , address=45.91.116.7:4010 , piece_id=3TXVQQWGJWMLCHSIRMBYXD3ELJW3B7BOBIZMIO6WBEBTEKQYL5QQ, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:02:39.713526964 (239h34m15.753100094s) [noise=true , address=45.91.116.14:4189 , piece_id=3YNRDCYE3IJTDFSJ4VA763ZGM5BBOBZG4GJJHKJP2QZXPZMREGPA, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:02:39.716302510 (239h34m15.75587563s) [noise=true , address=45.91.116.10:4082 , piece_id=XL2FCNOIJ3452K3Y6N4BR7QESGCSH5R534GHQ2PYMOFMR6KDUN6A, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:02:39.717302704 (239h34m15.756875834s) [noise=true , address=77.90.31.11:4554 , piece_id=6KEUBREZHHYIPDAHA4FL2L3AIF4OK5DP3FSAXEBJRHLI2OTRXJMA, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:02:39.731740868 (239h34m15.771313988s) [noise=true , address=77.90.31.17:4772 , piece_id=EOWQSI5Y2HCP7PDDP4OANHWXGPJL3Q4AN5SZG37IA33RM2XBJK6Q, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:02:39.753780446 (239h34m15.793353576s) [noise=true , address=45.91.116.11:4119 , piece_id=EAJFIAQNUPS6KJBYTBUJNB6XJP7TTDEYIYPQNNEL65NSB67EN77Q, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:02:39.776264412 (239h34m15.815837542s) [noise=true , address=45.91.116.5:4299 , piece_id=AN27MZ2Y3EKRHH74WTUK3NJFH4XNUDMFUTD7SUVQWXMUOHLKXZ6A, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:02:39.870211440 (239h34m15.909784571s) [noise=true , address=45.91.116.5:4297 , piece_id=T43VZSZDEXFFMEP2N3WUK5N7NR53AH4YIM3ZWAKZ3MSBBVUP7OUQ, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:02:39.871146912 (239h34m15.910720042s) [noise=true , address=77.90.31.16:4734 , piece_id=CXLMVWXVIM6AT45VRSNPWYCVROMPKERP3XFGA7M7FI4GOG5N4PJQ, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:02:39.922331911 (239h34m15.961905031s) [noise=true , address=45.91.116.9:4263 , piece_id=R7GSGT6R6XDBP6NHGZWRFP2JUMDMIYOZKKPDUKLXJO47PSSN35WA, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:02:40.095191999 (239h34m16.134765119s) [noise=true , address=77.90.31.12:4590 , piece_id=IPKZ52GXFSV4MM5JFWWSQUXBVW2LKEC5PNX3WHTOWUS2AAKWWVNQ, seg_pos={0 0}, upload=210535]: Done uploading piece. err: <nil> Sep 16 13:03:06.474668626 (239h34m42.514241756s) [noise=true , address=145.79.227.17:4971 , piece_id=FCVCEU2YITTRAVWRM7OAK27NSRR5RRL56HZAT3JTLKUFRLNOESSQ, seg_pos={0 0}, upload=210535]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:03:06.474888936 (239h34m42.514462066s) [noise=true , address=145.79.227.13:4803 , piece_id=WRRVWKY4NFX4GZFLK3NRIHKKJFMR75IWRFXLNWUOHY6XFSK6VCFA, seg_pos={0 0}, upload=210535]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:32772->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:32772->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32772->145.79.227.13:4803: use of closed network connection Sep 16 13:03:06.475006049 (239h34m42.514579179s) [noise=true , address=145.79.227.15:4876 , piece_id=UCOJY4BPPE244VKAHQC5W2FRZ3D4S2CTVAUFAMGBIYF27O6AXE4Q, seg_pos={0 0}, upload=210535]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: write tcp 188.166.225.170:51098->145.79.227.15:4876: use of closed network connection; write tcp 188.166.225.170:51098->145.79.227.15:4876: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51098->145.79.227.15:4876: use of closed network connection Sep 16 13:03:06.475016328 (239h34m42.514589458s) [noise=true , address=145.79.227.19:4079 , piece_id=CSELLEMP26KKP7KM7VBFW46PRI72GEBMWXXYLFQBAN6ZNSRJM2GA, seg_pos={0 0}, upload=210535]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:42270->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:42270->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42270->145.79.227.19:4079: use of closed network connection Sep 16 13:03:06.475046265 (239h34m42.514619395s) [seg_pos={0 0}, upload=210535]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 16 13:03:06.731221437 (239h34m42.770794567s) [upload=210535]: Done uploading segments... Sep 16 13:03:06.731251985 (239h34m42.770825115s) [upload=210535]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.258459995s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 32 out of 60 is failed (threshold=3) [........................X.X..XXX.XXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 1m0.316529172s FAIL (2025-09-16 13:03:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== 9555788 (239h33m40.169128928s) [noise=true , address=77.90.31.11:4561 , piece_id=LG4HNG76SOWY4J4QJYT3EGM3V2YRUCFF2NZGECOWCN4DTY57FGQQ, seg_pos={0 0}, upload=210527]: Uploading piece... Sep 16 13:02:04.130105474 (239h33m40.169678604s) [noise=true , address=145.79.227.14:4867 , piece_id=TXIBKSJ2JFSOI3AFBZWS3IVGLHPYNL5NSWAHK46TBEKU3R7K5BSQ, seg_pos={0 0}, upload=210527]: Uploading piece... Sep 16 13:02:04.130716448 (239h33m40.170289578s) [noise=true , address=145.79.227.28:4735 , piece_id=B44JCJULAVDCSHG3Z4GL5BQJUB2KEIKV55N7JWEC5ZSIFJV6I75Q, seg_pos={0 0}, upload=210527]: Uploading piece... Sep 16 13:02:04.130809365 (239h33m40.170382495s) [noise=true , address=145.79.227.13:4817 , piece_id=ZZFPTNPFACAJYVJSXSY3E5OLTQ7DENGSID75SWWO7TKDUNKSR4RA, seg_pos={0 0}, upload=210527]: Uploading piece... Sep 16 13:02:04.131192425 (239h33m40.170765555s) [noise=true , address=145.79.227.3:4175 , piece_id=QT7T6ZMUUBP4DIPKVXX7DKI4QGQ2C5F7OIW7ZC47W6RBIZXGDR2Q, seg_pos={0 0}, upload=210527]: Uploading piece... Sep 16 13:02:04.131809569 (239h33m40.171382699s) [noise=true , address=145.79.227.11:4760 , piece_id=JDNJHXC6WWB6NU3MJBCIRWLNIPGVJVCASTWAEXGPUSNIX4M4AKIQ, seg_pos={0 0}, upload=210527]: Uploading piece... Sep 16 13:02:04.132266039 (239h33m40.17183917s) [noise=true , address=145.79.227.17:4996 , piece_id=CC2QWKICY3G7IZP4HV353GLFWGKZTLC3IU4FNJXV6GMUVOQDIDBA, seg_pos={0 0}, upload=210527]: Uploading piece... Sep 16 13:02:04.133072986 (239h33m40.172646116s) [noise=true , address=145.79.227.27:4716 , piece_id=3I6SQWXHSB32KBI57TF5UXK4D6MDUSEMSFHNOFOPIZO26JL3EK2Q, seg_pos={0 0}, upload=210527]: Uploading piece... Sep 16 13:02:04.134333366 (239h33m40.173906496s) [noise=true , address=145.79.227.47:4292 , piece_id=A63RHEOMYMGRQSWOUYWEFBWNUFZTLMZRVLHDIH6G7BLML7PAOO3Q, seg_pos={0 0}, upload=210527]: Uploading piece... Sep 16 13:02:04.134729089 (239h33m40.174302209s) [noise=true , address=145.79.227.46:4635 , piece_id=LTV4KUBFAQ5XZHK3QSUZUMOYZSLKYGC7HF6OQDHA67OJUTAFWLDA, seg_pos={0 0}, upload=210527]: Uploading piece... Sep 16 13:02:04.135162855 (239h33m40.174735995s) [noise=true , address=145.79.227.7:4296 , piece_id=47C6VDDF673XCSP534DWJTAIWTHTLA6JD7AS2MOGJS5B4H2QKXWA, seg_pos={0 0}, upload=210527]: Uploading piece... Sep 16 13:02:04.135524003 (239h33m40.175097143s) [noise=true , address=77.90.31.15:4720 , piece_id=P7CDI7BKAS5CF46RYZJ4TNN37P76VXN3GQ5NZFKAOQFD5FD2LGTQ, seg_pos={0 0}, upload=210527]: Uploading piece... Sep 16 13:02:04.135870482 (239h33m40.175443612s) [noise=true , address=145.79.227.21:4500 , piece_id=STMZTMDOY5O3XSEHOPYPJJPE2GDUYAS246GH2KDX3H34N2KOCWLA, seg_pos={0 0}, upload=210527]: Uploading piece... Sep 16 13:02:04.136207985 (239h33m40.175781115s) [noise=true , address=145.79.227.26:4673 , piece_id=GRQ6MHBYUSCQQ7CM3JRTL35IRZOZ5OGCULQ4KNJW6BULXTU3IANQ, seg_pos={0 0}, upload=210527]: Uploading piece... Sep 16 13:02:04.136586957 (239h33m40.176160087s) [noise=true , address=145.79.227.3:4165 , piece_id=CGGZLMF5I45TEHDIJHHKOSYWOQSELBTQU4E5GP6VNV7W6CC2BXOA, seg_pos={0 0}, upload=210527]: Uploading piece... Sep 16 13:02:04.136944137 (239h33m40.176517267s) [noise=true , address=145.79.227.9:4389 , piece_id=7ETZJRDKTXHIYXFMACIFO47JOKYSYWB5FNY4UEDXXUN2K6CXY5OQ, seg_pos={0 0}, upload=210527]: Uploading piece... Sep 16 13:02:04.137319061 (239h33m40.176892191s) [noise=true , address=145.79.227.33:4883 , piece_id=EOIEDI7LGTW7YGPH65ZR6O25VCJXN6RVW3TGFN47PYPM3Z5BFMKQ, seg_pos={0 0}, upload=210527]: Uploading piece... Sep 16 13:02:05.849083122 (239h33m41.888656252s) [upload=210527]: Next returned nil segment Sep 16 13:02:05.849108530 (239h33m41.88868165s) [upload=210527]: Waiting for error group managing segments... Sep 16 13:02:06.298579244 (239h33m42.338152364s) [noise=true , address=77.90.31.11:4561 , piece_id=LG4HNG76SOWY4J4QJYT3EGM3V2YRUCFF2NZGECOWCN4DTY57FGQQ, seg_pos={0 0}, upload=210527]: Done uploading piece. err: <nil> Sep 16 13:02:06.650159459 (239h33m42.689732579s) [noise=true , address=77.90.31.15:4720 , piece_id=P7CDI7BKAS5CF46RYZJ4TNN37P76VXN3GQ5NZFKAOQFD5FD2LGTQ, seg_pos={0 0}, upload=210527]: Done uploading piece. err: <nil> Sep 16 13:02:24.826549453 (239h34m0.866122583s) [noise=true , address=145.79.227.33:4883 , piece_id=EOIEDI7LGTW7YGPH65ZR6O25VCJXN6RVW3TGFN47PYPM3Z5BFMKQ, seg_pos={0 0}, upload=210527]: Done uploading piece. err: <nil> Sep 16 13:02:35.625254810 (239h34m11.66482794s) [noise=true , address=145.79.227.27:4716 , piece_id=3I6SQWXHSB32KBI57TF5UXK4D6MDUSEMSFHNOFOPIZO26JL3EK2Q, seg_pos={0 0}, upload=210527]: Done uploading piece. err: <nil> Sep 16 13:02:38.106331314 (239h34m14.145904434s) [noise=true , address=145.79.227.21:4500 , piece_id=STMZTMDOY5O3XSEHOPYPJJPE2GDUYAS246GH2KDX3H34N2KOCWLA, seg_pos={0 0}, upload=210527]: Done uploading piece. err: <nil> Sep 16 13:02:39.444171785 (239h34m15.483744915s) [noise=true , address=145.79.227.47:4292 , piece_id=A63RHEOMYMGRQSWOUYWEFBWNUFZTLMZRVLHDIH6G7BLML7PAOO3Q, seg_pos={0 0}, upload=210527]: Done uploading piece. err: <nil> Sep 16 13:02:44.745161399 (239h34m20.784734529s) [noise=true , address=145.79.227.9:4389 , piece_id=7ETZJRDKTXHIYXFMACIFO47JOKYSYWB5FNY4UEDXXUN2K6CXY5OQ, seg_pos={0 0}, upload=210527]: Done uploading piece. err: <nil> Sep 16 13:02:56.671370563 (239h34m32.710943693s) [noise=true , address=145.79.227.7:4296 , piece_id=47C6VDDF673XCSP534DWJTAIWTHTLA6JD7AS2MOGJS5B4H2QKXWA, seg_pos={0 0}, upload=210527]: Done uploading piece. err: <nil> Sep 16 13:02:59.493780497 (239h34m35.533353617s) [noise=true , address=145.79.227.14:4867 , piece_id=TXIBKSJ2JFSOI3AFBZWS3IVGLHPYNL5NSWAHK46TBEKU3R7K5BSQ, seg_pos={0 0}, upload=210527]: Done uploading piece. err: <nil> Sep 16 13:02:59.855475033 (239h34m35.895048163s) [noise=true , address=145.79.227.17:4996 , piece_id=CC2QWKICY3G7IZP4HV353GLFWGKZTLC3IU4FNJXV6GMUVOQDIDBA, seg_pos={0 0}, upload=210527]: Done uploading piece. err: <nil> Sep 16 13:03:02.689265522 (239h34m38.728838652s) [noise=true , address=145.79.227.3:4175 , piece_id=QT7T6ZMUUBP4DIPKVXX7DKI4QGQ2C5F7OIW7ZC47W6RBIZXGDR2Q, seg_pos={0 0}, upload=210527]: Done uploading piece. err: <nil> Sep 16 13:03:02.899741701 (239h34m38.939314831s) [noise=true , address=145.79.227.46:4635 , piece_id=LTV4KUBFAQ5XZHK3QSUZUMOYZSLKYGC7HF6OQDHA67OJUTAFWLDA, seg_pos={0 0}, upload=210527]: Done uploading piece. err: ecclient: upload failed (node:12RbzkhiTy9LQNJ3fSAVV4rqujSphs4iucJHfuT38LU9SyjM7wB, address:145.79.227.46:4635): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:03:02.899783610 (239h34m38.93935674s) [noise=true , address=145.79.227.26:4673 , piece_id=GRQ6MHBYUSCQQ7CM3JRTL35IRZOZ5OGCULQ4KNJW6BULXTU3IANQ, seg_pos={0 0}, upload=210527]: Done uploading piece. err: ecclient: upload failed (node:12NkBjmh5iL2BtckR19qgXQ4wnfvnbpA9erSuMCTEijwX7ZdHGL, address:145.79.227.26:4673): protocol: expected piece hash; write tcp 188.166.225.170:48756->145.79.227.26:4673: use of closed network connection; write tcp 188.166.225.170:48756->145.79.227.26:4673: use of closed network connection; EOF Sep 16 13:03:02.899915301 (239h34m38.939488431s) [noise=true , address=145.79.227.11:4760 , piece_id=JDNJHXC6WWB6NU3MJBCIRWLNIPGVJVCASTWAEXGPUSNIX4M4AKIQ, seg_pos={0 0}, upload=210527]: Done uploading piece. err: ecclient: upload failed (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB, address:145.79.227.11:4760): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:03:02.900011174 (239h34m38.939584314s) [noise=true , address=145.79.227.28:4735 , piece_id=B44JCJULAVDCSHG3Z4GL5BQJUB2KEIKV55N7JWEC5ZSIFJV6I75Q, seg_pos={0 0}, upload=210527]: Done uploading piece. err: ecclient: upload failed (node:1QCQZ8eFGLa5TAaAJJzUip8o5DAELzTBTm4UFbt3Am5yYWXAZF, address:145.79.227.28:4735): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:03:02.900029318 (239h34m38.939602448s) [noise=true , address=145.79.227.3:4165 , piece_id=CGGZLMF5I45TEHDIJHHKOSYWOQSELBTQU4E5GP6VNV7W6CC2BXOA, seg_pos={0 0}, upload=210527]: Done uploading piece. err: ecclient: upload failed (node:13Ksy7YCGV5u3T5Z6WwKtMjFq6Rs4bayzR7mQFyXbSFuJjaH4F, address:145.79.227.3:4165): protocol: write tcp 188.166.225.170:33586->145.79.227.3:4165: use of closed network connection; write tcp 188.166.225.170:33586->145.79.227.3:4165: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33586->145.79.227.3:4165: use of closed network connection Sep 16 13:03:02.900097057 (239h34m38.939670187s) [noise=true , address=145.79.227.6:4277 , piece_id=4RTKSXC5LE752RDV4MZIUQ7NTF4R5TWRMZMMD4JEJRQ5PYUQR3GQ, seg_pos={0 0}, upload=210527]: Done uploading piece. err: ecclient: upload failed (node:1i493KQZuQYQwXzct9HamWDCq92CSGvLPHjZ6fxxVVZX1f7ofY, address:145.79.227.6:4277): protocol: write tcp 188.166.225.170:59404->145.79.227.6:4277: use of closed network connection; write tcp 188.166.225.170:59404->145.79.227.6:4277: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59404->145.79.227.6:4277: use of closed network connection Sep 16 13:03:02.900222536 (239h34m38.939795676s) [noise=true , address=145.79.227.13:4817 , piece_id=ZZFPTNPFACAJYVJSXSY3E5OLTQ7DENGSID75SWWO7TKDUNKSR4RA, seg_pos={0 0}, upload=210527]: Done uploading piece. err: ecclient: upload failed (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz, address:145.79.227.13:4817): protocol: expected piece hash; write tcp 188.166.225.170:34956->145.79.227.13:4817: use of closed network connection; write tcp 188.166.225.170:34956->145.79.227.13:4817: use of closed network connection; EOF Sep 16 13:03:02.900270247 (239h34m38.939843377s) [seg_pos={0 0}, upload=210527]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 16 13:03:03.213741845 (239h34m39.253314985s) [upload=210527]: Done uploading segments... Sep 16 13:03:03.213779797 (239h34m39.253352937s) [upload=210527]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 1m0.316552486s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 28 out of 60 is failed (threshold=3) [.......X......X.X.......XXXX.XX.XXXXXX..XX.XXX..XX.X.X.XX.XX] duration: 30.260850347s FAIL (2025-09-16 13:02:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 734224479 (239h33m42.773797609s) [upload=210529]: Starting upload Sep 16 13:02:06.734308029 (239h33m42.773881169s) [upload=210529]: Done starting upload Sep 16 13:02:06.734553556 (239h33m42.774126687s) [upload=210529]: Uploading segments... Sep 16 13:02:06.734613450 (239h33m42.77418659s) [upload=210529]: Got next segment. Inline: false Sep 16 13:02:06.734653286 (239h33m42.774226427s) [upload=210529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 16 13:02:06.734659769 (239h33m42.774232899s) [upload=210529]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 16 13:02:06.995147001 (239h33m43.034720141s) [seg_pos={0 0}, upload=210529]: Begin upload segment... Sep 16 13:02:06.995201795 (239h33m43.034774935s) [seg_pos={0 0}, upload=210529]: Done begin upload segment. Sep 16 13:02:06.995238274 (239h33m43.034811405s) [noise=true , address=45.91.116.8:4048 , piece_id=HEESFDKDFKIEK2UZAQX7CETFF5ZFUW76RFH7O5DHDSPVA26GSF4Q, seg_pos={0 0}, upload=210529]: Uploading piece... Sep 16 13:02:06.995245469 (239h33m43.034818599s) [noise=true , address=45.91.116.14:4190 , piece_id=W4TO6RDQHJAXB43IX3UOGL2O5X5EGM3VYOD2WRXZ2WA3NV2JJWAA, seg_pos={0 0}, upload=210529]: Uploading piece... Sep 16 13:02:06.995296225 (239h33m43.034869355s) [noise=true , address=77.90.31.21:4878 , piece_id=SZ3AK4ZMPJLMCO53PSUVAC7YAGRASPGZ2NMELXHX5ADBZTPPC43Q, seg_pos={0 0}, upload=210529]: Uploading piece... Sep 16 13:02:06.995735552 (239h33m43.035308682s) [noise=true , address=45.91.116.10:4082 , piece_id=7ZVEKIKTZCC4LSGILHOG56O4QORE5RK5LTZKIV5EAVLV4DUQVS7A, seg_pos={0 0}, upload=210529]: Uploading piece... Sep 16 13:02:06.995766791 (239h33m43.035339912s) [noise=true , address=45.91.116.6:4973 , piece_id=NOZ5II7M3B7EOTONA3ED47JBXTS3ARPVN3GRRDJ4KL5EL63PEFYQ, seg_pos={0 0}, upload=210529]: Uploading piece... Sep 16 13:02:06.996119583 (239h33m43.035692713s) [noise=true , address=145.79.227.4:4187 , piece_id=DI3RZKVLZFDIJLLUKWVYN2YMTFJHVVZCBKVCONRX44CTO6ELXBLA, seg_pos={0 0}, upload=210529]: Uploading piece... Sep 16 13:02:06.996212279 (239h33m43.035785409s) [noise=true , address=77.90.31.12:4590 , piece_id=NA6G2BJB3UYDWRDO3QPWGJTFJ2QQQWNZAWKFM4KQRSQY7VJQTRXQ, seg_pos={0 0}, upload=210529]: Uploading piece... Sep 16 13:02:06.996635264 (239h33m43.036208395s) [noise=true , address=145.79.227.7:4294 , piece_id=JTEKI6RKIJR24PWHRHWEUPYMSIR3FSMXBYKZN5KWV3GISOQ2D3DQ, seg_pos={0 0}, upload=210529]: Uploading piece... Sep 16 13:02:06.996739613 (239h33m43.036312743s) [noise=true , address=145.79.227.18:4006 , piece_id=ONDTUEXRGC7QGTYLKBY46UYFCNOVRGJSA4BLYDHX5CMVHENMJSOQ, seg_pos={0 0}, upload=210529]: Uploading piece... Sep 16 13:02:06.997172248 (239h33m43.036745378s) [noise=true , address=45.91.116.11:4118 , piece_id=KMP5R2NYZRP5TSLDJ6SM2MYFR4UOFVABCUI7ZPIPSJHP73QEVZJA, seg_pos={0 0}, upload=210529]: Uploading piece... Sep 16 13:02:06.997560286 (239h33m43.037133416s) [noise=true , address=45.91.116.9:4262 , piece_id=EKQFCBW2IFKEH3P35OBDAIHQ3Y3AEWSLK7HPNCIULWLG6FMWYXIQ, seg_pos={0 0}, upload=210529]: Uploading piece... Sep 16 13:02:06.997986317 (239h33m43.037559447s) [noise=true , address=145.79.227.6:4259 , piece_id=SRPYYDMWQF6XNIELFTHXNVSIJSSNR6KGF2VBH7EGQDRHPAJXADJA, seg_pos={0 0}, upload=210529]: Uploading piece... Sep 16 13:02:06.998405826 (239h33m43.037978956s) [noise=true , address=145.79.227.16:4911 , piece_id=PX7W3FMO6CYZ6EBVSDZKBX6O6YZPFJG7VDHSEKTO7JWCQM26OTAA, seg_pos={0 0}, upload=210529]: Uploading piece... Sep 16 13:02:06.998811128 (239h33m43.038384258s) [noise=true , address=45.91.116.7:4009 , piece_id=E6QYJUPVEWXW3OH4QI42EJ3VZFPQC2EXJWHOE3NR6SACWT7N3W2A, seg_pos={0 0}, upload=210529]: Uploading piece... Sep 16 13:02:06.999189629 (239h33m43.038762769s) [noise=true , address=45.91.116.6:4974 , piece_id=2S5KD3E7JS7OMBKGLA46G5R325MJTZCH4CI663RDNBZWOQSGIMCA, seg_pos={0 0}, upload=210529]: Uploading piece... Sep 16 13:02:06.999585312 (239h33m43.039158442s) [noise=true , address=77.90.31.18:4805 , piece_id=DRS6ZT7MUAZ63NKPNUL7XVWBDRBCOEM6G5ED4CZCF7ZWFZL3AXOA, seg_pos={0 0}, upload=210529]: Uploading piece... Sep 16 13:02:08.802706900 (239h33m44.84228003s) [upload=210529]: Next returned nil segment Sep 16 13:02:08.802730034 (239h33m44.842303164s) [upload=210529]: Waiting for error group managing segments... Sep 16 13:02:09.104954353 (239h33m45.144527484s) [noise=true , address=45.91.116.6:4973 , piece_id=NOZ5II7M3B7EOTONA3ED47JBXTS3ARPVN3GRRDJ4KL5EL63PEFYQ, seg_pos={0 0}, upload=210529]: Done uploading piece. err: <nil> Sep 16 13:02:09.165465191 (239h33m45.205038321s) [noise=true , address=77.90.31.12:4590 , piece_id=NA6G2BJB3UYDWRDO3QPWGJTFJ2QQQWNZAWKFM4KQRSQY7VJQTRXQ, seg_pos={0 0}, upload=210529]: Done uploading piece. err: <nil> Sep 16 13:02:09.202303091 (239h33m45.241876221s) [noise=true , address=45.91.116.9:4262 , piece_id=EKQFCBW2IFKEH3P35OBDAIHQ3Y3AEWSLK7HPNCIULWLG6FMWYXIQ, seg_pos={0 0}, upload=210529]: Done uploading piece. err: <nil> Sep 16 13:02:09.203899590 (239h33m45.24347271s) [noise=true , address=45.91.116.14:4190 , piece_id=W4TO6RDQHJAXB43IX3UOGL2O5X5EGM3VYOD2WRXZ2WA3NV2JJWAA, seg_pos={0 0}, upload=210529]: Done uploading piece. err: <nil> Sep 16 13:02:09.205678318 (239h33m45.245251448s) [noise=true , address=45.91.116.8:4048 , piece_id=HEESFDKDFKIEK2UZAQX7CETFF5ZFUW76RFH7O5DHDSPVA26GSF4Q, seg_pos={0 0}, upload=210529]: Done uploading piece. err: <nil> Sep 16 13:02:09.234770937 (239h33m45.274344068s) [noise=true , address=45.91.116.7:4009 , piece_id=E6QYJUPVEWXW3OH4QI42EJ3VZFPQC2EXJWHOE3NR6SACWT7N3W2A, seg_pos={0 0}, upload=210529]: Done uploading piece. err: <nil> Sep 16 13:02:09.236959234 (239h33m45.276532355s) [noise=true , address=45.91.116.10:4082 , piece_id=7ZVEKIKTZCC4LSGILHOG56O4QORE5RK5LTZKIV5EAVLV4DUQVS7A, seg_pos={0 0}, upload=210529]: Done uploading piece. err: <nil> Sep 16 13:02:09.245154761 (239h33m45.284727891s) [noise=true , address=45.91.116.6:4974 , piece_id=2S5KD3E7JS7OMBKGLA46G5R325MJTZCH4CI663RDNBZWOQSGIMCA, seg_pos={0 0}, upload=210529]: Done uploading piece. err: <nil> Sep 16 13:02:09.245688968 (239h33m45.285262098s) [noise=true , address=45.91.116.11:4118 , piece_id=KMP5R2NYZRP5TSLDJ6SM2MYFR4UOFVABCUI7ZPIPSJHP73QEVZJA, seg_pos={0 0}, upload=210529]: Done uploading piece. err: <nil> Sep 16 13:02:09.249336493 (239h33m45.288909623s) [noise=true , address=77.90.31.21:4878 , piece_id=SZ3AK4ZMPJLMCO53PSUVAC7YAGRASPGZ2NMELXHX5ADBZTPPC43Q, seg_pos={0 0}, upload=210529]: Done uploading piece. err: <nil> Sep 16 13:02:09.289845522 (239h33m45.329418672s) [noise=true , address=77.90.31.18:4805 , piece_id=DRS6ZT7MUAZ63NKPNUL7XVWBDRBCOEM6G5ED4CZCF7ZWFZL3AXOA, seg_pos={0 0}, upload=210529]: Done uploading piece. err: <nil> Sep 16 13:02:35.985150150 (239h34m12.02472328s) [noise=true , address=145.79.227.16:4911 , piece_id=PX7W3FMO6CYZ6EBVSDZKBX6O6YZPFJG7VDHSEKTO7JWCQM26OTAA, seg_pos={0 0}, upload=210529]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:02:35.985518931 (239h34m12.025092052s) [noise=true , address=145.79.227.6:4259 , piece_id=SRPYYDMWQF6XNIELFTHXNVSIJSSNR6KGF2VBH7EGQDRHPAJXADJA, seg_pos={0 0}, upload=210529]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:49910->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:49910->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49910->145.79.227.6:4259: use of closed network connection Sep 16 13:02:35.985669698 (239h34m12.025242838s) [noise=true , address=145.79.227.4:4187 , piece_id=DI3RZKVLZFDIJLLUKWVYN2YMTFJHVVZCBKVCONRX44CTO6ELXBLA, seg_pos={0 0}, upload=210529]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: write tcp 188.166.225.170:48134->145.79.227.4:4187: use of closed network connection; write tcp 188.166.225.170:48134->145.79.227.4:4187: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48134->145.79.227.4:4187: use of closed network connection Sep 16 13:02:35.985758758 (239h34m12.025331888s) [noise=true , address=145.79.227.7:4294 , piece_id=JTEKI6RKIJR24PWHRHWEUPYMSIR3FSMXBYKZN5KWV3GISOQ2D3DQ, seg_pos={0 0}, upload=210529]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:37878->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:37878->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37878->145.79.227.7:4294: use of closed network connection Sep 16 13:02:35.985893204 (239h34m12.025466334s) [noise=true , address=145.79.227.18:4006 , piece_id=ONDTUEXRGC7QGTYLKBY46UYFCNOVRGJSA4BLYDHX5CMVHENMJSOQ, seg_pos={0 0}, upload=210529]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:47486->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:47486->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47486->145.79.227.18:4006: use of closed network connection Sep 16 13:02:35.985916699 (239h34m12.02548982s) [seg_pos={0 0}, upload=210529]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Sep 16 13:02:36.243826844 (239h34m12.283399984s) [upload=210529]: Done uploading segments... Sep 16 13:02:36.243864245 (239h34m12.283437365s) [upload=210529]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 30.260884772s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 4.984952881s FAIL (2025-09-16 13:02:17 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== JFA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422604190 (238h59m45.46217732s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422896808 (238h59m45.462469928s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423232478 (238h59m45.462805608s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423565571 (238h59m45.463138691s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423935696 (238h59m45.463508826s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424280403 (238h59m45.463853533s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424633305 (238h59m45.464206435s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424994342 (238h59m45.464567472s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425341152 (238h59m45.464914282s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425707831 (238h59m45.465280951s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.426034432 (238h59m45.465607562s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429082236 (238h59m45.468655366s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429521483 (238h59m45.469094613s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:10.278696743 (238h59m46.318269863s) [upload=210063]: Next returned nil segment Sep 16 12:28:10.278720237 (238h59m46.318293367s) [upload=210063]: Waiting for error group managing segments... Sep 16 12:28:10.652409183 (238h59m46.691982303s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.662938092 (238h59m46.702511222s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.670032272 (238h59m46.709605402s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.701595607 (238h59m46.741168737s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.704157255 (238h59m46.743730385s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.707972140 (238h59m46.74754527s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.708523660 (238h59m46.74809678s) [noise=true , address=89.149.201.147:4007 , piece_id=BOQVD3EW5UAYWKEZ5FWC2QCDGIROAEOQN2OEYQ4QACNVDEIFF2IA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.754549157 (238h59m46.794122277s) [noise=true , address=89.149.201.147:4010 , piece_id=OALYBM6QEAOKMQPP2R3Y7LBVOEJYPMTBHJTGE2DSRO3KLRGBZC3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.138412786 (238h59m47.177985916s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.163219826 (238h59m47.202792956s) [noise=true , address=81.171.14.70:4039 , piece_id=IMLIU4QCGFNXWATVWK4L7FZPWOVPCRXNH4F3HSMF5VLQZJUEBO3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.169643348 (238h59m47.209216478s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.231770296 (238h59m47.271343416s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.258046263 (238h59m47.297619383s) [noise=true , address=185.167.204.205:4034 , piece_id=FUHHRFVDRYETJRWVBQZRALI4UGKDQ6DXV7TDKXBRASOMGOEN6YOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.263155884 (238h59m47.302729004s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.269762875 (238h59m47.309336005s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.281404505 (238h59m47.320977635s) [noise=true , address=185.167.204.205:4027 , piece_id=3O5SOEMEXYDYR5OE6SZJ2AVVLNYG4V4IMZOFUL7XDJEZUHDUV5TA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.289386705 (238h59m47.328959825s) [noise=true , address=185.167.204.206:4063 , piece_id=ERJLEJ5EILBCN4WUPZBVYSB2CGDWORVZ3GASSXBVNGR25GWVFYOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.298140815 (238h59m47.337713945s) [noise=true , address=185.167.204.206:4043 , piece_id=LDZTOC67YHM344PUCLVJ7RMKQAYJAQJ4GMKYZNN5LLU5KIUQCW7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.311391579 (238h59m47.350964709s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.317381906 (238h59m47.356955036s) [noise=true , address=185.167.204.206:4065 , piece_id=UXYM6MEGCQFRRRSMGI5XKJJJ6GYW7IJXG5QDGMICLP3FNJDSFRSQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.318355050 (238h59m47.35792818s) [noise=true , address=185.167.204.205:4018 , piece_id=VZP55ZA5Y5IA2PUH75QDVB56UHRJJ2XNC75L5WCRUSHGHQGZ463A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.330083334 (238h59m47.369656464s) [noise=true , address=185.167.204.206:4052 , piece_id=CDKZXVC22A62STE3NYD4R2TWT3AF45U2A7MHEIQJPTNMUKBVFJFA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.331429858 (238h59m47.371002988s) [noise=true , address=185.167.204.205:4035 , piece_id=M6LWKXSTJHGHXHY4VEJ2IGLI2UX4IIZV5KD4A6YY3BMIQ6ZRBMAQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.341689555 (238h59m47.381262686s) [noise=true , address=185.167.204.205:4014 , piece_id=MDSUAX4XNI5INUUQCMAP26PQFV62U3TZ2OITZR3BSNDQLHWEOKIA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.346694947 (238h59m47.386268077s) [noise=true , address=185.167.204.205:4023 , piece_id=YNW6TYPAVMYIHD5BT6QZGJJAGDM2XSZ4QYX4C2TH5QRGNTNP4KUQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363156895 (238h59m47.402730015s) [noise=true , address=185.167.204.206:4059 , piece_id=IX3H3WSLKDNPCCA5NMFUGMO2P6CA274AEUXLGVA3WRGJM3SN2OZQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363183276 (238h59m47.402756406s) [seg_pos={0 0}, upload=210063]: Segment reached optimal threshold of 26 pieces. Sep 16 12:28:11.363333942 (238h59m47.402907072s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363361435 (238h59m47.402934565s) [noise=true , address=185.167.204.206:4066 , piece_id=XXWYU36QFNZ2HCZF2WGAG4LKIBE3GCCKNVBDV6N5RQMCDJJXJULQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: expected piece hash; context canceled; EOF Sep 16 12:28:11.363393326 (238h59m47.402966456s) [seg_pos={0 0}, upload=210063]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil> Sep 16 12:28:11.363496222 (238h59m47.403069362s) [upload=210063]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 16 12:28:11.363503285 (238h59m47.403076405s) [upload=210063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 16 12:28:11.633947931 (238h59m47.673521071s) [upload=210063]: Done uploading segments... Sep 16 12:28:11.633974231 (238h59m47.673547372s) [upload=210063]: Upload finished. err: <nil> Duration: 4.984980234s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 31 out of 60 is failed (threshold=3) [.........................X.X..XXX.XXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 1m0.277973753s FAIL (2025-09-16 13:02:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 9) ======LOGS====== 3 , piece_id=EYBXM6J5PWWN63G35O7VRXVJJQ4TFGA3PCRTG7WPJZEDZQJD3TEQ, seg_pos={0 0}, upload=210511]: Uploading piece... Sep 16 13:01:03.770795767 (239h32m39.810368917s) [noise=true , address=145.79.227.32:4846 , piece_id=Q3XWYYCCGAECZIVVAMEUSZFIJ4RRKSGILATL6DLIRG7VYAQNR4FQ, seg_pos={0 0}, upload=210511]: Uploading piece... Sep 16 13:01:03.770849410 (239h32m39.81042254s) [noise=true , address=145.79.227.12:4789 , piece_id=CU7NVCNQKVOEHQ3CT5JQE6MQ2GASQRD4W632IZXB2MR2S7K4CYUQ, seg_pos={0 0}, upload=210511]: Uploading piece... Sep 16 13:01:03.771304546 (239h32m39.810877676s) [noise=true , address=145.79.227.17:4992 , piece_id=4ULWOB6AROPXQMQBM3WCBLTG4S4LUZEEXXIAH3UUCBRQVAZTE2MQ, seg_pos={0 0}, upload=210511]: Uploading piece... Sep 16 13:01:03.771602323 (239h32m39.811175453s) [noise=true , address=145.79.227.39:4035 , piece_id=KQJSWPV2O2GXYDVKKGWKESBKAK26WXQGGMM6BPUEDBCFETZUF3AQ, seg_pos={0 0}, upload=210511]: Uploading piece... Sep 16 13:01:03.771716050 (239h32m39.81128919s) [noise=true , address=145.79.227.49:4359 , piece_id=XJDOE3ZRGOQRLFH2N25H4OZ44IJRLAVIUDDVXXUSBSNZOAOQSOSA, seg_pos={0 0}, upload=210511]: Uploading piece... Sep 16 13:01:03.772116863 (239h32m39.811689993s) [noise=true , address=145.79.227.46:4601 , piece_id=MGZU26KAAL3KIG4TPTAJMAZGJJYM46SBEV6USNBKSB3LN5ZPOWAA, seg_pos={0 0}, upload=210511]: Uploading piece... Sep 16 13:01:03.772613659 (239h32m39.812186789s) [noise=true , address=145.79.227.13:4813 , piece_id=WKI5KO27ENHBJSZ4722SNNHYDJUIAWWR7NWFLHZ5V3BQ4JV6N5TA, seg_pos={0 0}, upload=210511]: Uploading piece... Sep 16 13:01:03.773007589 (239h32m39.812580719s) [noise=true , address=145.79.227.52:4459 , piece_id=ZVVFPTQBVEWXULQQ4CWDVL4YALOND5BWFRIL5XCZSMPCBB5D4JCQ, seg_pos={0 0}, upload=210511]: Uploading piece... Sep 16 13:01:03.773381201 (239h32m39.812954341s) [noise=true , address=145.79.227.6:4286 , piece_id=V44ZTM3BF4AVYUNZ47IV6XPJVUVKKXFETSXCHGIWLSFX5BAT56GQ, seg_pos={0 0}, upload=210511]: Uploading piece... Sep 16 13:01:03.773756926 (239h32m39.813330067s) [noise=true , address=145.79.227.11:4736 , piece_id=C5565GOTGR6Q36VJ2IDMDVZOUMTGDOPMPRRNBSWMEN7PDSXQA3IQ, seg_pos={0 0}, upload=210511]: Uploading piece... Sep 16 13:01:03.774208456 (239h32m39.813781576s) [noise=true , address=145.79.227.50:4390 , piece_id=3GHEJ2SK7LZK7TC7MMEK3R5J6XIKGNIMY5OM3W4F4YXRZ7ZX2KAQ, seg_pos={0 0}, upload=210511]: Uploading piece... Sep 16 13:01:03.774592227 (239h32m39.814165357s) [noise=true , address=145.79.227.26:4680 , piece_id=6JDMXRVKVNU33F6J55DZGMD6PIOSWDODE3ZJOQAB7H5NQTL2NYNA, seg_pos={0 0}, upload=210511]: Uploading piece... Sep 16 13:01:03.774974435 (239h32m39.814547565s) [noise=true , address=145.79.227.18:4026 , piece_id=7YTB7UV2QWWMPJ3QJGD6S5G7PMZRTBBK7UJN6QF6CWNBI7Y7EULQ, seg_pos={0 0}, upload=210511]: Uploading piece... Sep 16 13:01:03.775321977 (239h32m39.814895107s) [noise=true , address=145.79.227.33:4880 , piece_id=DBDBZQFK2BZDHH5VXRCS45TWBPPCZFJB3WLBYC6UBZ3JDJWC5ZDA, seg_pos={0 0}, upload=210511]: Uploading piece... Sep 16 13:01:03.775671512 (239h32m39.815244642s) [noise=true , address=145.79.227.23:4560 , piece_id=3A3RXYUOB7RUMSMZS2K2V22RARQETXBF7S5RV2T7IZJQEUMYJTMQ, seg_pos={0 0}, upload=210511]: Uploading piece... Sep 16 13:01:03.776027520 (239h32m39.81560065s) [noise=true , address=145.79.227.10:4408 , piece_id=APO7GKXKRKSX2V6EWPI7UCT67QQOZ255IA5KIAVGOIFB4IIZV46Q, seg_pos={0 0}, upload=210511]: Uploading piece... Sep 16 13:01:03.776409417 (239h32m39.815982547s) [noise=true , address=145.79.227.2:4137 , piece_id=GRYJQ2KAAG24MAPHYGORQBDQSRX6AOETR66OFRMGYJLGYAAYQ6YQ, seg_pos={0 0}, upload=210511]: Uploading piece... Sep 16 13:01:05.511808826 (239h32m41.551381957s) [upload=210511]: Next returned nil segment Sep 16 13:01:05.511836349 (239h32m41.551409479s) [upload=210511]: Waiting for error group managing segments... Sep 16 13:01:05.967095976 (239h32m42.006669116s) [noise=true , address=77.90.31.19:4853 , piece_id=EYBXM6J5PWWN63G35O7VRXVJJQ4TFGA3PCRTG7WPJZEDZQJD3TEQ, seg_pos={0 0}, upload=210511]: Done uploading piece. err: <nil> Sep 16 13:01:25.775115988 (239h33m1.814689108s) [noise=true , address=145.79.227.6:4286 , piece_id=V44ZTM3BF4AVYUNZ47IV6XPJVUVKKXFETSXCHGIWLSFX5BAT56GQ, seg_pos={0 0}, upload=210511]: Done uploading piece. err: <nil> Sep 16 13:01:27.941320109 (239h33m3.980893229s) [noise=true , address=145.79.227.12:4789 , piece_id=CU7NVCNQKVOEHQ3CT5JQE6MQ2GASQRD4W632IZXB2MR2S7K4CYUQ, seg_pos={0 0}, upload=210511]: Done uploading piece. err: <nil> Sep 16 13:01:28.538254990 (239h33m4.57782811s) [noise=true , address=145.79.227.32:4846 , piece_id=Q3XWYYCCGAECZIVVAMEUSZFIJ4RRKSGILATL6DLIRG7VYAQNR4FQ, seg_pos={0 0}, upload=210511]: Done uploading piece. err: <nil> Sep 16 13:01:33.814473057 (239h33m9.854046187s) [noise=true , address=145.79.227.17:4992 , piece_id=4ULWOB6AROPXQMQBM3WCBLTG4S4LUZEEXXIAH3UUCBRQVAZTE2MQ, seg_pos={0 0}, upload=210511]: Done uploading piece. err: <nil> Sep 16 13:01:34.268641346 (239h33m10.308214466s) [noise=true , address=145.79.227.13:4813 , piece_id=WKI5KO27ENHBJSZ4722SNNHYDJUIAWWR7NWFLHZ5V3BQ4JV6N5TA, seg_pos={0 0}, upload=210511]: Done uploading piece. err: <nil> Sep 16 13:01:46.695017663 (239h33m22.734590794s) [noise=true , address=145.79.227.26:4680 , piece_id=6JDMXRVKVNU33F6J55DZGMD6PIOSWDODE3ZJOQAB7H5NQTL2NYNA, seg_pos={0 0}, upload=210511]: Done uploading piece. err: <nil> Sep 16 13:01:58.291471398 (239h33m34.331044548s) [noise=true , address=145.79.227.11:4736 , piece_id=C5565GOTGR6Q36VJ2IDMDVZOUMTGDOPMPRRNBSWMEN7PDSXQA3IQ, seg_pos={0 0}, upload=210511]: Done uploading piece. err: <nil> Sep 16 13:02:00.046006377 (239h33m36.085579517s) [noise=true , address=145.79.227.10:4408 , piece_id=APO7GKXKRKSX2V6EWPI7UCT67QQOZ255IA5KIAVGOIFB4IIZV46Q, seg_pos={0 0}, upload=210511]: Done uploading piece. err: <nil> Sep 16 13:02:02.393438291 (239h33m38.433011421s) [noise=true , address=145.79.227.49:4359 , piece_id=XJDOE3ZRGOQRLFH2N25H4OZ44IJRLAVIUDDVXXUSBSNZOAOQSOSA, seg_pos={0 0}, upload=210511]: Done uploading piece. err: ecclient: upload failed (node:1YgFc7P9RCbYw9u2wfow8Z3DMwFvJ6AnCsvzoxU9pTwPWGw8MV, address:145.79.227.49:4359): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:02:02.393568659 (239h33m38.433141789s) [noise=true , address=145.79.227.46:4601 , piece_id=MGZU26KAAL3KIG4TPTAJMAZGJJYM46SBEV6USNBKSB3LN5ZPOWAA, seg_pos={0 0}, upload=210511]: Done uploading piece. err: ecclient: upload failed (node:125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, address:145.79.227.46:4601): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:02:02.393667838 (239h33m38.433240978s) [noise=true , address=145.79.227.18:4026 , piece_id=7YTB7UV2QWWMPJ3QJGD6S5G7PMZRTBBK7UJN6QF6CWNBI7Y7EULQ, seg_pos={0 0}, upload=210511]: Done uploading piece. err: ecclient: upload failed (node:1M7HJBLoxHkRHXbPuDiqwxdb4EAq5wktfJY5FygdoDdgy59rRq, address:145.79.227.18:4026): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:02:02.393757088 (239h33m38.433330218s) [noise=true , address=145.79.227.33:4880 , piece_id=DBDBZQFK2BZDHH5VXRCS45TWBPPCZFJB3WLBYC6UBZ3JDJWC5ZDA, seg_pos={0 0}, upload=210511]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:02:02.393872658 (239h33m38.433445788s) [noise=true , address=145.79.227.52:4459 , piece_id=ZVVFPTQBVEWXULQQ4CWDVL4YALOND5BWFRIL5XCZSMPCBB5D4JCQ, seg_pos={0 0}, upload=210511]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:02:02.394049414 (239h33m38.433622545s) [noise=true , address=145.79.227.39:4035 , piece_id=KQJSWPV2O2GXYDVKKGWKESBKAK26WXQGGMM6BPUEDBCFETZUF3AQ, seg_pos={0 0}, upload=210511]: Done uploading piece. err: ecclient: upload failed (node:12nevdZspAt1ce9XA2Emh8QJDxcmEKpYemCMwWidVi8RU6T6vZD, address:145.79.227.39:4035): protocol: expected piece hash; write tcp 188.166.225.170:50034->145.79.227.39:4035: use of closed network connection; write tcp 188.166.225.170:50034->145.79.227.39:4035: use of closed network connection; EOF Sep 16 13:02:02.394141450 (239h33m38.43371458s) [noise=true , address=145.79.227.2:4137 , piece_id=GRYJQ2KAAG24MAPHYGORQBDQSRX6AOETR66OFRMGYJLGYAAYQ6YQ, seg_pos={0 0}, upload=210511]: Done uploading piece. err: ecclient: upload failed (node:12tkbodtFrNCuJbvZk8YnpSdJfVsKasNuKhg2wGD8rDkNPrHZ21, address:145.79.227.2:4137): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:02:02.394232072 (239h33m38.433805202s) [noise=true , address=145.79.227.50:4390 , piece_id=3GHEJ2SK7LZK7TC7MMEK3R5J6XIKGNIMY5OM3W4F4YXRZ7ZX2KAQ, seg_pos={0 0}, upload=210511]: Done uploading piece. err: ecclient: upload failed (node:12Ex3KjvY38tkSstUAgALSN9i4tBKj2D24BfA6jWi34ntvqmJNT, address:145.79.227.50:4390): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:02:02.394373342 (239h33m38.433946482s) [noise=true , address=145.79.227.23:4560 , piece_id=3A3RXYUOB7RUMSMZS2K2V22RARQETXBF7S5RV2T7IZJQEUMYJTMQ, seg_pos={0 0}, upload=210511]: Done uploading piece. err: ecclient: upload failed (node:12sNZ8qhPusEuj4saH5puqvuptETQfx8zJQ4SbsRVT48K2WRx58, address:145.79.227.23:4560): protocol: expected piece hash; write tcp 188.166.225.170:54210->145.79.227.23:4560: use of closed network connection; write tcp 188.166.225.170:54210->145.79.227.23:4560: use of closed network connection; EOF Sep 16 13:02:02.394400012 (239h33m38.433973152s) [seg_pos={0 0}, upload=210511]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil> Sep 16 13:02:02.669247830 (239h33m38.70882097s) [upload=210511]: Done uploading segments... Sep 16 13:02:02.669286494 (239h33m38.708859634s) [upload=210511]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9) Duration: 1m0.278005944s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 27 out of 60 is failed (threshold=3) [........X......X.X.......XXXX.XX.XXXXXX..XX.XXX..XX.X.X.XX.X] duration: 30.284105211s FAIL (2025-09-16 13:01:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 16 13:01:29.095487349 (239h33m5.135060479s) [upload=210518]: Starting upload Sep 16 13:01:29.095581268 (239h33m5.135154398s) [upload=210518]: Done starting upload Sep 16 13:01:29.095718259 (239h33m5.135291399s) [upload=210518]: Uploading segments... Sep 16 13:01:29.095891398 (239h33m5.135464528s) [upload=210518]: Got next segment. Inline: false Sep 16 13:01:29.095924962 (239h33m5.135498092s) [upload=210518]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 16 13:01:29.095931314 (239h33m5.135504434s) [upload=210518]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 16 13:01:29.357090897 (239h33m5.396664027s) [seg_pos={0 0}, upload=210518]: Begin upload segment... Sep 16 13:01:29.357158456 (239h33m5.396731586s) [seg_pos={0 0}, upload=210518]: Done begin upload segment. Sep 16 13:01:29.357204152 (239h33m5.396777312s) [noise=true , address=77.90.31.19:4841 , piece_id=2PSJ5U7KJVLRVWXOBB25H7ATIYBNCMEXJGGX45ACBXV4MIDSED2Q, seg_pos={0 0}, upload=210518]: Uploading piece... Sep 16 13:01:29.357706869 (239h33m5.397279999s) [noise=true , address=45.91.116.9:4261 , piece_id=YDSNJFYD4AY7AALFMPNTOIZRQG4HUFMXZ5OOLBU5Q6BJVHZ7GQRA, seg_pos={0 0}, upload=210518]: Uploading piece... Sep 16 13:01:29.358119515 (239h33m5.397692645s) [noise=true , address=45.91.116.13:4154 , piece_id=F36B4RWFOKVVTM62EY53YSSE43GQ23GYPUH5RY554HKMF5QCHJRA, seg_pos={0 0}, upload=210518]: Uploading piece... Sep 16 13:01:29.358438984 (239h33m5.398012114s) [noise=true , address=145.79.227.2:4113 , piece_id=4HAFKBP6U5TRSSXYT5XQIWLC6QEVVWL74S5X4ZF5TQDKDMVXECIQ, seg_pos={0 0}, upload=210518]: Uploading piece... Sep 16 13:01:29.358729156 (239h33m5.398302286s) [noise=true , address=145.79.227.3:4151 , piece_id=RNERVEBJJLCBBFXO6HT5NV6IPC3NNCZLPEPAKWBZDQP3M5LK5NFQ, seg_pos={0 0}, upload=210518]: Uploading piece... Sep 16 13:01:29.359062021 (239h33m5.398635151s) [noise=true , address=45.91.116.5:4298 , piece_id=54ULT6MJVEYFBQGDARXQCLNRCJTJGY6EH5MH5BFL5EYOVG7A2J4A, seg_pos={0 0}, upload=210518]: Uploading piece... Sep 16 13:01:29.359365808 (239h33m5.398938928s) [noise=true , address=45.91.116.10:4082 , piece_id=XMOW3RJWTZ4WHT466ACGYZK5HJASH6Q7AKNA7OCCWXM2MZOR7J4A, seg_pos={0 0}, upload=210518]: Uploading piece... Sep 16 13:01:29.359637947 (239h33m5.399211077s) [noise=true , address=45.91.116.4:4939 , piece_id=YKVCUASONMQKAOANYMWWZTSZ5XKIEMXDYZWWIMXJQRP2SIDZWLEQ, seg_pos={0 0}, upload=210518]: Uploading piece... Sep 16 13:01:29.359888874 (239h33m5.399462004s) [noise=true , address=45.91.116.6:4973 , piece_id=MN7NTMYZBCDPNZDAECURJIA354KOZAXGNGVNQPDLMEVIW2NAXRYQ, seg_pos={0 0}, upload=210518]: Uploading piece... Sep 16 13:01:29.360137819 (239h33m5.399710939s) [noise=true , address=45.91.116.9:4263 , piece_id=O5KZA56HEJAZ2GMDXVJHY6VZOIBJTYKEQM3KQDC7QN24KUG6L36A, seg_pos={0 0}, upload=210518]: Uploading piece... Sep 16 13:01:29.360487585 (239h33m5.400060705s) [noise=true , address=77.90.31.17:4771 , piece_id=SED26LOQBMQOWDUX3ZCUBMEQEWDYZJ5FYUBCT2BYKEPKAHNUW4WQ, seg_pos={0 0}, upload=210518]: Uploading piece... Sep 16 13:01:29.360849083 (239h33m5.400422213s) [noise=true , address=45.91.116.9:4262 , piece_id=OAQWNLIZ6WMQ7MJSWETVTZQBBZFP2AXS7F2XCWM3TU5N2VQKVFDA, seg_pos={0 0}, upload=210518]: Uploading piece... Sep 16 13:01:29.361167890 (239h33m5.40074101s) [noise=true , address=45.91.116.8:4047 , piece_id=NS6SXGFPIQP3NGHI3VIZFXDY52UROBCECLG7Q6BPLRCNZNMO5XXQ, seg_pos={0 0}, upload=210518]: Uploading piece... Sep 16 13:01:29.361511134 (239h33m5.401084264s) [noise=true , address=145.79.227.7:4294 , piece_id=RIOKUY2UR2MCX4ENNND6QHTQECTAUJWTWHAN5A52FCMIMRD6FOCQ, seg_pos={0 0}, upload=210518]: Uploading piece... Sep 16 13:01:29.361836965 (239h33m5.401410095s) [noise=true , address=145.79.227.18:4007 , piece_id=WUELI72JZO5UUATHB4SGABFD532OYZD2LDA7NMSP4NDVT7RWX5UQ, seg_pos={0 0}, upload=210518]: Uploading piece... Sep 16 13:01:29.374793637 (239h33m5.414366757s) [noise=true , address=45.91.116.7:4011 , piece_id=N3QGB7GYVRC7NEVFCCRLCCV56F4UQL4RZF6G7OPAGATEWHVATV5Q, seg_pos={0 0}, upload=210518]: Uploading piece... Sep 16 13:01:31.231121786 (239h33m7.270694916s) [upload=210518]: Next returned nil segment Sep 16 13:01:31.231144930 (239h33m7.270718061s) [upload=210518]: Waiting for error group managing segments... Sep 16 13:01:31.523710729 (239h33m7.563283849s) [noise=true , address=45.91.116.7:4011 , piece_id=N3QGB7GYVRC7NEVFCCRLCCV56F4UQL4RZF6G7OPAGATEWHVATV5Q, seg_pos={0 0}, upload=210518]: Done uploading piece. err: <nil> Sep 16 13:01:31.537114653 (239h33m7.576687783s) [noise=true , address=45.91.116.13:4154 , piece_id=F36B4RWFOKVVTM62EY53YSSE43GQ23GYPUH5RY554HKMF5QCHJRA, seg_pos={0 0}, upload=210518]: Done uploading piece. err: <nil> Sep 16 13:01:31.539073443 (239h33m7.578646573s) [noise=true , address=45.91.116.9:4261 , piece_id=YDSNJFYD4AY7AALFMPNTOIZRQG4HUFMXZ5OOLBU5Q6BJVHZ7GQRA, seg_pos={0 0}, upload=210518]: Done uploading piece. err: <nil> Sep 16 13:01:31.542925488 (239h33m7.582498608s) [noise=true , address=77.90.31.17:4771 , piece_id=SED26LOQBMQOWDUX3ZCUBMEQEWDYZJ5FYUBCT2BYKEPKAHNUW4WQ, seg_pos={0 0}, upload=210518]: Done uploading piece. err: <nil> Sep 16 13:01:31.546511667 (239h33m7.586084797s) [noise=true , address=45.91.116.5:4298 , piece_id=54ULT6MJVEYFBQGDARXQCLNRCJTJGY6EH5MH5BFL5EYOVG7A2J4A, seg_pos={0 0}, upload=210518]: Done uploading piece. err: <nil> Sep 16 13:01:31.566851018 (239h33m7.606424148s) [noise=true , address=45.91.116.9:4262 , piece_id=OAQWNLIZ6WMQ7MJSWETVTZQBBZFP2AXS7F2XCWM3TU5N2VQKVFDA, seg_pos={0 0}, upload=210518]: Done uploading piece. err: <nil> Sep 16 13:01:31.568454992 (239h33m7.608028122s) [noise=true , address=77.90.31.19:4841 , piece_id=2PSJ5U7KJVLRVWXOBB25H7ATIYBNCMEXJGGX45ACBXV4MIDSED2Q, seg_pos={0 0}, upload=210518]: Done uploading piece. err: <nil> Sep 16 13:01:31.572151712 (239h33m7.611724832s) [noise=true , address=45.91.116.8:4047 , piece_id=NS6SXGFPIQP3NGHI3VIZFXDY52UROBCECLG7Q6BPLRCNZNMO5XXQ, seg_pos={0 0}, upload=210518]: Done uploading piece. err: <nil> Sep 16 13:01:31.582427099 (239h33m7.622000219s) [noise=true , address=45.91.116.6:4973 , piece_id=MN7NTMYZBCDPNZDAECURJIA354KOZAXGNGVNQPDLMEVIW2NAXRYQ, seg_pos={0 0}, upload=210518]: Done uploading piece. err: <nil> Sep 16 13:01:31.588211493 (239h33m7.627784613s) [noise=true , address=45.91.116.4:4939 , piece_id=YKVCUASONMQKAOANYMWWZTSZ5XKIEMXDYZWWIMXJQRP2SIDZWLEQ, seg_pos={0 0}, upload=210518]: Done uploading piece. err: <nil> Sep 16 13:01:31.616209980 (239h33m7.65578311s) [noise=true , address=45.91.116.10:4082 , piece_id=XMOW3RJWTZ4WHT466ACGYZK5HJASH6Q7AKNA7OCCWXM2MZOR7J4A, seg_pos={0 0}, upload=210518]: Done uploading piece. err: <nil> Sep 16 13:01:31.617690078 (239h33m7.657263198s) [noise=true , address=45.91.116.9:4263 , piece_id=O5KZA56HEJAZ2GMDXVJHY6VZOIBJTYKEQM3KQDC7QN24KUG6L36A, seg_pos={0 0}, upload=210518]: Done uploading piece. err: <nil> Sep 16 13:01:58.342092213 (239h33m34.381665333s) [noise=true , address=145.79.227.7:4294 , piece_id=RIOKUY2UR2MCX4ENNND6QHTQECTAUJWTWHAN5A52FCMIMRD6FOCQ, seg_pos={0 0}, upload=210518]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:47860->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:47860->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47860->145.79.227.7:4294: use of closed network connection Sep 16 13:01:58.342140524 (239h33m34.381713644s) [noise=true , address=145.79.227.18:4007 , piece_id=WUELI72JZO5UUATHB4SGABFD532OYZD2LDA7NMSP4NDVT7RWX5UQ, seg_pos={0 0}, upload=210518]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:36208->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:36208->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36208->145.79.227.18:4007: use of closed network connection Sep 16 13:01:58.342223653 (239h33m34.381796783s) [noise=true , address=145.79.227.2:4113 , piece_id=4HAFKBP6U5TRSSXYT5XQIWLC6QEVVWL74S5X4ZF5TQDKDMVXECIQ, seg_pos={0 0}, upload=210518]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: write tcp 188.166.225.170:49962->145.79.227.2:4113: use of closed network connection; write tcp 188.166.225.170:49962->145.79.227.2:4113: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49962->145.79.227.2:4113: use of closed network connection Sep 16 13:01:58.342449182 (239h33m34.382022312s) [noise=true , address=145.79.227.3:4151 , piece_id=RNERVEBJJLCBBFXO6HT5NV6IPC3NNCZLPEPAKWBZDQP3M5LK5NFQ, seg_pos={0 0}, upload=210518]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:56894->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:56894->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56894->145.79.227.3:4151: use of closed network connection Sep 16 13:01:58.342483487 (239h33m34.382056608s) [seg_pos={0 0}, upload=210518]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 16 13:01:58.624520116 (239h33m34.664093246s) [upload=210518]: Done uploading segments... Sep 16 13:01:58.624550373 (239h33m34.664123493s) [upload=210518]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.284149104s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.063594368s FAIL (2025-09-16 13:01:42 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== JFA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422604190 (238h59m45.46217732s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422896808 (238h59m45.462469928s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423232478 (238h59m45.462805608s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423565571 (238h59m45.463138691s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423935696 (238h59m45.463508826s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424280403 (238h59m45.463853533s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424633305 (238h59m45.464206435s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424994342 (238h59m45.464567472s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425341152 (238h59m45.464914282s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425707831 (238h59m45.465280951s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.426034432 (238h59m45.465607562s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429082236 (238h59m45.468655366s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429521483 (238h59m45.469094613s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:10.278696743 (238h59m46.318269863s) [upload=210063]: Next returned nil segment Sep 16 12:28:10.278720237 (238h59m46.318293367s) [upload=210063]: Waiting for error group managing segments... Sep 16 12:28:10.652409183 (238h59m46.691982303s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.662938092 (238h59m46.702511222s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.670032272 (238h59m46.709605402s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.701595607 (238h59m46.741168737s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.704157255 (238h59m46.743730385s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.707972140 (238h59m46.74754527s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.708523660 (238h59m46.74809678s) [noise=true , address=89.149.201.147:4007 , piece_id=BOQVD3EW5UAYWKEZ5FWC2QCDGIROAEOQN2OEYQ4QACNVDEIFF2IA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.754549157 (238h59m46.794122277s) [noise=true , address=89.149.201.147:4010 , piece_id=OALYBM6QEAOKMQPP2R3Y7LBVOEJYPMTBHJTGE2DSRO3KLRGBZC3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.138412786 (238h59m47.177985916s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.163219826 (238h59m47.202792956s) [noise=true , address=81.171.14.70:4039 , piece_id=IMLIU4QCGFNXWATVWK4L7FZPWOVPCRXNH4F3HSMF5VLQZJUEBO3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.169643348 (238h59m47.209216478s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.231770296 (238h59m47.271343416s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.258046263 (238h59m47.297619383s) [noise=true , address=185.167.204.205:4034 , piece_id=FUHHRFVDRYETJRWVBQZRALI4UGKDQ6DXV7TDKXBRASOMGOEN6YOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.263155884 (238h59m47.302729004s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.269762875 (238h59m47.309336005s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.281404505 (238h59m47.320977635s) [noise=true , address=185.167.204.205:4027 , piece_id=3O5SOEMEXYDYR5OE6SZJ2AVVLNYG4V4IMZOFUL7XDJEZUHDUV5TA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.289386705 (238h59m47.328959825s) [noise=true , address=185.167.204.206:4063 , piece_id=ERJLEJ5EILBCN4WUPZBVYSB2CGDWORVZ3GASSXBVNGR25GWVFYOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.298140815 (238h59m47.337713945s) [noise=true , address=185.167.204.206:4043 , piece_id=LDZTOC67YHM344PUCLVJ7RMKQAYJAQJ4GMKYZNN5LLU5KIUQCW7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.311391579 (238h59m47.350964709s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.317381906 (238h59m47.356955036s) [noise=true , address=185.167.204.206:4065 , piece_id=UXYM6MEGCQFRRRSMGI5XKJJJ6GYW7IJXG5QDGMICLP3FNJDSFRSQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.318355050 (238h59m47.35792818s) [noise=true , address=185.167.204.205:4018 , piece_id=VZP55ZA5Y5IA2PUH75QDVB56UHRJJ2XNC75L5WCRUSHGHQGZ463A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.330083334 (238h59m47.369656464s) [noise=true , address=185.167.204.206:4052 , piece_id=CDKZXVC22A62STE3NYD4R2TWT3AF45U2A7MHEIQJPTNMUKBVFJFA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.331429858 (238h59m47.371002988s) [noise=true , address=185.167.204.205:4035 , piece_id=M6LWKXSTJHGHXHY4VEJ2IGLI2UX4IIZV5KD4A6YY3BMIQ6ZRBMAQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.341689555 (238h59m47.381262686s) [noise=true , address=185.167.204.205:4014 , piece_id=MDSUAX4XNI5INUUQCMAP26PQFV62U3TZ2OITZR3BSNDQLHWEOKIA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.346694947 (238h59m47.386268077s) [noise=true , address=185.167.204.205:4023 , piece_id=YNW6TYPAVMYIHD5BT6QZGJJAGDM2XSZ4QYX4C2TH5QRGNTNP4KUQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363156895 (238h59m47.402730015s) [noise=true , address=185.167.204.206:4059 , piece_id=IX3H3WSLKDNPCCA5NMFUGMO2P6CA274AEUXLGVA3WRGJM3SN2OZQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363183276 (238h59m47.402756406s) [seg_pos={0 0}, upload=210063]: Segment reached optimal threshold of 26 pieces. Sep 16 12:28:11.363333942 (238h59m47.402907072s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363361435 (238h59m47.402934565s) [noise=true , address=185.167.204.206:4066 , piece_id=XXWYU36QFNZ2HCZF2WGAG4LKIBE3GCCKNVBDV6N5RQMCDJJXJULQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: expected piece hash; context canceled; EOF Sep 16 12:28:11.363393326 (238h59m47.402966456s) [seg_pos={0 0}, upload=210063]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil> Sep 16 12:28:11.363496222 (238h59m47.403069362s) [upload=210063]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 16 12:28:11.363503285 (238h59m47.403076405s) [upload=210063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 16 12:28:11.633947931 (238h59m47.673521071s) [upload=210063]: Done uploading segments... Sep 16 12:28:11.633974231 (238h59m47.673547372s) [upload=210063]: Upload finished. err: <nil> Duration: 5.063633053s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 26 out of 60 is failed (threshold=3) [.........X......X.X.......XXXX.XX.XXXXXX..XX.XXX..XX.X.X.XX.] duration: 6.792499913s FAIL (2025-09-16 13:01:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 16 13:00:33.639936317 (239h32m9.679509457s) [upload=210506]: Starting upload Sep 16 13:00:33.640042980 (239h32m9.67961611s) [upload=210506]: Done starting upload Sep 16 13:00:33.640497606 (239h32m9.680070736s) [upload=210506]: Uploading segments... Sep 16 13:00:33.640561328 (239h32m9.680134458s) [upload=210506]: Got next segment. Inline: false Sep 16 13:00:33.640608136 (239h32m9.680181266s) [upload=210506]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 16 13:00:33.640614889 (239h32m9.680188019s) [upload=210506]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 16 13:00:33.897425831 (239h32m9.936998961s) [seg_pos={0 0}, upload=210506]: Begin upload segment... Sep 16 13:00:33.897488621 (239h32m9.937061751s) [seg_pos={0 0}, upload=210506]: Done begin upload segment. Sep 16 13:00:33.897525982 (239h32m9.937099112s) [noise=true , address=45.91.116.13:4153 , piece_id=5YTCKWPUPJTEOOZGB4MSZEQVZVE65GJKPFJRGNIGRI3NS3HTRSGQ, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.897553675 (239h32m9.937126805s) [noise=true , address=145.79.227.15:4876 , piece_id=2NMDEBGXRZIBJQDUOUNBR56LNYZZY2PKFWCPXWPEMYNMRWFBDTJA, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.898132446 (239h32m9.937705576s) [noise=true , address=145.79.227.2:4114 , piece_id=WYRU4Q2YEDONBX2XEONAE5MJB3VY3YMXTBOBQWGYGU2UVL4CYBOQ, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.898179547 (239h32m9.937752677s) [noise=true , address=45.91.116.14:4191 , piece_id=LDMDL5E6VNAEDT5BKCU4HU22TEEDYR5FDXFYUB3SXNQ4BIU65VVQ, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.898476742 (239h32m9.938049872s) [noise=true , address=45.91.116.7:4010 , piece_id=UGXEF43PWGLF753T2HCTB26WOMCPDTFA4EHOBZQBZJAMZ7NX7GNQ, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.898540924 (239h32m9.938114054s) [noise=true , address=45.91.116.7:4011 , piece_id=26RC4F4NH2TO37LOEY6LHJDVAZVWEWS2LPXH3MELBHUWOVRCHRUQ, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.898806210 (239h32m9.93837934s) [noise=true , address=77.90.31.11:4553 , piece_id=73IX2QNLIEPRYTYV5CVV6466BYCEO625676BFUAFFJFC4Q3RBSWA, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.898915187 (239h32m9.938488317s) [noise=true , address=45.91.116.6:4973 , piece_id=DR6GTV334243GCJU2BZVKFJXBNIIDIFLPXWHDZP4J33QYNJ2PBMA, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.899365725 (239h32m9.938938855s) [noise=true , address=77.90.31.21:4879 , piece_id=QKUP46YGMZHIGSXWAJMBHWL27ODKGGXJZGSRGXUNT5WNGNHVF4PQ, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.899842203 (239h32m9.939415333s) [noise=true , address=45.91.116.8:4045 , piece_id=FTVLG6RNCUUBOIKL5QQPTLK4DOXHNAELPLQUS7KOUBFFOAICPO6Q, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.900285216 (239h32m9.939858356s) [noise=true , address=145.79.227.11:4730 , piece_id=SLBHAUKSJYYK54WEL2QB35FBOJSFDV4GI5CV4ICK3CWIBAVF2ONA, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.900855202 (239h32m9.940428322s) [noise=true , address=77.90.31.16:4734 , piece_id=KRFHJULQGK2WHJRZ4R5Z7L4SRGPN72K2AYPPZUSNKYCIJFY56QOA, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.901517743 (239h32m9.941090873s) [noise=true , address=45.91.116.9:4262 , piece_id=ZCDBPWF24DZRXVCLRY4ZOIWG66Z73Z3JRJWSZ4F6QNKZYKIKQYIQ, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.901937643 (239h32m9.941510773s) [noise=true , address=145.79.227.14:4840 , piece_id=VOJM27SDPYFWJIUVQYA3PLFDNBLLJNYNGDMRPLA6QMZSPQGLB7XA, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.908498075 (239h32m9.948071205s) [noise=true , address=45.91.116.4:4939 , piece_id=ASIWHOFIIIBN7M5N3XL3S3ZVVTHUG4MIRLNOHW5JXMMD2DEOTXEQ, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.910980081 (239h32m9.950553211s) [noise=true , address=45.91.116.10:4081 , piece_id=QYTHELQNS4XU2ZSWUGYONF3WURXE5DGXU6JJ5PQ2LTY74DJCC76Q, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:35.671800248 (239h32m11.711373378s) [upload=210506]: Next returned nil segment Sep 16 13:00:35.671819053 (239h32m11.711392173s) [upload=210506]: Waiting for error group managing segments... Sep 16 13:00:36.099053954 (239h32m12.138627084s) [noise=true , address=77.90.31.11:4553 , piece_id=73IX2QNLIEPRYTYV5CVV6466BYCEO625676BFUAFFJFC4Q3RBSWA, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:00:36.121670753 (239h32m12.161243883s) [noise=true , address=45.91.116.4:4939 , piece_id=ASIWHOFIIIBN7M5N3XL3S3ZVVTHUG4MIRLNOHW5JXMMD2DEOTXEQ, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:00:36.148550638 (239h32m12.188123768s) [noise=true , address=45.91.116.10:4081 , piece_id=QYTHELQNS4XU2ZSWUGYONF3WURXE5DGXU6JJ5PQ2LTY74DJCC76Q, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:00:36.170737718 (239h32m12.210310848s) [noise=true , address=45.91.116.7:4011 , piece_id=26RC4F4NH2TO37LOEY6LHJDVAZVWEWS2LPXH3MELBHUWOVRCHRUQ, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:00:36.171742161 (239h32m12.211315291s) [noise=true , address=45.91.116.14:4191 , piece_id=LDMDL5E6VNAEDT5BKCU4HU22TEEDYR5FDXFYUB3SXNQ4BIU65VVQ, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:00:36.172053794 (239h32m12.211626924s) [noise=true , address=45.91.116.7:4010 , piece_id=UGXEF43PWGLF753T2HCTB26WOMCPDTFA4EHOBZQBZJAMZ7NX7GNQ, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:00:36.186773695 (239h32m12.226346825s) [noise=true , address=45.91.116.9:4262 , piece_id=ZCDBPWF24DZRXVCLRY4ZOIWG66Z73Z3JRJWSZ4F6QNKZYKIKQYIQ, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:00:36.215324333 (239h32m12.254897473s) [noise=true , address=45.91.116.6:4973 , piece_id=DR6GTV334243GCJU2BZVKFJXBNIIDIFLPXWHDZP4J33QYNJ2PBMA, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:00:36.222447367 (239h32m12.262020497s) [noise=true , address=77.90.31.21:4879 , piece_id=QKUP46YGMZHIGSXWAJMBHWL27ODKGGXJZGSRGXUNT5WNGNHVF4PQ, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:00:36.240324700 (239h32m12.27989783s) [noise=true , address=77.90.31.16:4734 , piece_id=KRFHJULQGK2WHJRZ4R5Z7L4SRGPN72K2AYPPZUSNKYCIJFY56QOA, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:00:36.293686444 (239h32m12.333259594s) [noise=true , address=45.91.116.8:4045 , piece_id=FTVLG6RNCUUBOIKL5QQPTLK4DOXHNAELPLQUS7KOUBFFOAICPO6Q, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:00:36.305774472 (239h32m12.345347602s) [noise=true , address=45.91.116.13:4153 , piece_id=5YTCKWPUPJTEOOZGB4MSZEQVZVE65GJKPFJRGNIGRI3NS3HTRSGQ, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:01:02.917215289 (239h32m38.956788409s) [noise=true , address=145.79.227.14:4840 , piece_id=VOJM27SDPYFWJIUVQYA3PLFDNBLLJNYNGDMRPLA6QMZSPQGLB7XA, seg_pos={0 0}, upload=210506]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 188.166.225.170:40026->145.79.227.14:4840: use of closed network connection; write tcp 188.166.225.170:40026->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40026->145.79.227.14:4840: use of closed network connection Sep 16 13:01:02.917345045 (239h32m38.956918176s) [noise=true , address=145.79.227.2:4114 , piece_id=WYRU4Q2YEDONBX2XEONAE5MJB3VY3YMXTBOBQWGYGU2UVL4CYBOQ, seg_pos={0 0}, upload=210506]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:60792->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:60792->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60792->145.79.227.2:4114: use of closed network connection Sep 16 13:01:02.917354634 (239h32m38.956927765s) [noise=true , address=145.79.227.11:4730 , piece_id=SLBHAUKSJYYK54WEL2QB35FBOJSFDV4GI5CV4ICK3CWIBAVF2ONA, seg_pos={0 0}, upload=210506]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:57970->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:57970->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57970->145.79.227.11:4730: use of closed network connection Sep 16 13:01:02.917402545 (239h32m38.956975675s) [noise=true , address=145.79.227.15:4876 , piece_id=2NMDEBGXRZIBJQDUOUNBR56LNYZZY2PKFWCPXWPEMYNMRWFBDTJA, seg_pos={0 0}, upload=210506]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: write tcp 188.166.225.170:42100->145.79.227.15:4876: use of closed network connection; write tcp 188.166.225.170:42100->145.79.227.15:4876: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42100->145.79.227.15:4876: use of closed network connection Sep 16 13:01:02.917434025 (239h32m38.957007155s) [seg_pos={0 0}, upload=210506]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 16 13:01:03.273083931 (239h32m39.312657072s) [upload=210506]: Done uploading segments... Sep 16 13:01:03.273123056 (239h32m39.312696186s) [upload=210506]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.79253515s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 4.974709469s FAIL (2025-09-16 13:01:10 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== JFA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422604190 (238h59m45.46217732s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422896808 (238h59m45.462469928s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423232478 (238h59m45.462805608s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423565571 (238h59m45.463138691s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423935696 (238h59m45.463508826s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424280403 (238h59m45.463853533s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424633305 (238h59m45.464206435s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424994342 (238h59m45.464567472s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425341152 (238h59m45.464914282s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425707831 (238h59m45.465280951s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.426034432 (238h59m45.465607562s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429082236 (238h59m45.468655366s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429521483 (238h59m45.469094613s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:10.278696743 (238h59m46.318269863s) [upload=210063]: Next returned nil segment Sep 16 12:28:10.278720237 (238h59m46.318293367s) [upload=210063]: Waiting for error group managing segments... Sep 16 12:28:10.652409183 (238h59m46.691982303s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.662938092 (238h59m46.702511222s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.670032272 (238h59m46.709605402s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.701595607 (238h59m46.741168737s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.704157255 (238h59m46.743730385s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.707972140 (238h59m46.74754527s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.708523660 (238h59m46.74809678s) [noise=true , address=89.149.201.147:4007 , piece_id=BOQVD3EW5UAYWKEZ5FWC2QCDGIROAEOQN2OEYQ4QACNVDEIFF2IA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.754549157 (238h59m46.794122277s) [noise=true , address=89.149.201.147:4010 , piece_id=OALYBM6QEAOKMQPP2R3Y7LBVOEJYPMTBHJTGE2DSRO3KLRGBZC3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.138412786 (238h59m47.177985916s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.163219826 (238h59m47.202792956s) [noise=true , address=81.171.14.70:4039 , piece_id=IMLIU4QCGFNXWATVWK4L7FZPWOVPCRXNH4F3HSMF5VLQZJUEBO3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.169643348 (238h59m47.209216478s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.231770296 (238h59m47.271343416s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.258046263 (238h59m47.297619383s) [noise=true , address=185.167.204.205:4034 , piece_id=FUHHRFVDRYETJRWVBQZRALI4UGKDQ6DXV7TDKXBRASOMGOEN6YOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.263155884 (238h59m47.302729004s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.269762875 (238h59m47.309336005s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.281404505 (238h59m47.320977635s) [noise=true , address=185.167.204.205:4027 , piece_id=3O5SOEMEXYDYR5OE6SZJ2AVVLNYG4V4IMZOFUL7XDJEZUHDUV5TA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.289386705 (238h59m47.328959825s) [noise=true , address=185.167.204.206:4063 , piece_id=ERJLEJ5EILBCN4WUPZBVYSB2CGDWORVZ3GASSXBVNGR25GWVFYOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.298140815 (238h59m47.337713945s) [noise=true , address=185.167.204.206:4043 , piece_id=LDZTOC67YHM344PUCLVJ7RMKQAYJAQJ4GMKYZNN5LLU5KIUQCW7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.311391579 (238h59m47.350964709s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.317381906 (238h59m47.356955036s) [noise=true , address=185.167.204.206:4065 , piece_id=UXYM6MEGCQFRRRSMGI5XKJJJ6GYW7IJXG5QDGMICLP3FNJDSFRSQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.318355050 (238h59m47.35792818s) [noise=true , address=185.167.204.205:4018 , piece_id=VZP55ZA5Y5IA2PUH75QDVB56UHRJJ2XNC75L5WCRUSHGHQGZ463A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.330083334 (238h59m47.369656464s) [noise=true , address=185.167.204.206:4052 , piece_id=CDKZXVC22A62STE3NYD4R2TWT3AF45U2A7MHEIQJPTNMUKBVFJFA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.331429858 (238h59m47.371002988s) [noise=true , address=185.167.204.205:4035 , piece_id=M6LWKXSTJHGHXHY4VEJ2IGLI2UX4IIZV5KD4A6YY3BMIQ6ZRBMAQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.341689555 (238h59m47.381262686s) [noise=true , address=185.167.204.205:4014 , piece_id=MDSUAX4XNI5INUUQCMAP26PQFV62U3TZ2OITZR3BSNDQLHWEOKIA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.346694947 (238h59m47.386268077s) [noise=true , address=185.167.204.205:4023 , piece_id=YNW6TYPAVMYIHD5BT6QZGJJAGDM2XSZ4QYX4C2TH5QRGNTNP4KUQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363156895 (238h59m47.402730015s) [noise=true , address=185.167.204.206:4059 , piece_id=IX3H3WSLKDNPCCA5NMFUGMO2P6CA274AEUXLGVA3WRGJM3SN2OZQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363183276 (238h59m47.402756406s) [seg_pos={0 0}, upload=210063]: Segment reached optimal threshold of 26 pieces. Sep 16 12:28:11.363333942 (238h59m47.402907072s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363361435 (238h59m47.402934565s) [noise=true , address=185.167.204.206:4066 , piece_id=XXWYU36QFNZ2HCZF2WGAG4LKIBE3GCCKNVBDV6N5RQMCDJJXJULQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: expected piece hash; context canceled; EOF Sep 16 12:28:11.363393326 (238h59m47.402966456s) [seg_pos={0 0}, upload=210063]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil> Sep 16 12:28:11.363496222 (238h59m47.403069362s) [upload=210063]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 16 12:28:11.363503285 (238h59m47.403076405s) [upload=210063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 16 12:28:11.633947931 (238h59m47.673521071s) [upload=210063]: Done uploading segments... Sep 16 12:28:11.633974231 (238h59m47.673547372s) [upload=210063]: Upload finished. err: <nil> Duration: 4.974761789s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 26 out of 60 is failed (threshold=3) [..........X......X.X.......XXXX.XX.XXXXXX..XX.XXX..XX.X.X.XX] duration: 30.3612079s FAIL (2025-09-16 13:01:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 16 13:00:33.639936317 (239h32m9.679509457s) [upload=210506]: Starting upload Sep 16 13:00:33.640042980 (239h32m9.67961611s) [upload=210506]: Done starting upload Sep 16 13:00:33.640497606 (239h32m9.680070736s) [upload=210506]: Uploading segments... Sep 16 13:00:33.640561328 (239h32m9.680134458s) [upload=210506]: Got next segment. Inline: false Sep 16 13:00:33.640608136 (239h32m9.680181266s) [upload=210506]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 16 13:00:33.640614889 (239h32m9.680188019s) [upload=210506]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 16 13:00:33.897425831 (239h32m9.936998961s) [seg_pos={0 0}, upload=210506]: Begin upload segment... Sep 16 13:00:33.897488621 (239h32m9.937061751s) [seg_pos={0 0}, upload=210506]: Done begin upload segment. Sep 16 13:00:33.897525982 (239h32m9.937099112s) [noise=true , address=45.91.116.13:4153 , piece_id=5YTCKWPUPJTEOOZGB4MSZEQVZVE65GJKPFJRGNIGRI3NS3HTRSGQ, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.897553675 (239h32m9.937126805s) [noise=true , address=145.79.227.15:4876 , piece_id=2NMDEBGXRZIBJQDUOUNBR56LNYZZY2PKFWCPXWPEMYNMRWFBDTJA, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.898132446 (239h32m9.937705576s) [noise=true , address=145.79.227.2:4114 , piece_id=WYRU4Q2YEDONBX2XEONAE5MJB3VY3YMXTBOBQWGYGU2UVL4CYBOQ, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.898179547 (239h32m9.937752677s) [noise=true , address=45.91.116.14:4191 , piece_id=LDMDL5E6VNAEDT5BKCU4HU22TEEDYR5FDXFYUB3SXNQ4BIU65VVQ, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.898476742 (239h32m9.938049872s) [noise=true , address=45.91.116.7:4010 , piece_id=UGXEF43PWGLF753T2HCTB26WOMCPDTFA4EHOBZQBZJAMZ7NX7GNQ, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.898540924 (239h32m9.938114054s) [noise=true , address=45.91.116.7:4011 , piece_id=26RC4F4NH2TO37LOEY6LHJDVAZVWEWS2LPXH3MELBHUWOVRCHRUQ, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.898806210 (239h32m9.93837934s) [noise=true , address=77.90.31.11:4553 , piece_id=73IX2QNLIEPRYTYV5CVV6466BYCEO625676BFUAFFJFC4Q3RBSWA, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.898915187 (239h32m9.938488317s) [noise=true , address=45.91.116.6:4973 , piece_id=DR6GTV334243GCJU2BZVKFJXBNIIDIFLPXWHDZP4J33QYNJ2PBMA, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.899365725 (239h32m9.938938855s) [noise=true , address=77.90.31.21:4879 , piece_id=QKUP46YGMZHIGSXWAJMBHWL27ODKGGXJZGSRGXUNT5WNGNHVF4PQ, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.899842203 (239h32m9.939415333s) [noise=true , address=45.91.116.8:4045 , piece_id=FTVLG6RNCUUBOIKL5QQPTLK4DOXHNAELPLQUS7KOUBFFOAICPO6Q, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.900285216 (239h32m9.939858356s) [noise=true , address=145.79.227.11:4730 , piece_id=SLBHAUKSJYYK54WEL2QB35FBOJSFDV4GI5CV4ICK3CWIBAVF2ONA, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.900855202 (239h32m9.940428322s) [noise=true , address=77.90.31.16:4734 , piece_id=KRFHJULQGK2WHJRZ4R5Z7L4SRGPN72K2AYPPZUSNKYCIJFY56QOA, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.901517743 (239h32m9.941090873s) [noise=true , address=45.91.116.9:4262 , piece_id=ZCDBPWF24DZRXVCLRY4ZOIWG66Z73Z3JRJWSZ4F6QNKZYKIKQYIQ, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.901937643 (239h32m9.941510773s) [noise=true , address=145.79.227.14:4840 , piece_id=VOJM27SDPYFWJIUVQYA3PLFDNBLLJNYNGDMRPLA6QMZSPQGLB7XA, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.908498075 (239h32m9.948071205s) [noise=true , address=45.91.116.4:4939 , piece_id=ASIWHOFIIIBN7M5N3XL3S3ZVVTHUG4MIRLNOHW5JXMMD2DEOTXEQ, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:33.910980081 (239h32m9.950553211s) [noise=true , address=45.91.116.10:4081 , piece_id=QYTHELQNS4XU2ZSWUGYONF3WURXE5DGXU6JJ5PQ2LTY74DJCC76Q, seg_pos={0 0}, upload=210506]: Uploading piece... Sep 16 13:00:35.671800248 (239h32m11.711373378s) [upload=210506]: Next returned nil segment Sep 16 13:00:35.671819053 (239h32m11.711392173s) [upload=210506]: Waiting for error group managing segments... Sep 16 13:00:36.099053954 (239h32m12.138627084s) [noise=true , address=77.90.31.11:4553 , piece_id=73IX2QNLIEPRYTYV5CVV6466BYCEO625676BFUAFFJFC4Q3RBSWA, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:00:36.121670753 (239h32m12.161243883s) [noise=true , address=45.91.116.4:4939 , piece_id=ASIWHOFIIIBN7M5N3XL3S3ZVVTHUG4MIRLNOHW5JXMMD2DEOTXEQ, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:00:36.148550638 (239h32m12.188123768s) [noise=true , address=45.91.116.10:4081 , piece_id=QYTHELQNS4XU2ZSWUGYONF3WURXE5DGXU6JJ5PQ2LTY74DJCC76Q, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:00:36.170737718 (239h32m12.210310848s) [noise=true , address=45.91.116.7:4011 , piece_id=26RC4F4NH2TO37LOEY6LHJDVAZVWEWS2LPXH3MELBHUWOVRCHRUQ, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:00:36.171742161 (239h32m12.211315291s) [noise=true , address=45.91.116.14:4191 , piece_id=LDMDL5E6VNAEDT5BKCU4HU22TEEDYR5FDXFYUB3SXNQ4BIU65VVQ, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:00:36.172053794 (239h32m12.211626924s) [noise=true , address=45.91.116.7:4010 , piece_id=UGXEF43PWGLF753T2HCTB26WOMCPDTFA4EHOBZQBZJAMZ7NX7GNQ, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:00:36.186773695 (239h32m12.226346825s) [noise=true , address=45.91.116.9:4262 , piece_id=ZCDBPWF24DZRXVCLRY4ZOIWG66Z73Z3JRJWSZ4F6QNKZYKIKQYIQ, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:00:36.215324333 (239h32m12.254897473s) [noise=true , address=45.91.116.6:4973 , piece_id=DR6GTV334243GCJU2BZVKFJXBNIIDIFLPXWHDZP4J33QYNJ2PBMA, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:00:36.222447367 (239h32m12.262020497s) [noise=true , address=77.90.31.21:4879 , piece_id=QKUP46YGMZHIGSXWAJMBHWL27ODKGGXJZGSRGXUNT5WNGNHVF4PQ, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:00:36.240324700 (239h32m12.27989783s) [noise=true , address=77.90.31.16:4734 , piece_id=KRFHJULQGK2WHJRZ4R5Z7L4SRGPN72K2AYPPZUSNKYCIJFY56QOA, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:00:36.293686444 (239h32m12.333259594s) [noise=true , address=45.91.116.8:4045 , piece_id=FTVLG6RNCUUBOIKL5QQPTLK4DOXHNAELPLQUS7KOUBFFOAICPO6Q, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:00:36.305774472 (239h32m12.345347602s) [noise=true , address=45.91.116.13:4153 , piece_id=5YTCKWPUPJTEOOZGB4MSZEQVZVE65GJKPFJRGNIGRI3NS3HTRSGQ, seg_pos={0 0}, upload=210506]: Done uploading piece. err: <nil> Sep 16 13:01:02.917215289 (239h32m38.956788409s) [noise=true , address=145.79.227.14:4840 , piece_id=VOJM27SDPYFWJIUVQYA3PLFDNBLLJNYNGDMRPLA6QMZSPQGLB7XA, seg_pos={0 0}, upload=210506]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 188.166.225.170:40026->145.79.227.14:4840: use of closed network connection; write tcp 188.166.225.170:40026->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40026->145.79.227.14:4840: use of closed network connection Sep 16 13:01:02.917345045 (239h32m38.956918176s) [noise=true , address=145.79.227.2:4114 , piece_id=WYRU4Q2YEDONBX2XEONAE5MJB3VY3YMXTBOBQWGYGU2UVL4CYBOQ, seg_pos={0 0}, upload=210506]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:60792->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:60792->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60792->145.79.227.2:4114: use of closed network connection Sep 16 13:01:02.917354634 (239h32m38.956927765s) [noise=true , address=145.79.227.11:4730 , piece_id=SLBHAUKSJYYK54WEL2QB35FBOJSFDV4GI5CV4ICK3CWIBAVF2ONA, seg_pos={0 0}, upload=210506]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:57970->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:57970->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57970->145.79.227.11:4730: use of closed network connection Sep 16 13:01:02.917402545 (239h32m38.956975675s) [noise=true , address=145.79.227.15:4876 , piece_id=2NMDEBGXRZIBJQDUOUNBR56LNYZZY2PKFWCPXWPEMYNMRWFBDTJA, seg_pos={0 0}, upload=210506]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: write tcp 188.166.225.170:42100->145.79.227.15:4876: use of closed network connection; write tcp 188.166.225.170:42100->145.79.227.15:4876: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42100->145.79.227.15:4876: use of closed network connection Sep 16 13:01:02.917434025 (239h32m38.957007155s) [seg_pos={0 0}, upload=210506]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 16 13:01:03.273083931 (239h32m39.312657072s) [upload=210506]: Done uploading segments... Sep 16 13:01:03.273123056 (239h32m39.312696186s) [upload=210506]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.361231264s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 30 out of 60 is failed (threshold=3) [..........................X.X..XXX.XXXXXXXXXXXXXXXXXXXXXXXXX] duration: 1m0.268612884s FAIL (2025-09-16 13:01:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== :4706 , piece_id=5J65NEZLBSWQ3OTYVKF5J7IK6UXRKUG6XA4KGREOSGDDASJ5TTVA, seg_pos={0 0}, upload=210496]: Uploading piece... Sep 16 13:00:01.772760792 (239h31m37.812333932s) [noise=true , address=145.79.227.24:4601 , piece_id=DH6VGEQQ2YQVAXROBD5BLIK7LVC3XUG4SV4YG7OW6GDQ3WLU7ZXQ, seg_pos={0 0}, upload=210496]: Uploading piece... Sep 16 13:00:01.773431499 (239h31m37.813004639s) [noise=true , address=145.79.227.11:4745 , piece_id=AE7YT3FLI5IXPLEDNH7VIM5UKOADFEFLUDSUARP2376DAP44CONA, seg_pos={0 0}, upload=210496]: Uploading piece... Sep 16 13:00:01.774175637 (239h31m37.813748787s) [noise=true , address=145.79.227.6:4266 , piece_id=II7SAZAE6QXS7WEEEO7FZJYULD5ETE4XIWZTWHWTPKNM4777NSSA, seg_pos={0 0}, upload=210496]: Uploading piece... Sep 16 13:00:01.774852936 (239h31m37.814426076s) [noise=true , address=145.79.227.35:4484 , piece_id=ADOL7IYFABTQLX644LN5OAFBILSGLPOVJHE7NAUGJA2JM6WTRYDA, seg_pos={0 0}, upload=210496]: Uploading piece... Sep 16 13:00:01.775556356 (239h31m37.815129496s) [noise=true , address=145.79.227.26:4664 , piece_id=VRHTGFS3XTLVF6DKVU5GBHW2O4INA5MP3VVV2XAYXLXUOGR4QNKA, seg_pos={0 0}, upload=210496]: Uploading piece... Sep 16 13:00:01.776276386 (239h31m37.815849527s) [noise=true , address=77.90.31.11:4564 , piece_id=SAEDDGUAJ3INOSF225CAVW7EKUBRZYQTK36EGCMS6J3FGUW7ZDGQ, seg_pos={0 0}, upload=210496]: Uploading piece... Sep 16 13:00:01.777024902 (239h31m37.816598042s) [noise=true , address=145.79.227.5:4253 , piece_id=PX46QEPX4S7UW654Q2UVL7TKY62B6CGMXHDU4YMYRGWE6BWV4ZUA, seg_pos={0 0}, upload=210496]: Uploading piece... Sep 16 13:00:01.778021550 (239h31m37.817594691s) [noise=true , address=145.79.227.49:4368 , piece_id=JYYGOOUPH2OTDK6PC4ERABWVXTEN6AAGR3WESHY2N6TEV2QXAJJA, seg_pos={0 0}, upload=210496]: Uploading piece... Sep 16 13:00:01.778693530 (239h31m37.81826666s) [noise=true , address=145.79.227.23:4578 , piece_id=BEKV2RQPZTKKUVCSGOHV6OKBKWPDN527U4QG6ACPYS3AOCLM6BKA, seg_pos={0 0}, upload=210496]: Uploading piece... Sep 16 13:00:01.779291668 (239h31m37.818864799s) [noise=true , address=145.79.227.46:4624 , piece_id=LXBBKQIML5MZOZQEUYHFVAUROIVWLJNYXSGLEEBRS4PE4ZCHMXRA, seg_pos={0 0}, upload=210496]: Uploading piece... Sep 16 13:00:01.779734272 (239h31m37.819307402s) [noise=true , address=145.79.227.10:4418 , piece_id=UALY7IVMJGJ24XZ5PMIFEXVBKAB75SM33T7MPZHLW3PWAFKYISYA, seg_pos={0 0}, upload=210496]: Uploading piece... Sep 16 13:00:01.780185270 (239h31m37.81975841s) [noise=true , address=145.79.227.34:4930 , piece_id=TMZMXTE5P364AYHFDBKS3FO52G6FYNICC3MJULN6APZ2GLUKXSHQ, seg_pos={0 0}, upload=210496]: Uploading piece... Sep 16 13:00:01.785248703 (239h31m37.824821853s) [noise=true , address=145.79.227.16:4937 , piece_id=EIG6QJV5ETSU6AOYQR4NDNC2BX5OUS7UKVMY2QGPF6CGDZYEOABA, seg_pos={0 0}, upload=210496]: Uploading piece... Sep 16 13:00:01.786016094 (239h31m37.825589234s) [noise=true , address=145.79.227.7:4319 , piece_id=ZQVUBBHWAC3WDMFBZO7UGKP2LS3MK3XDIMYGUHO3MYYZHMRFPKJQ, seg_pos={0 0}, upload=210496]: Uploading piece... Sep 16 13:00:01.786512559 (239h31m37.826085689s) [noise=true , address=145.79.227.25:4628 , piece_id=B6OHGWEMP23SMGWZHR6CDTJ4TRPNKDKEECRDGCRAV4HXZYAV5ZXA, seg_pos={0 0}, upload=210496]: Uploading piece... Sep 16 13:00:01.786956404 (239h31m37.826529544s) [noise=true , address=145.79.227.33:4872 , piece_id=K43M7WNVN2ITYUJTSIQZM6TASJ7EPYRQEEJQLYNVWKNEADQYFTSQ, seg_pos={0 0}, upload=210496]: Uploading piece... Sep 16 13:00:01.787343000 (239h31m37.82691613s) [noise=true , address=145.79.227.12:4800 , piece_id=HY7JHVXXKAE5DWJLTKSNAQ3LD5WYCAEZGFWDPFS4RHETKLJVU3UQ, seg_pos={0 0}, upload=210496]: Uploading piece... Sep 16 13:00:03.475786778 (239h31m39.515359908s) [upload=210496]: Next returned nil segment Sep 16 13:00:03.475812627 (239h31m39.515385768s) [upload=210496]: Waiting for error group managing segments... Sep 16 13:00:03.893474478 (239h31m39.933047608s) [noise=true , address=77.90.31.11:4564 , piece_id=SAEDDGUAJ3INOSF225CAVW7EKUBRZYQTK36EGCMS6J3FGUW7ZDGQ, seg_pos={0 0}, upload=210496]: Done uploading piece. err: <nil> Sep 16 13:00:17.463902782 (239h31m53.503475912s) [noise=true , address=145.79.227.26:4664 , piece_id=VRHTGFS3XTLVF6DKVU5GBHW2O4INA5MP3VVV2XAYXLXUOGR4QNKA, seg_pos={0 0}, upload=210496]: Done uploading piece. err: <nil> Sep 16 13:00:20.336874993 (239h31m56.376448123s) [noise=true , address=145.79.227.24:4601 , piece_id=DH6VGEQQ2YQVAXROBD5BLIK7LVC3XUG4SV4YG7OW6GDQ3WLU7ZXQ, seg_pos={0 0}, upload=210496]: Done uploading piece. err: <nil> Sep 16 13:00:20.353648985 (239h31m56.393222115s) [noise=true , address=145.79.227.33:4872 , piece_id=K43M7WNVN2ITYUJTSIQZM6TASJ7EPYRQEEJQLYNVWKNEADQYFTSQ, seg_pos={0 0}, upload=210496]: Done uploading piece. err: <nil> Sep 16 13:00:23.724725467 (239h31m59.764298597s) [noise=true , address=145.79.227.6:4266 , piece_id=II7SAZAE6QXS7WEEEO7FZJYULD5ETE4XIWZTWHWTPKNM4777NSSA, seg_pos={0 0}, upload=210496]: Done uploading piece. err: <nil> Sep 16 13:00:26.600873774 (239h32m2.640446904s) [noise=true , address=145.79.227.46:4624 , piece_id=LXBBKQIML5MZOZQEUYHFVAUROIVWLJNYXSGLEEBRS4PE4ZCHMXRA, seg_pos={0 0}, upload=210496]: Done uploading piece. err: <nil> Sep 16 13:00:27.484185639 (239h32m3.523758769s) [noise=true , address=145.79.227.12:4800 , piece_id=HY7JHVXXKAE5DWJLTKSNAQ3LD5WYCAEZGFWDPFS4RHETKLJVU3UQ, seg_pos={0 0}, upload=210496]: Done uploading piece. err: <nil> Sep 16 13:00:28.675807771 (239h32m4.715380901s) [noise=true , address=145.79.227.5:4253 , piece_id=PX46QEPX4S7UW654Q2UVL7TKY62B6CGMXHDU4YMYRGWE6BWV4ZUA, seg_pos={0 0}, upload=210496]: Done uploading piece. err: <nil> Sep 16 13:00:32.246067155 (239h32m8.285640275s) [noise=true , address=145.79.227.10:4418 , piece_id=UALY7IVMJGJ24XZ5PMIFEXVBKAB75SM33T7MPZHLW3PWAFKYISYA, seg_pos={0 0}, upload=210496]: Done uploading piece. err: <nil> Sep 16 13:00:34.314575467 (239h32m10.354148598s) [noise=true , address=145.79.227.27:4706 , piece_id=5J65NEZLBSWQ3OTYVKF5J7IK6UXRKUG6XA4KGREOSGDDASJ5TTVA, seg_pos={0 0}, upload=210496]: Done uploading piece. err: <nil> Sep 16 13:00:40.123826447 (239h32m16.163399577s) [noise=true , address=145.79.227.7:4319 , piece_id=ZQVUBBHWAC3WDMFBZO7UGKP2LS3MK3XDIMYGUHO3MYYZHMRFPKJQ, seg_pos={0 0}, upload=210496]: Done uploading piece. err: <nil> Sep 16 13:01:00.584208465 (239h32m36.623781595s) [noise=true , address=145.79.227.25:4628 , piece_id=B6OHGWEMP23SMGWZHR6CDTJ4TRPNKDKEECRDGCRAV4HXZYAV5ZXA, seg_pos={0 0}, upload=210496]: Done uploading piece. err: ecclient: upload failed (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp, address:145.79.227.25:4628): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:01:00.584297655 (239h32m36.623870785s) [noise=true , address=145.79.227.16:4937 , piece_id=EIG6QJV5ETSU6AOYQR4NDNC2BX5OUS7UKVMY2QGPF6CGDZYEOABA, seg_pos={0 0}, upload=210496]: Done uploading piece. err: ecclient: upload failed (node:1244drkeyc94qojgXAjt8oenBaGpzQBiMmisCjfBys5sLW4GvqU, address:145.79.227.16:4937): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:01:00.584323885 (239h32m36.623897015s) [noise=true , address=145.79.227.35:4484 , piece_id=ADOL7IYFABTQLX644LN5OAFBILSGLPOVJHE7NAUGJA2JM6WTRYDA, seg_pos={0 0}, upload=210496]: Done uploading piece. err: ecclient: upload failed (node:1a5S5Ar7jNbK9MESghbWfmEgBPNSMN2tEnZeeG1kKzeX2dnSX3, address:145.79.227.35:4484): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:01:00.584532011 (239h32m36.624105141s) [noise=true , address=145.79.227.34:4930 , piece_id=TMZMXTE5P364AYHFDBKS3FO52G6FYNICC3MJULN6APZ2GLUKXSHQ, seg_pos={0 0}, upload=210496]: Done uploading piece. err: ecclient: upload failed (node:12qaYFSpezuLAc5zJfAYruzad6nTpYFDpog7bmKMVTA8MVm76NB, address:145.79.227.34:4930): protocol: write tcp 188.166.225.170:38338->145.79.227.34:4930: use of closed network connection; write tcp 188.166.225.170:38338->145.79.227.34:4930: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38338->145.79.227.34:4930: use of closed network connection Sep 16 13:01:00.584553623 (239h32m36.624126753s) [noise=true , address=145.79.227.11:4745 , piece_id=AE7YT3FLI5IXPLEDNH7VIM5UKOADFEFLUDSUARP2376DAP44CONA, seg_pos={0 0}, upload=210496]: Done uploading piece. err: ecclient: upload failed (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF, address:145.79.227.11:4745): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:01:00.584615781 (239h32m36.624188911s) [noise=true , address=145.79.227.49:4368 , piece_id=JYYGOOUPH2OTDK6PC4ERABWVXTEN6AAGR3WESHY2N6TEV2QXAJJA, seg_pos={0 0}, upload=210496]: Done uploading piece. err: ecclient: upload failed (node:12Q6suyRuFmW1rG5qq8faCFbCkfAPaNfYQaBv6qhL1DNavUffkB, address:145.79.227.49:4368): protocol: expected piece hash; write tcp 188.166.225.170:56198->145.79.227.49:4368: use of closed network connection; write tcp 188.166.225.170:56198->145.79.227.49:4368: use of closed network connection; EOF Sep 16 13:01:00.584645889 (239h32m36.624219019s) [noise=true , address=145.79.227.23:4578 , piece_id=BEKV2RQPZTKKUVCSGOHV6OKBKWPDN527U4QG6ACPYS3AOCLM6BKA, seg_pos={0 0}, upload=210496]: Done uploading piece. err: ecclient: upload failed (node:1poqPvwwjWwAAhkJ5WCDavg9oKxbJrf9xktnYA9DB6o9BV1G49, address:145.79.227.23:4578): protocol: write tcp 188.166.225.170:53036->145.79.227.23:4578: use of closed network connection; write tcp 188.166.225.170:53036->145.79.227.23:4578: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53036->145.79.227.23:4578: use of closed network connection Sep 16 13:01:00.584683330 (239h32m36.62425646s) [seg_pos={0 0}, upload=210496]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 16 13:01:00.850575923 (239h32m36.890149053s) [upload=210496]: Done uploading segments... Sep 16 13:01:00.850606211 (239h32m36.890179331s) [upload=210496]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 1m0.268630447s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.066180408s FAIL (2025-09-16 13:00:34 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== JFA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422604190 (238h59m45.46217732s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422896808 (238h59m45.462469928s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423232478 (238h59m45.462805608s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423565571 (238h59m45.463138691s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423935696 (238h59m45.463508826s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424280403 (238h59m45.463853533s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424633305 (238h59m45.464206435s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424994342 (238h59m45.464567472s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425341152 (238h59m45.464914282s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425707831 (238h59m45.465280951s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.426034432 (238h59m45.465607562s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429082236 (238h59m45.468655366s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429521483 (238h59m45.469094613s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:10.278696743 (238h59m46.318269863s) [upload=210063]: Next returned nil segment Sep 16 12:28:10.278720237 (238h59m46.318293367s) [upload=210063]: Waiting for error group managing segments... Sep 16 12:28:10.652409183 (238h59m46.691982303s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.662938092 (238h59m46.702511222s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.670032272 (238h59m46.709605402s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.701595607 (238h59m46.741168737s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.704157255 (238h59m46.743730385s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.707972140 (238h59m46.74754527s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.708523660 (238h59m46.74809678s) [noise=true , address=89.149.201.147:4007 , piece_id=BOQVD3EW5UAYWKEZ5FWC2QCDGIROAEOQN2OEYQ4QACNVDEIFF2IA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.754549157 (238h59m46.794122277s) [noise=true , address=89.149.201.147:4010 , piece_id=OALYBM6QEAOKMQPP2R3Y7LBVOEJYPMTBHJTGE2DSRO3KLRGBZC3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.138412786 (238h59m47.177985916s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.163219826 (238h59m47.202792956s) [noise=true , address=81.171.14.70:4039 , piece_id=IMLIU4QCGFNXWATVWK4L7FZPWOVPCRXNH4F3HSMF5VLQZJUEBO3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.169643348 (238h59m47.209216478s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.231770296 (238h59m47.271343416s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.258046263 (238h59m47.297619383s) [noise=true , address=185.167.204.205:4034 , piece_id=FUHHRFVDRYETJRWVBQZRALI4UGKDQ6DXV7TDKXBRASOMGOEN6YOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.263155884 (238h59m47.302729004s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.269762875 (238h59m47.309336005s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.281404505 (238h59m47.320977635s) [noise=true , address=185.167.204.205:4027 , piece_id=3O5SOEMEXYDYR5OE6SZJ2AVVLNYG4V4IMZOFUL7XDJEZUHDUV5TA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.289386705 (238h59m47.328959825s) [noise=true , address=185.167.204.206:4063 , piece_id=ERJLEJ5EILBCN4WUPZBVYSB2CGDWORVZ3GASSXBVNGR25GWVFYOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.298140815 (238h59m47.337713945s) [noise=true , address=185.167.204.206:4043 , piece_id=LDZTOC67YHM344PUCLVJ7RMKQAYJAQJ4GMKYZNN5LLU5KIUQCW7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.311391579 (238h59m47.350964709s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.317381906 (238h59m47.356955036s) [noise=true , address=185.167.204.206:4065 , piece_id=UXYM6MEGCQFRRRSMGI5XKJJJ6GYW7IJXG5QDGMICLP3FNJDSFRSQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.318355050 (238h59m47.35792818s) [noise=true , address=185.167.204.205:4018 , piece_id=VZP55ZA5Y5IA2PUH75QDVB56UHRJJ2XNC75L5WCRUSHGHQGZ463A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.330083334 (238h59m47.369656464s) [noise=true , address=185.167.204.206:4052 , piece_id=CDKZXVC22A62STE3NYD4R2TWT3AF45U2A7MHEIQJPTNMUKBVFJFA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.331429858 (238h59m47.371002988s) [noise=true , address=185.167.204.205:4035 , piece_id=M6LWKXSTJHGHXHY4VEJ2IGLI2UX4IIZV5KD4A6YY3BMIQ6ZRBMAQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.341689555 (238h59m47.381262686s) [noise=true , address=185.167.204.205:4014 , piece_id=MDSUAX4XNI5INUUQCMAP26PQFV62U3TZ2OITZR3BSNDQLHWEOKIA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.346694947 (238h59m47.386268077s) [noise=true , address=185.167.204.205:4023 , piece_id=YNW6TYPAVMYIHD5BT6QZGJJAGDM2XSZ4QYX4C2TH5QRGNTNP4KUQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363156895 (238h59m47.402730015s) [noise=true , address=185.167.204.206:4059 , piece_id=IX3H3WSLKDNPCCA5NMFUGMO2P6CA274AEUXLGVA3WRGJM3SN2OZQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363183276 (238h59m47.402756406s) [seg_pos={0 0}, upload=210063]: Segment reached optimal threshold of 26 pieces. Sep 16 12:28:11.363333942 (238h59m47.402907072s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363361435 (238h59m47.402934565s) [noise=true , address=185.167.204.206:4066 , piece_id=XXWYU36QFNZ2HCZF2WGAG4LKIBE3GCCKNVBDV6N5RQMCDJJXJULQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: expected piece hash; context canceled; EOF Sep 16 12:28:11.363393326 (238h59m47.402966456s) [seg_pos={0 0}, upload=210063]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil> Sep 16 12:28:11.363496222 (238h59m47.403069362s) [upload=210063]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 16 12:28:11.363503285 (238h59m47.403076405s) [upload=210063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 16 12:28:11.633947931 (238h59m47.673521071s) [upload=210063]: Done uploading segments... Sep 16 12:28:11.633974231 (238h59m47.673547372s) [upload=210063]: Upload finished. err: <nil> Duration: 5.066218291s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 25 out of 60 is failed (threshold=3) [...........X......X.X.......XXXX.XX.XXXXXX..XX.XXX..XX.X.X.X] duration: 30.321720814s FAIL (2025-09-16 13:00:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 16 13:00:03.119527431 (239h31m39.159100561s) [upload=210498]: Starting upload Sep 16 13:00:03.119638663 (239h31m39.159211793s) [upload=210498]: Done starting upload Sep 16 13:00:03.119999851 (239h31m39.159572991s) [upload=210498]: Uploading segments... Sep 16 13:00:03.120077949 (239h31m39.15965136s) [upload=210498]: Got next segment. Inline: false Sep 16 13:00:03.120143414 (239h31m39.159716544s) [upload=210498]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 16 13:00:03.120150628 (239h31m39.159723768s) [upload=210498]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 16 13:00:03.420139992 (239h31m39.459713133s) [seg_pos={0 0}, upload=210498]: Begin upload segment... Sep 16 13:00:03.420245644 (239h31m39.459818774s) [seg_pos={0 0}, upload=210498]: Done begin upload segment. Sep 16 13:00:03.420283415 (239h31m39.459856546s) [noise=true , address=145.79.227.13:4803 , piece_id=2UCANUOUUPNNZXIJTSBQVOYY2R3GVWEP4O3X6F676XDVY725I2DA, seg_pos={0 0}, upload=210498]: Uploading piece... Sep 16 13:00:03.421937255 (239h31m39.461510395s) [noise=true , address=77.90.31.13:4628 , piece_id=VHIR4QEPUY3WDSK56LQAC2TTALPHDQCJNMI6F4WMSCJCBGODEK7A, seg_pos={0 0}, upload=210498]: Uploading piece... Sep 16 13:00:03.425044942 (239h31m39.464618103s) [noise=true , address=145.79.227.2:4115 , piece_id=IUKSQ52EIN6EA4T6SWWLMDDXOI745YNL2ZSMRYDJORXPY2MKWJVQ, seg_pos={0 0}, upload=210498]: Uploading piece... Sep 16 13:00:03.426021041 (239h31m39.465594171s) [noise=true , address=45.91.116.14:4190 , piece_id=DRLGPPQDVCRC33GKE56J2OET2VAIUSQGZ7WCZZMQ4AYTA6D4VNIQ, seg_pos={0 0}, upload=210498]: Uploading piece... Sep 16 13:00:03.426468473 (239h31m39.466041613s) [noise=true , address=145.79.227.18:4006 , piece_id=MSRJDJHGOH4TSAQRSNJ5EYFJCTZMPTKU7IMYTNLBR3CRLWFKN45A, seg_pos={0 0}, upload=210498]: Uploading piece... Sep 16 13:00:03.427090939 (239h31m39.466664069s) [noise=true , address=45.91.116.11:4117 , piece_id=VBCGPD2L2FJDEK45UN6YM4D4WSM2ZP5QCSFLPS5T7AL6YBUUYYLA, seg_pos={0 0}, upload=210498]: Uploading piece... Sep 16 13:00:03.427544532 (239h31m39.467117662s) [noise=true , address=45.91.116.10:4081 , piece_id=P5CEHSGY5FL4A7YF5HE5AZG3HORH7OHHFHOZ3JMUD2QK2WAEC6VQ, seg_pos={0 0}, upload=210498]: Uploading piece... Sep 16 13:00:03.427989199 (239h31m39.467562329s) [noise=true , address=45.91.116.5:4297 , piece_id=FJUTFYLBGLS2R5JQXRMBASEULUQSEXJNOTI722I4OC3IQDIYUH3Q, seg_pos={0 0}, upload=210498]: Uploading piece... Sep 16 13:00:03.428718237 (239h31m39.468291368s) [noise=true , address=145.79.227.14:4838 , piece_id=JN7N7CF33IX4QLDJXJXMXZD5FN4JE6JHYFCP2D72DGEPAW7X2UTQ, seg_pos={0 0}, upload=210498]: Uploading piece... Sep 16 13:00:03.429173725 (239h31m39.468746855s) [noise=true , address=45.91.116.8:4045 , piece_id=BGHWVQFPMO4AM25UETXKJJVO55PVOTOVXNDIMV6NUR7VXVBXZCGA, seg_pos={0 0}, upload=210498]: Uploading piece... Sep 16 13:00:03.429596490 (239h31m39.46916962s) [noise=true , address=45.91.116.12:4225 , piece_id=4TIK6C2QNB6BQDKT4AQREMQ5PRDHDKCMPGKBVA6SHLIJCGXO2LYQ, seg_pos={0 0}, upload=210498]: Uploading piece... Sep 16 13:00:03.431273593 (239h31m39.470846723s) [noise=true , address=45.91.116.5:4298 , piece_id=Q662LAMSXAW6XSKEZ5LAB4TCLLP5EXCAIMSDN67GPADBBGQQF2SQ, seg_pos={0 0}, upload=210498]: Uploading piece... Sep 16 13:00:03.431723750 (239h31m39.47129689s) [noise=true , address=45.91.116.9:4261 , piece_id=VPXHD2KGZTIS5A4PEFDZ4DXUBXVKVRW2D6NNP23CBLW65O6MABWQ, seg_pos={0 0}, upload=210498]: Uploading piece... Sep 16 13:00:03.432121739 (239h31m39.471694879s) [noise=true , address=77.90.31.16:4734 , piece_id=Y2FCS7PHLL6DNF47JBVAVETVUBKUMF2GTZ4YB6EU5JNZU66JTONA, seg_pos={0 0}, upload=210498]: Uploading piece... Sep 16 13:00:03.432648411 (239h31m39.472221541s) [noise=true , address=45.91.116.4:4940 , piece_id=VK75TPWAT5UTMVAXG3DSENIDNK67LAIIY2ZAE6HZWGPCI6HKZNDQ, seg_pos={0 0}, upload=210498]: Uploading piece... Sep 16 13:00:03.433074723 (239h31m39.472647853s) [noise=true , address=45.91.116.7:4009 , piece_id=FEFS6LIQ6KSIB7GQ3SAUSTH6GRGF6OOCP6MYCJJVA5TW2ZA2YBCA, seg_pos={0 0}, upload=210498]: Uploading piece... Sep 16 13:00:05.295505012 (239h31m41.335078142s) [upload=210498]: Next returned nil segment Sep 16 13:00:05.295534658 (239h31m41.335107788s) [upload=210498]: Waiting for error group managing segments... Sep 16 13:00:05.736070260 (239h31m41.77564339s) [noise=true , address=45.91.116.7:4009 , piece_id=FEFS6LIQ6KSIB7GQ3SAUSTH6GRGF6OOCP6MYCJJVA5TW2ZA2YBCA, seg_pos={0 0}, upload=210498]: Done uploading piece. err: <nil> Sep 16 13:00:05.764764220 (239h31m41.80433735s) [noise=true , address=45.91.116.8:4045 , piece_id=BGHWVQFPMO4AM25UETXKJJVO55PVOTOVXNDIMV6NUR7VXVBXZCGA, seg_pos={0 0}, upload=210498]: Done uploading piece. err: <nil> Sep 16 13:00:05.778190958 (239h31m41.817764088s) [noise=true , address=45.91.116.5:4297 , piece_id=FJUTFYLBGLS2R5JQXRMBASEULUQSEXJNOTI722I4OC3IQDIYUH3Q, seg_pos={0 0}, upload=210498]: Done uploading piece. err: <nil> Sep 16 13:00:05.793770055 (239h31m41.833343185s) [noise=true , address=45.91.116.11:4117 , piece_id=VBCGPD2L2FJDEK45UN6YM4D4WSM2ZP5QCSFLPS5T7AL6YBUUYYLA, seg_pos={0 0}, upload=210498]: Done uploading piece. err: <nil> Sep 16 13:00:05.821833374 (239h31m41.861406504s) [noise=true , address=45.91.116.4:4940 , piece_id=VK75TPWAT5UTMVAXG3DSENIDNK67LAIIY2ZAE6HZWGPCI6HKZNDQ, seg_pos={0 0}, upload=210498]: Done uploading piece. err: <nil> Sep 16 13:00:05.822839109 (239h31m41.862412239s) [noise=true , address=45.91.116.14:4190 , piece_id=DRLGPPQDVCRC33GKE56J2OET2VAIUSQGZ7WCZZMQ4AYTA6D4VNIQ, seg_pos={0 0}, upload=210498]: Done uploading piece. err: <nil> Sep 16 13:00:05.824592609 (239h31m41.864165739s) [noise=true , address=77.90.31.16:4734 , piece_id=Y2FCS7PHLL6DNF47JBVAVETVUBKUMF2GTZ4YB6EU5JNZU66JTONA, seg_pos={0 0}, upload=210498]: Done uploading piece. err: <nil> Sep 16 13:00:05.837916862 (239h31m41.877489992s) [noise=true , address=45.91.116.9:4261 , piece_id=VPXHD2KGZTIS5A4PEFDZ4DXUBXVKVRW2D6NNP23CBLW65O6MABWQ, seg_pos={0 0}, upload=210498]: Done uploading piece. err: <nil> Sep 16 13:00:05.838408548 (239h31m41.877981678s) [noise=true , address=45.91.116.5:4298 , piece_id=Q662LAMSXAW6XSKEZ5LAB4TCLLP5EXCAIMSDN67GPADBBGQQF2SQ, seg_pos={0 0}, upload=210498]: Done uploading piece. err: <nil> Sep 16 13:00:05.853129941 (239h31m41.892703071s) [noise=true , address=77.90.31.13:4628 , piece_id=VHIR4QEPUY3WDSK56LQAC2TTALPHDQCJNMI6F4WMSCJCBGODEK7A, seg_pos={0 0}, upload=210498]: Done uploading piece. err: <nil> Sep 16 13:00:05.863428231 (239h31m41.903001361s) [noise=true , address=45.91.116.10:4081 , piece_id=P5CEHSGY5FL4A7YF5HE5AZG3HORH7OHHFHOZ3JMUD2QK2WAEC6VQ, seg_pos={0 0}, upload=210498]: Done uploading piece. err: <nil> Sep 16 13:00:05.885440518 (239h31m41.925013658s) [noise=true , address=45.91.116.12:4225 , piece_id=4TIK6C2QNB6BQDKT4AQREMQ5PRDHDKCMPGKBVA6SHLIJCGXO2LYQ, seg_pos={0 0}, upload=210498]: Done uploading piece. err: <nil> Sep 16 13:00:32.352316711 (239h32m8.391889851s) [noise=true , address=145.79.227.13:4803 , piece_id=2UCANUOUUPNNZXIJTSBQVOYY2R3GVWEP4O3X6F676XDVY725I2DA, seg_pos={0 0}, upload=210498]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:34784->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:34784->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34784->145.79.227.13:4803: use of closed network connection Sep 16 13:00:32.352755026 (239h32m8.392328156s) [noise=true , address=145.79.227.18:4006 , piece_id=MSRJDJHGOH4TSAQRSNJ5EYFJCTZMPTKU7IMYTNLBR3CRLWFKN45A, seg_pos={0 0}, upload=210498]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:53986->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:53986->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53986->145.79.227.18:4006: use of closed network connection Sep 16 13:00:32.352944376 (239h32m8.392517506s) [noise=true , address=145.79.227.14:4838 , piece_id=JN7N7CF33IX4QLDJXJXMXZD5FN4JE6JHYFCP2D72DGEPAW7X2UTQ, seg_pos={0 0}, upload=210498]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:145.79.227.14:4838): protocol: write tcp 188.166.225.170:57240->145.79.227.14:4838: use of closed network connection; write tcp 188.166.225.170:57240->145.79.227.14:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57240->145.79.227.14:4838: use of closed network connection Sep 16 13:00:32.353138746 (239h32m8.392711876s) [noise=true , address=145.79.227.2:4115 , piece_id=IUKSQ52EIN6EA4T6SWWLMDDXOI745YNL2ZSMRYDJORXPY2MKWJVQ, seg_pos={0 0}, upload=210498]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:57218->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:57218->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57218->145.79.227.2:4115: use of closed network connection Sep 16 13:00:32.353183882 (239h32m8.392757012s) [seg_pos={0 0}, upload=210498]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 16 13:00:32.671699514 (239h32m8.711272644s) [upload=210498]: Done uploading segments... Sep 16 13:00:32.671738047 (239h32m8.711311187s) [upload=210498]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.321748336s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.197951013s FAIL (2025-09-16 13:00:03 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== JFA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422604190 (238h59m45.46217732s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422896808 (238h59m45.462469928s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423232478 (238h59m45.462805608s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423565571 (238h59m45.463138691s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423935696 (238h59m45.463508826s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424280403 (238h59m45.463853533s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424633305 (238h59m45.464206435s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424994342 (238h59m45.464567472s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425341152 (238h59m45.464914282s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425707831 (238h59m45.465280951s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.426034432 (238h59m45.465607562s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429082236 (238h59m45.468655366s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429521483 (238h59m45.469094613s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:10.278696743 (238h59m46.318269863s) [upload=210063]: Next returned nil segment Sep 16 12:28:10.278720237 (238h59m46.318293367s) [upload=210063]: Waiting for error group managing segments... Sep 16 12:28:10.652409183 (238h59m46.691982303s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.662938092 (238h59m46.702511222s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.670032272 (238h59m46.709605402s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.701595607 (238h59m46.741168737s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.704157255 (238h59m46.743730385s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.707972140 (238h59m46.74754527s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.708523660 (238h59m46.74809678s) [noise=true , address=89.149.201.147:4007 , piece_id=BOQVD3EW5UAYWKEZ5FWC2QCDGIROAEOQN2OEYQ4QACNVDEIFF2IA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.754549157 (238h59m46.794122277s) [noise=true , address=89.149.201.147:4010 , piece_id=OALYBM6QEAOKMQPP2R3Y7LBVOEJYPMTBHJTGE2DSRO3KLRGBZC3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.138412786 (238h59m47.177985916s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.163219826 (238h59m47.202792956s) [noise=true , address=81.171.14.70:4039 , piece_id=IMLIU4QCGFNXWATVWK4L7FZPWOVPCRXNH4F3HSMF5VLQZJUEBO3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.169643348 (238h59m47.209216478s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.231770296 (238h59m47.271343416s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.258046263 (238h59m47.297619383s) [noise=true , address=185.167.204.205:4034 , piece_id=FUHHRFVDRYETJRWVBQZRALI4UGKDQ6DXV7TDKXBRASOMGOEN6YOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.263155884 (238h59m47.302729004s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.269762875 (238h59m47.309336005s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.281404505 (238h59m47.320977635s) [noise=true , address=185.167.204.205:4027 , piece_id=3O5SOEMEXYDYR5OE6SZJ2AVVLNYG4V4IMZOFUL7XDJEZUHDUV5TA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.289386705 (238h59m47.328959825s) [noise=true , address=185.167.204.206:4063 , piece_id=ERJLEJ5EILBCN4WUPZBVYSB2CGDWORVZ3GASSXBVNGR25GWVFYOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.298140815 (238h59m47.337713945s) [noise=true , address=185.167.204.206:4043 , piece_id=LDZTOC67YHM344PUCLVJ7RMKQAYJAQJ4GMKYZNN5LLU5KIUQCW7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.311391579 (238h59m47.350964709s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.317381906 (238h59m47.356955036s) [noise=true , address=185.167.204.206:4065 , piece_id=UXYM6MEGCQFRRRSMGI5XKJJJ6GYW7IJXG5QDGMICLP3FNJDSFRSQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.318355050 (238h59m47.35792818s) [noise=true , address=185.167.204.205:4018 , piece_id=VZP55ZA5Y5IA2PUH75QDVB56UHRJJ2XNC75L5WCRUSHGHQGZ463A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.330083334 (238h59m47.369656464s) [noise=true , address=185.167.204.206:4052 , piece_id=CDKZXVC22A62STE3NYD4R2TWT3AF45U2A7MHEIQJPTNMUKBVFJFA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.331429858 (238h59m47.371002988s) [noise=true , address=185.167.204.205:4035 , piece_id=M6LWKXSTJHGHXHY4VEJ2IGLI2UX4IIZV5KD4A6YY3BMIQ6ZRBMAQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.341689555 (238h59m47.381262686s) [noise=true , address=185.167.204.205:4014 , piece_id=MDSUAX4XNI5INUUQCMAP26PQFV62U3TZ2OITZR3BSNDQLHWEOKIA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.346694947 (238h59m47.386268077s) [noise=true , address=185.167.204.205:4023 , piece_id=YNW6TYPAVMYIHD5BT6QZGJJAGDM2XSZ4QYX4C2TH5QRGNTNP4KUQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363156895 (238h59m47.402730015s) [noise=true , address=185.167.204.206:4059 , piece_id=IX3H3WSLKDNPCCA5NMFUGMO2P6CA274AEUXLGVA3WRGJM3SN2OZQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363183276 (238h59m47.402756406s) [seg_pos={0 0}, upload=210063]: Segment reached optimal threshold of 26 pieces. Sep 16 12:28:11.363333942 (238h59m47.402907072s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363361435 (238h59m47.402934565s) [noise=true , address=185.167.204.206:4066 , piece_id=XXWYU36QFNZ2HCZF2WGAG4LKIBE3GCCKNVBDV6N5RQMCDJJXJULQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: expected piece hash; context canceled; EOF Sep 16 12:28:11.363393326 (238h59m47.402966456s) [seg_pos={0 0}, upload=210063]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil> Sep 16 12:28:11.363496222 (238h59m47.403069362s) [upload=210063]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 16 12:28:11.363503285 (238h59m47.403076405s) [upload=210063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 16 12:28:11.633947931 (238h59m47.673521071s) [upload=210063]: Done uploading segments... Sep 16 12:28:11.633974231 (238h59m47.673547372s) [upload=210063]: Upload finished. err: <nil> Duration: 5.197987131s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 29 out of 60 is failed (threshold=3) [...........................X.X..XXX.XXXXXXXXXXXXXXXXXXXXXXXX] duration: 1m0.251066144s FAIL (2025-09-16 13:00:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 9) ======LOGS====== PVIA, seg_pos={0 0}, upload=210482]: Uploading piece... Sep 16 12:59:01.391368095 (239h30m37.430941225s) [noise=true , address=145.79.227.38:4986 , piece_id=UK6PRDM66LNUIW6QS2HYT54A6H5V6WWPN5HPBZM4TOAYZGWDQPKA, seg_pos={0 0}, upload=210482]: Uploading piece... Sep 16 12:59:01.391816149 (239h30m37.431389279s) [noise=true , address=145.79.227.48:4304 , piece_id=N462JVJDZUMFAB4L2OGOCTBJKQQ5I6SM3G2QXR72NZ4E2QCY2Y3Q, seg_pos={0 0}, upload=210482]: Uploading piece... Sep 16 12:59:01.391912030 (239h30m37.43148516s) [noise=true , address=145.79.227.23:4578 , piece_id=73D6BR2F2VTHWCBMSNCPNQG7UOB6VYUPK5QTCXRPKH3OGCB7APMA, seg_pos={0 0}, upload=210482]: Uploading piece... Sep 16 12:59:01.392236088 (239h30m37.431809218s) [noise=true , address=145.79.227.28:4751 , piece_id=CXNPGK56BMTT52UOOVALHBSACN733HSKGZA25UC2AEZPUWP33FYQ, seg_pos={0 0}, upload=210482]: Uploading piece... Sep 16 12:59:01.392272017 (239h30m37.431845147s) [noise=true , address=145.79.227.33:4875 , piece_id=SJ72E3FS2NJYQDLAF5HAQTNCDZV3WGLQDA6IVF6DGECBSTJNOKOA, seg_pos={0 0}, upload=210482]: Uploading piece... Sep 16 12:59:01.392800613 (239h30m37.432373743s) [noise=true , address=145.79.227.35:4490 , piece_id=2ZMXEG7SX7BVFB6X2VZZXOUC72ZR24LFLPGKKCJQQSIHDSJHRDSA, seg_pos={0 0}, upload=210482]: Uploading piece... Sep 16 12:59:01.392861489 (239h30m37.432434619s) [noise=true , address=145.79.227.46:4633 , piece_id=ASE7H5LVB6FWIB3QEU7Q7KNAIR7ZXHIOKKFVM34UXVVVTM5647XQ, seg_pos={0 0}, upload=210482]: Uploading piece... Sep 16 12:59:01.393321525 (239h30m37.432894655s) [noise=true , address=145.79.227.49:4359 , piece_id=MYFTMVV5435MSCBE7ROT2VEP55FNRWUVMPTNYNDCCMG4SCES2PKQ, seg_pos={0 0}, upload=210482]: Uploading piece... Sep 16 12:59:01.394568920 (239h30m37.43414205s) [noise=true , address=145.79.227.16:4942 , piece_id=Z2Y4UPYCMXTN6ED5NVFDFURGDNBBF5TQUTOFVTQD4FMM7HBPRQEQ, seg_pos={0 0}, upload=210482]: Uploading piece... Sep 16 12:59:01.398745694 (239h30m37.438318824s) [noise=true , address=145.79.227.52:4459 , piece_id=YCIUU7SJW56ZIBZO573666RO5LTO4S36UY4PS3MECPHRX5UOCIJA, seg_pos={0 0}, upload=210482]: Uploading piece... Sep 16 12:59:01.399213054 (239h30m37.438786184s) [noise=true , address=145.79.227.27:4694 , piece_id=67TD7PIPYO5HDGMPNEFTZFJQCEWQLXWN5NTPQ5UQLAS4NENRY6IQ, seg_pos={0 0}, upload=210482]: Uploading piece... Sep 16 12:59:01.399639626 (239h30m37.439212756s) [noise=true , address=145.79.227.26:4663 , piece_id=KHX2J3TR5DDP7JYXC3YKS7XHRPHU7O3OMSITRAERJIFBP3LSRN5A, seg_pos={0 0}, upload=210482]: Uploading piece... Sep 16 12:59:01.400063854 (239h30m37.439637034s) [noise=true , address=145.79.227.17:4996 , piece_id=32OUQPA2TA2JJQZA4PWGTNUSJNBQIS4B3MDL5KAHL6HQ3MXGLFXQ, seg_pos={0 0}, upload=210482]: Uploading piece... Sep 16 12:59:01.400894375 (239h30m37.440467505s) [noise=true , address=145.79.227.39:4015 , piece_id=HZ2JQOYFF5JDZFTZCUOBDUBB5YICRI6ZKEXTS4OEZPYKGCAGXSFA, seg_pos={0 0}, upload=210482]: Uploading piece... Sep 16 12:59:01.401532411 (239h30m37.441105541s) [noise=true , address=77.90.31.18:4830 , piece_id=F3IHLMCII5B5PXITJEESQPKVWIZ5GPEXELUEOPYVDEDI5YRKLX7Q, seg_pos={0 0}, upload=210482]: Uploading piece... Sep 16 12:59:03.071161356 (239h30m39.110734486s) [upload=210482]: Next returned nil segment Sep 16 12:59:03.071185411 (239h30m39.110758542s) [upload=210482]: Waiting for error group managing segments... Sep 16 12:59:03.503036813 (239h30m39.542609943s) [noise=true , address=77.90.31.18:4830 , piece_id=F3IHLMCII5B5PXITJEESQPKVWIZ5GPEXELUEOPYVDEDI5YRKLX7Q, seg_pos={0 0}, upload=210482]: Done uploading piece. err: <nil> Sep 16 12:59:20.542294940 (239h30m56.58186807s) [noise=true , address=145.79.227.5:4233 , piece_id=T6S4HGLSBEFYQIZYLSRHCRCSDCNSUMLKJNUIODS53JZL2MHVPVIA, seg_pos={0 0}, upload=210482]: Done uploading piece. err: <nil> Sep 16 12:59:21.076683659 (239h30m57.116256789s) [noise=true , address=145.79.227.35:4490 , piece_id=2ZMXEG7SX7BVFB6X2VZZXOUC72ZR24LFLPGKKCJQQSIHDSJHRDSA, seg_pos={0 0}, upload=210482]: Done uploading piece. err: <nil> Sep 16 12:59:22.415780531 (239h30m58.455353661s) [noise=true , address=145.79.227.16:4942 , piece_id=Z2Y4UPYCMXTN6ED5NVFDFURGDNBBF5TQUTOFVTQD4FMM7HBPRQEQ, seg_pos={0 0}, upload=210482]: Done uploading piece. err: <nil> Sep 16 12:59:29.099441864 (239h31m5.139014994s) [noise=true , address=145.79.227.38:4986 , piece_id=UK6PRDM66LNUIW6QS2HYT54A6H5V6WWPN5HPBZM4TOAYZGWDQPKA, seg_pos={0 0}, upload=210482]: Done uploading piece. err: <nil> Sep 16 12:59:36.915830385 (239h31m12.955403505s) [noise=true , address=145.79.227.46:4633 , piece_id=ASE7H5LVB6FWIB3QEU7Q7KNAIR7ZXHIOKKFVM34UXVVVTM5647XQ, seg_pos={0 0}, upload=210482]: Done uploading piece. err: <nil> Sep 16 12:59:39.912094095 (239h31m15.951667215s) [noise=true , address=145.79.227.28:4751 , piece_id=CXNPGK56BMTT52UOOVALHBSACN733HSKGZA25UC2AEZPUWP33FYQ, seg_pos={0 0}, upload=210482]: Done uploading piece. err: <nil> Sep 16 12:59:40.941278597 (239h31m16.980851717s) [noise=true , address=145.79.227.48:4304 , piece_id=N462JVJDZUMFAB4L2OGOCTBJKQQ5I6SM3G2QXR72NZ4E2QCY2Y3Q, seg_pos={0 0}, upload=210482]: Done uploading piece. err: <nil> Sep 16 12:59:49.036542541 (239h31m25.076115661s) [noise=true , address=145.79.227.11:4752 , piece_id=MR6A7KTJSY4SSKWSESCKHERIG7XOT7PI2QUQ7HVM3SX3O2TWSIHA, seg_pos={0 0}, upload=210482]: Done uploading piece. err: <nil> Sep 16 13:00:00.105399785 (239h31m36.144972905s) [noise=true , address=145.79.227.3:4166 , piece_id=RPLBHGFUX2JEQ72SL7MQ557LGW6D5D7YPA2OPUZIKGMBSN7CA2YQ, seg_pos={0 0}, upload=210482]: Done uploading piece. err: ecclient: upload failed (node:12iCB7c4ZfpqafpD1PtpbE6BfU81wJW65LmrPVJXtD58yeuoR9t, address:145.79.227.3:4166): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:00:00.105498543 (239h31m36.145071663s) [noise=true , address=145.79.227.17:4996 , piece_id=32OUQPA2TA2JJQZA4PWGTNUSJNBQIS4B3MDL5KAHL6HQ3MXGLFXQ, seg_pos={0 0}, upload=210482]: Done uploading piece. err: ecclient: upload failed (node:12r6XcE2fb6YxU6kez4UMPeq82jNPi7YiRNmi33tQcTVYMYrMV4, address:145.79.227.17:4996): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:00:00.105636977 (239h31m36.145210097s) [noise=true , address=145.79.227.39:4015 , piece_id=HZ2JQOYFF5JDZFTZCUOBDUBB5YICRI6ZKEXTS4OEZPYKGCAGXSFA, seg_pos={0 0}, upload=210482]: Done uploading piece. err: ecclient: upload failed (node:18etsqD4wpYunpwdbPETCAn3JGJawbFAK9mwTkVUYKuWB7ypQE, address:145.79.227.39:4015): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:00:00.105674017 (239h31m36.145247147s) [noise=true , address=145.79.227.33:4875 , piece_id=SJ72E3FS2NJYQDLAF5HAQTNCDZV3WGLQDA6IVF6DGECBSTJNOKOA, seg_pos={0 0}, upload=210482]: Done uploading piece. err: ecclient: upload failed (node:1ijEJgYouyMkUqpLWWz7eH2NGvvs9XpN2ujDjupPykDe5eWcB1, address:145.79.227.33:4875): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:00:00.105762806 (239h31m36.145335936s) [noise=true , address=145.79.227.26:4663 , piece_id=KHX2J3TR5DDP7JYXC3YKS7XHRPHU7O3OMSITRAERJIFBP3LSRN5A, seg_pos={0 0}, upload=210482]: Done uploading piece. err: ecclient: upload failed (node:12SwpAaXTA3BqUvwubzmJkvwokdz6SSpT9t8HPtQcXXJxmcgfm2, address:145.79.227.26:4663): protocol: write tcp 188.166.225.170:58162->145.79.227.26:4663: use of closed network connection; write tcp 188.166.225.170:58162->145.79.227.26:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58162->145.79.227.26:4663: use of closed network connection Sep 16 13:00:00.105788104 (239h31m36.145361234s) [noise=true , address=145.79.227.52:4459 , piece_id=YCIUU7SJW56ZIBZO573666RO5LTO4S36UY4PS3MECPHRX5UOCIJA, seg_pos={0 0}, upload=210482]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: expected piece hash; write tcp 188.166.225.170:44360->145.79.227.52:4459: use of closed network connection; write tcp 188.166.225.170:44360->145.79.227.52:4459: use of closed network connection; EOF Sep 16 13:00:00.105862636 (239h31m36.145435756s) [noise=true , address=145.79.227.49:4359 , piece_id=MYFTMVV5435MSCBE7ROT2VEP55FNRWUVMPTNYNDCCMG4SCES2PKQ, seg_pos={0 0}, upload=210482]: Done uploading piece. err: ecclient: upload failed (node:1YgFc7P9RCbYw9u2wfow8Z3DMwFvJ6AnCsvzoxU9pTwPWGw8MV, address:145.79.227.49:4359): protocol: expected piece hash; write tcp 188.166.225.170:40224->145.79.227.49:4359: use of closed network connection; write tcp 188.166.225.170:40224->145.79.227.49:4359: use of closed network connection; EOF Sep 16 13:00:00.105872425 (239h31m36.145445546s) [noise=true , address=145.79.227.27:4694 , piece_id=67TD7PIPYO5HDGMPNEFTZFJQCEWQLXWN5NTPQ5UQLAS4NENRY6IQ, seg_pos={0 0}, upload=210482]: Done uploading piece. err: ecclient: upload failed (node:17sHakGWopKRax7hbzezZASaWtH5tUUdFMP5diZDK3UwP153cd, address:145.79.227.27:4694): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 13:00:00.106014205 (239h31m36.145587335s) [noise=true , address=145.79.227.23:4578 , piece_id=73D6BR2F2VTHWCBMSNCPNQG7UOB6VYUPK5QTCXRPKH3OGCB7APMA, seg_pos={0 0}, upload=210482]: Done uploading piece. err: ecclient: upload failed (node:1poqPvwwjWwAAhkJ5WCDavg9oKxbJrf9xktnYA9DB6o9BV1G49, address:145.79.227.23:4578): protocol: write tcp 188.166.225.170:40490->145.79.227.23:4578: use of closed network connection; write tcp 188.166.225.170:40490->145.79.227.23:4578: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40490->145.79.227.23:4578: use of closed network connection Sep 16 13:00:00.106032550 (239h31m36.14560567s) [seg_pos={0 0}, upload=210482]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil> Sep 16 13:00:00.354227574 (239h31m36.393800704s) [upload=210482]: Done uploading segments... Sep 16 13:00:00.354263613 (239h31m36.393836733s) [upload=210482]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9) Duration: 1m0.251089419s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [............X......X.X.......XXXX.XX.XXXXXX..XX.XXX..XX.X.X.] duration: 10.747900888s FAIL (2025-09-16 12:59:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== lush batch item: pb.BatchRequestItem_ObjectBegin Sep 16 12:58:45.397668436 (239h30m21.437241556s) [upload=210477]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 16 12:58:45.682071689 (239h30m21.72164482s) [seg_pos={0 0}, upload=210477]: Begin upload segment... Sep 16 12:58:45.682114291 (239h30m21.721687411s) [seg_pos={0 0}, upload=210477]: Done begin upload segment. Sep 16 12:58:45.682143738 (239h30m21.721716868s) [noise=true , address=145.79.227.2:4113 , piece_id=P3HX5NVPCTDB4YSVENS55ERHBOO6JVKYMZJKCHHZKS7HKQHKC7IA, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.682151242 (239h30m21.721724372s) [noise=true , address=45.91.116.12:4226 , piece_id=KFVIRVRW2XOPOIOZLSZMTLH62BNNY5JLBSOGA5RCGP772ZLSPQ6Q, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.682491059 (239h30m21.722064189s) [noise=true , address=45.91.116.10:4081 , piece_id=KOESAOLYGNFTBKIOO2BTWEDNJCEVHDE4A35DPTOQ6SD3B635XWVA, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.682577343 (239h30m21.722150463s) [noise=true , address=145.79.227.14:4839 , piece_id=GWYEOZAOBIMPGVANDRNDLH2TDIXB7FCSBM2FQT5ZX7NO5HJBOBVQ, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.682731146 (239h30m21.722304276s) [noise=true , address=145.79.227.2:4114 , piece_id=APEVISS4GBXP2DHVDCDIJXCOQF4NLGL5OVE27VFRPQNQ5HMMMDXA, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.682941907 (239h30m21.722515038s) [noise=true , address=45.91.116.6:4975 , piece_id=LKW3W3GRXSNC3W3WX65O5YUC4NDOOR5ROPAX3ETM2MSLJUIM2J2A, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.682966985 (239h30m21.722540105s) [noise=true , address=77.90.31.10:4518 , piece_id=4YRRLCOAPKGPOBC52UALMOBY6ZRHVLGUPXCCJHLCW52DNWYZSPVQ, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.683311330 (239h30m21.72288445s) [noise=true , address=145.79.227.15:4876 , piece_id=MJ5FBUS6TQYUBHDWJNKUAVHADKUHWZ7RH6MWTMOLMQ6DHGUFE7JQ, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.683354643 (239h30m21.722927773s) [noise=true , address=45.91.116.11:4119 , piece_id=5HNSIW24TWZ6ZTNCX3NW2QFZJ7ZIQDN6KIUWG3G5OKD4WFTSPXLA, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.683594740 (239h30m21.72316787s) [noise=true , address=145.79.227.11:4730 , piece_id=HL2N3PLPG3K74ZYHCE2LTLSQ3TIR43AOBMGGWIPQHGMW4VRR4KBQ, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.683900532 (239h30m21.723473662s) [noise=true , address=145.79.227.7:4293 , piece_id=IYYVVHDFYTABDUO2AXQKFM5A5I6MQPEOAOLC3CPCNBGIO6GEL6DA, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.684201275 (239h30m21.723774405s) [noise=true , address=45.91.116.4:4940 , piece_id=ENJUMJXMNHSEZ6R7GWA45L6JMB7JI3JENZ3OGFUEP72CJ5Y3RCFA, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.684577722 (239h30m21.724150852s) [noise=true , address=45.91.116.12:4227 , piece_id=4GXSURL7OKNG6BD7VWT3N6JEJZIDR6CR3NUT44NDIII3FZDRWVRA, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.684892181 (239h30m21.724465301s) [noise=true , address=77.90.31.12:4590 , piece_id=BQ5664UNNTRDMGWJCXABCPYNLDI6AMNLCXAXML47HKBJYXLUD2BQ, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.685397763 (239h30m21.724970893s) [noise=true , address=45.91.116.5:4299 , piece_id=N4HZKHQ3HV7EKPLADX55ENE32PZ7PIMQNYQUHGCJSEQNN6HIPAYA, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.685710479 (239h30m21.725283609s) [noise=true , address=145.79.227.14:4837 , piece_id=3E2GLK27LSK2YC5XBNUDJ4GBNIEYMO27U3G2QH54WCDZU7VL6NUQ, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:47.420933433 (239h30m23.460506563s) [upload=210477]: Next returned nil segment Sep 16 12:58:47.420953462 (239h30m23.460526582s) [upload=210477]: Waiting for error group managing segments... Sep 16 12:58:47.825036537 (239h30m23.864609657s) [noise=true , address=45.91.116.12:4226 , piece_id=KFVIRVRW2XOPOIOZLSZMTLH62BNNY5JLBSOGA5RCGP772ZLSPQ6Q, seg_pos={0 0}, upload=210477]: Done uploading piece. err: <nil> Sep 16 12:58:47.840025298 (239h30m23.879598428s) [noise=true , address=45.91.116.11:4119 , piece_id=5HNSIW24TWZ6ZTNCX3NW2QFZJ7ZIQDN6KIUWG3G5OKD4WFTSPXLA, seg_pos={0 0}, upload=210477]: Done uploading piece. err: <nil> Sep 16 12:58:47.850645353 (239h30m23.890218473s) [noise=true , address=45.91.116.5:4299 , piece_id=N4HZKHQ3HV7EKPLADX55ENE32PZ7PIMQNYQUHGCJSEQNN6HIPAYA, seg_pos={0 0}, upload=210477]: Done uploading piece. err: <nil> Sep 16 12:58:47.863740368 (239h30m23.903313498s) [noise=true , address=45.91.116.10:4081 , piece_id=KOESAOLYGNFTBKIOO2BTWEDNJCEVHDE4A35DPTOQ6SD3B635XWVA, seg_pos={0 0}, upload=210477]: Done uploading piece. err: <nil> Sep 16 12:58:47.869054448 (239h30m23.908627578s) [noise=true , address=45.91.116.12:4227 , piece_id=4GXSURL7OKNG6BD7VWT3N6JEJZIDR6CR3NUT44NDIII3FZDRWVRA, seg_pos={0 0}, upload=210477]: Done uploading piece. err: <nil> Sep 16 12:58:47.878814363 (239h30m23.918387483s) [noise=true , address=77.90.31.12:4590 , piece_id=BQ5664UNNTRDMGWJCXABCPYNLDI6AMNLCXAXML47HKBJYXLUD2BQ, seg_pos={0 0}, upload=210477]: Done uploading piece. err: <nil> Sep 16 12:58:47.895449310 (239h30m23.93502243s) [noise=true , address=45.91.116.6:4975 , piece_id=LKW3W3GRXSNC3W3WX65O5YUC4NDOOR5ROPAX3ETM2MSLJUIM2J2A, seg_pos={0 0}, upload=210477]: Done uploading piece. err: <nil> Sep 16 12:58:47.957271936 (239h30m23.996845066s) [noise=true , address=77.90.31.10:4518 , piece_id=4YRRLCOAPKGPOBC52UALMOBY6ZRHVLGUPXCCJHLCW52DNWYZSPVQ, seg_pos={0 0}, upload=210477]: Done uploading piece. err: <nil> Sep 16 12:58:47.984766191 (239h30m24.024339311s) [noise=true , address=45.91.116.4:4940 , piece_id=ENJUMJXMNHSEZ6R7GWA45L6JMB7JI3JENZ3OGFUEP72CJ5Y3RCFA, seg_pos={0 0}, upload=210477]: Done uploading piece. err: <nil> Sep 16 12:59:13.662600356 (239h30m49.702173486s) [noise=true , address=145.79.227.11:4730 , piece_id=HL2N3PLPG3K74ZYHCE2LTLSQ3TIR43AOBMGGWIPQHGMW4VRR4KBQ, seg_pos={0 0}, upload=210477]: Done uploading piece. err: <nil> Sep 16 12:59:14.643012543 (239h30m50.682585673s) [noise=true , address=145.79.227.14:4837 , piece_id=3E2GLK27LSK2YC5XBNUDJ4GBNIEYMO27U3G2QH54WCDZU7VL6NUQ, seg_pos={0 0}, upload=210477]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:59:14.643280934 (239h30m50.682854064s) [noise=true , address=145.79.227.2:4114 , piece_id=APEVISS4GBXP2DHVDCDIJXCOQF4NLGL5OVE27VFRPQNQ5HMMMDXA, seg_pos={0 0}, upload=210477]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:41704->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:41704->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41704->145.79.227.2:4114: use of closed network connection Sep 16 12:59:14.643335829 (239h30m50.682908959s) [noise=true , address=145.79.227.7:4293 , piece_id=IYYVVHDFYTABDUO2AXQKFM5A5I6MQPEOAOLC3CPCNBGIO6GEL6DA, seg_pos={0 0}, upload=210477]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 188.166.225.170:38760->145.79.227.7:4293: use of closed network connection; write tcp 188.166.225.170:38760->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38760->145.79.227.7:4293: use of closed network connection Sep 16 12:59:14.643402215 (239h30m50.682975345s) [noise=true , address=145.79.227.14:4839 , piece_id=GWYEOZAOBIMPGVANDRNDLH2TDIXB7FCSBM2FQT5ZX7NO5HJBOBVQ, seg_pos={0 0}, upload=210477]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:40572->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:40572->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40572->145.79.227.14:4839: use of closed network connection Sep 16 12:59:14.643447511 (239h30m50.683020631s) [noise=true , address=145.79.227.15:4876 , piece_id=MJ5FBUS6TQYUBHDWJNKUAVHADKUHWZ7RH6MWTMOLMQ6DHGUFE7JQ, seg_pos={0 0}, upload=210477]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: write tcp 188.166.225.170:57920->145.79.227.15:4876: use of closed network connection; write tcp 188.166.225.170:57920->145.79.227.15:4876: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57920->145.79.227.15:4876: use of closed network connection Sep 16 12:59:14.643492588 (239h30m50.683065718s) [noise=true , address=145.79.227.2:4113 , piece_id=P3HX5NVPCTDB4YSVENS55ERHBOO6JVKYMZJKCHHZKS7HKQHKC7IA, seg_pos={0 0}, upload=210477]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: write tcp 188.166.225.170:38784->145.79.227.2:4113: use of closed network connection; write tcp 188.166.225.170:38784->145.79.227.2:4113: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38784->145.79.227.2:4113: use of closed network connection Sep 16 12:59:14.643510872 (239h30m50.683084002s) [seg_pos={0 0}, upload=210477]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 16 12:59:14.903881683 (239h30m50.943454803s) [upload=210477]: Done uploading segments... Sep 16 12:59:14.903918002 (239h30m50.943491132s) [upload=210477]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 10.747932377s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 4.960305925s FAIL (2025-09-16 12:59:45 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== JFA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422604190 (238h59m45.46217732s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422896808 (238h59m45.462469928s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423232478 (238h59m45.462805608s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423565571 (238h59m45.463138691s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423935696 (238h59m45.463508826s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424280403 (238h59m45.463853533s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424633305 (238h59m45.464206435s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424994342 (238h59m45.464567472s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425341152 (238h59m45.464914282s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425707831 (238h59m45.465280951s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.426034432 (238h59m45.465607562s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429082236 (238h59m45.468655366s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429521483 (238h59m45.469094613s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:10.278696743 (238h59m46.318269863s) [upload=210063]: Next returned nil segment Sep 16 12:28:10.278720237 (238h59m46.318293367s) [upload=210063]: Waiting for error group managing segments... Sep 16 12:28:10.652409183 (238h59m46.691982303s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.662938092 (238h59m46.702511222s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.670032272 (238h59m46.709605402s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.701595607 (238h59m46.741168737s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.704157255 (238h59m46.743730385s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.707972140 (238h59m46.74754527s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.708523660 (238h59m46.74809678s) [noise=true , address=89.149.201.147:4007 , piece_id=BOQVD3EW5UAYWKEZ5FWC2QCDGIROAEOQN2OEYQ4QACNVDEIFF2IA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.754549157 (238h59m46.794122277s) [noise=true , address=89.149.201.147:4010 , piece_id=OALYBM6QEAOKMQPP2R3Y7LBVOEJYPMTBHJTGE2DSRO3KLRGBZC3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.138412786 (238h59m47.177985916s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.163219826 (238h59m47.202792956s) [noise=true , address=81.171.14.70:4039 , piece_id=IMLIU4QCGFNXWATVWK4L7FZPWOVPCRXNH4F3HSMF5VLQZJUEBO3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.169643348 (238h59m47.209216478s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.231770296 (238h59m47.271343416s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.258046263 (238h59m47.297619383s) [noise=true , address=185.167.204.205:4034 , piece_id=FUHHRFVDRYETJRWVBQZRALI4UGKDQ6DXV7TDKXBRASOMGOEN6YOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.263155884 (238h59m47.302729004s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.269762875 (238h59m47.309336005s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.281404505 (238h59m47.320977635s) [noise=true , address=185.167.204.205:4027 , piece_id=3O5SOEMEXYDYR5OE6SZJ2AVVLNYG4V4IMZOFUL7XDJEZUHDUV5TA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.289386705 (238h59m47.328959825s) [noise=true , address=185.167.204.206:4063 , piece_id=ERJLEJ5EILBCN4WUPZBVYSB2CGDWORVZ3GASSXBVNGR25GWVFYOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.298140815 (238h59m47.337713945s) [noise=true , address=185.167.204.206:4043 , piece_id=LDZTOC67YHM344PUCLVJ7RMKQAYJAQJ4GMKYZNN5LLU5KIUQCW7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.311391579 (238h59m47.350964709s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.317381906 (238h59m47.356955036s) [noise=true , address=185.167.204.206:4065 , piece_id=UXYM6MEGCQFRRRSMGI5XKJJJ6GYW7IJXG5QDGMICLP3FNJDSFRSQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.318355050 (238h59m47.35792818s) [noise=true , address=185.167.204.205:4018 , piece_id=VZP55ZA5Y5IA2PUH75QDVB56UHRJJ2XNC75L5WCRUSHGHQGZ463A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.330083334 (238h59m47.369656464s) [noise=true , address=185.167.204.206:4052 , piece_id=CDKZXVC22A62STE3NYD4R2TWT3AF45U2A7MHEIQJPTNMUKBVFJFA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.331429858 (238h59m47.371002988s) [noise=true , address=185.167.204.205:4035 , piece_id=M6LWKXSTJHGHXHY4VEJ2IGLI2UX4IIZV5KD4A6YY3BMIQ6ZRBMAQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.341689555 (238h59m47.381262686s) [noise=true , address=185.167.204.205:4014 , piece_id=MDSUAX4XNI5INUUQCMAP26PQFV62U3TZ2OITZR3BSNDQLHWEOKIA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.346694947 (238h59m47.386268077s) [noise=true , address=185.167.204.205:4023 , piece_id=YNW6TYPAVMYIHD5BT6QZGJJAGDM2XSZ4QYX4C2TH5QRGNTNP4KUQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363156895 (238h59m47.402730015s) [noise=true , address=185.167.204.206:4059 , piece_id=IX3H3WSLKDNPCCA5NMFUGMO2P6CA274AEUXLGVA3WRGJM3SN2OZQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363183276 (238h59m47.402756406s) [seg_pos={0 0}, upload=210063]: Segment reached optimal threshold of 26 pieces. Sep 16 12:28:11.363333942 (238h59m47.402907072s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363361435 (238h59m47.402934565s) [noise=true , address=185.167.204.206:4066 , piece_id=XXWYU36QFNZ2HCZF2WGAG4LKIBE3GCCKNVBDV6N5RQMCDJJXJULQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: expected piece hash; context canceled; EOF Sep 16 12:28:11.363393326 (238h59m47.402966456s) [seg_pos={0 0}, upload=210063]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil> Sep 16 12:28:11.363496222 (238h59m47.403069362s) [upload=210063]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 16 12:28:11.363503285 (238h59m47.403076405s) [upload=210063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 16 12:28:11.633947931 (238h59m47.673521071s) [upload=210063]: Done uploading segments... Sep 16 12:28:11.633974231 (238h59m47.673547372s) [upload=210063]: Upload finished. err: <nil> Duration: 4.960348065s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [.............X......X.X.......XXXX.XX.XXXXXX..XX.XXX..XX.X.X] duration: 30.262627939s FAIL (2025-09-16 12:59:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== lush batch item: pb.BatchRequestItem_ObjectBegin Sep 16 12:58:45.397668436 (239h30m21.437241556s) [upload=210477]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 16 12:58:45.682071689 (239h30m21.72164482s) [seg_pos={0 0}, upload=210477]: Begin upload segment... Sep 16 12:58:45.682114291 (239h30m21.721687411s) [seg_pos={0 0}, upload=210477]: Done begin upload segment. Sep 16 12:58:45.682143738 (239h30m21.721716868s) [noise=true , address=145.79.227.2:4113 , piece_id=P3HX5NVPCTDB4YSVENS55ERHBOO6JVKYMZJKCHHZKS7HKQHKC7IA, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.682151242 (239h30m21.721724372s) [noise=true , address=45.91.116.12:4226 , piece_id=KFVIRVRW2XOPOIOZLSZMTLH62BNNY5JLBSOGA5RCGP772ZLSPQ6Q, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.682491059 (239h30m21.722064189s) [noise=true , address=45.91.116.10:4081 , piece_id=KOESAOLYGNFTBKIOO2BTWEDNJCEVHDE4A35DPTOQ6SD3B635XWVA, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.682577343 (239h30m21.722150463s) [noise=true , address=145.79.227.14:4839 , piece_id=GWYEOZAOBIMPGVANDRNDLH2TDIXB7FCSBM2FQT5ZX7NO5HJBOBVQ, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.682731146 (239h30m21.722304276s) [noise=true , address=145.79.227.2:4114 , piece_id=APEVISS4GBXP2DHVDCDIJXCOQF4NLGL5OVE27VFRPQNQ5HMMMDXA, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.682941907 (239h30m21.722515038s) [noise=true , address=45.91.116.6:4975 , piece_id=LKW3W3GRXSNC3W3WX65O5YUC4NDOOR5ROPAX3ETM2MSLJUIM2J2A, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.682966985 (239h30m21.722540105s) [noise=true , address=77.90.31.10:4518 , piece_id=4YRRLCOAPKGPOBC52UALMOBY6ZRHVLGUPXCCJHLCW52DNWYZSPVQ, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.683311330 (239h30m21.72288445s) [noise=true , address=145.79.227.15:4876 , piece_id=MJ5FBUS6TQYUBHDWJNKUAVHADKUHWZ7RH6MWTMOLMQ6DHGUFE7JQ, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.683354643 (239h30m21.722927773s) [noise=true , address=45.91.116.11:4119 , piece_id=5HNSIW24TWZ6ZTNCX3NW2QFZJ7ZIQDN6KIUWG3G5OKD4WFTSPXLA, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.683594740 (239h30m21.72316787s) [noise=true , address=145.79.227.11:4730 , piece_id=HL2N3PLPG3K74ZYHCE2LTLSQ3TIR43AOBMGGWIPQHGMW4VRR4KBQ, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.683900532 (239h30m21.723473662s) [noise=true , address=145.79.227.7:4293 , piece_id=IYYVVHDFYTABDUO2AXQKFM5A5I6MQPEOAOLC3CPCNBGIO6GEL6DA, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.684201275 (239h30m21.723774405s) [noise=true , address=45.91.116.4:4940 , piece_id=ENJUMJXMNHSEZ6R7GWA45L6JMB7JI3JENZ3OGFUEP72CJ5Y3RCFA, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.684577722 (239h30m21.724150852s) [noise=true , address=45.91.116.12:4227 , piece_id=4GXSURL7OKNG6BD7VWT3N6JEJZIDR6CR3NUT44NDIII3FZDRWVRA, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.684892181 (239h30m21.724465301s) [noise=true , address=77.90.31.12:4590 , piece_id=BQ5664UNNTRDMGWJCXABCPYNLDI6AMNLCXAXML47HKBJYXLUD2BQ, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.685397763 (239h30m21.724970893s) [noise=true , address=45.91.116.5:4299 , piece_id=N4HZKHQ3HV7EKPLADX55ENE32PZ7PIMQNYQUHGCJSEQNN6HIPAYA, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:45.685710479 (239h30m21.725283609s) [noise=true , address=145.79.227.14:4837 , piece_id=3E2GLK27LSK2YC5XBNUDJ4GBNIEYMO27U3G2QH54WCDZU7VL6NUQ, seg_pos={0 0}, upload=210477]: Uploading piece... Sep 16 12:58:47.420933433 (239h30m23.460506563s) [upload=210477]: Next returned nil segment Sep 16 12:58:47.420953462 (239h30m23.460526582s) [upload=210477]: Waiting for error group managing segments... Sep 16 12:58:47.825036537 (239h30m23.864609657s) [noise=true , address=45.91.116.12:4226 , piece_id=KFVIRVRW2XOPOIOZLSZMTLH62BNNY5JLBSOGA5RCGP772ZLSPQ6Q, seg_pos={0 0}, upload=210477]: Done uploading piece. err: <nil> Sep 16 12:58:47.840025298 (239h30m23.879598428s) [noise=true , address=45.91.116.11:4119 , piece_id=5HNSIW24TWZ6ZTNCX3NW2QFZJ7ZIQDN6KIUWG3G5OKD4WFTSPXLA, seg_pos={0 0}, upload=210477]: Done uploading piece. err: <nil> Sep 16 12:58:47.850645353 (239h30m23.890218473s) [noise=true , address=45.91.116.5:4299 , piece_id=N4HZKHQ3HV7EKPLADX55ENE32PZ7PIMQNYQUHGCJSEQNN6HIPAYA, seg_pos={0 0}, upload=210477]: Done uploading piece. err: <nil> Sep 16 12:58:47.863740368 (239h30m23.903313498s) [noise=true , address=45.91.116.10:4081 , piece_id=KOESAOLYGNFTBKIOO2BTWEDNJCEVHDE4A35DPTOQ6SD3B635XWVA, seg_pos={0 0}, upload=210477]: Done uploading piece. err: <nil> Sep 16 12:58:47.869054448 (239h30m23.908627578s) [noise=true , address=45.91.116.12:4227 , piece_id=4GXSURL7OKNG6BD7VWT3N6JEJZIDR6CR3NUT44NDIII3FZDRWVRA, seg_pos={0 0}, upload=210477]: Done uploading piece. err: <nil> Sep 16 12:58:47.878814363 (239h30m23.918387483s) [noise=true , address=77.90.31.12:4590 , piece_id=BQ5664UNNTRDMGWJCXABCPYNLDI6AMNLCXAXML47HKBJYXLUD2BQ, seg_pos={0 0}, upload=210477]: Done uploading piece. err: <nil> Sep 16 12:58:47.895449310 (239h30m23.93502243s) [noise=true , address=45.91.116.6:4975 , piece_id=LKW3W3GRXSNC3W3WX65O5YUC4NDOOR5ROPAX3ETM2MSLJUIM2J2A, seg_pos={0 0}, upload=210477]: Done uploading piece. err: <nil> Sep 16 12:58:47.957271936 (239h30m23.996845066s) [noise=true , address=77.90.31.10:4518 , piece_id=4YRRLCOAPKGPOBC52UALMOBY6ZRHVLGUPXCCJHLCW52DNWYZSPVQ, seg_pos={0 0}, upload=210477]: Done uploading piece. err: <nil> Sep 16 12:58:47.984766191 (239h30m24.024339311s) [noise=true , address=45.91.116.4:4940 , piece_id=ENJUMJXMNHSEZ6R7GWA45L6JMB7JI3JENZ3OGFUEP72CJ5Y3RCFA, seg_pos={0 0}, upload=210477]: Done uploading piece. err: <nil> Sep 16 12:59:13.662600356 (239h30m49.702173486s) [noise=true , address=145.79.227.11:4730 , piece_id=HL2N3PLPG3K74ZYHCE2LTLSQ3TIR43AOBMGGWIPQHGMW4VRR4KBQ, seg_pos={0 0}, upload=210477]: Done uploading piece. err: <nil> Sep 16 12:59:14.643012543 (239h30m50.682585673s) [noise=true , address=145.79.227.14:4837 , piece_id=3E2GLK27LSK2YC5XBNUDJ4GBNIEYMO27U3G2QH54WCDZU7VL6NUQ, seg_pos={0 0}, upload=210477]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:59:14.643280934 (239h30m50.682854064s) [noise=true , address=145.79.227.2:4114 , piece_id=APEVISS4GBXP2DHVDCDIJXCOQF4NLGL5OVE27VFRPQNQ5HMMMDXA, seg_pos={0 0}, upload=210477]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:41704->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:41704->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41704->145.79.227.2:4114: use of closed network connection Sep 16 12:59:14.643335829 (239h30m50.682908959s) [noise=true , address=145.79.227.7:4293 , piece_id=IYYVVHDFYTABDUO2AXQKFM5A5I6MQPEOAOLC3CPCNBGIO6GEL6DA, seg_pos={0 0}, upload=210477]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 188.166.225.170:38760->145.79.227.7:4293: use of closed network connection; write tcp 188.166.225.170:38760->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38760->145.79.227.7:4293: use of closed network connection Sep 16 12:59:14.643402215 (239h30m50.682975345s) [noise=true , address=145.79.227.14:4839 , piece_id=GWYEOZAOBIMPGVANDRNDLH2TDIXB7FCSBM2FQT5ZX7NO5HJBOBVQ, seg_pos={0 0}, upload=210477]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:40572->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:40572->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40572->145.79.227.14:4839: use of closed network connection Sep 16 12:59:14.643447511 (239h30m50.683020631s) [noise=true , address=145.79.227.15:4876 , piece_id=MJ5FBUS6TQYUBHDWJNKUAVHADKUHWZ7RH6MWTMOLMQ6DHGUFE7JQ, seg_pos={0 0}, upload=210477]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: write tcp 188.166.225.170:57920->145.79.227.15:4876: use of closed network connection; write tcp 188.166.225.170:57920->145.79.227.15:4876: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57920->145.79.227.15:4876: use of closed network connection Sep 16 12:59:14.643492588 (239h30m50.683065718s) [noise=true , address=145.79.227.2:4113 , piece_id=P3HX5NVPCTDB4YSVENS55ERHBOO6JVKYMZJKCHHZKS7HKQHKC7IA, seg_pos={0 0}, upload=210477]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: write tcp 188.166.225.170:38784->145.79.227.2:4113: use of closed network connection; write tcp 188.166.225.170:38784->145.79.227.2:4113: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38784->145.79.227.2:4113: use of closed network connection Sep 16 12:59:14.643510872 (239h30m50.683084002s) [seg_pos={0 0}, upload=210477]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 16 12:59:14.903881683 (239h30m50.943454803s) [upload=210477]: Done uploading segments... Sep 16 12:59:14.903918002 (239h30m50.943491132s) [upload=210477]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 30.262655732s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 28 out of 60 is failed (threshold=3) [............................X.X..XXX.XXXXXXXXXXXXXXXXXXXXXXX] duration: 1m0.973517555s FAIL (2025-09-16 12:58:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== 59.636422987 (239h29m35.675996107s) [upload=210468]: Done starting upload Sep 16 12:57:59.636589515 (239h29m35.676162645s) [upload=210468]: Uploading segments... Sep 16 12:57:59.636847135 (239h29m35.676420265s) [upload=210468]: Got next segment. Inline: false Sep 16 12:57:59.636889686 (239h29m35.676462816s) [upload=210468]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 16 12:57:59.636896128 (239h29m35.676469258s) [upload=210468]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 16 12:58:00.126930804 (239h29m36.166503934s) [seg_pos={0 0}, upload=210468]: Begin upload segment... Sep 16 12:58:00.127013040 (239h29m36.16658616s) [noise=true , address=77.90.31.11:4561 , piece_id=FRK2ZBIFPQ3T3HJ6UCHKFTSSKBNIU6ZTS6XX6WE32SIXTKBOGEHQ, seg_pos={0 0}, upload=210468]: Uploading piece... Sep 16 12:58:00.127447328 (239h29m36.167020448s) [noise=true , address=77.90.31.19:4870 , piece_id=PJUTYZQRLKKRLK2LIYABKWLSTGOVBWMXM2DR64XYYXBJXKDRB4TA, seg_pos={0 0}, upload=210468]: Uploading piece... Sep 16 12:58:00.127750455 (239h29m36.167323585s) [noise=true , address=145.79.227.16:4942 , piece_id=HK3O3VJWR4GDUMGPKXIATWZZOMLNO5Q75PLH3RT6ZD5WPSA46X7Q, seg_pos={0 0}, upload=210468]: Uploading piece... Sep 16 12:58:00.128247742 (239h29m36.167820872s) [noise=true , address=145.79.227.11:4746 , piece_id=CPIS5OA6N62J5YT4GM5SSKZLZNAM7VF2IOTWYNV5OEIDIZKIMT7Q, seg_pos={0 0}, upload=210468]: Uploading piece... Sep 16 12:58:00.128911325 (239h29m36.168484446s) [noise=true , address=145.79.227.23:4564 , piece_id=AHPBIQNMHO3HDISKK2AP66VR7TVLAG26GSTBMXZUAOYK34DOBETQ, seg_pos={0 0}, upload=210468]: Uploading piece... Sep 16 12:58:00.129429663 (239h29m36.169002793s) [noise=true , address=145.79.227.24:4590 , piece_id=B7YSPUTOBVZ3B2U3FTZVFOY4INJLJOWOTBCSROUDS5TRY5QPIBMQ, seg_pos={0 0}, upload=210468]: Uploading piece... Sep 16 12:58:00.129625776 (239h29m36.169198896s) [noise=true , address=145.79.227.6:4287 , piece_id=YIIX377Q5WYMEZVGBZTRN33SUUR4YK6KCEAPAPUS6XYBWIJVML6Q, seg_pos={0 0}, upload=210468]: Uploading piece... Sep 16 12:58:00.130322844 (239h29m36.169895964s) [noise=true , address=145.79.227.17:4998 , piece_id=DDAHVS7QZJL3MD5LASG3RU7K7EL4SKJ2HM4L6I7RBMMYKLRZOF4Q, seg_pos={0 0}, upload=210468]: Uploading piece... Sep 16 12:58:00.131092810 (239h29m36.17066593s) [noise=true , address=145.79.227.36:4549 , piece_id=2PQLMZLVM4QOPBQBMPIKROM5WKNXFANY7AH776KHEOH5I66HQKPA, seg_pos={0 0}, upload=210468]: Uploading piece... Sep 16 12:58:00.131401868 (239h29m36.170974988s) [noise=true , address=145.79.227.33:4902 , piece_id=O4OQA74X4D72AK25YEZE6C7XIKG6PGRC6BMSLYBIZOZH5RC3P5GA, seg_pos={0 0}, upload=210468]: Uploading piece... Sep 16 12:58:00.131680539 (239h29m36.171253659s) [noise=true , address=145.79.227.52:4446 , piece_id=OVQ7RPUD3MLGLREOBX2TANOR6TK7EHFVZJB2GDTSP37ESAHP4Z6A, seg_pos={0 0}, upload=210468]: Uploading piece... Sep 16 12:58:00.131925095 (239h29m36.171498225s) [noise=true , address=145.79.227.50:4381 , piece_id=SJK6QZYOISXYT7XY445FZWDERYWRX3KG2VZBJCFQANYZMIM6LMSA, seg_pos={0 0}, upload=210468]: Uploading piece... Sep 16 12:58:00.132241387 (239h29m36.171814517s) [noise=true , address=145.79.227.46:4631 , piece_id=KHUU2RZBLK522EF6Q2LCVA5RN5OUSGI6TL6SET5FZSRTNEBRIHZA, seg_pos={0 0}, upload=210468]: Uploading piece... Sep 16 12:58:00.133872122 (239h29m36.173445242s) [seg_pos={0 0}, upload=210468]: Done begin upload segment. Sep 16 12:58:00.133890057 (239h29m36.173463177s) [noise=true , address=145.79.227.10:4434 , piece_id=BAPGJV2Z64ZVIESFWDJWYGYTLW2INKKX35GLOYKEPC7U4BRQZ5DA, seg_pos={0 0}, upload=210468]: Uploading piece... Sep 16 12:58:00.134503315 (239h29m36.174076445s) [noise=true , address=145.79.227.51:4443 , piece_id=2ZYE5KZLF6BAHN5IXWBWB4F5ML4UUQEZHLAUWGZO22IFYFZUAVJA, seg_pos={0 0}, upload=210468]: Uploading piece... Sep 16 12:58:00.135082708 (239h29m36.174655838s) [noise=true , address=145.79.227.4:4193 , piece_id=OL4EDYTSB2KXGMUAAFH5S2OXMUHVHYEGUC6G5ILBQPPH2WSRISDQ, seg_pos={0 0}, upload=210468]: Uploading piece... Sep 16 12:58:00.135663313 (239h29m36.175236444s) [noise=true , address=145.79.227.13:4824 , piece_id=GFDUKKPTX7ATMHNBEUNSUEVSB7UUCD6NLJ2VSTU77M2I67F7OS4A, seg_pos={0 0}, upload=210468]: Uploading piece... Sep 16 12:58:00.136243469 (239h29m36.175816589s) [noise=true , address=145.79.227.27:4692 , piece_id=TJSFTIN65BLIMPMR6J77TDVQXAG32BJD3ILIR3OENJ6AX7P7FDWA, seg_pos={0 0}, upload=210468]: Uploading piece... Sep 16 12:58:01.779342708 (239h29m37.818915838s) [upload=210468]: Next returned nil segment Sep 16 12:58:01.779368036 (239h29m37.818941167s) [upload=210468]: Waiting for error group managing segments... Sep 16 12:58:02.203870523 (239h29m38.243443653s) [noise=true , address=77.90.31.19:4870 , piece_id=PJUTYZQRLKKRLK2LIYABKWLSTGOVBWMXM2DR64XYYXBJXKDRB4TA, seg_pos={0 0}, upload=210468]: Done uploading piece. err: <nil> Sep 16 12:58:02.310204550 (239h29m38.34977769s) [noise=true , address=77.90.31.11:4561 , piece_id=FRK2ZBIFPQ3T3HJ6UCHKFTSSKBNIU6ZTS6XX6WE32SIXTKBOGEHQ, seg_pos={0 0}, upload=210468]: Done uploading piece. err: <nil> Sep 16 12:58:21.606194270 (239h29m57.6457674s) [noise=true , address=145.79.227.46:4631 , piece_id=KHUU2RZBLK522EF6Q2LCVA5RN5OUSGI6TL6SET5FZSRTNEBRIHZA, seg_pos={0 0}, upload=210468]: Done uploading piece. err: <nil> Sep 16 12:58:23.969959693 (239h30m0.009532823s) [noise=true , address=145.79.227.33:4902 , piece_id=O4OQA74X4D72AK25YEZE6C7XIKG6PGRC6BMSLYBIZOZH5RC3P5GA, seg_pos={0 0}, upload=210468]: Done uploading piece. err: <nil> Sep 16 12:58:25.197721355 (239h30m1.237294475s) [noise=true , address=145.79.227.11:4746 , piece_id=CPIS5OA6N62J5YT4GM5SSKZLZNAM7VF2IOTWYNV5OEIDIZKIMT7Q, seg_pos={0 0}, upload=210468]: Done uploading piece. err: <nil> Sep 16 12:58:28.839504471 (239h30m4.879077601s) [noise=true , address=145.79.227.23:4564 , piece_id=AHPBIQNMHO3HDISKK2AP66VR7TVLAG26GSTBMXZUAOYK34DOBETQ, seg_pos={0 0}, upload=210468]: Done uploading piece. err: <nil> Sep 16 12:58:47.298805993 (239h30m23.338379123s) [noise=true , address=145.79.227.13:4824 , piece_id=GFDUKKPTX7ATMHNBEUNSUEVSB7UUCD6NLJ2VSTU77M2I67F7OS4A, seg_pos={0 0}, upload=210468]: Done uploading piece. err: <nil> Sep 16 12:58:47.610139319 (239h30m23.649712449s) [noise=true , address=145.79.227.24:4590 , piece_id=B7YSPUTOBVZ3B2U3FTZVFOY4INJLJOWOTBCSROUDS5TRY5QPIBMQ, seg_pos={0 0}, upload=210468]: Done uploading piece. err: <nil> Sep 16 12:58:50.398541888 (239h30m26.438115008s) [noise=true , address=145.79.227.36:4549 , piece_id=2PQLMZLVM4QOPBQBMPIKROM5WKNXFANY7AH776KHEOH5I66HQKPA, seg_pos={0 0}, upload=210468]: Done uploading piece. err: <nil> Sep 16 12:58:51.713606138 (239h30m27.753179268s) [noise=true , address=145.79.227.6:4287 , piece_id=YIIX377Q5WYMEZVGBZTRN33SUUR4YK6KCEAPAPUS6XYBWIJVML6Q, seg_pos={0 0}, upload=210468]: Done uploading piece. err: <nil> Sep 16 12:58:53.023270092 (239h30m29.062843222s) [noise=true , address=145.79.227.4:4193 , piece_id=OL4EDYTSB2KXGMUAAFH5S2OXMUHVHYEGUC6G5ILBQPPH2WSRISDQ, seg_pos={0 0}, upload=210468]: Done uploading piece. err: <nil> Sep 16 12:58:53.962308984 (239h30m30.001882114s) [noise=true , address=145.79.227.16:4942 , piece_id=HK3O3VJWR4GDUMGPKXIATWZZOMLNO5Q75PLH3RT6ZD5WPSA46X7Q, seg_pos={0 0}, upload=210468]: Done uploading piece. err: <nil> Sep 16 12:58:58.898868417 (239h30m34.938441547s) [noise=true , address=145.79.227.10:4434 , piece_id=BAPGJV2Z64ZVIESFWDJWYGYTLW2INKKX35GLOYKEPC7U4BRQZ5DA, seg_pos={0 0}, upload=210468]: Done uploading piece. err: ecclient: upload failed (node:12hC4vAqz6Twt4iWiySS8pxktAKkiDfJAoRTSjcUk8oYgeC8GDt, address:145.79.227.10:4434): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:58:58.898939282 (239h30m34.938512402s) [noise=true , address=145.79.227.27:4692 , piece_id=TJSFTIN65BLIMPMR6J77TDVQXAG32BJD3ILIR3OENJ6AX7P7FDWA, seg_pos={0 0}, upload=210468]: Done uploading piece. err: ecclient: upload failed (node:1n3SDzXGgXbvYBGtLdND9oy93AHNFokRnF6Yv3EvoMC9UgN2H9, address:145.79.227.27:4692): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:58:58.898995660 (239h30m34.93856879s) [noise=true , address=145.79.227.52:4446 , piece_id=OVQ7RPUD3MLGLREOBX2TANOR6TK7EHFVZJB2GDTSP37ESAHP4Z6A, seg_pos={0 0}, upload=210468]: Done uploading piece. err: ecclient: upload failed (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7, address:145.79.227.52:4446): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:58:58.899048059 (239h30m34.938621179s) [noise=true , address=145.79.227.51:4443 , piece_id=2ZYE5KZLF6BAHN5IXWBWB4F5ML4UUQEZHLAUWGZO22IFYFZUAVJA, seg_pos={0 0}, upload=210468]: Done uploading piece. err: ecclient: upload failed (node:18Nf8ARLHWguGwfizGHNVtyCHU2vLcTYvCUwR7595ikTKfTDvk, address:145.79.227.51:4443): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:58:58.899092423 (239h30m34.938665644s) [noise=true , address=145.79.227.50:4381 , piece_id=SJK6QZYOISXYT7XY445FZWDERYWRX3KG2VZBJCFQANYZMIM6LMSA, seg_pos={0 0}, upload=210468]: Done uploading piece. err: ecclient: upload failed (node:1zU35MWWaaC1npkP5qGcWBXAkfxGsd5UsdkM2nwX9x7wUGCDbY, address:145.79.227.50:4381): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:58:58.899123683 (239h30m34.938696813s) [noise=true , address=145.79.227.17:4998 , piece_id=DDAHVS7QZJL3MD5LASG3RU7K7EL4SKJ2HM4L6I7RBMMYKLRZOF4Q, seg_pos={0 0}, upload=210468]: Done uploading piece. err: ecclient: upload failed (node:12m8BAEezShMZxBdiwdLhUD6FVbQfDdaFmNDkdM1mKC4WYsidMR, address:145.79.227.17:4998): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:58:58.899145335 (239h30m34.938718465s) [seg_pos={0 0}, upload=210468]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Sep 16 12:58:59.870591218 (239h30m35.910164348s) [upload=210468]: Done uploading segments... Sep 16 12:58:59.870625814 (239h30m35.910198944s) [upload=210468]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 1m0.973534458s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.059686798s FAIL (2025-09-16 12:58:39 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== JFA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422604190 (238h59m45.46217732s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422896808 (238h59m45.462469928s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423232478 (238h59m45.462805608s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423565571 (238h59m45.463138691s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423935696 (238h59m45.463508826s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424280403 (238h59m45.463853533s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424633305 (238h59m45.464206435s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424994342 (238h59m45.464567472s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425341152 (238h59m45.464914282s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425707831 (238h59m45.465280951s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.426034432 (238h59m45.465607562s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429082236 (238h59m45.468655366s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429521483 (238h59m45.469094613s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:10.278696743 (238h59m46.318269863s) [upload=210063]: Next returned nil segment Sep 16 12:28:10.278720237 (238h59m46.318293367s) [upload=210063]: Waiting for error group managing segments... Sep 16 12:28:10.652409183 (238h59m46.691982303s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.662938092 (238h59m46.702511222s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.670032272 (238h59m46.709605402s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.701595607 (238h59m46.741168737s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.704157255 (238h59m46.743730385s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.707972140 (238h59m46.74754527s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.708523660 (238h59m46.74809678s) [noise=true , address=89.149.201.147:4007 , piece_id=BOQVD3EW5UAYWKEZ5FWC2QCDGIROAEOQN2OEYQ4QACNVDEIFF2IA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.754549157 (238h59m46.794122277s) [noise=true , address=89.149.201.147:4010 , piece_id=OALYBM6QEAOKMQPP2R3Y7LBVOEJYPMTBHJTGE2DSRO3KLRGBZC3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.138412786 (238h59m47.177985916s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.163219826 (238h59m47.202792956s) [noise=true , address=81.171.14.70:4039 , piece_id=IMLIU4QCGFNXWATVWK4L7FZPWOVPCRXNH4F3HSMF5VLQZJUEBO3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.169643348 (238h59m47.209216478s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.231770296 (238h59m47.271343416s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.258046263 (238h59m47.297619383s) [noise=true , address=185.167.204.205:4034 , piece_id=FUHHRFVDRYETJRWVBQZRALI4UGKDQ6DXV7TDKXBRASOMGOEN6YOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.263155884 (238h59m47.302729004s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.269762875 (238h59m47.309336005s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.281404505 (238h59m47.320977635s) [noise=true , address=185.167.204.205:4027 , piece_id=3O5SOEMEXYDYR5OE6SZJ2AVVLNYG4V4IMZOFUL7XDJEZUHDUV5TA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.289386705 (238h59m47.328959825s) [noise=true , address=185.167.204.206:4063 , piece_id=ERJLEJ5EILBCN4WUPZBVYSB2CGDWORVZ3GASSXBVNGR25GWVFYOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.298140815 (238h59m47.337713945s) [noise=true , address=185.167.204.206:4043 , piece_id=LDZTOC67YHM344PUCLVJ7RMKQAYJAQJ4GMKYZNN5LLU5KIUQCW7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.311391579 (238h59m47.350964709s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.317381906 (238h59m47.356955036s) [noise=true , address=185.167.204.206:4065 , piece_id=UXYM6MEGCQFRRRSMGI5XKJJJ6GYW7IJXG5QDGMICLP3FNJDSFRSQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.318355050 (238h59m47.35792818s) [noise=true , address=185.167.204.205:4018 , piece_id=VZP55ZA5Y5IA2PUH75QDVB56UHRJJ2XNC75L5WCRUSHGHQGZ463A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.330083334 (238h59m47.369656464s) [noise=true , address=185.167.204.206:4052 , piece_id=CDKZXVC22A62STE3NYD4R2TWT3AF45U2A7MHEIQJPTNMUKBVFJFA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.331429858 (238h59m47.371002988s) [noise=true , address=185.167.204.205:4035 , piece_id=M6LWKXSTJHGHXHY4VEJ2IGLI2UX4IIZV5KD4A6YY3BMIQ6ZRBMAQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.341689555 (238h59m47.381262686s) [noise=true , address=185.167.204.205:4014 , piece_id=MDSUAX4XNI5INUUQCMAP26PQFV62U3TZ2OITZR3BSNDQLHWEOKIA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.346694947 (238h59m47.386268077s) [noise=true , address=185.167.204.205:4023 , piece_id=YNW6TYPAVMYIHD5BT6QZGJJAGDM2XSZ4QYX4C2TH5QRGNTNP4KUQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363156895 (238h59m47.402730015s) [noise=true , address=185.167.204.206:4059 , piece_id=IX3H3WSLKDNPCCA5NMFUGMO2P6CA274AEUXLGVA3WRGJM3SN2OZQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363183276 (238h59m47.402756406s) [seg_pos={0 0}, upload=210063]: Segment reached optimal threshold of 26 pieces. Sep 16 12:28:11.363333942 (238h59m47.402907072s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363361435 (238h59m47.402934565s) [noise=true , address=185.167.204.206:4066 , piece_id=XXWYU36QFNZ2HCZF2WGAG4LKIBE3GCCKNVBDV6N5RQMCDJJXJULQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: expected piece hash; context canceled; EOF Sep 16 12:28:11.363393326 (238h59m47.402966456s) [seg_pos={0 0}, upload=210063]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil> Sep 16 12:28:11.363496222 (238h59m47.403069362s) [upload=210063]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 16 12:28:11.363503285 (238h59m47.403076405s) [upload=210063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 16 12:28:11.633947931 (238h59m47.673521071s) [upload=210063]: Done uploading segments... Sep 16 12:28:11.633974231 (238h59m47.673547372s) [upload=210063]: Upload finished. err: <nil> Duration: 5.059726504s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 27 out of 60 is failed (threshold=3) [.............................X.X..XXX.XXXXXXXXXXXXXXXXXXXXXX] duration: 1m0.248908807s FAIL (2025-09-16 12:57:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== }, upload=210454]: Begin upload segment... Sep 16 12:56:59.692602094 (239h28m35.732175224s) [seg_pos={0 0}, upload=210454]: Done begin upload segment. Sep 16 12:56:59.692620730 (239h28m35.73219386s) [noise=true , address=77.90.31.19:4870 , piece_id=UJXES6SRQC3UXXZ7UBFQNRGQCUKX4PLENKMPDQKR5OPVMKMDWNKQ, seg_pos={0 0}, upload=210454]: Uploading piece... Sep 16 12:56:59.692642702 (239h28m35.732215822s) [noise=true , address=145.79.227.2:4131 , piece_id=JBA5KBLGQ6Y3IKWSTT5I3KMANDX5355DPIMZYFXL6MEVZBLR24TQ, seg_pos={0 0}, upload=210454]: Uploading piece... Sep 16 12:56:59.693104741 (239h28m35.732677881s) [noise=true , address=145.79.227.46:4631 , piece_id=RIYSFOSXEZ3LDC6SMRDTH3QMS4XGW5MTPZJUWZUYH4XWJUMSAC3A, seg_pos={0 0}, upload=210454]: Uploading piece... Sep 16 12:56:59.693479986 (239h28m35.733053116s) [noise=true , address=145.79.227.38:4986 , piece_id=QWEZPMABJG6DUFBHHCZDOHJYXA3AQG762WW23BDBFO26MBBPJ4CA, seg_pos={0 0}, upload=210454]: Uploading piece... Sep 16 12:56:59.693973896 (239h28m35.733547016s) [noise=true , address=145.79.227.12:4798 , piece_id=XIPEM6HA4EW2DF5VUUBKXOVHV5OXFAF7D5XQGJCYODMMIDY7A44A, seg_pos={0 0}, upload=210454]: Uploading piece... Sep 16 12:56:59.694318833 (239h28m35.733891963s) [noise=true , address=145.79.227.11:4764 , piece_id=WY2MPU6HOGA4QMEK573RYKUQLPMU5DKMDOXXZNJK3Q7D3J4SQNHQ, seg_pos={0 0}, upload=210454]: Uploading piece... Sep 16 12:56:59.694670232 (239h28m35.734243362s) [noise=true , address=145.79.227.52:4450 , piece_id=4I3SOTXEOSLFH7IQOUC44DXY2P7DJLB25JM4TN3OTC4CDULZJOTA, seg_pos={0 0}, upload=210454]: Uploading piece... Sep 16 12:56:59.695043744 (239h28m35.734616874s) [noise=true , address=145.79.227.26:4673 , piece_id=YF4JOVI7DDDWNSIVSFS2BX76ZY4N4XC2XWGCY7SUYEM4DXT3KEWA, seg_pos={0 0}, upload=210454]: Uploading piece... Sep 16 12:56:59.695420922 (239h28m35.734994052s) [noise=true , address=145.79.227.18:4031 , piece_id=WO6JTH5UVJBHXPMIPPTEBQGF74IHK2J6TMBKBXDQ6SRFMBWC6NUQ, seg_pos={0 0}, upload=210454]: Uploading piece... Sep 16 12:56:59.695812357 (239h28m35.735385507s) [noise=true , address=145.79.227.33:4876 , piece_id=FX7IAQUYQVHRSV32GOAEPKPCKHGJ4HHXIBNQ3N4QSUV5DB7UEVFA, seg_pos={0 0}, upload=210454]: Uploading piece... Sep 16 12:56:59.696220996 (239h28m35.735794126s) [noise=true , address=145.79.227.36:4534 , piece_id=NPPSN4AKLRZ2R5YIRLXE5YQC3QF7KHC37MDCSLL57SK6THAOSATA, seg_pos={0 0}, upload=210454]: Uploading piece... Sep 16 12:56:59.696676874 (239h28m35.736250014s) [noise=true , address=77.90.31.15:4700 , piece_id=RQGH3J7MCVVTRXSUSA7UGQV2XVDOVTNDUZGTWTOH4BUDR6CRPUOQ, seg_pos={0 0}, upload=210454]: Uploading piece... Sep 16 12:56:59.697065043 (239h28m35.736638173s) [noise=true , address=145.79.227.8:4331 , piece_id=H42PQBDD37474MM6HZMMYGHDHSYZGHZ7NQNVX3T2JHTX6FCGYNCQ, seg_pos={0 0}, upload=210454]: Uploading piece... Sep 16 12:56:59.697450527 (239h28m35.737023647s) [noise=true , address=145.79.227.35:4511 , piece_id=QOBKOOAEDEA2HJHSNT7GK536CHU7N7TSQWOWNZPXYCQU6BGNFYAQ, seg_pos={0 0}, upload=210454]: Uploading piece... Sep 16 12:56:59.697884372 (239h28m35.737457502s) [noise=true , address=145.79.227.27:4714 , piece_id=SQFSA4NBQVJHSLJUJQ7DLSLGZHUQG6HRDIY2PB7ZNEYG54THHWDA, seg_pos={0 0}, upload=210454]: Uploading piece... Sep 16 12:56:59.698267542 (239h28m35.737840682s) [noise=true , address=145.79.227.15:4879 , piece_id=ZH3Y5ENWG25K7MTJR4HBOWJIS4IW3CUNRO7JYPHTITNWE7456ZCA, seg_pos={0 0}, upload=210454]: Uploading piece... Sep 16 12:56:59.698645532 (239h28m35.738218662s) [noise=true , address=145.79.227.49:4369 , piece_id=7IAPRXIZKHUO7ZIWPEHZT4BE4SM3YYT7VHEQISJD4PRLQBVZ4T5A, seg_pos={0 0}, upload=210454]: Uploading piece... Sep 16 12:56:59.699033671 (239h28m35.738606801s) [noise=true , address=145.79.227.9:4371 , piece_id=YW6STZF5EC7Q4SVAXZJHDNVW6RYWL5GYEDKETNBEXL6NCDSK37EA, seg_pos={0 0}, upload=210454]: Uploading piece... Sep 16 12:57:01.360826376 (239h28m37.400399496s) [upload=210454]: Next returned nil segment Sep 16 12:57:01.360848298 (239h28m37.400421458s) [upload=210454]: Waiting for error group managing segments... Sep 16 12:57:01.816497907 (239h28m37.856071037s) [noise=true , address=77.90.31.15:4700 , piece_id=RQGH3J7MCVVTRXSUSA7UGQV2XVDOVTNDUZGTWTOH4BUDR6CRPUOQ, seg_pos={0 0}, upload=210454]: Done uploading piece. err: <nil> Sep 16 12:57:01.831107357 (239h28m37.870680497s) [noise=true , address=77.90.31.19:4870 , piece_id=UJXES6SRQC3UXXZ7UBFQNRGQCUKX4PLENKMPDQKR5OPVMKMDWNKQ, seg_pos={0 0}, upload=210454]: Done uploading piece. err: <nil> Sep 16 12:57:23.151551506 (239h28m59.191124626s) [noise=true , address=145.79.227.33:4876 , piece_id=FX7IAQUYQVHRSV32GOAEPKPCKHGJ4HHXIBNQ3N4QSUV5DB7UEVFA, seg_pos={0 0}, upload=210454]: Done uploading piece. err: <nil> Sep 16 12:57:30.018024457 (239h29m6.057597587s) [noise=true , address=145.79.227.35:4511 , piece_id=QOBKOOAEDEA2HJHSNT7GK536CHU7N7TSQWOWNZPXYCQU6BGNFYAQ, seg_pos={0 0}, upload=210454]: Done uploading piece. err: <nil> Sep 16 12:57:36.276262718 (239h29m12.315835848s) [noise=true , address=145.79.227.27:4714 , piece_id=SQFSA4NBQVJHSLJUJQ7DLSLGZHUQG6HRDIY2PB7ZNEYG54THHWDA, seg_pos={0 0}, upload=210454]: Done uploading piece. err: <nil> Sep 16 12:57:43.338737879 (239h29m19.378310999s) [noise=true , address=145.79.227.49:4369 , piece_id=7IAPRXIZKHUO7ZIWPEHZT4BE4SM3YYT7VHEQISJD4PRLQBVZ4T5A, seg_pos={0 0}, upload=210454]: Done uploading piece. err: <nil> Sep 16 12:57:46.733400960 (239h29m22.77297408s) [noise=true , address=145.79.227.52:4450 , piece_id=4I3SOTXEOSLFH7IQOUC44DXY2P7DJLB25JM4TN3OTC4CDULZJOTA, seg_pos={0 0}, upload=210454]: Done uploading piece. err: <nil> Sep 16 12:57:47.314920445 (239h29m23.354493575s) [noise=true , address=145.79.227.9:4371 , piece_id=YW6STZF5EC7Q4SVAXZJHDNVW6RYWL5GYEDKETNBEXL6NCDSK37EA, seg_pos={0 0}, upload=210454]: Done uploading piece. err: <nil> Sep 16 12:57:48.870334592 (239h29m24.909907722s) [noise=true , address=145.79.227.12:4798 , piece_id=XIPEM6HA4EW2DF5VUUBKXOVHV5OXFAF7D5XQGJCYODMMIDY7A44A, seg_pos={0 0}, upload=210454]: Done uploading piece. err: <nil> Sep 16 12:57:48.971908875 (239h29m25.011481995s) [noise=true , address=145.79.227.46:4631 , piece_id=RIYSFOSXEZ3LDC6SMRDTH3QMS4XGW5MTPZJUWZUYH4XWJUMSAC3A, seg_pos={0 0}, upload=210454]: Done uploading piece. err: <nil> Sep 16 12:57:49.777990633 (239h29m25.817563764s) [noise=true , address=145.79.227.11:4764 , piece_id=WY2MPU6HOGA4QMEK573RYKUQLPMU5DKMDOXXZNJK3Q7D3J4SQNHQ, seg_pos={0 0}, upload=210454]: Done uploading piece. err: <nil> Sep 16 12:57:58.424200735 (239h29m34.463773865s) [noise=true , address=145.79.227.18:4031 , piece_id=WO6JTH5UVJBHXPMIPPTEBQGF74IHK2J6TMBKBXDQ6SRFMBWC6NUQ, seg_pos={0 0}, upload=210454]: Done uploading piece. err: ecclient: upload failed (node:12Hx9KabcKhsb2oGPefNr12E2ibDkaVnPJ6Q38rtxxudkDdXMta, address:145.79.227.18:4031): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:57:58.424221574 (239h29m34.463794704s) [noise=true , address=145.79.227.26:4673 , piece_id=YF4JOVI7DDDWNSIVSFS2BX76ZY4N4XC2XWGCY7SUYEM4DXT3KEWA, seg_pos={0 0}, upload=210454]: Done uploading piece. err: ecclient: upload failed (node:12NkBjmh5iL2BtckR19qgXQ4wnfvnbpA9erSuMCTEijwX7ZdHGL, address:145.79.227.26:4673): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:57:58.424278523 (239h29m34.463851643s) [noise=true , address=145.79.227.2:4131 , piece_id=JBA5KBLGQ6Y3IKWSTT5I3KMANDX5355DPIMZYFXL6MEVZBLR24TQ, seg_pos={0 0}, upload=210454]: Done uploading piece. err: ecclient: upload failed (node:129jahwAmyPHqyYaXz7XTCK8FakBrYZw94pBKGhPzzX23yjM3RQ, address:145.79.227.2:4131): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:57:58.424295966 (239h29m34.463869096s) [noise=true , address=145.79.227.8:4331 , piece_id=H42PQBDD37474MM6HZMMYGHDHSYZGHZ7NQNVX3T2JHTX6FCGYNCQ, seg_pos={0 0}, upload=210454]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:57:58.424461752 (239h29m34.464034882s) [noise=true , address=145.79.227.15:4879 , piece_id=ZH3Y5ENWG25K7MTJR4HBOWJIS4IW3CUNRO7JYPHTITNWE7456ZCA, seg_pos={0 0}, upload=210454]: Done uploading piece. err: ecclient: upload failed (node:12jH7W99nQ77T67b8WVVqmg9Jqi5QoB1qM5Wcj8WexywAZ7fRNT, address:145.79.227.15:4879): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:57:58.424536484 (239h29m34.464109614s) [noise=true , address=145.79.227.38:4986 , piece_id=QWEZPMABJG6DUFBHHCZDOHJYXA3AQG762WW23BDBFO26MBBPJ4CA, seg_pos={0 0}, upload=210454]: Done uploading piece. err: ecclient: upload failed (node:1xiyNnuK7RcA3pYJRz2QStzUVfaU6gVUovxX2gV86xAQ2K9np4, address:145.79.227.38:4986): protocol: expected piece hash; write tcp 188.166.225.170:48938->145.79.227.38:4986: use of closed network connection; write tcp 188.166.225.170:48938->145.79.227.38:4986: use of closed network connection; EOF Sep 16 12:57:58.424564437 (239h29m34.464137567s) [noise=true , address=145.79.227.36:4534 , piece_id=NPPSN4AKLRZ2R5YIRLXE5YQC3QF7KHC37MDCSLL57SK6THAOSATA, seg_pos={0 0}, upload=210454]: Done uploading piece. err: ecclient: upload failed (node:1VDrNGcCnaKEmG5NN4nex1JoZAgdCEfX5CdsKbxytfLfKzPbr, address:145.79.227.36:4534): protocol: write tcp 188.166.225.170:38486->145.79.227.36:4534: use of closed network connection; write tcp 188.166.225.170:38486->145.79.227.36:4534: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38486->145.79.227.36:4534: use of closed network connection Sep 16 12:57:58.424583274 (239h29m34.464156394s) [seg_pos={0 0}, upload=210454]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 16 12:57:58.671527406 (239h29m34.711100526s) [upload=210454]: Done uploading segments... Sep 16 12:57:58.671564276 (239h29m34.711137426s) [upload=210454]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 1m0.248937611s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 23 out of 60 is failed (threshold=3) [..............X......X.X.......XXXX.XX.XXXXXX..XX.XXX..XX.X.] duration: 14.404871091s FAIL (2025-09-16 12:57:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ddress=145.79.227.6:4258 , piece_id=OAIEEALEMSBKKKNUGUOWW7F444BGVFISXILDLFPSDR65LG756USQ, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.175243728 (239h28m11.214816858s) [noise=true , address=45.91.116.4:4937 , piece_id=WTGFKRVY4VVI3JOG75ZFHBG3NLV75DLIVU6YU36HXBKMA4HNDUHA, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.175280037 (239h28m11.214853157s) [noise=true , address=45.91.116.10:4081 , piece_id=L6TTAE7I2VQYZDGRDIIVZIFGYTTZWF2DECUXCIJBPAMTZ3SS7BOQ, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.175612721 (239h28m11.215185841s) [noise=true , address=77.90.31.11:4554 , piece_id=4GYOLEDX5N2DHRZUE43Z7FBDHBEA3BJMKKU76SAZG4WTXCESC5OQ, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.175624964 (239h28m11.215198094s) [noise=true , address=45.91.116.7:4009 , piece_id=FQEE3BG2XM6TIXWKU3Y6H2NVEGJSMI4765RAZCIA3ZPGZXX35TRQ, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.176056185 (239h28m11.215629315s) [noise=true , address=45.91.116.11:4117 , piece_id=V5TVBAVGKY7ZVVWML24RGK5GTS3K3CBE3DSQVRVTSQQIBWY6O35A, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.176535548 (239h28m11.216108678s) [noise=true , address=45.91.116.6:4975 , piece_id=32LJKKWXVZ6BJDZ2UNXXRYNWTBQFGEGUMI7WEAVI74H4ZXGZLFYQ, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.176921684 (239h28m11.216494814s) [noise=true , address=145.79.227.16:4910 , piece_id=XGYX3YV2RU4ME6KCO667NY35OY3V6JETGKT733ZCURQU6VPRHKZA, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.177321003 (239h28m11.216894134s) [noise=true , address=145.79.227.11:4730 , piece_id=CJELCJYOITJV7SKXGUNMJYRVCQD2X5PLAS6H43GML6ZKWFRLLOYQ, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.177696719 (239h28m11.217269849s) [noise=true , address=145.79.227.15:4874 , piece_id=RTVQACOCOBYH6SX6Y57YVXVAWIZTASJQXSWNSHP273DBWNUV5DKA, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.178096872 (239h28m11.217670002s) [noise=true , address=45.91.116.12:4225 , piece_id=LCKU677TJDOK2UH3GABMZX4GVGYQVBF23MRV6RQJK7XVC4LIG62A, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.178490851 (239h28m11.218063971s) [noise=true , address=145.79.227.17:4971 , piece_id=MG563BLBS7FRD477VA77BS4V5ZKUCGBR6RDSYOZK5GYS6RWKSL6Q, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.178931581 (239h28m11.218504711s) [noise=true , address=45.91.116.6:4973 , piece_id=GTOW5LBDFKGKRSWC7Q4XU2DTBYEBGA3PND4KYKPIASS6FTL42NQA, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.179340439 (239h28m11.218913569s) [noise=true , address=145.79.227.7:4293 , piece_id=6IUGR4EM6DADXDRLVR5UWYPTRWH4G2NECJEITQRRXHA5HKFGZCRA, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.179774295 (239h28m11.219347426s) [noise=true , address=45.91.116.9:4262 , piece_id=HDP4RIE34WWHC5YUFRFBOTR3BWQ4NZAEZFAEUXF5QGXTPNAYDP3A, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:37.022361448 (239h28m13.061934568s) [upload=210447]: Next returned nil segment Sep 16 12:56:37.022379071 (239h28m13.061952201s) [upload=210447]: Waiting for error group managing segments... Sep 16 12:56:37.346282283 (239h28m13.385855413s) [noise=true , address=45.91.116.9:4262 , piece_id=HDP4RIE34WWHC5YUFRFBOTR3BWQ4NZAEZFAEUXF5QGXTPNAYDP3A, seg_pos={0 0}, upload=210447]: Done uploading piece. err: <nil> Sep 16 12:56:37.346660874 (239h28m13.386233994s) [noise=true , address=77.90.31.11:4554 , piece_id=4GYOLEDX5N2DHRZUE43Z7FBDHBEA3BJMKKU76SAZG4WTXCESC5OQ, seg_pos={0 0}, upload=210447]: Done uploading piece. err: <nil> Sep 16 12:56:37.350771963 (239h28m13.390345083s) [noise=true , address=45.91.116.7:4009 , piece_id=FQEE3BG2XM6TIXWKU3Y6H2NVEGJSMI4765RAZCIA3ZPGZXX35TRQ, seg_pos={0 0}, upload=210447]: Done uploading piece. err: <nil> Sep 16 12:56:37.352194291 (239h28m13.391767421s) [noise=true , address=45.91.116.4:4937 , piece_id=WTGFKRVY4VVI3JOG75ZFHBG3NLV75DLIVU6YU36HXBKMA4HNDUHA, seg_pos={0 0}, upload=210447]: Done uploading piece. err: <nil> Sep 16 12:56:37.360240813 (239h28m13.399813953s) [noise=true , address=45.91.116.12:4225 , piece_id=LCKU677TJDOK2UH3GABMZX4GVGYQVBF23MRV6RQJK7XVC4LIG62A, seg_pos={0 0}, upload=210447]: Done uploading piece. err: <nil> Sep 16 12:56:37.383368895 (239h28m13.422942015s) [noise=true , address=45.91.116.10:4081 , piece_id=L6TTAE7I2VQYZDGRDIIVZIFGYTTZWF2DECUXCIJBPAMTZ3SS7BOQ, seg_pos={0 0}, upload=210447]: Done uploading piece. err: <nil> Sep 16 12:56:37.417646147 (239h28m13.457219277s) [noise=true , address=45.91.116.6:4975 , piece_id=32LJKKWXVZ6BJDZ2UNXXRYNWTBQFGEGUMI7WEAVI74H4ZXGZLFYQ, seg_pos={0 0}, upload=210447]: Done uploading piece. err: <nil> Sep 16 12:56:37.430584194 (239h28m13.470157314s) [noise=true , address=45.91.116.11:4117 , piece_id=V5TVBAVGKY7ZVVWML24RGK5GTS3K3CBE3DSQVRVTSQQIBWY6O35A, seg_pos={0 0}, upload=210447]: Done uploading piece. err: <nil> Sep 16 12:56:37.583366931 (239h28m13.622940071s) [noise=true , address=45.91.116.6:4973 , piece_id=GTOW5LBDFKGKRSWC7Q4XU2DTBYEBGA3PND4KYKPIASS6FTL42NQA, seg_pos={0 0}, upload=210447]: Done uploading piece. err: <nil> Sep 16 12:57:02.466182597 (239h28m38.505755757s) [noise=true , address=145.79.227.17:4971 , piece_id=MG563BLBS7FRD477VA77BS4V5ZKUCGBR6RDSYOZK5GYS6RWKSL6Q, seg_pos={0 0}, upload=210447]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: write tcp 188.166.225.170:43506->145.79.227.17:4971: use of closed network connection; write tcp 188.166.225.170:43506->145.79.227.17:4971: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43506->145.79.227.17:4971: use of closed network connection Sep 16 12:57:02.466301364 (239h28m38.505874494s) [noise=true , address=145.79.227.11:4730 , piece_id=CJELCJYOITJV7SKXGUNMJYRVCQD2X5PLAS6H43GML6ZKWFRLLOYQ, seg_pos={0 0}, upload=210447]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42740->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42740->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42740->145.79.227.11:4730: use of closed network connection Sep 16 12:57:02.466408047 (239h28m38.505981177s) [noise=true , address=145.79.227.7:4293 , piece_id=6IUGR4EM6DADXDRLVR5UWYPTRWH4G2NECJEITQRRXHA5HKFGZCRA, seg_pos={0 0}, upload=210447]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 188.166.225.170:50198->145.79.227.7:4293: use of closed network connection; write tcp 188.166.225.170:50198->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50198->145.79.227.7:4293: use of closed network connection Sep 16 12:57:02.466484312 (239h28m38.506057442s) [noise=true , address=145.79.227.15:4874 , piece_id=RTVQACOCOBYH6SX6Y57YVXVAWIZTASJQXSWNSHP273DBWNUV5DKA, seg_pos={0 0}, upload=210447]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:145.79.227.15:4874): protocol: write tcp 188.166.225.170:48214->145.79.227.15:4874: use of closed network connection; write tcp 188.166.225.170:48214->145.79.227.15:4874: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48214->145.79.227.15:4874: use of closed network connection Sep 16 12:57:02.466544557 (239h28m38.506117687s) [noise=true , address=145.79.227.16:4910 , piece_id=XGYX3YV2RU4ME6KCO667NY35OY3V6JETGKT733ZCURQU6VPRHKZA, seg_pos={0 0}, upload=210447]: Done uploading piece. err: ecclient: upload failed (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn, address:145.79.227.16:4910): protocol: write tcp 188.166.225.170:54208->145.79.227.16:4910: use of closed network connection; write tcp 188.166.225.170:54208->145.79.227.16:4910: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54208->145.79.227.16:4910: use of closed network connection Sep 16 12:57:02.466596606 (239h28m38.506169736s) [noise=true , address=145.79.227.6:4258 , piece_id=OAIEEALEMSBKKKNUGUOWW7F444BGVFISXILDLFPSDR65LG756USQ, seg_pos={0 0}, upload=210447]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:35714->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:35714->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35714->145.79.227.6:4258: use of closed network connection Sep 16 12:57:02.466724840 (239h28m38.50629797s) [noise=true , address=145.79.227.13:4803 , piece_id=OLHRN7G5GN3GEQWVN4CSIVJERN6I65B3GOG5YASK5UYV6SSSVKYQ, seg_pos={0 0}, upload=210447]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44132->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44132->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44132->145.79.227.13:4803: use of closed network connection Sep 16 12:57:02.466791086 (239h28m38.506364217s) [seg_pos={0 0}, upload=210447]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Sep 16 12:57:02.761036794 (239h28m38.800609924s) [upload=210447]: Done uploading segments... Sep 16 12:57:02.761066441 (239h28m38.800639571s) [upload=210447]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 14.404899365s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.056826804s FAIL (2025-09-16 12:57:52 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== JFA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422604190 (238h59m45.46217732s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422896808 (238h59m45.462469928s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423232478 (238h59m45.462805608s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423565571 (238h59m45.463138691s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423935696 (238h59m45.463508826s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424280403 (238h59m45.463853533s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424633305 (238h59m45.464206435s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424994342 (238h59m45.464567472s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425341152 (238h59m45.464914282s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425707831 (238h59m45.465280951s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.426034432 (238h59m45.465607562s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429082236 (238h59m45.468655366s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429521483 (238h59m45.469094613s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:10.278696743 (238h59m46.318269863s) [upload=210063]: Next returned nil segment Sep 16 12:28:10.278720237 (238h59m46.318293367s) [upload=210063]: Waiting for error group managing segments... Sep 16 12:28:10.652409183 (238h59m46.691982303s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.662938092 (238h59m46.702511222s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.670032272 (238h59m46.709605402s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.701595607 (238h59m46.741168737s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.704157255 (238h59m46.743730385s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.707972140 (238h59m46.74754527s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.708523660 (238h59m46.74809678s) [noise=true , address=89.149.201.147:4007 , piece_id=BOQVD3EW5UAYWKEZ5FWC2QCDGIROAEOQN2OEYQ4QACNVDEIFF2IA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.754549157 (238h59m46.794122277s) [noise=true , address=89.149.201.147:4010 , piece_id=OALYBM6QEAOKMQPP2R3Y7LBVOEJYPMTBHJTGE2DSRO3KLRGBZC3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.138412786 (238h59m47.177985916s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.163219826 (238h59m47.202792956s) [noise=true , address=81.171.14.70:4039 , piece_id=IMLIU4QCGFNXWATVWK4L7FZPWOVPCRXNH4F3HSMF5VLQZJUEBO3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.169643348 (238h59m47.209216478s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.231770296 (238h59m47.271343416s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.258046263 (238h59m47.297619383s) [noise=true , address=185.167.204.205:4034 , piece_id=FUHHRFVDRYETJRWVBQZRALI4UGKDQ6DXV7TDKXBRASOMGOEN6YOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.263155884 (238h59m47.302729004s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.269762875 (238h59m47.309336005s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.281404505 (238h59m47.320977635s) [noise=true , address=185.167.204.205:4027 , piece_id=3O5SOEMEXYDYR5OE6SZJ2AVVLNYG4V4IMZOFUL7XDJEZUHDUV5TA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.289386705 (238h59m47.328959825s) [noise=true , address=185.167.204.206:4063 , piece_id=ERJLEJ5EILBCN4WUPZBVYSB2CGDWORVZ3GASSXBVNGR25GWVFYOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.298140815 (238h59m47.337713945s) [noise=true , address=185.167.204.206:4043 , piece_id=LDZTOC67YHM344PUCLVJ7RMKQAYJAQJ4GMKYZNN5LLU5KIUQCW7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.311391579 (238h59m47.350964709s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.317381906 (238h59m47.356955036s) [noise=true , address=185.167.204.206:4065 , piece_id=UXYM6MEGCQFRRRSMGI5XKJJJ6GYW7IJXG5QDGMICLP3FNJDSFRSQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.318355050 (238h59m47.35792818s) [noise=true , address=185.167.204.205:4018 , piece_id=VZP55ZA5Y5IA2PUH75QDVB56UHRJJ2XNC75L5WCRUSHGHQGZ463A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.330083334 (238h59m47.369656464s) [noise=true , address=185.167.204.206:4052 , piece_id=CDKZXVC22A62STE3NYD4R2TWT3AF45U2A7MHEIQJPTNMUKBVFJFA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.331429858 (238h59m47.371002988s) [noise=true , address=185.167.204.205:4035 , piece_id=M6LWKXSTJHGHXHY4VEJ2IGLI2UX4IIZV5KD4A6YY3BMIQ6ZRBMAQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.341689555 (238h59m47.381262686s) [noise=true , address=185.167.204.205:4014 , piece_id=MDSUAX4XNI5INUUQCMAP26PQFV62U3TZ2OITZR3BSNDQLHWEOKIA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.346694947 (238h59m47.386268077s) [noise=true , address=185.167.204.205:4023 , piece_id=YNW6TYPAVMYIHD5BT6QZGJJAGDM2XSZ4QYX4C2TH5QRGNTNP4KUQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363156895 (238h59m47.402730015s) [noise=true , address=185.167.204.206:4059 , piece_id=IX3H3WSLKDNPCCA5NMFUGMO2P6CA274AEUXLGVA3WRGJM3SN2OZQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363183276 (238h59m47.402756406s) [seg_pos={0 0}, upload=210063]: Segment reached optimal threshold of 26 pieces. Sep 16 12:28:11.363333942 (238h59m47.402907072s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363361435 (238h59m47.402934565s) [noise=true , address=185.167.204.206:4066 , piece_id=XXWYU36QFNZ2HCZF2WGAG4LKIBE3GCCKNVBDV6N5RQMCDJJXJULQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: expected piece hash; context canceled; EOF Sep 16 12:28:11.363393326 (238h59m47.402966456s) [seg_pos={0 0}, upload=210063]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil> Sep 16 12:28:11.363496222 (238h59m47.403069362s) [upload=210063]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 16 12:28:11.363503285 (238h59m47.403076405s) [upload=210063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 16 12:28:11.633947931 (238h59m47.673521071s) [upload=210063]: Done uploading segments... Sep 16 12:28:11.633974231 (238h59m47.673547372s) [upload=210063]: Upload finished. err: <nil> Duration: 5.056859116s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 4.960009808s FAIL (2025-09-16 12:57:08 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== JFA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422604190 (238h59m45.46217732s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422896808 (238h59m45.462469928s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423232478 (238h59m45.462805608s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423565571 (238h59m45.463138691s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423935696 (238h59m45.463508826s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424280403 (238h59m45.463853533s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424633305 (238h59m45.464206435s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424994342 (238h59m45.464567472s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425341152 (238h59m45.464914282s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425707831 (238h59m45.465280951s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.426034432 (238h59m45.465607562s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429082236 (238h59m45.468655366s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429521483 (238h59m45.469094613s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:10.278696743 (238h59m46.318269863s) [upload=210063]: Next returned nil segment Sep 16 12:28:10.278720237 (238h59m46.318293367s) [upload=210063]: Waiting for error group managing segments... Sep 16 12:28:10.652409183 (238h59m46.691982303s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.662938092 (238h59m46.702511222s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.670032272 (238h59m46.709605402s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.701595607 (238h59m46.741168737s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.704157255 (238h59m46.743730385s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.707972140 (238h59m46.74754527s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.708523660 (238h59m46.74809678s) [noise=true , address=89.149.201.147:4007 , piece_id=BOQVD3EW5UAYWKEZ5FWC2QCDGIROAEOQN2OEYQ4QACNVDEIFF2IA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.754549157 (238h59m46.794122277s) [noise=true , address=89.149.201.147:4010 , piece_id=OALYBM6QEAOKMQPP2R3Y7LBVOEJYPMTBHJTGE2DSRO3KLRGBZC3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.138412786 (238h59m47.177985916s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.163219826 (238h59m47.202792956s) [noise=true , address=81.171.14.70:4039 , piece_id=IMLIU4QCGFNXWATVWK4L7FZPWOVPCRXNH4F3HSMF5VLQZJUEBO3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.169643348 (238h59m47.209216478s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.231770296 (238h59m47.271343416s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.258046263 (238h59m47.297619383s) [noise=true , address=185.167.204.205:4034 , piece_id=FUHHRFVDRYETJRWVBQZRALI4UGKDQ6DXV7TDKXBRASOMGOEN6YOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.263155884 (238h59m47.302729004s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.269762875 (238h59m47.309336005s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.281404505 (238h59m47.320977635s) [noise=true , address=185.167.204.205:4027 , piece_id=3O5SOEMEXYDYR5OE6SZJ2AVVLNYG4V4IMZOFUL7XDJEZUHDUV5TA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.289386705 (238h59m47.328959825s) [noise=true , address=185.167.204.206:4063 , piece_id=ERJLEJ5EILBCN4WUPZBVYSB2CGDWORVZ3GASSXBVNGR25GWVFYOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.298140815 (238h59m47.337713945s) [noise=true , address=185.167.204.206:4043 , piece_id=LDZTOC67YHM344PUCLVJ7RMKQAYJAQJ4GMKYZNN5LLU5KIUQCW7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.311391579 (238h59m47.350964709s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.317381906 (238h59m47.356955036s) [noise=true , address=185.167.204.206:4065 , piece_id=UXYM6MEGCQFRRRSMGI5XKJJJ6GYW7IJXG5QDGMICLP3FNJDSFRSQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.318355050 (238h59m47.35792818s) [noise=true , address=185.167.204.205:4018 , piece_id=VZP55ZA5Y5IA2PUH75QDVB56UHRJJ2XNC75L5WCRUSHGHQGZ463A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.330083334 (238h59m47.369656464s) [noise=true , address=185.167.204.206:4052 , piece_id=CDKZXVC22A62STE3NYD4R2TWT3AF45U2A7MHEIQJPTNMUKBVFJFA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.331429858 (238h59m47.371002988s) [noise=true , address=185.167.204.205:4035 , piece_id=M6LWKXSTJHGHXHY4VEJ2IGLI2UX4IIZV5KD4A6YY3BMIQ6ZRBMAQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.341689555 (238h59m47.381262686s) [noise=true , address=185.167.204.205:4014 , piece_id=MDSUAX4XNI5INUUQCMAP26PQFV62U3TZ2OITZR3BSNDQLHWEOKIA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.346694947 (238h59m47.386268077s) [noise=true , address=185.167.204.205:4023 , piece_id=YNW6TYPAVMYIHD5BT6QZGJJAGDM2XSZ4QYX4C2TH5QRGNTNP4KUQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363156895 (238h59m47.402730015s) [noise=true , address=185.167.204.206:4059 , piece_id=IX3H3WSLKDNPCCA5NMFUGMO2P6CA274AEUXLGVA3WRGJM3SN2OZQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363183276 (238h59m47.402756406s) [seg_pos={0 0}, upload=210063]: Segment reached optimal threshold of 26 pieces. Sep 16 12:28:11.363333942 (238h59m47.402907072s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363361435 (238h59m47.402934565s) [noise=true , address=185.167.204.206:4066 , piece_id=XXWYU36QFNZ2HCZF2WGAG4LKIBE3GCCKNVBDV6N5RQMCDJJXJULQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: expected piece hash; context canceled; EOF Sep 16 12:28:11.363393326 (238h59m47.402966456s) [seg_pos={0 0}, upload=210063]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil> Sep 16 12:28:11.363496222 (238h59m47.403069362s) [upload=210063]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 16 12:28:11.363503285 (238h59m47.403076405s) [upload=210063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 16 12:28:11.633947931 (238h59m47.673521071s) [upload=210063]: Done uploading segments... Sep 16 12:28:11.633974231 (238h59m47.673547372s) [upload=210063]: Upload finished. err: <nil> Duration: 4.960117914s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 23 out of 60 is failed (threshold=3) [...............X......X.X.......XXXX.XX.XXXXXX..XX.XXX..XX.X] duration: 30.306357427s FAIL (2025-09-16 12:57:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ddress=145.79.227.6:4258 , piece_id=OAIEEALEMSBKKKNUGUOWW7F444BGVFISXILDLFPSDR65LG756USQ, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.175243728 (239h28m11.214816858s) [noise=true , address=45.91.116.4:4937 , piece_id=WTGFKRVY4VVI3JOG75ZFHBG3NLV75DLIVU6YU36HXBKMA4HNDUHA, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.175280037 (239h28m11.214853157s) [noise=true , address=45.91.116.10:4081 , piece_id=L6TTAE7I2VQYZDGRDIIVZIFGYTTZWF2DECUXCIJBPAMTZ3SS7BOQ, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.175612721 (239h28m11.215185841s) [noise=true , address=77.90.31.11:4554 , piece_id=4GYOLEDX5N2DHRZUE43Z7FBDHBEA3BJMKKU76SAZG4WTXCESC5OQ, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.175624964 (239h28m11.215198094s) [noise=true , address=45.91.116.7:4009 , piece_id=FQEE3BG2XM6TIXWKU3Y6H2NVEGJSMI4765RAZCIA3ZPGZXX35TRQ, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.176056185 (239h28m11.215629315s) [noise=true , address=45.91.116.11:4117 , piece_id=V5TVBAVGKY7ZVVWML24RGK5GTS3K3CBE3DSQVRVTSQQIBWY6O35A, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.176535548 (239h28m11.216108678s) [noise=true , address=45.91.116.6:4975 , piece_id=32LJKKWXVZ6BJDZ2UNXXRYNWTBQFGEGUMI7WEAVI74H4ZXGZLFYQ, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.176921684 (239h28m11.216494814s) [noise=true , address=145.79.227.16:4910 , piece_id=XGYX3YV2RU4ME6KCO667NY35OY3V6JETGKT733ZCURQU6VPRHKZA, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.177321003 (239h28m11.216894134s) [noise=true , address=145.79.227.11:4730 , piece_id=CJELCJYOITJV7SKXGUNMJYRVCQD2X5PLAS6H43GML6ZKWFRLLOYQ, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.177696719 (239h28m11.217269849s) [noise=true , address=145.79.227.15:4874 , piece_id=RTVQACOCOBYH6SX6Y57YVXVAWIZTASJQXSWNSHP273DBWNUV5DKA, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.178096872 (239h28m11.217670002s) [noise=true , address=45.91.116.12:4225 , piece_id=LCKU677TJDOK2UH3GABMZX4GVGYQVBF23MRV6RQJK7XVC4LIG62A, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.178490851 (239h28m11.218063971s) [noise=true , address=145.79.227.17:4971 , piece_id=MG563BLBS7FRD477VA77BS4V5ZKUCGBR6RDSYOZK5GYS6RWKSL6Q, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.178931581 (239h28m11.218504711s) [noise=true , address=45.91.116.6:4973 , piece_id=GTOW5LBDFKGKRSWC7Q4XU2DTBYEBGA3PND4KYKPIASS6FTL42NQA, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.179340439 (239h28m11.218913569s) [noise=true , address=145.79.227.7:4293 , piece_id=6IUGR4EM6DADXDRLVR5UWYPTRWH4G2NECJEITQRRXHA5HKFGZCRA, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:35.179774295 (239h28m11.219347426s) [noise=true , address=45.91.116.9:4262 , piece_id=HDP4RIE34WWHC5YUFRFBOTR3BWQ4NZAEZFAEUXF5QGXTPNAYDP3A, seg_pos={0 0}, upload=210447]: Uploading piece... Sep 16 12:56:37.022361448 (239h28m13.061934568s) [upload=210447]: Next returned nil segment Sep 16 12:56:37.022379071 (239h28m13.061952201s) [upload=210447]: Waiting for error group managing segments... Sep 16 12:56:37.346282283 (239h28m13.385855413s) [noise=true , address=45.91.116.9:4262 , piece_id=HDP4RIE34WWHC5YUFRFBOTR3BWQ4NZAEZFAEUXF5QGXTPNAYDP3A, seg_pos={0 0}, upload=210447]: Done uploading piece. err: <nil> Sep 16 12:56:37.346660874 (239h28m13.386233994s) [noise=true , address=77.90.31.11:4554 , piece_id=4GYOLEDX5N2DHRZUE43Z7FBDHBEA3BJMKKU76SAZG4WTXCESC5OQ, seg_pos={0 0}, upload=210447]: Done uploading piece. err: <nil> Sep 16 12:56:37.350771963 (239h28m13.390345083s) [noise=true , address=45.91.116.7:4009 , piece_id=FQEE3BG2XM6TIXWKU3Y6H2NVEGJSMI4765RAZCIA3ZPGZXX35TRQ, seg_pos={0 0}, upload=210447]: Done uploading piece. err: <nil> Sep 16 12:56:37.352194291 (239h28m13.391767421s) [noise=true , address=45.91.116.4:4937 , piece_id=WTGFKRVY4VVI3JOG75ZFHBG3NLV75DLIVU6YU36HXBKMA4HNDUHA, seg_pos={0 0}, upload=210447]: Done uploading piece. err: <nil> Sep 16 12:56:37.360240813 (239h28m13.399813953s) [noise=true , address=45.91.116.12:4225 , piece_id=LCKU677TJDOK2UH3GABMZX4GVGYQVBF23MRV6RQJK7XVC4LIG62A, seg_pos={0 0}, upload=210447]: Done uploading piece. err: <nil> Sep 16 12:56:37.383368895 (239h28m13.422942015s) [noise=true , address=45.91.116.10:4081 , piece_id=L6TTAE7I2VQYZDGRDIIVZIFGYTTZWF2DECUXCIJBPAMTZ3SS7BOQ, seg_pos={0 0}, upload=210447]: Done uploading piece. err: <nil> Sep 16 12:56:37.417646147 (239h28m13.457219277s) [noise=true , address=45.91.116.6:4975 , piece_id=32LJKKWXVZ6BJDZ2UNXXRYNWTBQFGEGUMI7WEAVI74H4ZXGZLFYQ, seg_pos={0 0}, upload=210447]: Done uploading piece. err: <nil> Sep 16 12:56:37.430584194 (239h28m13.470157314s) [noise=true , address=45.91.116.11:4117 , piece_id=V5TVBAVGKY7ZVVWML24RGK5GTS3K3CBE3DSQVRVTSQQIBWY6O35A, seg_pos={0 0}, upload=210447]: Done uploading piece. err: <nil> Sep 16 12:56:37.583366931 (239h28m13.622940071s) [noise=true , address=45.91.116.6:4973 , piece_id=GTOW5LBDFKGKRSWC7Q4XU2DTBYEBGA3PND4KYKPIASS6FTL42NQA, seg_pos={0 0}, upload=210447]: Done uploading piece. err: <nil> Sep 16 12:57:02.466182597 (239h28m38.505755757s) [noise=true , address=145.79.227.17:4971 , piece_id=MG563BLBS7FRD477VA77BS4V5ZKUCGBR6RDSYOZK5GYS6RWKSL6Q, seg_pos={0 0}, upload=210447]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: write tcp 188.166.225.170:43506->145.79.227.17:4971: use of closed network connection; write tcp 188.166.225.170:43506->145.79.227.17:4971: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43506->145.79.227.17:4971: use of closed network connection Sep 16 12:57:02.466301364 (239h28m38.505874494s) [noise=true , address=145.79.227.11:4730 , piece_id=CJELCJYOITJV7SKXGUNMJYRVCQD2X5PLAS6H43GML6ZKWFRLLOYQ, seg_pos={0 0}, upload=210447]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42740->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42740->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42740->145.79.227.11:4730: use of closed network connection Sep 16 12:57:02.466408047 (239h28m38.505981177s) [noise=true , address=145.79.227.7:4293 , piece_id=6IUGR4EM6DADXDRLVR5UWYPTRWH4G2NECJEITQRRXHA5HKFGZCRA, seg_pos={0 0}, upload=210447]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 188.166.225.170:50198->145.79.227.7:4293: use of closed network connection; write tcp 188.166.225.170:50198->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50198->145.79.227.7:4293: use of closed network connection Sep 16 12:57:02.466484312 (239h28m38.506057442s) [noise=true , address=145.79.227.15:4874 , piece_id=RTVQACOCOBYH6SX6Y57YVXVAWIZTASJQXSWNSHP273DBWNUV5DKA, seg_pos={0 0}, upload=210447]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:145.79.227.15:4874): protocol: write tcp 188.166.225.170:48214->145.79.227.15:4874: use of closed network connection; write tcp 188.166.225.170:48214->145.79.227.15:4874: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48214->145.79.227.15:4874: use of closed network connection Sep 16 12:57:02.466544557 (239h28m38.506117687s) [noise=true , address=145.79.227.16:4910 , piece_id=XGYX3YV2RU4ME6KCO667NY35OY3V6JETGKT733ZCURQU6VPRHKZA, seg_pos={0 0}, upload=210447]: Done uploading piece. err: ecclient: upload failed (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn, address:145.79.227.16:4910): protocol: write tcp 188.166.225.170:54208->145.79.227.16:4910: use of closed network connection; write tcp 188.166.225.170:54208->145.79.227.16:4910: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54208->145.79.227.16:4910: use of closed network connection Sep 16 12:57:02.466596606 (239h28m38.506169736s) [noise=true , address=145.79.227.6:4258 , piece_id=OAIEEALEMSBKKKNUGUOWW7F444BGVFISXILDLFPSDR65LG756USQ, seg_pos={0 0}, upload=210447]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:35714->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:35714->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35714->145.79.227.6:4258: use of closed network connection Sep 16 12:57:02.466724840 (239h28m38.50629797s) [noise=true , address=145.79.227.13:4803 , piece_id=OLHRN7G5GN3GEQWVN4CSIVJERN6I65B3GOG5YASK5UYV6SSSVKYQ, seg_pos={0 0}, upload=210447]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44132->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44132->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44132->145.79.227.13:4803: use of closed network connection Sep 16 12:57:02.466791086 (239h28m38.506364217s) [seg_pos={0 0}, upload=210447]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Sep 16 12:57:02.761036794 (239h28m38.800609924s) [upload=210447]: Done uploading segments... Sep 16 12:57:02.761066441 (239h28m38.800639571s) [upload=210447]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 30.30639121s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 26 out of 60 is failed (threshold=3) [..............................X.X..XXX.XXXXXXXXXXXXXXXXXXXXX] duration: 1m0.273493218s FAIL (2025-09-16 12:56:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 38]: Begin upload segment... Sep 16 12:55:45.460574012 (239h27m21.500147142s) [seg_pos={0 0}, upload=210438]: Done begin upload segment. Sep 16 12:55:45.460608317 (239h27m21.500181447s) [noise=true , address=145.79.227.46:4608 , piece_id=HZXF2AAKXS36HR2KO4N4IB4BLA3QAR6RB6IR6AI7PMTVEMHTPO7A, seg_pos={0 0}, upload=210438]: Uploading piece... Sep 16 12:55:45.461230562 (239h27m21.500803692s) [noise=true , address=145.79.227.48:4318 , piece_id=GNNEFRM2DZNN4MUPD35QCZAFJJSP3RWVVY54E55PECHEYRHBR2IQ, seg_pos={0 0}, upload=210438]: Uploading piece... Sep 16 12:55:45.461868567 (239h27m21.501441687s) [noise=true , address=145.79.227.35:4495 , piece_id=7JFK4EFNDTSIREE63H3P7F7L3TZKOWR4HM3PHUWVAS2S553JR2EA, seg_pos={0 0}, upload=210438]: Uploading piece... Sep 16 12:55:45.462336487 (239h27m21.501909617s) [noise=true , address=145.79.227.23:4552 , piece_id=UZTRMMNL5I7ENHFWTTP2O7ZL7QBUWRGCEWUEA6K6GW5GELDHOPLQ, seg_pos={0 0}, upload=210438]: Uploading piece... Sep 16 12:55:45.462675222 (239h27m21.502248352s) [noise=true , address=145.79.227.11:4735 , piece_id=RRJWUGNXTZLUHIU46JYJDWJBLTHFCHPTUEIHZWDZNKT5CK2WYZOQ, seg_pos={0 0}, upload=210438]: Uploading piece... Sep 16 12:55:45.463025319 (239h27m21.502598449s) [noise=true , address=77.90.31.11:4561 , piece_id=6U6I72NBTC2FUJ6VQ4JCKHYBQ3CFSLWOVYBTNSD3AWE3IGQ4U6EQ, seg_pos={0 0}, upload=210438]: Uploading piece... Sep 16 12:55:45.463422035 (239h27m21.502995155s) [noise=true , address=145.79.227.19:4101 , piece_id=QJQPYUZCPKPUKEDPGS6DYLUA7OY4CAS5ADEM5YJM2XHMNCNVHYGA, seg_pos={0 0}, upload=210438]: Uploading piece... Sep 16 12:55:45.463716575 (239h27m21.503289705s) [noise=true , address=145.79.227.24:4609 , piece_id=OV3LZB5IONBKVTJRNA7Z62GCPPHL4XTXHKZA44UTA7QXP227BOKQ, seg_pos={0 0}, upload=210438]: Uploading piece... Sep 16 12:55:45.464119744 (239h27m21.503692864s) [noise=true , address=145.79.227.32:4857 , piece_id=WU3OIQ2X3YEAHPDNUUV2E75IH4JRPAGNXNTOG3XJQBTBQK3JUGQQ, seg_pos={0 0}, upload=210438]: Uploading piece... Sep 16 12:55:45.464485970 (239h27m21.5040591s) [noise=true , address=145.79.227.33:4873 , piece_id=7EHYUDFITLXKSVPAFGP5H6O6TVDXGFRUPJRW4IKGWSKLTG3TMMIQ, seg_pos={0 0}, upload=210438]: Uploading piece... Sep 16 12:55:45.464820448 (239h27m21.504393578s) [noise=true , address=145.79.227.5:4235 , piece_id=5PF6QDCUY5DHHNUIMHDMOGTOBQETUXEFATJPRAOC6EVWLGRUH4VA, seg_pos={0 0}, upload=210438]: Uploading piece... Sep 16 12:55:45.465151157 (239h27m21.504724287s) [noise=true , address=145.79.227.21:4494 , piece_id=VW3V4XHBMETVAKHLWWGNS4JU4LWEUL2CTEZZSUQ5OVCN4SJDIS3A, seg_pos={0 0}, upload=210438]: Uploading piece... Sep 16 12:55:45.465507465 (239h27m21.505080595s) [noise=true , address=145.79.227.52:4459 , piece_id=EO2CMGM5ZBFXPF24DUA5LH5NSR52Y27TWQMKWVESC5AM5QEJAXAA, seg_pos={0 0}, upload=210438]: Uploading piece... Sep 16 12:55:45.466108601 (239h27m21.505681731s) [noise=true , address=145.79.227.8:4348 , piece_id=JZMSKGAAC22S5O7ZZZMR3WLO7SRFN4PHYTVBKRWXHQI2CWLOX4HA, seg_pos={0 0}, upload=210438]: Uploading piece... Sep 16 12:55:45.466464879 (239h27m21.506038009s) [noise=true , address=145.79.227.17:4003 , piece_id=GHUD7FT5T7UQS44NYK2PQB33MMA26LSUELSVBSX4TX2H6Y64HYZA, seg_pos={0 0}, upload=210438]: Uploading piece... Sep 16 12:55:45.466741526 (239h27m21.506314656s) [noise=true , address=145.79.227.3:4153 , piece_id=ZRVLD3MB4HTBYTSTVLW5AQIK62FJ4DHKBDOFZY3WLDC6BQHO6Q7Q, seg_pos={0 0}, upload=210438]: Uploading piece... Sep 16 12:55:45.467015718 (239h27m21.506588838s) [noise=true , address=145.79.227.51:4412 , piece_id=S5BTIGOL5D7G76JDNGOQ2PSVQ45X5FFPUPDK4D5S2ZY3KJSRVBCA, seg_pos={0 0}, upload=210438]: Uploading piece... Sep 16 12:55:45.467274791 (239h27m21.506847911s) [noise=true , address=145.79.227.5:4247 , piece_id=SCCPS2KMENNWSK63E2LX3X6ZAREPWISV6MUAHDOX4IIWE6BBA7BQ, seg_pos={0 0}, upload=210438]: Uploading piece... Sep 16 12:55:47.125657290 (239h27m23.16523042s) [upload=210438]: Next returned nil segment Sep 16 12:55:47.125682337 (239h27m23.165255457s) [upload=210438]: Waiting for error group managing segments... Sep 16 12:55:47.539670001 (239h27m23.579243131s) [noise=true , address=77.90.31.11:4561 , piece_id=6U6I72NBTC2FUJ6VQ4JCKHYBQ3CFSLWOVYBTNSD3AWE3IGQ4U6EQ, seg_pos={0 0}, upload=210438]: Done uploading piece. err: <nil> Sep 16 12:55:57.057293041 (239h27m33.096866171s) [noise=true , address=145.79.227.48:4318 , piece_id=GNNEFRM2DZNN4MUPD35QCZAFJJSP3RWVVY54E55PECHEYRHBR2IQ, seg_pos={0 0}, upload=210438]: Done uploading piece. err: <nil> Sep 16 12:56:06.303781710 (239h27m42.34335484s) [noise=true , address=145.79.227.24:4609 , piece_id=OV3LZB5IONBKVTJRNA7Z62GCPPHL4XTXHKZA44UTA7QXP227BOKQ, seg_pos={0 0}, upload=210438]: Done uploading piece. err: <nil> Sep 16 12:56:10.775492745 (239h27m46.815065875s) [noise=true , address=145.79.227.17:4003 , piece_id=GHUD7FT5T7UQS44NYK2PQB33MMA26LSUELSVBSX4TX2H6Y64HYZA, seg_pos={0 0}, upload=210438]: Done uploading piece. err: <nil> Sep 16 12:56:13.845982086 (239h27m49.885555216s) [noise=true , address=145.79.227.19:4101 , piece_id=QJQPYUZCPKPUKEDPGS6DYLUA7OY4CAS5ADEM5YJM2XHMNCNVHYGA, seg_pos={0 0}, upload=210438]: Done uploading piece. err: <nil> Sep 16 12:56:18.063442815 (239h27m54.103015945s) [noise=true , address=145.79.227.52:4459 , piece_id=EO2CMGM5ZBFXPF24DUA5LH5NSR52Y27TWQMKWVESC5AM5QEJAXAA, seg_pos={0 0}, upload=210438]: Done uploading piece. err: <nil> Sep 16 12:56:25.466515833 (239h28m1.506088953s) [noise=true , address=145.79.227.46:4608 , piece_id=HZXF2AAKXS36HR2KO4N4IB4BLA3QAR6RB6IR6AI7PMTVEMHTPO7A, seg_pos={0 0}, upload=210438]: Done uploading piece. err: <nil> Sep 16 12:56:32.592425641 (239h28m8.631998772s) [noise=true , address=145.79.227.35:4495 , piece_id=7JFK4EFNDTSIREE63H3P7F7L3TZKOWR4HM3PHUWVAS2S553JR2EA, seg_pos={0 0}, upload=210438]: Done uploading piece. err: <nil> Sep 16 12:56:35.427028418 (239h28m11.466601548s) [noise=true , address=145.79.227.8:4348 , piece_id=JZMSKGAAC22S5O7ZZZMR3WLO7SRFN4PHYTVBKRWXHQI2CWLOX4HA, seg_pos={0 0}, upload=210438]: Done uploading piece. err: <nil> Sep 16 12:56:42.892314290 (239h28m18.93188741s) [noise=true , address=145.79.227.11:4735 , piece_id=RRJWUGNXTZLUHIU46JYJDWJBLTHFCHPTUEIHZWDZNKT5CK2WYZOQ, seg_pos={0 0}, upload=210438]: Done uploading piece. err: <nil> Sep 16 12:56:44.186022722 (239h28m20.225595842s) [noise=true , address=145.79.227.3:4153 , piece_id=ZRVLD3MB4HTBYTSTVLW5AQIK62FJ4DHKBDOFZY3WLDC6BQHO6Q7Q, seg_pos={0 0}, upload=210438]: Done uploading piece. err: ecclient: upload failed (node:124myE1wFhvjA5paJy5tr2hRe8jZCoEdbJLdBwvss1ZnT4GvtZv, address:145.79.227.3:4153): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:56:44.186079279 (239h28m20.225652409s) [noise=true , address=145.79.227.21:4494 , piece_id=VW3V4XHBMETVAKHLWWGNS4JU4LWEUL2CTEZZSUQ5OVCN4SJDIS3A, seg_pos={0 0}, upload=210438]: Done uploading piece. err: ecclient: upload failed (node:1sRaMuQG18B5SfPpzxp5VWjrwe38SS38g4askmbURxU9tepJHi, address:145.79.227.21:4494): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:56:44.186194308 (239h28m20.225767438s) [noise=true , address=145.79.227.23:4552 , piece_id=UZTRMMNL5I7ENHFWTTP2O7ZL7QBUWRGCEWUEA6K6GW5GELDHOPLQ, seg_pos={0 0}, upload=210438]: Done uploading piece. err: ecclient: upload failed (node:12YmWSZZQgXm2gdZCahnyCdSzxYPAerzCfD38mWPmpTDyGYT823, address:145.79.227.23:4552): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:56:44.186220608 (239h28m20.225793738s) [noise=true , address=145.79.227.5:4235 , piece_id=5PF6QDCUY5DHHNUIMHDMOGTOBQETUXEFATJPRAOC6EVWLGRUH4VA, seg_pos={0 0}, upload=210438]: Done uploading piece. err: ecclient: upload failed (node:1nn8EX7mq6mXic78Jura9BcAHfgw8rFwzfqf5HtwJtrYt6PUDV, address:145.79.227.5:4235): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:56:44.186257488 (239h28m20.225830608s) [noise=true , address=145.79.227.33:4873 , piece_id=7EHYUDFITLXKSVPAFGP5H6O6TVDXGFRUPJRW4IKGWSKLTG3TMMIQ, seg_pos={0 0}, upload=210438]: Done uploading piece. err: ecclient: upload failed (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo, address:145.79.227.33:4873): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:56:44.186276825 (239h28m20.225849955s) [noise=true , address=145.79.227.51:4412 , piece_id=S5BTIGOL5D7G76JDNGOQ2PSVQ45X5FFPUPDK4D5S2ZY3KJSRVBCA, seg_pos={0 0}, upload=210438]: Done uploading piece. err: ecclient: upload failed (node:12vBvEfCYZxsv17cVsQTbCQ4YjZfiD4RXjWyz7Ka9ZZrtvzC7SS, address:145.79.227.51:4412): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:56:44.186313004 (239h28m20.225886194s) [noise=true , address=145.79.227.32:4857 , piece_id=WU3OIQ2X3YEAHPDNUUV2E75IH4JRPAGNXNTOG3XJQBTBQK3JUGQQ, seg_pos={0 0}, upload=210438]: Done uploading piece. err: ecclient: upload failed (node:1DK5cJhprAFbNCSceZ527v5rMFw7e3teUTsxBXVPcjXUDiVv4P, address:145.79.227.32:4857): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:56:44.186411532 (239h28m20.225984652s) [noise=true , address=145.79.227.5:4247 , piece_id=SCCPS2KMENNWSK63E2LX3X6ZAREPWISV6MUAHDOX4IIWE6BBA7BQ, seg_pos={0 0}, upload=210438]: Done uploading piece. err: ecclient: upload failed (node:1262xxX6aUPTYgKdvRxAyc77PmPBWJtq5cXRJFoELxHbfn18DLE, address:145.79.227.5:4247): protocol: write tcp 188.166.225.170:34704->145.79.227.5:4247: use of closed network connection; write tcp 188.166.225.170:34704->145.79.227.5:4247: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34704->145.79.227.5:4247: use of closed network connection Sep 16 12:56:44.186454503 (239h28m20.226027623s) [seg_pos={0 0}, upload=210438]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Sep 16 12:56:44.457182656 (239h28m20.496755796s) [upload=210438]: Done uploading segments... Sep 16 12:56:44.457218044 (239h28m20.496791174s) [upload=210438]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 1m0.273508948s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 4.9643924s FAIL (2025-09-16 12:55:59 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== JFA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422604190 (238h59m45.46217732s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422896808 (238h59m45.462469928s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423232478 (238h59m45.462805608s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423565571 (238h59m45.463138691s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423935696 (238h59m45.463508826s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424280403 (238h59m45.463853533s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424633305 (238h59m45.464206435s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424994342 (238h59m45.464567472s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425341152 (238h59m45.464914282s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425707831 (238h59m45.465280951s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.426034432 (238h59m45.465607562s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429082236 (238h59m45.468655366s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429521483 (238h59m45.469094613s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:10.278696743 (238h59m46.318269863s) [upload=210063]: Next returned nil segment Sep 16 12:28:10.278720237 (238h59m46.318293367s) [upload=210063]: Waiting for error group managing segments... Sep 16 12:28:10.652409183 (238h59m46.691982303s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.662938092 (238h59m46.702511222s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.670032272 (238h59m46.709605402s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.701595607 (238h59m46.741168737s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.704157255 (238h59m46.743730385s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.707972140 (238h59m46.74754527s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.708523660 (238h59m46.74809678s) [noise=true , address=89.149.201.147:4007 , piece_id=BOQVD3EW5UAYWKEZ5FWC2QCDGIROAEOQN2OEYQ4QACNVDEIFF2IA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.754549157 (238h59m46.794122277s) [noise=true , address=89.149.201.147:4010 , piece_id=OALYBM6QEAOKMQPP2R3Y7LBVOEJYPMTBHJTGE2DSRO3KLRGBZC3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.138412786 (238h59m47.177985916s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.163219826 (238h59m47.202792956s) [noise=true , address=81.171.14.70:4039 , piece_id=IMLIU4QCGFNXWATVWK4L7FZPWOVPCRXNH4F3HSMF5VLQZJUEBO3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.169643348 (238h59m47.209216478s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.231770296 (238h59m47.271343416s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.258046263 (238h59m47.297619383s) [noise=true , address=185.167.204.205:4034 , piece_id=FUHHRFVDRYETJRWVBQZRALI4UGKDQ6DXV7TDKXBRASOMGOEN6YOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.263155884 (238h59m47.302729004s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.269762875 (238h59m47.309336005s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.281404505 (238h59m47.320977635s) [noise=true , address=185.167.204.205:4027 , piece_id=3O5SOEMEXYDYR5OE6SZJ2AVVLNYG4V4IMZOFUL7XDJEZUHDUV5TA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.289386705 (238h59m47.328959825s) [noise=true , address=185.167.204.206:4063 , piece_id=ERJLEJ5EILBCN4WUPZBVYSB2CGDWORVZ3GASSXBVNGR25GWVFYOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.298140815 (238h59m47.337713945s) [noise=true , address=185.167.204.206:4043 , piece_id=LDZTOC67YHM344PUCLVJ7RMKQAYJAQJ4GMKYZNN5LLU5KIUQCW7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.311391579 (238h59m47.350964709s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.317381906 (238h59m47.356955036s) [noise=true , address=185.167.204.206:4065 , piece_id=UXYM6MEGCQFRRRSMGI5XKJJJ6GYW7IJXG5QDGMICLP3FNJDSFRSQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.318355050 (238h59m47.35792818s) [noise=true , address=185.167.204.205:4018 , piece_id=VZP55ZA5Y5IA2PUH75QDVB56UHRJJ2XNC75L5WCRUSHGHQGZ463A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.330083334 (238h59m47.369656464s) [noise=true , address=185.167.204.206:4052 , piece_id=CDKZXVC22A62STE3NYD4R2TWT3AF45U2A7MHEIQJPTNMUKBVFJFA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.331429858 (238h59m47.371002988s) [noise=true , address=185.167.204.205:4035 , piece_id=M6LWKXSTJHGHXHY4VEJ2IGLI2UX4IIZV5KD4A6YY3BMIQ6ZRBMAQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.341689555 (238h59m47.381262686s) [noise=true , address=185.167.204.205:4014 , piece_id=MDSUAX4XNI5INUUQCMAP26PQFV62U3TZ2OITZR3BSNDQLHWEOKIA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.346694947 (238h59m47.386268077s) [noise=true , address=185.167.204.205:4023 , piece_id=YNW6TYPAVMYIHD5BT6QZGJJAGDM2XSZ4QYX4C2TH5QRGNTNP4KUQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363156895 (238h59m47.402730015s) [noise=true , address=185.167.204.206:4059 , piece_id=IX3H3WSLKDNPCCA5NMFUGMO2P6CA274AEUXLGVA3WRGJM3SN2OZQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363183276 (238h59m47.402756406s) [seg_pos={0 0}, upload=210063]: Segment reached optimal threshold of 26 pieces. Sep 16 12:28:11.363333942 (238h59m47.402907072s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363361435 (238h59m47.402934565s) [noise=true , address=185.167.204.206:4066 , piece_id=XXWYU36QFNZ2HCZF2WGAG4LKIBE3GCCKNVBDV6N5RQMCDJJXJULQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: expected piece hash; context canceled; EOF Sep 16 12:28:11.363393326 (238h59m47.402966456s) [seg_pos={0 0}, upload=210063]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil> Sep 16 12:28:11.363496222 (238h59m47.403069362s) [upload=210063]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 16 12:28:11.363503285 (238h59m47.403076405s) [upload=210063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 16 12:28:11.633947931 (238h59m47.673521071s) [upload=210063]: Done uploading segments... Sep 16 12:28:11.633974231 (238h59m47.673547372s) [upload=210063]: Upload finished. err: <nil> Duration: 4.964433578s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 22 out of 60 is failed (threshold=3) [................X......X.X.......XXXX.XX.XXXXXX..XX.XXX..XX.] duration: 10.088058623s FAIL (2025-09-16 12:55:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== s={0 0}, upload=210421]: Begin upload segment... Sep 16 12:54:33.198430767 (239h26m9.238003897s) [seg_pos={0 0}, upload=210421]: Done begin upload segment. Sep 16 12:54:33.198454893 (239h26m9.238028013s) [noise=true , address=77.90.31.12:4590 , piece_id=XBW745CNFGDDXDJ65IUJM2HBLOAQXYGCOLER3EW3OH4VXDQ65LAA, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.198523243 (239h26m9.238096373s) [noise=true , address=145.79.227.3:4151 , piece_id=EBZH5BQG4TC5H64QX7ZT32YF2TKF4EN4P7BP6ANEJNQAV2CIXAIQ, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.198973481 (239h26m9.238546611s) [noise=true , address=145.79.227.17:4972 , piece_id=PZRG6BGX6KQE5PQJITR5RVRUVFK43VS2OD5MRPOSK6IHRWNO2FDA, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.199288260 (239h26m9.23886138s) [noise=true , address=45.91.116.10:4082 , piece_id=HASDAQHTYAXZFBA3XTVXAKOMXEUJN7A7BG2QMYBWHT52AHZQMXFA, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.199373352 (239h26m9.238946472s) [noise=true , address=77.90.31.19:4842 , piece_id=ORNANPX56Q4HJ3SWIA2E3NYNK6H2NFZRI43QALO7EAM7VYWQCDVA, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.199642705 (239h26m9.239215835s) [noise=true , address=145.79.227.2:4115 , piece_id=XQNUZCRTB2LCQ3F5LI6J7INOLHLLUPVDAWOZZEOBYD52PEZWQKMQ, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.199822237 (239h26m9.239395367s) [noise=true , address=77.90.31.18:4807 , piece_id=FS4DM6QUWRQXH6VSAPYQJGJ3EMYO7BM6CEKLITPSH6UXHKTH3LXQ, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.199922167 (239h26m9.239495297s) [noise=true , address=45.91.116.9:4262 , piece_id=PD673BILFD6DON6P5QH5ZLLPV3OO7NOLXMNWKFDFESLX4Q2USVAQ, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.200171181 (239h26m9.239744301s) [noise=true , address=45.91.116.4:4940 , piece_id=VUARZBNTSJ53PRIZ5FQMQE22V66ESGS4KFYYDKCKWC5LH74F5R4A, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.200434583 (239h26m9.240007713s) [noise=true , address=77.90.31.11:4555 , piece_id=OPAPRAGQYS6GX4NHR3VFCMFIURWL6LQ4ACS4WVFAB7NAEDZHAS2A, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.200566483 (239h26m9.240139603s) [noise=true , address=145.79.227.6:4257 , piece_id=URSAMZFKBX5WCKSMJA3BKWVKAVDFAADFLQLVPQSWZQ652OCC22IQ, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.200820357 (239h26m9.240393478s) [noise=true , address=145.79.227.19:4079 , piece_id=RTNBVRNS4355K32645KSURYNQPHAGMX2O5TQZ47XZJJJZLQSDPKQ, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.200964111 (239h26m9.240537231s) [noise=true , address=45.91.116.11:4118 , piece_id=RP63BJ3UONOX73OLRA4OOJT2AKO27ZJBHOHBQOEZC2Q6A3O5LMRQ, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.201108907 (239h26m9.240682037s) [noise=true , address=45.91.116.5:4297 , piece_id=AAEVE3OC5F7QLTPB23AEOJYILY5IUIEKY2CZT645C4CUGUZIK77A, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.201348824 (239h26m9.240921944s) [noise=true , address=45.91.116.10:4081 , piece_id=4EVAYN7P5OATXOGGBTKUMNXVB6W4KZCTPPJZWR7A7EZMFXHAWHWQ, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.201480845 (239h26m9.241053965s) [noise=true , address=145.79.227.16:4911 , piece_id=4J2UU6ZPXAITX32Z5XWGKZ22A6JGBJ2CUD3634GEYN4VII2W6R5A, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:35.035598540 (239h26m11.07517167s) [upload=210421]: Next returned nil segment Sep 16 12:54:35.035621274 (239h26m11.075194404s) [upload=210421]: Waiting for error group managing segments... Sep 16 12:54:35.376788091 (239h26m11.416361211s) [noise=true , address=45.91.116.5:4297 , piece_id=AAEVE3OC5F7QLTPB23AEOJYILY5IUIEKY2CZT645C4CUGUZIK77A, seg_pos={0 0}, upload=210421]: Done uploading piece. err: <nil> Sep 16 12:54:35.382199305 (239h26m11.421772435s) [noise=true , address=45.91.116.10:4082 , piece_id=HASDAQHTYAXZFBA3XTVXAKOMXEUJN7A7BG2QMYBWHT52AHZQMXFA, seg_pos={0 0}, upload=210421]: Done uploading piece. err: <nil> Sep 16 12:54:35.401259952 (239h26m11.440833082s) [noise=true , address=45.91.116.4:4940 , piece_id=VUARZBNTSJ53PRIZ5FQMQE22V66ESGS4KFYYDKCKWC5LH74F5R4A, seg_pos={0 0}, upload=210421]: Done uploading piece. err: <nil> Sep 16 12:54:35.406063889 (239h26m11.445637019s) [noise=true , address=45.91.116.11:4118 , piece_id=RP63BJ3UONOX73OLRA4OOJT2AKO27ZJBHOHBQOEZC2Q6A3O5LMRQ, seg_pos={0 0}, upload=210421]: Done uploading piece. err: <nil> Sep 16 12:54:35.420551857 (239h26m11.460124977s) [noise=true , address=45.91.116.9:4262 , piece_id=PD673BILFD6DON6P5QH5ZLLPV3OO7NOLXMNWKFDFESLX4Q2USVAQ, seg_pos={0 0}, upload=210421]: Done uploading piece. err: <nil> Sep 16 12:54:35.428233877 (239h26m11.467807007s) [noise=true , address=45.91.116.10:4081 , piece_id=4EVAYN7P5OATXOGGBTKUMNXVB6W4KZCTPPJZWR7A7EZMFXHAWHWQ, seg_pos={0 0}, upload=210421]: Done uploading piece. err: <nil> Sep 16 12:54:35.432540257 (239h26m11.472113387s) [noise=true , address=77.90.31.11:4555 , piece_id=OPAPRAGQYS6GX4NHR3VFCMFIURWL6LQ4ACS4WVFAB7NAEDZHAS2A, seg_pos={0 0}, upload=210421]: Done uploading piece. err: <nil> Sep 16 12:54:35.442637324 (239h26m11.482210454s) [noise=true , address=77.90.31.19:4842 , piece_id=ORNANPX56Q4HJ3SWIA2E3NYNK6H2NFZRI43QALO7EAM7VYWQCDVA, seg_pos={0 0}, upload=210421]: Done uploading piece. err: <nil> Sep 16 12:54:35.476144100 (239h26m11.51571723s) [noise=true , address=77.90.31.12:4590 , piece_id=XBW745CNFGDDXDJ65IUJM2HBLOAQXYGCOLER3EW3OH4VXDQ65LAA, seg_pos={0 0}, upload=210421]: Done uploading piece. err: <nil> Sep 16 12:54:36.228906283 (239h26m12.268479413s) [noise=true , address=77.90.31.18:4807 , piece_id=FS4DM6QUWRQXH6VSAPYQJGJ3EMYO7BM6CEKLITPSH6UXHKTH3LXQ, seg_pos={0 0}, upload=210421]: Done uploading piece. err: <nil> Sep 16 12:55:02.187236517 (239h26m38.226809657s) [noise=true , address=145.79.227.17:4972 , piece_id=PZRG6BGX6KQE5PQJITR5RVRUVFK43VS2OD5MRPOSK6IHRWNO2FDA, seg_pos={0 0}, upload=210421]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:37248->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:37248->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37248->145.79.227.17:4972: use of closed network connection Sep 16 12:55:02.187346256 (239h26m38.226919396s) [noise=true , address=145.79.227.19:4079 , piece_id=RTNBVRNS4355K32645KSURYNQPHAGMX2O5TQZ47XZJJJZLQSDPKQ, seg_pos={0 0}, upload=210421]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:32970->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:32970->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32970->145.79.227.19:4079: use of closed network connection Sep 16 12:55:02.187425797 (239h26m38.226998937s) [noise=true , address=145.79.227.16:4911 , piece_id=4J2UU6ZPXAITX32Z5XWGKZ22A6JGBJ2CUD3634GEYN4VII2W6R5A, seg_pos={0 0}, upload=210421]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:57332->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:57332->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57332->145.79.227.16:4911: use of closed network connection Sep 16 12:55:02.187500389 (239h26m38.227073519s) [noise=true , address=145.79.227.2:4115 , piece_id=XQNUZCRTB2LCQ3F5LI6J7INOLHLLUPVDAWOZZEOBYD52PEZWQKMQ, seg_pos={0 0}, upload=210421]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:47174->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:47174->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47174->145.79.227.2:4115: use of closed network connection Sep 16 12:55:02.187575913 (239h26m38.227149043s) [noise=true , address=145.79.227.6:4257 , piece_id=URSAMZFKBX5WCKSMJA3BKWVKAVDFAADFLQLVPQSWZQ652OCC22IQ, seg_pos={0 0}, upload=210421]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:56886->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:56886->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56886->145.79.227.6:4257: use of closed network connection Sep 16 12:55:02.187651096 (239h26m38.227224226s) [noise=true , address=145.79.227.3:4151 , piece_id=EBZH5BQG4TC5H64QX7ZT32YF2TKF4EN4P7BP6ANEJNQAV2CIXAIQ, seg_pos={0 0}, upload=210421]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:59810->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:59810->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59810->145.79.227.3:4151: use of closed network connection Sep 16 12:55:02.187702604 (239h26m38.227275734s) [seg_pos={0 0}, upload=210421]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 16 12:55:02.450945674 (239h26m38.490518814s) [upload=210421]: Done uploading segments... Sep 16 12:55:02.450986401 (239h26m38.490559531s) [upload=210421]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 10.088090164s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 25 out of 60 is failed (threshold=3) [...............................X.X..XXX.XXXXXXXXXXXXXXXXXXXX] duration: 1m0.263469838s FAIL (2025-09-16 12:55:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== (239h26m20.959119266s) [seg_pos={0 0}, upload=210425]: Done begin upload segment. Sep 16 12:54:44.919567466 (239h26m20.959140586s) [noise=true , address=145.79.227.49:4370 , piece_id=5DXQ6MNPD4IXQ6VW2QRGUSQHAKGLQ6KPSBRDHVVZMWJTPYSXIETQ, seg_pos={0 0}, upload=210425]: Uploading piece... Sep 16 12:54:44.919587124 (239h26m20.959160264s) [noise=true , address=145.79.227.6:4267 , piece_id=ACDHHSUV7FSIXKM5C6AM35FHJC6LJVRZA2JOV3MTYQ2DWMFYNMKQ, seg_pos={0 0}, upload=210425]: Uploading piece... Sep 16 12:54:44.920040807 (239h26m20.959613937s) [noise=true , address=145.79.227.14:4863 , piece_id=RIVLEAQSYUQJ2KRU3NOAKJVDHQXIUOJO7Y2KNQTRIMTRH7QVX7ZQ, seg_pos={0 0}, upload=210425]: Uploading piece... Sep 16 12:54:44.920118716 (239h26m20.959691846s) [noise=true , address=145.79.227.13:4811 , piece_id=42RFDNYZBSAYKE4XIHTAALJ2AM73SWBYBLAPFNPZDWAC7CCNIQGQ, seg_pos={0 0}, upload=210425]: Uploading piece... Sep 16 12:54:44.920610682 (239h26m20.960183802s) [noise=true , address=145.79.227.2:4119 , piece_id=5IOCZ7AMXHTN5LXZFEIOXZNFAJEGAGDYK6IRIPN7H3PYBWEVAXIQ, seg_pos={0 0}, upload=210425]: Uploading piece... Sep 16 12:54:44.920993391 (239h26m20.960566511s) [noise=true , address=145.79.227.35:4487 , piece_id=XX56ULAGSEXENKQJHZC3STTJGFEL6O64CMBJO4ETH4TOKYT7QPJQ, seg_pos={0 0}, upload=210425]: Uploading piece... Sep 16 12:54:44.921416287 (239h26m20.960989417s) [noise=true , address=145.79.227.8:4349 , piece_id=UVTXCQGQSVM44FOOAWI5RTPWHDBG6CCE3D3V2JVOACVMLA3FXYYQ, seg_pos={0 0}, upload=210425]: Uploading piece... Sep 16 12:54:44.921791571 (239h26m20.961364711s) [noise=true , address=145.79.227.20:4439 , piece_id=JP7O4VFP7XQRBVAL4K5JWQ2FYJTGLQHCY5LWZ7ZUETOTSIHU3E5A, seg_pos={0 0}, upload=210425]: Uploading piece... Sep 16 12:54:44.922191683 (239h26m20.961764813s) [noise=true , address=145.79.227.23:4557 , piece_id=YHRM3T7CBANGEJM33ZTAL4RORE7IOP6BSSA3LM7LRCM2IY6TQ2PQ, seg_pos={0 0}, upload=210425]: Uploading piece... Sep 16 12:54:44.922551378 (239h26m20.962124508s) [noise=true , address=145.79.227.40:4070 , piece_id=JSVOCD6Z4D6T7LYO6S3LWEKCMWCR5MUVAZNIY57FYIY2A5TW47JA, seg_pos={0 0}, upload=210425]: Uploading piece... Sep 16 12:54:44.923009059 (239h26m20.962582179s) [noise=true , address=145.79.227.11:4759 , piece_id=ZUDQ4N5JHNBUBHMAJIR3KHXCUYJ7EF7GZGPCOR237DN5PDVSDTXQ, seg_pos={0 0}, upload=210425]: Uploading piece... Sep 16 12:54:44.923305003 (239h26m20.962878123s) [noise=true , address=145.79.227.46:4613 , piece_id=5F5NXJ63OS7YW7XSCKQYHODZLWWBAOXRNRTUOQ7HAUWFQOKXNRYQ, seg_pos={0 0}, upload=210425]: Uploading piece... Sep 16 12:54:44.923685508 (239h26m20.963258638s) [noise=true , address=145.79.227.29:4959 , piece_id=BX33VA45XHWON5AS3CWKNGSXVNTMTSUEVGDPHIQUEWPFLXT4672A, seg_pos={0 0}, upload=210425]: Uploading piece... Sep 16 12:54:44.923739191 (239h26m20.963312311s) [noise=true , address=77.90.31.11:4577 , piece_id=5BJSJXX6B3KA7C65OHTARM7BJ3NJXEWUXMKWJRUPYZ7J5CN4KQ5Q, seg_pos={0 0}, upload=210425]: Uploading piece... Sep 16 12:54:44.924088967 (239h26m20.963662087s) [noise=true , address=145.79.227.7:4321 , piece_id=ELYHFQPM7WHYYRZ4ZEL2IZO7ZB7S66XUIMHMZ2BPNSGUJOLFK3PA, seg_pos={0 0}, upload=210425]: Uploading piece... Sep 16 12:54:44.924516651 (239h26m20.964089781s) [noise=true , address=145.79.227.22:4526 , piece_id=S4UM5UQYU3BYC6HIZTAOTKHUNFWBOMKGLV3WCWE3643FWKH7SEAA, seg_pos={0 0}, upload=210425]: Uploading piece... Sep 16 12:54:44.924904800 (239h26m20.96447793s) [noise=true , address=145.79.227.33:4884 , piece_id=SJS3WVQ77HKOPOH4TBQJGX3SFHOPLRZRBEF6EXDWYFNCJMHWRQUQ, seg_pos={0 0}, upload=210425]: Uploading piece... Sep 16 12:54:44.925071297 (239h26m20.964644427s) [noise=true , address=145.79.227.12:4771 , piece_id=2K5M2N3GRL3QHD7PDNNKOMBWMI63MIO53Y6OLIP4SJH2GGZPCGPQ, seg_pos={0 0}, upload=210425]: Uploading piece... Sep 16 12:54:46.506421330 (239h26m22.54599445s) [upload=210425]: Next returned nil segment Sep 16 12:54:46.506441038 (239h26m22.546014158s) [upload=210425]: Waiting for error group managing segments... Sep 16 12:54:46.929974039 (239h26m22.969547159s) [noise=true , address=77.90.31.11:4577 , piece_id=5BJSJXX6B3KA7C65OHTARM7BJ3NJXEWUXMKWJRUPYZ7J5CN4KQ5Q, seg_pos={0 0}, upload=210425]: Done uploading piece. err: <nil> Sep 16 12:54:58.290593104 (239h26m34.330166254s) [noise=true , address=145.79.227.23:4557 , piece_id=YHRM3T7CBANGEJM33ZTAL4RORE7IOP6BSSA3LM7LRCM2IY6TQ2PQ, seg_pos={0 0}, upload=210425]: Done uploading piece. err: <nil> Sep 16 12:55:00.776613032 (239h26m36.816186162s) [noise=true , address=145.79.227.2:4119 , piece_id=5IOCZ7AMXHTN5LXZFEIOXZNFAJEGAGDYK6IRIPN7H3PYBWEVAXIQ, seg_pos={0 0}, upload=210425]: Done uploading piece. err: <nil> Sep 16 12:55:08.343309026 (239h26m44.382882166s) [noise=true , address=145.79.227.33:4884 , piece_id=SJS3WVQ77HKOPOH4TBQJGX3SFHOPLRZRBEF6EXDWYFNCJMHWRQUQ, seg_pos={0 0}, upload=210425]: Done uploading piece. err: <nil> Sep 16 12:55:17.754582178 (239h26m53.794155308s) [noise=true , address=145.79.227.13:4811 , piece_id=42RFDNYZBSAYKE4XIHTAALJ2AM73SWBYBLAPFNPZDWAC7CCNIQGQ, seg_pos={0 0}, upload=210425]: Done uploading piece. err: <nil> Sep 16 12:55:25.099572892 (239h27m1.139146022s) [noise=true , address=145.79.227.7:4321 , piece_id=ELYHFQPM7WHYYRZ4ZEL2IZO7ZB7S66XUIMHMZ2BPNSGUJOLFK3PA, seg_pos={0 0}, upload=210425]: Done uploading piece. err: <nil> Sep 16 12:55:26.177666115 (239h27m2.217239246s) [noise=true , address=145.79.227.6:4267 , piece_id=ACDHHSUV7FSIXKM5C6AM35FHJC6LJVRZA2JOV3MTYQ2DWMFYNMKQ, seg_pos={0 0}, upload=210425]: Done uploading piece. err: <nil> Sep 16 12:55:29.328571557 (239h27m5.368144687s) [noise=true , address=145.79.227.14:4863 , piece_id=RIVLEAQSYUQJ2KRU3NOAKJVDHQXIUOJO7Y2KNQTRIMTRH7QVX7ZQ, seg_pos={0 0}, upload=210425]: Done uploading piece. err: <nil> Sep 16 12:55:38.760753082 (239h27m14.800326212s) [noise=true , address=145.79.227.12:4771 , piece_id=2K5M2N3GRL3QHD7PDNNKOMBWMI63MIO53Y6OLIP4SJH2GGZPCGPQ, seg_pos={0 0}, upload=210425]: Done uploading piece. err: <nil> Sep 16 12:55:39.185210154 (239h27m15.224783274s) [noise=true , address=145.79.227.8:4349 , piece_id=UVTXCQGQSVM44FOOAWI5RTPWHDBG6CCE3D3V2JVOACVMLA3FXYYQ, seg_pos={0 0}, upload=210425]: Done uploading piece. err: <nil> Sep 16 12:55:40.298515023 (239h27m16.338088143s) [noise=true , address=145.79.227.11:4759 , piece_id=ZUDQ4N5JHNBUBHMAJIR3KHXCUYJ7EF7GZGPCOR237DN5PDVSDTXQ, seg_pos={0 0}, upload=210425]: Done uploading piece. err: <nil> Sep 16 12:55:42.974166106 (239h27m19.013739236s) [noise=true , address=145.79.227.40:4070 , piece_id=JSVOCD6Z4D6T7LYO6S3LWEKCMWCR5MUVAZNIY57FYIY2A5TW47JA, seg_pos={0 0}, upload=210425]: Done uploading piece. err: <nil> Sep 16 12:55:43.692634298 (239h27m19.732207428s) [noise=true , address=145.79.227.20:4439 , piece_id=JP7O4VFP7XQRBVAL4K5JWQ2FYJTGLQHCY5LWZ7ZUETOTSIHU3E5A, seg_pos={0 0}, upload=210425]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:55:43.692749657 (239h27m19.732322777s) [noise=true , address=145.79.227.22:4526 , piece_id=S4UM5UQYU3BYC6HIZTAOTKHUNFWBOMKGLV3WCWE3643FWKH7SEAA, seg_pos={0 0}, upload=210425]: Done uploading piece. err: ecclient: upload failed (node:12VcjRprUr7vgU2bqHenqbzwM38keZzNJbpYAShs4few2Dtm3WH, address:145.79.227.22:4526): protocol: write tcp 188.166.225.170:35904->145.79.227.22:4526: use of closed network connection; write tcp 188.166.225.170:35904->145.79.227.22:4526: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35904->145.79.227.22:4526: use of closed network connection Sep 16 12:55:43.692804792 (239h27m19.732377913s) [noise=true , address=145.79.227.46:4613 , piece_id=5F5NXJ63OS7YW7XSCKQYHODZLWWBAOXRNRTUOQ7HAUWFQOKXNRYQ, seg_pos={0 0}, upload=210425]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:55:43.692831143 (239h27m19.732404263s) [noise=true , address=145.79.227.29:4959 , piece_id=BX33VA45XHWON5AS3CWKNGSXVNTMTSUEVGDPHIQUEWPFLXT4672A, seg_pos={0 0}, upload=210425]: Done uploading piece. err: ecclient: upload failed (node:1NCN7sTw12KVDpD8zLjUxQki2MdMuDJyEnPSirG8ni5L2xi7aa, address:145.79.227.29:4959): protocol: expected piece hash; write tcp 188.166.225.170:48964->145.79.227.29:4959: use of closed network connection; write tcp 188.166.225.170:48964->145.79.227.29:4959: use of closed network connection; EOF Sep 16 12:55:43.692886297 (239h27m19.732459417s) [noise=true , address=145.79.227.49:4370 , piece_id=5DXQ6MNPD4IXQ6VW2QRGUSQHAKGLQ6KPSBRDHVVZMWJTPYSXIETQ, seg_pos={0 0}, upload=210425]: Done uploading piece. err: ecclient: upload failed (node:14LBgixGGgNeYs63ZSpkYJmrEGr3W9Ma1s2Sj8cCxU6mUxm1aC, address:145.79.227.49:4370): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:55:43.692981799 (239h27m19.73255493s) [noise=true , address=145.79.227.35:4487 , piece_id=XX56ULAGSEXENKQJHZC3STTJGFEL6O64CMBJO4ETH4TOKYT7QPJQ, seg_pos={0 0}, upload=210425]: Done uploading piece. err: ecclient: upload failed (node:1AdZLDV7UBbV2DimCHzmoNxycLigvLMx6Fy9U9QB35WTtiV1KX, address:145.79.227.35:4487): protocol: write tcp 188.166.225.170:41358->145.79.227.35:4487: use of closed network connection; write tcp 188.166.225.170:41358->145.79.227.35:4487: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41358->145.79.227.35:4487: use of closed network connection Sep 16 12:55:43.693000265 (239h27m19.732573385s) [seg_pos={0 0}, upload=210425]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Sep 16 12:55:43.954381989 (239h27m19.993955129s) [upload=210425]: Done uploading segments... Sep 16 12:55:43.954417487 (239h27m19.993990617s) [upload=210425]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 1m0.263501239s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 5.05028296s FAIL (2025-09-16 12:55:11 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== JFA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422604190 (238h59m45.46217732s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422896808 (238h59m45.462469928s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423232478 (238h59m45.462805608s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423565571 (238h59m45.463138691s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423935696 (238h59m45.463508826s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424280403 (238h59m45.463853533s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424633305 (238h59m45.464206435s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424994342 (238h59m45.464567472s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425341152 (238h59m45.464914282s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425707831 (238h59m45.465280951s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.426034432 (238h59m45.465607562s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429082236 (238h59m45.468655366s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429521483 (238h59m45.469094613s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:10.278696743 (238h59m46.318269863s) [upload=210063]: Next returned nil segment Sep 16 12:28:10.278720237 (238h59m46.318293367s) [upload=210063]: Waiting for error group managing segments... Sep 16 12:28:10.652409183 (238h59m46.691982303s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.662938092 (238h59m46.702511222s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.670032272 (238h59m46.709605402s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.701595607 (238h59m46.741168737s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.704157255 (238h59m46.743730385s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.707972140 (238h59m46.74754527s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.708523660 (238h59m46.74809678s) [noise=true , address=89.149.201.147:4007 , piece_id=BOQVD3EW5UAYWKEZ5FWC2QCDGIROAEOQN2OEYQ4QACNVDEIFF2IA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.754549157 (238h59m46.794122277s) [noise=true , address=89.149.201.147:4010 , piece_id=OALYBM6QEAOKMQPP2R3Y7LBVOEJYPMTBHJTGE2DSRO3KLRGBZC3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.138412786 (238h59m47.177985916s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.163219826 (238h59m47.202792956s) [noise=true , address=81.171.14.70:4039 , piece_id=IMLIU4QCGFNXWATVWK4L7FZPWOVPCRXNH4F3HSMF5VLQZJUEBO3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.169643348 (238h59m47.209216478s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.231770296 (238h59m47.271343416s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.258046263 (238h59m47.297619383s) [noise=true , address=185.167.204.205:4034 , piece_id=FUHHRFVDRYETJRWVBQZRALI4UGKDQ6DXV7TDKXBRASOMGOEN6YOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.263155884 (238h59m47.302729004s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.269762875 (238h59m47.309336005s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.281404505 (238h59m47.320977635s) [noise=true , address=185.167.204.205:4027 , piece_id=3O5SOEMEXYDYR5OE6SZJ2AVVLNYG4V4IMZOFUL7XDJEZUHDUV5TA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.289386705 (238h59m47.328959825s) [noise=true , address=185.167.204.206:4063 , piece_id=ERJLEJ5EILBCN4WUPZBVYSB2CGDWORVZ3GASSXBVNGR25GWVFYOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.298140815 (238h59m47.337713945s) [noise=true , address=185.167.204.206:4043 , piece_id=LDZTOC67YHM344PUCLVJ7RMKQAYJAQJ4GMKYZNN5LLU5KIUQCW7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.311391579 (238h59m47.350964709s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.317381906 (238h59m47.356955036s) [noise=true , address=185.167.204.206:4065 , piece_id=UXYM6MEGCQFRRRSMGI5XKJJJ6GYW7IJXG5QDGMICLP3FNJDSFRSQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.318355050 (238h59m47.35792818s) [noise=true , address=185.167.204.205:4018 , piece_id=VZP55ZA5Y5IA2PUH75QDVB56UHRJJ2XNC75L5WCRUSHGHQGZ463A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.330083334 (238h59m47.369656464s) [noise=true , address=185.167.204.206:4052 , piece_id=CDKZXVC22A62STE3NYD4R2TWT3AF45U2A7MHEIQJPTNMUKBVFJFA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.331429858 (238h59m47.371002988s) [noise=true , address=185.167.204.205:4035 , piece_id=M6LWKXSTJHGHXHY4VEJ2IGLI2UX4IIZV5KD4A6YY3BMIQ6ZRBMAQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.341689555 (238h59m47.381262686s) [noise=true , address=185.167.204.205:4014 , piece_id=MDSUAX4XNI5INUUQCMAP26PQFV62U3TZ2OITZR3BSNDQLHWEOKIA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.346694947 (238h59m47.386268077s) [noise=true , address=185.167.204.205:4023 , piece_id=YNW6TYPAVMYIHD5BT6QZGJJAGDM2XSZ4QYX4C2TH5QRGNTNP4KUQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363156895 (238h59m47.402730015s) [noise=true , address=185.167.204.206:4059 , piece_id=IX3H3WSLKDNPCCA5NMFUGMO2P6CA274AEUXLGVA3WRGJM3SN2OZQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363183276 (238h59m47.402756406s) [seg_pos={0 0}, upload=210063]: Segment reached optimal threshold of 26 pieces. Sep 16 12:28:11.363333942 (238h59m47.402907072s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363361435 (238h59m47.402934565s) [noise=true , address=185.167.204.206:4066 , piece_id=XXWYU36QFNZ2HCZF2WGAG4LKIBE3GCCKNVBDV6N5RQMCDJJXJULQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: expected piece hash; context canceled; EOF Sep 16 12:28:11.363393326 (238h59m47.402966456s) [seg_pos={0 0}, upload=210063]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil> Sep 16 12:28:11.363496222 (238h59m47.403069362s) [upload=210063]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 16 12:28:11.363503285 (238h59m47.403076405s) [upload=210063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 16 12:28:11.633947931 (238h59m47.673521071s) [upload=210063]: Done uploading segments... Sep 16 12:28:11.633974231 (238h59m47.673547372s) [upload=210063]: Upload finished. err: <nil> Duration: 5.050317776s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 22 out of 60 is failed (threshold=3) [.................X......X.X.......XXXX.XX.XXXXXX..XX.XXX..XX] duration: 30.266416116s FAIL (2025-09-16 12:55:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== s={0 0}, upload=210421]: Begin upload segment... Sep 16 12:54:33.198430767 (239h26m9.238003897s) [seg_pos={0 0}, upload=210421]: Done begin upload segment. Sep 16 12:54:33.198454893 (239h26m9.238028013s) [noise=true , address=77.90.31.12:4590 , piece_id=XBW745CNFGDDXDJ65IUJM2HBLOAQXYGCOLER3EW3OH4VXDQ65LAA, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.198523243 (239h26m9.238096373s) [noise=true , address=145.79.227.3:4151 , piece_id=EBZH5BQG4TC5H64QX7ZT32YF2TKF4EN4P7BP6ANEJNQAV2CIXAIQ, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.198973481 (239h26m9.238546611s) [noise=true , address=145.79.227.17:4972 , piece_id=PZRG6BGX6KQE5PQJITR5RVRUVFK43VS2OD5MRPOSK6IHRWNO2FDA, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.199288260 (239h26m9.23886138s) [noise=true , address=45.91.116.10:4082 , piece_id=HASDAQHTYAXZFBA3XTVXAKOMXEUJN7A7BG2QMYBWHT52AHZQMXFA, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.199373352 (239h26m9.238946472s) [noise=true , address=77.90.31.19:4842 , piece_id=ORNANPX56Q4HJ3SWIA2E3NYNK6H2NFZRI43QALO7EAM7VYWQCDVA, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.199642705 (239h26m9.239215835s) [noise=true , address=145.79.227.2:4115 , piece_id=XQNUZCRTB2LCQ3F5LI6J7INOLHLLUPVDAWOZZEOBYD52PEZWQKMQ, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.199822237 (239h26m9.239395367s) [noise=true , address=77.90.31.18:4807 , piece_id=FS4DM6QUWRQXH6VSAPYQJGJ3EMYO7BM6CEKLITPSH6UXHKTH3LXQ, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.199922167 (239h26m9.239495297s) [noise=true , address=45.91.116.9:4262 , piece_id=PD673BILFD6DON6P5QH5ZLLPV3OO7NOLXMNWKFDFESLX4Q2USVAQ, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.200171181 (239h26m9.239744301s) [noise=true , address=45.91.116.4:4940 , piece_id=VUARZBNTSJ53PRIZ5FQMQE22V66ESGS4KFYYDKCKWC5LH74F5R4A, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.200434583 (239h26m9.240007713s) [noise=true , address=77.90.31.11:4555 , piece_id=OPAPRAGQYS6GX4NHR3VFCMFIURWL6LQ4ACS4WVFAB7NAEDZHAS2A, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.200566483 (239h26m9.240139603s) [noise=true , address=145.79.227.6:4257 , piece_id=URSAMZFKBX5WCKSMJA3BKWVKAVDFAADFLQLVPQSWZQ652OCC22IQ, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.200820357 (239h26m9.240393478s) [noise=true , address=145.79.227.19:4079 , piece_id=RTNBVRNS4355K32645KSURYNQPHAGMX2O5TQZ47XZJJJZLQSDPKQ, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.200964111 (239h26m9.240537231s) [noise=true , address=45.91.116.11:4118 , piece_id=RP63BJ3UONOX73OLRA4OOJT2AKO27ZJBHOHBQOEZC2Q6A3O5LMRQ, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.201108907 (239h26m9.240682037s) [noise=true , address=45.91.116.5:4297 , piece_id=AAEVE3OC5F7QLTPB23AEOJYILY5IUIEKY2CZT645C4CUGUZIK77A, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.201348824 (239h26m9.240921944s) [noise=true , address=45.91.116.10:4081 , piece_id=4EVAYN7P5OATXOGGBTKUMNXVB6W4KZCTPPJZWR7A7EZMFXHAWHWQ, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:33.201480845 (239h26m9.241053965s) [noise=true , address=145.79.227.16:4911 , piece_id=4J2UU6ZPXAITX32Z5XWGKZ22A6JGBJ2CUD3634GEYN4VII2W6R5A, seg_pos={0 0}, upload=210421]: Uploading piece... Sep 16 12:54:35.035598540 (239h26m11.07517167s) [upload=210421]: Next returned nil segment Sep 16 12:54:35.035621274 (239h26m11.075194404s) [upload=210421]: Waiting for error group managing segments... Sep 16 12:54:35.376788091 (239h26m11.416361211s) [noise=true , address=45.91.116.5:4297 , piece_id=AAEVE3OC5F7QLTPB23AEOJYILY5IUIEKY2CZT645C4CUGUZIK77A, seg_pos={0 0}, upload=210421]: Done uploading piece. err: <nil> Sep 16 12:54:35.382199305 (239h26m11.421772435s) [noise=true , address=45.91.116.10:4082 , piece_id=HASDAQHTYAXZFBA3XTVXAKOMXEUJN7A7BG2QMYBWHT52AHZQMXFA, seg_pos={0 0}, upload=210421]: Done uploading piece. err: <nil> Sep 16 12:54:35.401259952 (239h26m11.440833082s) [noise=true , address=45.91.116.4:4940 , piece_id=VUARZBNTSJ53PRIZ5FQMQE22V66ESGS4KFYYDKCKWC5LH74F5R4A, seg_pos={0 0}, upload=210421]: Done uploading piece. err: <nil> Sep 16 12:54:35.406063889 (239h26m11.445637019s) [noise=true , address=45.91.116.11:4118 , piece_id=RP63BJ3UONOX73OLRA4OOJT2AKO27ZJBHOHBQOEZC2Q6A3O5LMRQ, seg_pos={0 0}, upload=210421]: Done uploading piece. err: <nil> Sep 16 12:54:35.420551857 (239h26m11.460124977s) [noise=true , address=45.91.116.9:4262 , piece_id=PD673BILFD6DON6P5QH5ZLLPV3OO7NOLXMNWKFDFESLX4Q2USVAQ, seg_pos={0 0}, upload=210421]: Done uploading piece. err: <nil> Sep 16 12:54:35.428233877 (239h26m11.467807007s) [noise=true , address=45.91.116.10:4081 , piece_id=4EVAYN7P5OATXOGGBTKUMNXVB6W4KZCTPPJZWR7A7EZMFXHAWHWQ, seg_pos={0 0}, upload=210421]: Done uploading piece. err: <nil> Sep 16 12:54:35.432540257 (239h26m11.472113387s) [noise=true , address=77.90.31.11:4555 , piece_id=OPAPRAGQYS6GX4NHR3VFCMFIURWL6LQ4ACS4WVFAB7NAEDZHAS2A, seg_pos={0 0}, upload=210421]: Done uploading piece. err: <nil> Sep 16 12:54:35.442637324 (239h26m11.482210454s) [noise=true , address=77.90.31.19:4842 , piece_id=ORNANPX56Q4HJ3SWIA2E3NYNK6H2NFZRI43QALO7EAM7VYWQCDVA, seg_pos={0 0}, upload=210421]: Done uploading piece. err: <nil> Sep 16 12:54:35.476144100 (239h26m11.51571723s) [noise=true , address=77.90.31.12:4590 , piece_id=XBW745CNFGDDXDJ65IUJM2HBLOAQXYGCOLER3EW3OH4VXDQ65LAA, seg_pos={0 0}, upload=210421]: Done uploading piece. err: <nil> Sep 16 12:54:36.228906283 (239h26m12.268479413s) [noise=true , address=77.90.31.18:4807 , piece_id=FS4DM6QUWRQXH6VSAPYQJGJ3EMYO7BM6CEKLITPSH6UXHKTH3LXQ, seg_pos={0 0}, upload=210421]: Done uploading piece. err: <nil> Sep 16 12:55:02.187236517 (239h26m38.226809657s) [noise=true , address=145.79.227.17:4972 , piece_id=PZRG6BGX6KQE5PQJITR5RVRUVFK43VS2OD5MRPOSK6IHRWNO2FDA, seg_pos={0 0}, upload=210421]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:37248->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:37248->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37248->145.79.227.17:4972: use of closed network connection Sep 16 12:55:02.187346256 (239h26m38.226919396s) [noise=true , address=145.79.227.19:4079 , piece_id=RTNBVRNS4355K32645KSURYNQPHAGMX2O5TQZ47XZJJJZLQSDPKQ, seg_pos={0 0}, upload=210421]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:32970->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:32970->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32970->145.79.227.19:4079: use of closed network connection Sep 16 12:55:02.187425797 (239h26m38.226998937s) [noise=true , address=145.79.227.16:4911 , piece_id=4J2UU6ZPXAITX32Z5XWGKZ22A6JGBJ2CUD3634GEYN4VII2W6R5A, seg_pos={0 0}, upload=210421]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:57332->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:57332->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57332->145.79.227.16:4911: use of closed network connection Sep 16 12:55:02.187500389 (239h26m38.227073519s) [noise=true , address=145.79.227.2:4115 , piece_id=XQNUZCRTB2LCQ3F5LI6J7INOLHLLUPVDAWOZZEOBYD52PEZWQKMQ, seg_pos={0 0}, upload=210421]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:47174->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:47174->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47174->145.79.227.2:4115: use of closed network connection Sep 16 12:55:02.187575913 (239h26m38.227149043s) [noise=true , address=145.79.227.6:4257 , piece_id=URSAMZFKBX5WCKSMJA3BKWVKAVDFAADFLQLVPQSWZQ652OCC22IQ, seg_pos={0 0}, upload=210421]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:56886->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:56886->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56886->145.79.227.6:4257: use of closed network connection Sep 16 12:55:02.187651096 (239h26m38.227224226s) [noise=true , address=145.79.227.3:4151 , piece_id=EBZH5BQG4TC5H64QX7ZT32YF2TKF4EN4P7BP6ANEJNQAV2CIXAIQ, seg_pos={0 0}, upload=210421]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:59810->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:59810->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59810->145.79.227.3:4151: use of closed network connection Sep 16 12:55:02.187702604 (239h26m38.227275734s) [seg_pos={0 0}, upload=210421]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 16 12:55:02.450945674 (239h26m38.490518814s) [upload=210421]: Done uploading segments... Sep 16 12:55:02.450986401 (239h26m38.490559531s) [upload=210421]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 30.266478355s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 24 out of 60 is failed (threshold=3) [................................X.X..XXX.XXXXXXXXXXXXXXXXXXX] duration: 1m0.257811558s FAIL (2025-09-16 12:54:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m13.388299789s) [upload=210412]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 16 12:53:37.946398414 (239h25m13.985971544s) [seg_pos={0 0}, upload=210412]: Begin upload segment... Sep 16 12:53:37.946458148 (239h25m13.986031268s) [seg_pos={0 0}, upload=210412]: Done begin upload segment. Sep 16 12:53:37.946583517 (239h25m13.986156647s) [noise=true , address=145.79.227.23:4557 , piece_id=CCGDTWHAGXUDQSS66GWP7CTER24BPLAR5W3HVWMDYU7LR7RYO3TA, seg_pos={0 0}, upload=210412]: Uploading piece... Sep 16 12:53:37.946655845 (239h25m13.986228965s) [noise=true , address=145.79.227.52:4454 , piece_id=A2FXEGBKINBXTNXH7VTO4U2TAOUZHX2H2YI3BUBMWL2B42UD3RKA, seg_pos={0 0}, upload=210412]: Uploading piece... Sep 16 12:53:37.947177538 (239h25m13.986750668s) [noise=true , address=145.79.227.32:4842 , piece_id=QDQNQ4YCROWQAGIHKYHFULEJPGRDWBI7VPD2OBHHODBY54XU2P2A, seg_pos={0 0}, upload=210412]: Uploading piece... Sep 16 12:53:37.948024571 (239h25m13.987597701s) [noise=true , address=145.79.227.13:4813 , piece_id=JYJPMF3SRMO7F5BKXYKVQVD6PD2R27V3O5OKQCN42SKNNEEXOMRA, seg_pos={0 0}, upload=210412]: Uploading piece... Sep 16 12:53:37.948687463 (239h25m13.988260613s) [noise=true , address=145.79.227.33:4901 , piece_id=2HVWEB5QQINGAKCMSWCSOJWZWE273ZZAKMN57P3MLARYHPZ3VCYA, seg_pos={0 0}, upload=210412]: Uploading piece... Sep 16 12:53:37.949016039 (239h25m13.988589159s) [noise=true , address=145.79.227.8:4339 , piece_id=2UCLA2SRSJVXSBUBABFT6CUQ7V7LLRSC64B64YZQF4MSH3BEURRA, seg_pos={0 0}, upload=210412]: Uploading piece... Sep 16 12:53:37.949537372 (239h25m13.989110492s) [noise=true , address=145.79.227.50:4375 , piece_id=I4LRTXKRAUGTRMNDO3T5HTRQRQQSWXVWKVJST3ASPV7NZB2DLM3A, seg_pos={0 0}, upload=210412]: Uploading piece... Sep 16 12:53:37.950155179 (239h25m13.989728309s) [noise=true , address=145.79.227.46:4614 , piece_id=RVNOUM7ZJJSXOJUJFPOKMDM2VR37WUKQ6FRULEDJRLU7MICJD3UQ, seg_pos={0 0}, upload=210412]: Uploading piece... Sep 16 12:53:37.951201070 (239h25m13.9907742s) [noise=true , address=145.79.227.22:4523 , piece_id=7UUBAAP5EFIQ63UNAE74I37PDYF5QA5F5XZDJTYJVQEYN35E7VBA, seg_pos={0 0}, upload=210412]: Uploading piece... Sep 16 12:53:37.951451857 (239h25m13.991024987s) [noise=true , address=145.79.227.7:4299 , piece_id=WOULPNNYDHSY72KHXURYRGPW7PZNSTQXJZ5TRIOHJQNHIME3K3EA, seg_pos={0 0}, upload=210412]: Uploading piece... Sep 16 12:53:37.951754234 (239h25m13.991327354s) [noise=true , address=145.79.227.15:4886 , piece_id=3PX64RBCNGWL5RPU6HP7CMTJ26YLSPNWYTFCN2KZFPHI3SNL77KA, seg_pos={0 0}, upload=210412]: Uploading piece... Sep 16 12:53:37.951946479 (239h25m13.991519599s) [noise=true , address=77.90.31.11:4579 , piece_id=NTX37DME2T5N2KG2W6FYEBXBKXC6SZU4TIK6AUOC4GKZU6YTW3CA, seg_pos={0 0}, upload=210412]: Uploading piece... Sep 16 12:53:37.952285595 (239h25m13.991858715s) [noise=true , address=145.79.227.30:4780 , piece_id=KB7ET3V2FMB4GBQXMJBPBVBJH6QF2DOTK6ELZYVGCBRT4FAKE3RQ, seg_pos={0 0}, upload=210412]: Uploading piece... Sep 16 12:53:37.952478291 (239h25m13.992051411s) [noise=true , address=145.79.227.11:4739 , piece_id=4QET7TZC5MUTPNRFXJ6SZ3VHASTO37FHQS2W7HJI2OXYWVOD6UDQ, seg_pos={0 0}, upload=210412]: Uploading piece... Sep 16 12:53:37.952983474 (239h25m13.992556604s) [noise=true , address=77.90.31.16:4768 , piece_id=KVVUGE7EANXX3GLRVVWSIPI67HVYCP5RY5BVRLO5VT6IURXY3X5Q, seg_pos={0 0}, upload=210412]: Uploading piece... Sep 16 12:53:37.953108432 (239h25m13.992681562s) [noise=true , address=145.79.227.26:4681 , piece_id=FPQCBT56NTX6PMJY33LBCEOD2QNUHAA3MZT54G7PGRYHYTCW7SKQ, seg_pos={0 0}, upload=210412]: Uploading piece... Sep 16 12:53:37.953430545 (239h25m13.993003675s) [noise=true , address=145.79.227.12:4793 , piece_id=BT5SMWB7SME4NL2MBKJTTMXIYPILVTJCK6FYRIA65OT4BQRS4MPA, seg_pos={0 0}, upload=210412]: Uploading piece... Sep 16 12:53:37.953708865 (239h25m13.993281995s) [noise=true , address=145.79.227.18:4031 , piece_id=2NHCOCVROBAH367XODLNQQ4OT4G6GSTUEFCWVVWPQYSKQ27CKLLA, seg_pos={0 0}, upload=210412]: Uploading piece... Sep 16 12:53:39.588853485 (239h25m15.628426615s) [upload=210412]: Next returned nil segment Sep 16 12:53:39.588875356 (239h25m15.628448476s) [upload=210412]: Waiting for error group managing segments... Sep 16 12:53:40.004489749 (239h25m16.044062879s) [noise=true , address=77.90.31.11:4579 , piece_id=NTX37DME2T5N2KG2W6FYEBXBKXC6SZU4TIK6AUOC4GKZU6YTW3CA, seg_pos={0 0}, upload=210412]: Done uploading piece. err: <nil> Sep 16 12:53:40.031474634 (239h25m16.071047764s) [noise=true , address=77.90.31.16:4768 , piece_id=KVVUGE7EANXX3GLRVVWSIPI67HVYCP5RY5BVRLO5VT6IURXY3X5Q, seg_pos={0 0}, upload=210412]: Done uploading piece. err: <nil> Sep 16 12:54:00.154789783 (239h25m36.194362903s) [noise=true , address=145.79.227.32:4842 , piece_id=QDQNQ4YCROWQAGIHKYHFULEJPGRDWBI7VPD2OBHHODBY54XU2P2A, seg_pos={0 0}, upload=210412]: Done uploading piece. err: <nil> Sep 16 12:54:06.520858481 (239h25m42.560431611s) [noise=true , address=145.79.227.11:4739 , piece_id=4QET7TZC5MUTPNRFXJ6SZ3VHASTO37FHQS2W7HJI2OXYWVOD6UDQ, seg_pos={0 0}, upload=210412]: Done uploading piece. err: <nil> Sep 16 12:54:07.390295704 (239h25m43.429868834s) [noise=true , address=145.79.227.12:4793 , piece_id=BT5SMWB7SME4NL2MBKJTTMXIYPILVTJCK6FYRIA65OT4BQRS4MPA, seg_pos={0 0}, upload=210412]: Done uploading piece. err: <nil> Sep 16 12:54:08.106470018 (239h25m44.146043138s) [noise=true , address=145.79.227.50:4375 , piece_id=I4LRTXKRAUGTRMNDO3T5HTRQRQQSWXVWKVJST3ASPV7NZB2DLM3A, seg_pos={0 0}, upload=210412]: Done uploading piece. err: <nil> Sep 16 12:54:12.038041583 (239h25m48.077614714s) [noise=true , address=145.79.227.26:4681 , piece_id=FPQCBT56NTX6PMJY33LBCEOD2QNUHAA3MZT54G7PGRYHYTCW7SKQ, seg_pos={0 0}, upload=210412]: Done uploading piece. err: <nil> Sep 16 12:54:17.687172037 (239h25m53.726745167s) [noise=true , address=145.79.227.52:4454 , piece_id=A2FXEGBKINBXTNXH7VTO4U2TAOUZHX2H2YI3BUBMWL2B42UD3RKA, seg_pos={0 0}, upload=210412]: Done uploading piece. err: <nil> Sep 16 12:54:19.691069365 (239h25m55.730642485s) [noise=true , address=145.79.227.30:4780 , piece_id=KB7ET3V2FMB4GBQXMJBPBVBJH6QF2DOTK6ELZYVGCBRT4FAKE3RQ, seg_pos={0 0}, upload=210412]: Done uploading piece. err: <nil> Sep 16 12:54:24.610959654 (239h26m0.650532784s) [noise=true , address=145.79.227.7:4299 , piece_id=WOULPNNYDHSY72KHXURYRGPW7PZNSTQXJZ5TRIOHJQNHIME3K3EA, seg_pos={0 0}, upload=210412]: Done uploading piece. err: <nil> Sep 16 12:54:36.524682085 (239h26m12.564255215s) [noise=true , address=145.79.227.23:4557 , piece_id=CCGDTWHAGXUDQSS66GWP7CTER24BPLAR5W3HVWMDYU7LR7RYO3TA, seg_pos={0 0}, upload=210412]: Done uploading piece. err: <nil> Sep 16 12:54:36.618433732 (239h26m12.658006862s) [noise=true , address=145.79.227.33:4901 , piece_id=2HVWEB5QQINGAKCMSWCSOJWZWE273ZZAKMN57P3MLARYHPZ3VCYA, seg_pos={0 0}, upload=210412]: Done uploading piece. err: ecclient: upload failed (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1, address:145.79.227.33:4901): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:54:36.618638542 (239h26m12.658211662s) [noise=true , address=145.79.227.15:4886 , piece_id=3PX64RBCNGWL5RPU6HP7CMTJ26YLSPNWYTFCN2KZFPHI3SNL77KA, seg_pos={0 0}, upload=210412]: Done uploading piece. err: ecclient: upload failed (node:1QyBnKe6fVUVSg38Hv6aPP6pY7haXCa4kQb45LHkPTSdTWHjkF, address:145.79.227.15:4886): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:54:36.618666955 (239h26m12.658240085s) [noise=true , address=145.79.227.22:4523 , piece_id=7UUBAAP5EFIQ63UNAE74I37PDYF5QA5F5XZDJTYJVQEYN35E7VBA, seg_pos={0 0}, upload=210412]: Done uploading piece. err: ecclient: upload failed (node:1affHJR5pyytf5iLmsF2pd81qU3SK5F8JEUf47WqcshpD972LQ, address:145.79.227.22:4523): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:54:36.618776635 (239h26m12.658349765s) [noise=true , address=145.79.227.13:4813 , piece_id=JYJPMF3SRMO7F5BKXYKVQVD6PD2R27V3O5OKQCN42SKNNEEXOMRA, seg_pos={0 0}, upload=210412]: Done uploading piece. err: ecclient: upload failed (node:12EHHTcQmhaHswSx1ubyHmPTHBB5ptuxmydbKHLjYChF1mudMSB, address:145.79.227.13:4813): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:54:36.618808194 (239h26m12.658381324s) [noise=true , address=145.79.227.18:4031 , piece_id=2NHCOCVROBAH367XODLNQQ4OT4G6GSTUEFCWVVWPQYSKQ27CKLLA, seg_pos={0 0}, upload=210412]: Done uploading piece. err: ecclient: upload failed (node:12Hx9KabcKhsb2oGPefNr12E2ibDkaVnPJ6Q38rtxxudkDdXMta, address:145.79.227.18:4031): protocol: write tcp 188.166.225.170:38680->145.79.227.18:4031: use of closed network connection; write tcp 188.166.225.170:38680->145.79.227.18:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38680->145.79.227.18:4031: use of closed network connection Sep 16 12:54:36.618884651 (239h26m12.658457791s) [noise=true , address=145.79.227.46:4614 , piece_id=RVNOUM7ZJJSXOJUJFPOKMDM2VR37WUKQ6FRULEDJRLU7MICJD3UQ, seg_pos={0 0}, upload=210412]: Done uploading piece. err: ecclient: upload failed (node:1bA2ujBKNyhzvmtxo8UuA2xzDqEjhc6CQPrcbgfHk15TxircAE, address:145.79.227.46:4614): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:54:36.618911351 (239h26m12.658484481s) [noise=true , address=145.79.227.8:4339 , piece_id=2UCLA2SRSJVXSBUBABFT6CUQ7V7LLRSC64B64YZQF4MSH3BEURRA, seg_pos={0 0}, upload=210412]: Done uploading piece. err: ecclient: upload failed (node:1BwQctDb8mxcmcvf6jvTdQqPx7xv4QMsbaVimioZxGS5vstuvk, address:145.79.227.8:4339): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:54:36.618967428 (239h26m12.658540548s) [seg_pos={0 0}, upload=210412]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 16 12:54:36.874142424 (239h26m12.913715544s) [upload=210412]: Done uploading segments... Sep 16 12:54:36.874185526 (239h26m12.913758647s) [upload=210412]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration:* 1m0.257840284s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 4.97944111s FAIL (2025-09-16 12:54:23 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== JFA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422604190 (238h59m45.46217732s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422896808 (238h59m45.462469928s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423232478 (238h59m45.462805608s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423565571 (238h59m45.463138691s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423935696 (238h59m45.463508826s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424280403 (238h59m45.463853533s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424633305 (238h59m45.464206435s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424994342 (238h59m45.464567472s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425341152 (238h59m45.464914282s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425707831 (238h59m45.465280951s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.426034432 (238h59m45.465607562s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429082236 (238h59m45.468655366s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429521483 (238h59m45.469094613s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:10.278696743 (238h59m46.318269863s) [upload=210063]: Next returned nil segment Sep 16 12:28:10.278720237 (238h59m46.318293367s) [upload=210063]: Waiting for error group managing segments... Sep 16 12:28:10.652409183 (238h59m46.691982303s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.662938092 (238h59m46.702511222s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.670032272 (238h59m46.709605402s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.701595607 (238h59m46.741168737s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.704157255 (238h59m46.743730385s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.707972140 (238h59m46.74754527s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.708523660 (238h59m46.74809678s) [noise=true , address=89.149.201.147:4007 , piece_id=BOQVD3EW5UAYWKEZ5FWC2QCDGIROAEOQN2OEYQ4QACNVDEIFF2IA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.754549157 (238h59m46.794122277s) [noise=true , address=89.149.201.147:4010 , piece_id=OALYBM6QEAOKMQPP2R3Y7LBVOEJYPMTBHJTGE2DSRO3KLRGBZC3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.138412786 (238h59m47.177985916s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.163219826 (238h59m47.202792956s) [noise=true , address=81.171.14.70:4039 , piece_id=IMLIU4QCGFNXWATVWK4L7FZPWOVPCRXNH4F3HSMF5VLQZJUEBO3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.169643348 (238h59m47.209216478s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.231770296 (238h59m47.271343416s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.258046263 (238h59m47.297619383s) [noise=true , address=185.167.204.205:4034 , piece_id=FUHHRFVDRYETJRWVBQZRALI4UGKDQ6DXV7TDKXBRASOMGOEN6YOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.263155884 (238h59m47.302729004s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.269762875 (238h59m47.309336005s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.281404505 (238h59m47.320977635s) [noise=true , address=185.167.204.205:4027 , piece_id=3O5SOEMEXYDYR5OE6SZJ2AVVLNYG4V4IMZOFUL7XDJEZUHDUV5TA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.289386705 (238h59m47.328959825s) [noise=true , address=185.167.204.206:4063 , piece_id=ERJLEJ5EILBCN4WUPZBVYSB2CGDWORVZ3GASSXBVNGR25GWVFYOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.298140815 (238h59m47.337713945s) [noise=true , address=185.167.204.206:4043 , piece_id=LDZTOC67YHM344PUCLVJ7RMKQAYJAQJ4GMKYZNN5LLU5KIUQCW7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.311391579 (238h59m47.350964709s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.317381906 (238h59m47.356955036s) [noise=true , address=185.167.204.206:4065 , piece_id=UXYM6MEGCQFRRRSMGI5XKJJJ6GYW7IJXG5QDGMICLP3FNJDSFRSQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.318355050 (238h59m47.35792818s) [noise=true , address=185.167.204.205:4018 , piece_id=VZP55ZA5Y5IA2PUH75QDVB56UHRJJ2XNC75L5WCRUSHGHQGZ463A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.330083334 (238h59m47.369656464s) [noise=true , address=185.167.204.206:4052 , piece_id=CDKZXVC22A62STE3NYD4R2TWT3AF45U2A7MHEIQJPTNMUKBVFJFA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.331429858 (238h59m47.371002988s) [noise=true , address=185.167.204.205:4035 , piece_id=M6LWKXSTJHGHXHY4VEJ2IGLI2UX4IIZV5KD4A6YY3BMIQ6ZRBMAQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.341689555 (238h59m47.381262686s) [noise=true , address=185.167.204.205:4014 , piece_id=MDSUAX4XNI5INUUQCMAP26PQFV62U3TZ2OITZR3BSNDQLHWEOKIA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.346694947 (238h59m47.386268077s) [noise=true , address=185.167.204.205:4023 , piece_id=YNW6TYPAVMYIHD5BT6QZGJJAGDM2XSZ4QYX4C2TH5QRGNTNP4KUQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363156895 (238h59m47.402730015s) [noise=true , address=185.167.204.206:4059 , piece_id=IX3H3WSLKDNPCCA5NMFUGMO2P6CA274AEUXLGVA3WRGJM3SN2OZQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363183276 (238h59m47.402756406s) [seg_pos={0 0}, upload=210063]: Segment reached optimal threshold of 26 pieces. Sep 16 12:28:11.363333942 (238h59m47.402907072s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363361435 (238h59m47.402934565s) [noise=true , address=185.167.204.206:4066 , piece_id=XXWYU36QFNZ2HCZF2WGAG4LKIBE3GCCKNVBDV6N5RQMCDJJXJULQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: expected piece hash; context canceled; EOF Sep 16 12:28:11.363393326 (238h59m47.402966456s) [seg_pos={0 0}, upload=210063]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil> Sep 16 12:28:11.363496222 (238h59m47.403069362s) [upload=210063]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 16 12:28:11.363503285 (238h59m47.403076405s) [upload=210063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 16 12:28:11.633947931 (238h59m47.673521071s) [upload=210063]: Done uploading segments... Sep 16 12:28:11.633974231 (238h59m47.673547372s) [upload=210063]: Upload finished. err: <nil> Duration: 4.979475875s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 21 out of 60 is failed (threshold=3) [..................X......X.X.......XXXX.XX.XXXXXX..XX.XXX..X] duration: 30.277451917s FAIL (2025-09-16 12:54:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 16 12:53:35.162727657 (239h25m11.202300777s) [upload=210411]: Starting upload Sep 16 12:53:35.162796297 (239h25m11.202369427s) [upload=210411]: Done starting upload Sep 16 12:53:35.163022317 (239h25m11.202595437s) [upload=210411]: Uploading segments... Sep 16 12:53:35.163140983 (239h25m11.202714113s) [upload=210411]: Got next segment. Inline: false Sep 16 12:53:35.163175198 (239h25m11.202748318s) [upload=210411]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 16 12:53:35.163181801 (239h25m11.202754931s) [upload=210411]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 16 12:53:35.436985120 (239h25m11.47655825s) [seg_pos={0 0}, upload=210411]: Begin upload segment... Sep 16 12:53:35.437042880 (239h25m11.47661601s) [seg_pos={0 0}, upload=210411]: Done begin upload segment. Sep 16 12:53:35.437067016 (239h25m11.476640136s) [noise=true , address=45.91.116.4:4940 , piece_id=LX5DMJK6LV27NQIBHOUCAME6QYQJO3AQOFHZQWZV5LPQ2DFTWGIQ, seg_pos={0 0}, upload=210411]: Uploading piece... Sep 16 12:53:35.437079339 (239h25m11.476652469s) [noise=true , address=45.91.116.4:4939 , piece_id=HLD4IMRZXP7NBXT6GRU2LOYLQ6245DN7JF2SIUQOIIJR62LCLJSA, seg_pos={0 0}, upload=210411]: Uploading piece... Sep 16 12:53:35.437192274 (239h25m11.476765404s) [noise=true , address=77.90.31.18:4805 , piece_id=WPLF4A2SLTLOC2QAEKJ7IE3D4QY5JRV4BNQGMBANTP2WSH3VFUJQ, seg_pos={0 0}, upload=210411]: Uploading piece... Sep 16 12:53:35.437529557 (239h25m11.477102687s) [noise=true , address=145.79.227.6:4257 , piece_id=UJTMYLKGS237CA2GNRBJDQ26PRKSRJB4JPU6AIVGV2EH3TQQLG3Q, seg_pos={0 0}, upload=210411]: Uploading piece... Sep 16 12:53:35.437645868 (239h25m11.477218988s) [noise=true , address=45.91.116.14:4189 , piece_id=22A3MZA4HGB3XKRPUTWRQXE6WVGPZOJG62GXAFNKBQICHPNBSMJQ, seg_pos={0 0}, upload=210411]: Uploading piece... Sep 16 12:53:35.437891285 (239h25m11.477464405s) [noise=true , address=77.90.31.14:4662 , piece_id=RPURNVS7HEECJUBNYKLT64GIWS64PPY6T6ITCJEN33TVUIQLREQQ, seg_pos={0 0}, upload=210411]: Uploading piece... Sep 16 12:53:35.438086257 (239h25m11.477659387s) [noise=true , address=45.91.116.5:4299 , piece_id=3SHITST3GYDCFENOBACBO4MLZJNQEG77AQSHZWRHWDR5PBRETYZA, seg_pos={0 0}, upload=210411]: Uploading piece... Sep 16 12:53:35.438908793 (239h25m11.478481913s) [noise=true , address=45.91.116.9:4261 , piece_id=B4CAIQWIQRDYGJQLL7S7XSFXBVCKYKNKWL7RELMEK5INTE2VKY7Q, seg_pos={0 0}, upload=210411]: Uploading piece... Sep 16 12:53:35.439576344 (239h25m11.479149464s) [noise=true , address=145.79.227.3:4149 , piece_id=MEW5CSSHULSJ3546UK7NENNHRPJJU7RBVANYWP6LUVYP4QZVVHTQ, seg_pos={0 0}, upload=210411]: Uploading piece... Sep 16 12:53:35.440161759 (239h25m11.479734889s) [noise=true , address=45.91.116.11:4119 , piece_id=EHBCBRUIHEOIQQHXQR3XFTNM6FU5XJLFBVVYLJE2YYY3OWPMLGGA, seg_pos={0 0}, upload=210411]: Uploading piece... Sep 16 12:53:35.440902820 (239h25m11.48047594s) [noise=true , address=45.91.116.12:4227 , piece_id=H2A3QO2FWGRQ46T6QJDPT5WZQW3UIB5NLSOC6HLEZ654NZTB2Z4A, seg_pos={0 0}, upload=210411]: Uploading piece... Sep 16 12:53:35.441766094 (239h25m11.481339224s) [noise=true , address=77.90.31.19:4842 , piece_id=JFPQSKYABVMNRP4QZ2MYKKULVMVUWRIXVDLUQJUCP3ARZ2KSGHCQ, seg_pos={0 0}, upload=210411]: Uploading piece... Sep 16 12:53:35.442118465 (239h25m11.481691585s) [noise=true , address=145.79.227.15:4875 , piece_id=VXJ25P6OAFXCG457KCTDZZAFPVODDT5RM7FXQHPDGSZDCOZ2PXIQ, seg_pos={0 0}, upload=210411]: Uploading piece... Sep 16 12:53:35.442576277 (239h25m11.482149408s) [noise=true , address=45.91.116.13:4154 , piece_id=QPLYEO6BZ2UNDJNSNJKNJMCYRA6NVTVA6AZENWAFRJL62HXPTPSA, seg_pos={0 0}, upload=210411]: Uploading piece... Sep 16 12:53:35.443710507 (239h25m11.483283637s) [noise=true , address=145.79.227.16:4910 , piece_id=JK2VDR3AQLTBQYXDV4PHEEZR753DHDU67BZT5A5IUGVSYCRYMZ6A, seg_pos={0 0}, upload=210411]: Uploading piece... Sep 16 12:53:35.444026699 (239h25m11.483599829s) [noise=true , address=45.91.116.11:4117 , piece_id=WZJ4T5TO3DSEHC5ZPXEFDM5GWEZHTT5THXPUZ27QLPZDWGEXCE5Q, seg_pos={0 0}, upload=210411]: Uploading piece... Sep 16 12:53:37.273914989 (239h25m13.313488109s) [upload=210411]: Next returned nil segment Sep 16 12:53:37.273937561 (239h25m13.313510681s) [upload=210411]: Waiting for error group managing segments... Sep 16 12:53:37.574513393 (239h25m13.614086523s) [noise=true , address=45.91.116.4:4939 , piece_id=HLD4IMRZXP7NBXT6GRU2LOYLQ6245DN7JF2SIUQOIIJR62LCLJSA, seg_pos={0 0}, upload=210411]: Done uploading piece. err: <nil> Sep 16 12:53:37.593522771 (239h25m13.633095901s) [noise=true , address=45.91.116.9:4261 , piece_id=B4CAIQWIQRDYGJQLL7S7XSFXBVCKYKNKWL7RELMEK5INTE2VKY7Q, seg_pos={0 0}, upload=210411]: Done uploading piece. err: <nil> Sep 16 12:53:37.618593202 (239h25m13.658166332s) [noise=true , address=45.91.116.13:4154 , piece_id=QPLYEO6BZ2UNDJNSNJKNJMCYRA6NVTVA6AZENWAFRJL62HXPTPSA, seg_pos={0 0}, upload=210411]: Done uploading piece. err: <nil> Sep 16 12:53:37.654417460 (239h25m13.69399058s) [noise=true , address=45.91.116.4:4940 , piece_id=LX5DMJK6LV27NQIBHOUCAME6QYQJO3AQOFHZQWZV5LPQ2DFTWGIQ, seg_pos={0 0}, upload=210411]: Done uploading piece. err: <nil> Sep 16 12:53:37.654501420 (239h25m13.69407455s) [noise=true , address=45.91.116.11:4117 , piece_id=WZJ4T5TO3DSEHC5ZPXEFDM5GWEZHTT5THXPUZ27QLPZDWGEXCE5Q, seg_pos={0 0}, upload=210411]: Done uploading piece. err: <nil> Sep 16 12:53:37.666741037 (239h25m13.706314157s) [noise=true , address=77.90.31.19:4842 , piece_id=JFPQSKYABVMNRP4QZ2MYKKULVMVUWRIXVDLUQJUCP3ARZ2KSGHCQ, seg_pos={0 0}, upload=210411]: Done uploading piece. err: <nil> Sep 16 12:53:37.668302941 (239h25m13.707876061s) [noise=true , address=45.91.116.12:4227 , piece_id=H2A3QO2FWGRQ46T6QJDPT5WZQW3UIB5NLSOC6HLEZ654NZTB2Z4A, seg_pos={0 0}, upload=210411]: Done uploading piece. err: <nil> Sep 16 12:53:37.680492443 (239h25m13.720065563s) [noise=true , address=77.90.31.18:4805 , piece_id=WPLF4A2SLTLOC2QAEKJ7IE3D4QY5JRV4BNQGMBANTP2WSH3VFUJQ, seg_pos={0 0}, upload=210411]: Done uploading piece. err: <nil> Sep 16 12:53:37.690073427 (239h25m13.729646557s) [noise=true , address=45.91.116.5:4299 , piece_id=3SHITST3GYDCFENOBACBO4MLZJNQEG77AQSHZWRHWDR5PBRETYZA, seg_pos={0 0}, upload=210411]: Done uploading piece. err: <nil> Sep 16 12:53:37.701394175 (239h25m13.740967305s) [noise=true , address=45.91.116.11:4119 , piece_id=EHBCBRUIHEOIQQHXQR3XFTNM6FU5XJLFBVVYLJE2YYY3OWPMLGGA, seg_pos={0 0}, upload=210411]: Done uploading piece. err: <nil> Sep 16 12:53:37.741667776 (239h25m13.781240896s) [noise=true , address=77.90.31.14:4662 , piece_id=RPURNVS7HEECJUBNYKLT64GIWS64PPY6T6ITCJEN33TVUIQLREQQ, seg_pos={0 0}, upload=210411]: Done uploading piece. err: <nil> Sep 16 12:53:38.340262520 (239h25m14.37983564s) [noise=true , address=45.91.116.14:4189 , piece_id=22A3MZA4HGB3XKRPUTWRQXE6WVGPZOJG62GXAFNKBQICHPNBSMJQ, seg_pos={0 0}, upload=210411]: Done uploading piece. err: <nil> Sep 16 12:54:04.409949530 (239h25m40.44952266s) [noise=true , address=145.79.227.15:4875 , piece_id=VXJ25P6OAFXCG457KCTDZZAFPVODDT5RM7FXQHPDGSZDCOZ2PXIQ, seg_pos={0 0}, upload=210411]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:54:04.409982022 (239h25m40.449555142s) [noise=true , address=145.79.227.6:4257 , piece_id=UJTMYLKGS237CA2GNRBJDQ26PRKSRJB4JPU6AIVGV2EH3TQQLG3Q, seg_pos={0 0}, upload=210411]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: context deadline exceeded; context deadline exceeded Sep 16 12:54:04.410058187 (239h25m40.449631317s) [noise=true , address=145.79.227.3:4149 , piece_id=MEW5CSSHULSJ3546UK7NENNHRPJJU7RBVANYWP6LUVYP4QZVVHTQ, seg_pos={0 0}, upload=210411]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:59436->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:59436->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59436->145.79.227.3:4149: use of closed network connection Sep 16 12:54:04.410074167 (239h25m40.449647297s) [noise=true , address=145.79.227.16:4910 , piece_id=JK2VDR3AQLTBQYXDV4PHEEZR753DHDU67BZT5A5IUGVSYCRYMZ6A, seg_pos={0 0}, upload=210411]: Done uploading piece. err: ecclient: upload failed (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn, address:145.79.227.16:4910): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:54:04.410109153 (239h25m40.449682273s) [seg_pos={0 0}, upload=210411]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 16 12:54:04.685067583 (239h25m40.724640723s) [upload=210411]: Done uploading segments... Sep 16 12:54:04.685101778 (239h25m40.724674928s) [upload=210411]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.277478326s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.114937405s FAIL (2025-09-16 12:53:34 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== JFA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422604190 (238h59m45.46217732s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422896808 (238h59m45.462469928s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423232478 (238h59m45.462805608s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423565571 (238h59m45.463138691s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423935696 (238h59m45.463508826s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424280403 (238h59m45.463853533s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424633305 (238h59m45.464206435s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424994342 (238h59m45.464567472s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425341152 (238h59m45.464914282s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425707831 (238h59m45.465280951s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.426034432 (238h59m45.465607562s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429082236 (238h59m45.468655366s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429521483 (238h59m45.469094613s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:10.278696743 (238h59m46.318269863s) [upload=210063]: Next returned nil segment Sep 16 12:28:10.278720237 (238h59m46.318293367s) [upload=210063]: Waiting for error group managing segments... Sep 16 12:28:10.652409183 (238h59m46.691982303s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.662938092 (238h59m46.702511222s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.670032272 (238h59m46.709605402s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.701595607 (238h59m46.741168737s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.704157255 (238h59m46.743730385s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.707972140 (238h59m46.74754527s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.708523660 (238h59m46.74809678s) [noise=true , address=89.149.201.147:4007 , piece_id=BOQVD3EW5UAYWKEZ5FWC2QCDGIROAEOQN2OEYQ4QACNVDEIFF2IA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.754549157 (238h59m46.794122277s) [noise=true , address=89.149.201.147:4010 , piece_id=OALYBM6QEAOKMQPP2R3Y7LBVOEJYPMTBHJTGE2DSRO3KLRGBZC3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.138412786 (238h59m47.177985916s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.163219826 (238h59m47.202792956s) [noise=true , address=81.171.14.70:4039 , piece_id=IMLIU4QCGFNXWATVWK4L7FZPWOVPCRXNH4F3HSMF5VLQZJUEBO3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.169643348 (238h59m47.209216478s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.231770296 (238h59m47.271343416s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.258046263 (238h59m47.297619383s) [noise=true , address=185.167.204.205:4034 , piece_id=FUHHRFVDRYETJRWVBQZRALI4UGKDQ6DXV7TDKXBRASOMGOEN6YOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.263155884 (238h59m47.302729004s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.269762875 (238h59m47.309336005s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.281404505 (238h59m47.320977635s) [noise=true , address=185.167.204.205:4027 , piece_id=3O5SOEMEXYDYR5OE6SZJ2AVVLNYG4V4IMZOFUL7XDJEZUHDUV5TA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.289386705 (238h59m47.328959825s) [noise=true , address=185.167.204.206:4063 , piece_id=ERJLEJ5EILBCN4WUPZBVYSB2CGDWORVZ3GASSXBVNGR25GWVFYOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.298140815 (238h59m47.337713945s) [noise=true , address=185.167.204.206:4043 , piece_id=LDZTOC67YHM344PUCLVJ7RMKQAYJAQJ4GMKYZNN5LLU5KIUQCW7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.311391579 (238h59m47.350964709s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.317381906 (238h59m47.356955036s) [noise=true , address=185.167.204.206:4065 , piece_id=UXYM6MEGCQFRRRSMGI5XKJJJ6GYW7IJXG5QDGMICLP3FNJDSFRSQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.318355050 (238h59m47.35792818s) [noise=true , address=185.167.204.205:4018 , piece_id=VZP55ZA5Y5IA2PUH75QDVB56UHRJJ2XNC75L5WCRUSHGHQGZ463A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.330083334 (238h59m47.369656464s) [noise=true , address=185.167.204.206:4052 , piece_id=CDKZXVC22A62STE3NYD4R2TWT3AF45U2A7MHEIQJPTNMUKBVFJFA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.331429858 (238h59m47.371002988s) [noise=true , address=185.167.204.205:4035 , piece_id=M6LWKXSTJHGHXHY4VEJ2IGLI2UX4IIZV5KD4A6YY3BMIQ6ZRBMAQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.341689555 (238h59m47.381262686s) [noise=true , address=185.167.204.205:4014 , piece_id=MDSUAX4XNI5INUUQCMAP26PQFV62U3TZ2OITZR3BSNDQLHWEOKIA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.346694947 (238h59m47.386268077s) [noise=true , address=185.167.204.205:4023 , piece_id=YNW6TYPAVMYIHD5BT6QZGJJAGDM2XSZ4QYX4C2TH5QRGNTNP4KUQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363156895 (238h59m47.402730015s) [noise=true , address=185.167.204.206:4059 , piece_id=IX3H3WSLKDNPCCA5NMFUGMO2P6CA274AEUXLGVA3WRGJM3SN2OZQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363183276 (238h59m47.402756406s) [seg_pos={0 0}, upload=210063]: Segment reached optimal threshold of 26 pieces. Sep 16 12:28:11.363333942 (238h59m47.402907072s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363361435 (238h59m47.402934565s) [noise=true , address=185.167.204.206:4066 , piece_id=XXWYU36QFNZ2HCZF2WGAG4LKIBE3GCCKNVBDV6N5RQMCDJJXJULQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: expected piece hash; context canceled; EOF Sep 16 12:28:11.363393326 (238h59m47.402966456s) [seg_pos={0 0}, upload=210063]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil> Sep 16 12:28:11.363496222 (238h59m47.403069362s) [upload=210063]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 16 12:28:11.363503285 (238h59m47.403076405s) [upload=210063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 16 12:28:11.633947931 (238h59m47.673521071s) [upload=210063]: Done uploading segments... Sep 16 12:28:11.633974231 (238h59m47.673547372s) [upload=210063]: Upload finished. err: <nil> Duration: 5.114970286s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 23 out of 60 is failed (threshold=3) [.................................X.X..XXX.XXXXXXXXXXXXXXXXXX] duration: 1m0.304078944s FAIL (2025-09-16 12:53:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 7) ======LOGS====== Sep 16 12:52:29.250806487 (239h24m5.290379617s) [noise=true , address=145.79.227.11:4752 , piece_id=6UOXJYY2DQIIVYGJREBGG3P2SMTY5RGMKIB7QNNS4LSC66BOYUNQ, seg_pos={0 0}, upload=210398]: Uploading piece... Sep 16 12:52:29.250818760 (239h24m5.29039189s) [noise=true , address=145.79.227.48:4325 , piece_id=WLSXUAW2DXOZDFCH4YYL7XGP6TDTZYNULGWCCBTKMLIFWT7KJOMQ, seg_pos={0 0}, upload=210398]: Uploading piece... Sep 16 12:52:29.251365812 (239h24m5.290938932s) [noise=true , address=145.79.227.33:4880 , piece_id=4ZEOPGD3VU6GI2MBURJGM6PHJ4RH3JTTREDAQQZPIHARY63KU3XA, seg_pos={0 0}, upload=210398]: Uploading piece... Sep 16 12:52:29.251739202 (239h24m5.291312332s) [noise=true , address=145.79.227.17:4974 , piece_id=AG5DJ3AQ5HYWNI4Z7OCRTDFORWI45QS3PSFKKZTXX6WWC6MLWSZA, seg_pos={0 0}, upload=210398]: Uploading piece... Sep 16 12:52:29.252084960 (239h24m5.2916581s) [noise=true , address=77.90.31.11:4561 , piece_id=2WE7CE6ZF3R3RSYDRYOHZYAYZRIQ54T6XOPZZYLPA6KISXEQ3IMQ, seg_pos={0 0}, upload=210398]: Uploading piece... Sep 16 12:52:29.252534456 (239h24m5.292107586s) [noise=true , address=77.90.31.16:4751 , piece_id=EM4MBBFORBRJEPBP467XGJ2T6U5G2IUSJKY3CPGQPVP3ZY5FC5NA, seg_pos={0 0}, upload=210398]: Uploading piece... Sep 16 12:52:29.252891407 (239h24m5.292464537s) [noise=true , address=145.79.227.35:4483 , piece_id=22PIBIRKROD6YOZ3S7UOVAXYU6EDSONU7E5EYNFBEHMNNTUH3VIQ, seg_pos={0 0}, upload=210398]: Uploading piece... Sep 16 12:52:29.253261190 (239h24m5.29283432s) [noise=true , address=145.79.227.38:4986 , piece_id=GMOCRBARIB5TMTWLK3Z22GUE53THFIBONRFWQYGTOPEZMPNMQZQQ, seg_pos={0 0}, upload=210398]: Uploading piece... Sep 16 12:52:29.253674127 (239h24m5.293247257s) [noise=true , address=145.79.227.46:4609 , piece_id=3XID7BWUX7IH6FMWKX7M53C3RFVREERN7II4ONVTEKMZTYKCR2QA, seg_pos={0 0}, upload=210398]: Uploading piece... Sep 16 12:52:29.254065523 (239h24m5.293638653s) [noise=true , address=145.79.227.24:4584 , piece_id=GZCSAHKJKH2HQ2XGBTT7UQ52QMZG6ZICAL4PQNZCJDGDH677SWFQ, seg_pos={0 0}, upload=210398]: Uploading piece... Sep 16 12:52:29.254467969 (239h24m5.294041099s) [noise=true , address=145.79.227.5:4246 , piece_id=WCJXIKAFNVNBOOLUX6XXMFQHUARXSOYBXRLG7NPBWPYQAR2QZIOQ, seg_pos={0 0}, upload=210398]: Uploading piece... Sep 16 12:52:29.254824367 (239h24m5.294397487s) [noise=true , address=145.79.227.21:4504 , piece_id=BZTOLFIIWSKID55VIOOOOMDUQPJUBFXKQBJPAOE6RWNAHV4T5WHQ, seg_pos={0 0}, upload=210398]: Uploading piece... Sep 16 12:52:29.255174814 (239h24m5.294747944s) [noise=true , address=77.90.31.15:4716 , piece_id=Q5QXNBSJBIACVIDKPPPJXU35M2JJQJP3V3SJF77KERFFJNCCIDTA, seg_pos={0 0}, upload=210398]: Uploading piece... Sep 16 12:52:29.255545039 (239h24m5.29511816s) [noise=true , address=145.79.227.26:4656 , piece_id=JECY72V5NW6EGQ36R7SEX5QVDM5HXXLIU4FSOQO2LWGDZK7PYEPQ, seg_pos={0 0}, upload=210398]: Uploading piece... Sep 16 12:52:29.255884346 (239h24m5.295457476s) [noise=true , address=145.79.227.27:4709 , piece_id=P745HG7XYJKG2BK2RMDJAAC5L4Z67LZSHWJCHJOANEC67NHXHASA, seg_pos={0 0}, upload=210398]: Uploading piece... Sep 16 12:52:30.907661700 (239h24m6.94723482s) [upload=210398]: Next returned nil segment Sep 16 12:52:30.907714461 (239h24m6.947287591s) [upload=210398]: Waiting for error group managing segments... Sep 16 12:52:31.373434977 (239h24m7.413008107s) [noise=true , address=77.90.31.16:4751 , piece_id=EM4MBBFORBRJEPBP467XGJ2T6U5G2IUSJKY3CPGQPVP3ZY5FC5NA, seg_pos={0 0}, upload=210398]: Done uploading piece. err: <nil> Sep 16 12:52:31.385842906 (239h24m7.425416036s) [noise=true , address=77.90.31.11:4561 , piece_id=2WE7CE6ZF3R3RSYDRYOHZYAYZRIQ54T6XOPZZYLPA6KISXEQ3IMQ, seg_pos={0 0}, upload=210398]: Done uploading piece. err: <nil> Sep 16 12:52:31.407980260 (239h24m7.44755339s) [noise=true , address=77.90.31.15:4716 , piece_id=Q5QXNBSJBIACVIDKPPPJXU35M2JJQJP3V3SJF77KERFFJNCCIDTA, seg_pos={0 0}, upload=210398]: Done uploading piece. err: <nil> Sep 16 12:52:44.621600154 (239h24m20.661173284s) [noise=true , address=145.79.227.15:4905 , piece_id=VZI276R7X7APYQKDQ3KMAWTGF6VRLP5XMAQVENGT77F5CK3Y4SNA, seg_pos={0 0}, upload=210398]: Done uploading piece. err: <nil> Sep 16 12:53:20.450015235 (239h24m56.489588365s) [noise=true , address=145.79.227.35:4483 , piece_id=22PIBIRKROD6YOZ3S7UOVAXYU6EDSONU7E5EYNFBEHMNNTUH3VIQ, seg_pos={0 0}, upload=210398]: Done uploading piece. err: <nil> Sep 16 12:53:20.836934014 (239h24m56.876507144s) [noise=true , address=145.79.227.33:4880 , piece_id=4ZEOPGD3VU6GI2MBURJGM6PHJ4RH3JTTREDAQQZPIHARY63KU3XA, seg_pos={0 0}, upload=210398]: Done uploading piece. err: <nil> Sep 16 12:53:20.855706662 (239h24m56.895279792s) [noise=true , address=145.79.227.24:4584 , piece_id=GZCSAHKJKH2HQ2XGBTT7UQ52QMZG6ZICAL4PQNZCJDGDH677SWFQ, seg_pos={0 0}, upload=210398]: Done uploading piece. err: <nil> Sep 16 12:53:28.016462910 (239h25m4.05603604s) [noise=true , address=145.79.227.17:4974 , piece_id=AG5DJ3AQ5HYWNI4Z7OCRTDFORWI45QS3PSFKKZTXX6WWC6MLWSZA, seg_pos={0 0}, upload=210398]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:53:28.016623275 (239h25m4.056196415s) [noise=true , address=145.79.227.26:4656 , piece_id=JECY72V5NW6EGQ36R7SEX5QVDM5HXXLIU4FSOQO2LWGDZK7PYEPQ, seg_pos={0 0}, upload=210398]: Done uploading piece. err: ecclient: upload failed (node:1u6e2ZjrPg2q3EDN2ZjDj9hzEmCAoRvt39HMeM79gcVmMVm53j, address:145.79.227.26:4656): protocol: expected piece hash; write tcp 188.166.225.170:45472->145.79.227.26:4656: use of closed network connection; write tcp 188.166.225.170:45472->145.79.227.26:4656: use of closed network connection; EOF Sep 16 12:53:28.016698449 (239h25m4.056271579s) [noise=true , address=145.79.227.21:4504 , piece_id=BZTOLFIIWSKID55VIOOOOMDUQPJUBFXKQBJPAOE6RWNAHV4T5WHQ, seg_pos={0 0}, upload=210398]: Done uploading piece. err: ecclient: upload failed (node:1EKUezs16ty651Y224ZZugySQQBQjEYRnRghbjdX8uFQBor2hM, address:145.79.227.21:4504): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:53:28.016771898 (239h25m4.056345038s) [noise=true , address=145.79.227.32:4846 , piece_id=HKGOY4BVU6GRZM343ORTKJIXG2RCL2A3QJVCAAH5RBR7Q2LYNTUQ, seg_pos={0 0}, upload=210398]: Done uploading piece. err: ecclient: upload failed (node:1X6WKD6kuW1CgatniwYHDWrT9tfdq9sxB25UxAUBzTRXsJPyfH, address:145.79.227.32:4846): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:53:28.016868952 (239h25m4.056442082s) [noise=true , address=145.79.227.6:4268 , piece_id=7JZHNBHCD4SCSDKI2ERNJHEFAE3OMSSU76QBSEDARFVOEFNJT7BA, seg_pos={0 0}, upload=210398]: Done uploading piece. err: ecclient: upload failed (node:112ocg8g8hf2huUskC1Kty3z51wXc8VuNUgARTFjKZxsF6RFFy, address:145.79.227.6:4268): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:53:28.016964995 (239h25m4.056538136s) [noise=true , address=145.79.227.46:4609 , piece_id=3XID7BWUX7IH6FMWKX7M53C3RFVREERN7II4ONVTEKMZTYKCR2QA, seg_pos={0 0}, upload=210398]: Done uploading piece. err: ecclient: upload failed (node:12UAQumMcpv8UZtMFT6gUNFte1PXdpTdjUjbSuPfqKcmGMiPzo5, address:145.79.227.46:4609): protocol: expected piece hash; write tcp 188.166.225.170:60940->145.79.227.46:4609: use of closed network connection; write tcp 188.166.225.170:60940->145.79.227.46:4609: use of closed network connection; EOF Sep 16 12:53:28.017035920 (239h25m4.056609041s) [noise=true , address=145.79.227.11:4752 , piece_id=6UOXJYY2DQIIVYGJREBGG3P2SMTY5RGMKIB7QNNS4LSC66BOYUNQ, seg_pos={0 0}, upload=210398]: Done uploading piece. err: ecclient: upload failed (node:12oRYWQwoe5JtDCqfSShqtyRWVQLjL4UtbokBgNpDAocBKv1vqL, address:145.79.227.11:4752): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:53:28.017097779 (239h25m4.056670909s) [noise=true , address=145.79.227.48:4325 , piece_id=WLSXUAW2DXOZDFCH4YYL7XGP6TDTZYNULGWCCBTKMLIFWT7KJOMQ, seg_pos={0 0}, upload=210398]: Done uploading piece. err: ecclient: upload failed (node:1onAnFbXC1LbUAD31oHGp75v9DpnWmx8LTe6Wazf7XuR3rKnJw, address:145.79.227.48:4325): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:53:28.017174565 (239h25m4.056747705s) [noise=true , address=145.79.227.38:4986 , piece_id=GMOCRBARIB5TMTWLK3Z22GUE53THFIBONRFWQYGTOPEZMPNMQZQQ, seg_pos={0 0}, upload=210398]: Done uploading piece. err: ecclient: upload failed (node:1xiyNnuK7RcA3pYJRz2QStzUVfaU6gVUovxX2gV86xAQ2K9np4, address:145.79.227.38:4986): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:53:28.017239027 (239h25m4.056812168s) [noise=true , address=145.79.227.5:4246 , piece_id=WCJXIKAFNVNBOOLUX6XXMFQHUARXSOYBXRLG7NPBWPYQAR2QZIOQ, seg_pos={0 0}, upload=210398]: Done uploading piece. err: ecclient: upload failed (node:12dqLB6LVQJaSdEfjKmu5nXqRST733hn5rTxCcMQS8YJVv8Hwdc, address:145.79.227.5:4246): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:53:28.017544700 (239h25m4.05711783s) [noise=true , address=145.79.227.27:4709 , piece_id=P745HG7XYJKG2BK2RMDJAAC5L4Z67LZSHWJCHJOANEC67NHXHASA, seg_pos={0 0}, upload=210398]: Done uploading piece. err: ecclient: upload failed (node:1Ad77dgyCKuYL8o9Ac1WrMfk7pG1mgkakcVXwZa2QHD6KG5sdH, address:145.79.227.27:4709): protocol: write tcp 188.166.225.170:35706->145.79.227.27:4709: use of closed network connection; write tcp 188.166.225.170:35706->145.79.227.27:4709: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35706->145.79.227.27:4709: use of closed network connection Sep 16 12:53:28.017572563 (239h25m4.057145693s) [seg_pos={0 0}, upload=210398]: Done waiting for segment. successful: 7 optimal: 14 errs: <nil> Sep 16 12:53:28.318959950 (239h25m4.35853308s) [upload=210398]: Done uploading segments... Sep 16 12:53:28.318991690 (239h25m4.35856481s) [upload=210398]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 7) Duration: 1m0.304096858s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 20 out of 60 is failed (threshold=3) [...................X......X.X.......XXXX.XX.XXXXXX..XX.XXX..] duration: 8.965068143s FAIL (2025-09-16 12:52:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 0 (239h22m50.55604104s) [upload=210382]: Starting upload Sep 16 12:51:14.516573461 (239h22m50.556146601s) [upload=210382]: Done starting upload Sep 16 12:51:14.516790153 (239h22m50.556363283s) [upload=210382]: Uploading segments... Sep 16 12:51:14.516914108 (239h22m50.556487239s) [upload=210382]: Got next segment. Inline: false Sep 16 12:51:14.516950108 (239h22m50.556523228s) [upload=210382]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 16 12:51:14.516955648 (239h22m50.556528778s) [upload=210382]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 16 12:51:14.788843105 (239h22m50.828416236s) [seg_pos={0 0}, upload=210382]: Begin upload segment... Sep 16 12:51:14.788914832 (239h22m50.828487962s) [seg_pos={0 0}, upload=210382]: Done begin upload segment. Sep 16 12:51:14.788950410 (239h22m50.82852354s) [noise=true , address=77.90.31.15:4698 , piece_id=U3XLXQJ42QH5MC654CHPLFT3X7YRWAF5HRMCTNSE6MA5SXSX5URA, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.788980187 (239h22m50.828553307s) [noise=true , address=45.91.116.6:4975 , piece_id=QE7XHPZOM3MQDQ24W4KB4JURZDZPFLMRAZCDT2PMD52SQ76LU6MQ, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.789358187 (239h22m50.828931317s) [noise=true , address=145.79.227.18:4006 , piece_id=7QW4UNEZXXM2HP27NP7FAYWNMHYB62K4BGWH37YMROSULS7RCDUA, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.789569429 (239h22m50.829142549s) [noise=true , address=45.91.116.4:4937 , piece_id=37WC6YJY6NNAWGPQQBWWC4SQAH6VV62JN3TIMBIE3OFJP5GHDUOA, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.789630175 (239h22m50.829203305s) [noise=true , address=77.90.31.19:4842 , piece_id=N47XG62BNBQZVEBJ3UUGOHUL225GGLGP24UZOTZFPZX5E56XQFCQ, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.789977867 (239h22m50.829550987s) [noise=true , address=145.79.227.3:4150 , piece_id=THV34WXXSRZIR6DVOD32QX26TEIHYUPUNNAUWIIV4YCEZ7AM2DVQ, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.790224496 (239h22m50.829797626s) [noise=true , address=45.91.116.12:4227 , piece_id=3XMQVSP7NUPWYWA3NUBOATAQXALJJNOI6IFNFURL6NKBVY7LX4DA, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.790527824 (239h22m50.830100954s) [noise=true , address=145.79.227.18:4005 , piece_id=AHEVEZ7HSQATBMIMC73Q72XGFRID24FAZ4RGCXZQ5FUP7Z54JBMQ, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.790832453 (239h22m50.830405583s) [noise=true , address=45.91.116.8:4048 , piece_id=U22Z3HVK64HFS25OCBPQDOGQEOURFJ3K4NMZT7SAK6DA5X2NVQGA, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.791082470 (239h22m50.8306556s) [noise=true , address=145.79.227.11:4732 , piece_id=T7N55LHKKEK342HK7QFFWRMG6OFYWHJ3ZIDTWNJBTZGWGYJBS4HA, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.791356271 (239h22m50.830929401s) [noise=true , address=45.91.116.9:4262 , piece_id=ETMESVAMJ7ZADS6PVHSLPHH262FLOPCW5ZTCZVGO4ZUXKNIPECZQ, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.791604925 (239h22m50.831178045s) [noise=true , address=145.79.227.17:4971 , piece_id=3N7CZRZAYA5M5Z7OLICRR33V5Z7PD73IGCF5VKG7OHCPYFKCVMDA, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.791849751 (239h22m50.831422881s) [noise=true , address=45.91.116.6:4973 , piece_id=O5QMBYT2RHMQTM2Y3OSGJCL4N7KJNK2OUQI7CSLXGJC5OYKSAKAQ, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.792128222 (239h22m50.831701352s) [noise=true , address=45.91.116.10:4082 , piece_id=LFEUX4XUVFWLZWG2E2DS2TBB6QDN7Q2JDVUSWRERDSW4MBQNWLBA, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.792433633 (239h22m50.832006763s) [noise=true , address=45.91.116.5:4297 , piece_id=SGD6ZWO3NDSX2JGJZ3PM7ORYGBPRS2JHZIAM4F4S2OY7MHIOI2QA, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.792710871 (239h22m50.832284001s) [noise=true , address=45.91.116.8:4045 , piece_id=4RTCTN7XDE22A4A2G6MQWAR2ZDIJHLGMVJXHSIXDMRH7J5GLMFLQ, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:16.606369374 (239h22m52.645942504s) [upload=210382]: Next returned nil segment Sep 16 12:51:16.606397248 (239h22m52.645970378s) [upload=210382]: Waiting for error group managing segments... Sep 16 12:51:16.913944410 (239h22m52.95351754s) [noise=true , address=45.91.116.5:4297 , piece_id=SGD6ZWO3NDSX2JGJZ3PM7ORYGBPRS2JHZIAM4F4S2OY7MHIOI2QA, seg_pos={0 0}, upload=210382]: Done uploading piece. err: <nil> Sep 16 12:51:16.959591073 (239h22m52.999164203s) [noise=true , address=45.91.116.9:4262 , piece_id=ETMESVAMJ7ZADS6PVHSLPHH262FLOPCW5ZTCZVGO4ZUXKNIPECZQ, seg_pos={0 0}, upload=210382]: Done uploading piece. err: <nil> Sep 16 12:51:16.996049500 (239h22m53.03562263s) [noise=true , address=77.90.31.15:4698 , piece_id=U3XLXQJ42QH5MC654CHPLFT3X7YRWAF5HRMCTNSE6MA5SXSX5URA, seg_pos={0 0}, upload=210382]: Done uploading piece. err: <nil> Sep 16 12:51:17.027758413 (239h22m53.067331543s) [noise=true , address=45.91.116.6:4975 , piece_id=QE7XHPZOM3MQDQ24W4KB4JURZDZPFLMRAZCDT2PMD52SQ76LU6MQ, seg_pos={0 0}, upload=210382]: Done uploading piece. err: <nil> Sep 16 12:51:17.028581160 (239h22m53.06815429s) [noise=true , address=45.91.116.4:4937 , piece_id=37WC6YJY6NNAWGPQQBWWC4SQAH6VV62JN3TIMBIE3OFJP5GHDUOA, seg_pos={0 0}, upload=210382]: Done uploading piece. err: <nil> Sep 16 12:51:17.031439863 (239h22m53.071012993s) [noise=true , address=45.91.116.6:4973 , piece_id=O5QMBYT2RHMQTM2Y3OSGJCL4N7KJNK2OUQI7CSLXGJC5OYKSAKAQ, seg_pos={0 0}, upload=210382]: Done uploading piece. err: <nil> Sep 16 12:51:17.054400246 (239h22m53.093973376s) [noise=true , address=45.91.116.10:4082 , piece_id=LFEUX4XUVFWLZWG2E2DS2TBB6QDN7Q2JDVUSWRERDSW4MBQNWLBA, seg_pos={0 0}, upload=210382]: Done uploading piece. err: <nil> Sep 16 12:51:17.062225808 (239h22m53.101798938s) [noise=true , address=45.91.116.8:4048 , piece_id=U22Z3HVK64HFS25OCBPQDOGQEOURFJ3K4NMZT7SAK6DA5X2NVQGA, seg_pos={0 0}, upload=210382]: Done uploading piece. err: <nil> Sep 16 12:51:17.064970044 (239h22m53.104543164s) [noise=true , address=45.91.116.12:4227 , piece_id=3XMQVSP7NUPWYWA3NUBOATAQXALJJNOI6IFNFURL6NKBVY7LX4DA, seg_pos={0 0}, upload=210382]: Done uploading piece. err: <nil> Sep 16 12:51:17.079973354 (239h22m53.119546484s) [noise=true , address=45.91.116.8:4045 , piece_id=4RTCTN7XDE22A4A2G6MQWAR2ZDIJHLGMVJXHSIXDMRH7J5GLMFLQ, seg_pos={0 0}, upload=210382]: Done uploading piece. err: <nil> Sep 16 12:51:17.247921362 (239h22m53.287494492s) [noise=true , address=77.90.31.19:4842 , piece_id=N47XG62BNBQZVEBJ3UUGOHUL225GGLGP24UZOTZFPZX5E56XQFCQ, seg_pos={0 0}, upload=210382]: Done uploading piece. err: <nil> Sep 16 12:51:43.787090097 (239h23m19.826663217s) [noise=true , address=145.79.227.17:4971 , piece_id=3N7CZRZAYA5M5Z7OLICRR33V5Z7PD73IGCF5VKG7OHCPYFKCVMDA, seg_pos={0 0}, upload=210382]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:51:43.787233920 (239h23m19.826807051s) [noise=true , address=145.79.227.18:4005 , piece_id=AHEVEZ7HSQATBMIMC73Q72XGFRID24FAZ4RGCXZQ5FUP7Z54JBMQ, seg_pos={0 0}, upload=210382]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: write tcp 188.166.225.170:57784->145.79.227.18:4005: use of closed network connection; write tcp 188.166.225.170:57784->145.79.227.18:4005: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57784->145.79.227.18:4005: use of closed network connection Sep 16 12:51:43.787293905 (239h23m19.826867035s) [noise=true , address=145.79.227.11:4732 , piece_id=T7N55LHKKEK342HK7QFFWRMG6OFYWHJ3ZIDTWNJBTZGWGYJBS4HA, seg_pos={0 0}, upload=210382]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:47776->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:47776->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47776->145.79.227.11:4732: use of closed network connection Sep 16 12:51:43.787413482 (239h23m19.826986612s) [noise=true , address=145.79.227.3:4150 , piece_id=THV34WXXSRZIR6DVOD32QX26TEIHYUPUNNAUWIIV4YCEZ7AM2DVQ, seg_pos={0 0}, upload=210382]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:51686->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:51686->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51686->145.79.227.3:4150: use of closed network connection Sep 16 12:51:43.787508023 (239h23m19.827081143s) [noise=true , address=145.79.227.18:4006 , piece_id=7QW4UNEZXXM2HP27NP7FAYWNMHYB62K4BGWH37YMROSULS7RCDUA, seg_pos={0 0}, upload=210382]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42748->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42748->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42748->145.79.227.18:4006: use of closed network connection Sep 16 12:51:43.787597753 (239h23m19.827170883s) [seg_pos={0 0}, upload=210382]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Sep 16 12:51:44.054541917 (239h23m20.094115047s) [upload=210382]: Done uploading segments... Sep 16 12:51:44.054565252 (239h23m20.094138372s) [upload=210382]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 8.965091226s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.008625235s FAIL (2025-09-16 12:52:43 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== JFA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422604190 (238h59m45.46217732s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.422896808 (238h59m45.462469928s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423232478 (238h59m45.462805608s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423565571 (238h59m45.463138691s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.423935696 (238h59m45.463508826s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424280403 (238h59m45.463853533s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424633305 (238h59m45.464206435s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.424994342 (238h59m45.464567472s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425341152 (238h59m45.464914282s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.425707831 (238h59m45.465280951s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.426034432 (238h59m45.465607562s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429082236 (238h59m45.468655366s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:09.429521483 (238h59m45.469094613s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Uploading piece... Sep 16 12:28:10.278696743 (238h59m46.318269863s) [upload=210063]: Next returned nil segment Sep 16 12:28:10.278720237 (238h59m46.318293367s) [upload=210063]: Waiting for error group managing segments... Sep 16 12:28:10.652409183 (238h59m46.691982303s) [noise=true , address=81.171.14.70:4028 , piece_id=DGA3IOKD6FFDYWGOD5RETUF7T3FPC4AHTUDLZWT6PEDEMLP2JHLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.662938092 (238h59m46.702511222s) [noise=true , address=81.171.14.70:4030 , piece_id=OKFTTI5W4W53OOQRVQ5QGHBI4KSO77JYZB3JHDLIYMMSA25PQWOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.670032272 (238h59m46.709605402s) [noise=true , address=81.171.14.70:4026 , piece_id=J5VXSSJKBH6EKKX6CGKW6YA2WF4HV73WADMQGTC5C7EK5CFDKHHQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.701595607 (238h59m46.741168737s) [noise=true , address=81.171.14.70:4038 , piece_id=NLEYJCBOOLA5KFS5HGOKGN234GVH6HKJDBGTXG7JEAATJLCVILSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.704157255 (238h59m46.743730385s) [noise=true , address=89.149.201.147:4006 , piece_id=JKEUWAAH4LWVD6JBZEFZNMR4WJG7G24SWBAZ3Y4JTPN6TVGNOBSA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.707972140 (238h59m46.74754527s) [noise=true , address=81.171.14.70:4040 , piece_id=ECUWYRUQ67YUZYXDJHSPDWWUDI5IKKK2YKRP4KOEHAAL4KEW3MLQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.708523660 (238h59m46.74809678s) [noise=true , address=89.149.201.147:4007 , piece_id=BOQVD3EW5UAYWKEZ5FWC2QCDGIROAEOQN2OEYQ4QACNVDEIFF2IA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:10.754549157 (238h59m46.794122277s) [noise=true , address=89.149.201.147:4010 , piece_id=OALYBM6QEAOKMQPP2R3Y7LBVOEJYPMTBHJTGE2DSRO3KLRGBZC3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.138412786 (238h59m47.177985916s) [noise=true , address=81.171.14.70:4035 , piece_id=EC24PZIIVA52WLIQHLVOQDFXCF23GIRAHPP4XHPY3M5X4WBCREFQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.163219826 (238h59m47.202792956s) [noise=true , address=81.171.14.70:4039 , piece_id=IMLIU4QCGFNXWATVWK4L7FZPWOVPCRXNH4F3HSMF5VLQZJUEBO3Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.169643348 (238h59m47.209216478s) [noise=true , address=89.149.201.147:4003 , piece_id=HUHFUFMZWGP5KLYHQQ5CYIVQRZN7CK2VZ2J5KV2AB6MPUKPT6W2Q, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.231770296 (238h59m47.271343416s) [noise=true , address=185.167.204.205:4012 , piece_id=VUR4BGCL5J6IXC2L5HQ7FLW2BKX7IOGWYXH27ZNQZC3LOVLU5EPA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.258046263 (238h59m47.297619383s) [noise=true , address=185.167.204.205:4034 , piece_id=FUHHRFVDRYETJRWVBQZRALI4UGKDQ6DXV7TDKXBRASOMGOEN6YOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.263155884 (238h59m47.302729004s) [noise=true , address=185.167.204.206:4038 , piece_id=7FXGYLR5F6SIPNMEGDPTLSREZNFASJCL6AXSGWNCFBZLCC7NVNOQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.269762875 (238h59m47.309336005s) [noise=true , address=185.167.204.205:4002 , piece_id=F7ZGQEPBTGIKXSGFPUOHBN62B3S5SUXL7XC4XUIALAQOAO5RJSUA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.281404505 (238h59m47.320977635s) [noise=true , address=185.167.204.205:4027 , piece_id=3O5SOEMEXYDYR5OE6SZJ2AVVLNYG4V4IMZOFUL7XDJEZUHDUV5TA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.289386705 (238h59m47.328959825s) [noise=true , address=185.167.204.206:4063 , piece_id=ERJLEJ5EILBCN4WUPZBVYSB2CGDWORVZ3GASSXBVNGR25GWVFYOA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.298140815 (238h59m47.337713945s) [noise=true , address=185.167.204.206:4043 , piece_id=LDZTOC67YHM344PUCLVJ7RMKQAYJAQJ4GMKYZNN5LLU5KIUQCW7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.311391579 (238h59m47.350964709s) [noise=true , address=185.167.204.205:4006 , piece_id=KERC5TYTGNYDI6ZNS4DBNIGGJMGA3FA2QWJAXEZUPY4JLAR2ZTYQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.317381906 (238h59m47.356955036s) [noise=true , address=185.167.204.206:4065 , piece_id=UXYM6MEGCQFRRRSMGI5XKJJJ6GYW7IJXG5QDGMICLP3FNJDSFRSQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.318355050 (238h59m47.35792818s) [noise=true , address=185.167.204.205:4018 , piece_id=VZP55ZA5Y5IA2PUH75QDVB56UHRJJ2XNC75L5WCRUSHGHQGZ463A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.330083334 (238h59m47.369656464s) [noise=true , address=185.167.204.206:4052 , piece_id=CDKZXVC22A62STE3NYD4R2TWT3AF45U2A7MHEIQJPTNMUKBVFJFA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.331429858 (238h59m47.371002988s) [noise=true , address=185.167.204.205:4035 , piece_id=M6LWKXSTJHGHXHY4VEJ2IGLI2UX4IIZV5KD4A6YY3BMIQ6ZRBMAQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.341689555 (238h59m47.381262686s) [noise=true , address=185.167.204.205:4014 , piece_id=MDSUAX4XNI5INUUQCMAP26PQFV62U3TZ2OITZR3BSNDQLHWEOKIA, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.346694947 (238h59m47.386268077s) [noise=true , address=185.167.204.205:4023 , piece_id=YNW6TYPAVMYIHD5BT6QZGJJAGDM2XSZ4QYX4C2TH5QRGNTNP4KUQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363156895 (238h59m47.402730015s) [noise=true , address=185.167.204.206:4059 , piece_id=IX3H3WSLKDNPCCA5NMFUGMO2P6CA274AEUXLGVA3WRGJM3SN2OZQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363183276 (238h59m47.402756406s) [seg_pos={0 0}, upload=210063]: Segment reached optimal threshold of 26 pieces. Sep 16 12:28:11.363333942 (238h59m47.402907072s) [noise=true , address=185.167.204.206:4039 , piece_id=YRE2Y34OG4V6HY56AVPZZVEXKWHUCE2NYLWOPZGIDWEF7UKKLP7A, seg_pos={0 0}, upload=210063]: Done uploading piece. err: <nil> Sep 16 12:28:11.363361435 (238h59m47.402934565s) [noise=true , address=185.167.204.206:4066 , piece_id=XXWYU36QFNZ2HCZF2WGAG4LKIBE3GCCKNVBDV6N5RQMCDJJXJULQ, seg_pos={0 0}, upload=210063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: expected piece hash; context canceled; EOF Sep 16 12:28:11.363393326 (238h59m47.402966456s) [seg_pos={0 0}, upload=210063]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil> Sep 16 12:28:11.363496222 (238h59m47.403069362s) [upload=210063]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 16 12:28:11.363503285 (238h59m47.403076405s) [upload=210063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 16 12:28:11.633947931 (238h59m47.673521071s) [upload=210063]: Done uploading segments... Sep 16 12:28:11.633974231 (238h59m47.673547372s) [upload=210063]: Upload finished. err: <nil> Duration: 5.008654393s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 22 out of 60 is failed (threshold=3) [..................................X.X..XXX.XXXXXXXXXXXXXXXXX] duration: 1m0.259982329s FAIL (2025-09-16 12:52:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== 4]: Uploading segments... Sep 16 12:51:28.246905326 (239h23m4.286478456s) [upload=210384]: Got next segment. Inline: false Sep 16 12:51:28.246931395 (239h23m4.286504525s) [upload=210384]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 16 12:51:28.246938449 (239h23m4.286511579s) [upload=210384]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 16 12:51:28.746002400 (239h23m4.78557553s) [seg_pos={0 0}, upload=210384]: Begin upload segment... Sep 16 12:51:28.746045451 (239h23m4.785618581s) [seg_pos={0 0}, upload=210384]: Done begin upload segment. Sep 16 12:51:28.746074727 (239h23m4.785647847s) [noise=true , address=145.79.227.48:4306 , piece_id=HAGFEDNQEDZHFOVF7SC2WZ6K7M3TWJM5L72RSMAIWCQRZII4PDEA, seg_pos={0 0}, upload=210384]: Uploading piece... Sep 16 12:51:28.746086059 (239h23m4.785659179s) [noise=true , address=145.79.227.17:4990 , piece_id=HYLV2QFQ25SDFLZNZ6PEIGUTARUENROXYXTIT4XW7SJ5LX4EOI5Q, seg_pos={0 0}, upload=210384]: Uploading piece... Sep 16 12:51:28.746420686 (239h23m4.785993816s) [noise=true , address=193.149.164.143:4693 , piece_id=XBV4M3XNL5ZMSG6U4O6IQQ4DTVIPVFVNN3WCBPYEFQOZPPLW3XIA, seg_pos={0 0}, upload=210384]: Uploading piece... Sep 16 12:51:28.746429813 (239h23m4.786002943s) [noise=true , address=145.79.227.29:4965 , piece_id=DAWVFEH5CO3PDOMTZGUS57VYECEXUXXLFS5HU6Q5LZV4UZGWWIEA, seg_pos={0 0}, upload=210384]: Uploading piece... Sep 16 12:51:28.746678366 (239h23m4.786251496s) [noise=true , address=145.79.227.25:4626 , piece_id=74QFKEFTWK4EKYNEYW2WFKITVW3SUNVPR4YAZY2OKHSX7WEVAGJQ, seg_pos={0 0}, upload=210384]: Uploading piece... Sep 16 12:51:28.746774059 (239h23m4.786347179s) [noise=true , address=145.79.227.14:4842 , piece_id=FKVLYJHGPVIHR5WE427V6I4VMDSCAIOPMIVWLIAON22WJEZVVP3A, seg_pos={0 0}, upload=210384]: Uploading piece... Sep 16 12:51:28.746919646 (239h23m4.786492776s) [noise=true , address=145.79.227.22:4543 , piece_id=DDNSFIZTHWR3PYBJJFI2AN24LVTILV2SMKDWD3M5IT3K5M25JQ3Q, seg_pos={0 0}, upload=210384]: Uploading piece... Sep 16 12:51:28.747041358 (239h23m4.786614478s) [noise=true , address=145.79.227.51:4419 , piece_id=VUHPHPKXZAKBBDPAUKNRJLFHQZZA5AOJKSZTLGYQ3MJSIGQOJAKA, seg_pos={0 0}, upload=210384]: Uploading piece... Sep 16 12:51:28.747199318 (239h23m4.786772449s) [noise=true , address=145.79.227.12:4792 , piece_id=QJKOIRJDY65G4DTLUP6RTMDQNPHN6ZXXTPHOSXFX4VUPRANDMNYA, seg_pos={0 0}, upload=210384]: Uploading piece... Sep 16 12:51:28.747377788 (239h23m4.786950908s) [noise=true , address=145.79.227.15:4878 , piece_id=7ZASGCHV3RXMCWPY3O425YYCKHXQSIF4ELAPCIYTWJYBGI7JKHCA, seg_pos={0 0}, upload=210384]: Uploading piece... Sep 16 12:51:28.747462059 (239h23m4.787035179s) [noise=true , address=145.79.227.23:4553 , piece_id=TZLXSXAJKDG4P4UMFODZHUNHRLG2RYILRYGH2A6WLOVSCBR5WJSQ, seg_pos={0 0}, upload=210384]: Uploading piece... Sep 16 12:51:28.747619438 (239h23m4.787192558s) [noise=true , address=145.79.227.46:4603 , piece_id=BCGHC3BUBKWCWYZVU3HA2RQ6EAUDRXMOLLJK77YJUAIV3MVEGW4A, seg_pos={0 0}, upload=210384]: Uploading piece... Sep 16 12:51:28.747694662 (239h23m4.787267782s) [noise=true , address=145.79.227.24:4601 , piece_id=AYJZH4ALGDUGJUIG2KEL4G5LCUP4DRB5GGRYTHBIQREOUICWYOWA, seg_pos={0 0}, upload=210384]: Uploading piece... Sep 16 12:51:28.747878442 (239h23m4.787451572s) [noise=true , address=145.79.227.33:4870 , piece_id=N5Q5K2O3G4BSW63WMS7YFAMOTNXVHM7BHMKCFEVGAU52XOM6YQSA, seg_pos={0 0}, upload=210384]: Uploading piece... Sep 16 12:51:28.748111456 (239h23m4.787684576s) [noise=true , address=145.79.227.49:4346 , piece_id=2CJH5TYVWWMJIFNWOSO4MLEDJNJ7QI7RGTWBBBG25FR7XNJPB4KQ, seg_pos={0 0}, upload=210384]: Uploading piece... Sep 16 12:51:28.748420704 (239h23m4.787993834s) [noise=true , address=145.79.227.11:4755 , piece_id=WA66EV6SJHKGSDVBOXYKQ4E7TEFCJHVFA2P2WPONLKJCCP4GOLLA, seg_pos={0 0}, upload=210384]: Uploading piece... Sep 16 12:51:28.749191653 (239h23m4.788764773s) [noise=true , address=145.79.227.26:4664 , piece_id=F7ULPDMCQ24ZXSWV4PTI6ZNZDO4G6MMQNZMC7EVGB75CGNVNMMPQ, seg_pos={0 0}, upload=210384]: Uploading piece... Sep 16 12:51:28.749982388 (239h23m4.789555518s) [noise=true , address=145.79.227.16:4941 , piece_id=YOL5HQFDFQUZVEJWCC5CRWEOKEBVBJIGWEX35QVN7VHKOF2DLE2A, seg_pos={0 0}, upload=210384]: Uploading piece... Sep 16 12:51:30.119170594 (239h23m6.158743724s) [upload=210384]: Next returned nil segment Sep 16 12:51:30.119194470 (239h23m6.1587676s) [upload=210384]: Waiting for error group managing segments... Sep 16 12:51:30.469939233 (239h23m6.509512363s) [noise=true , address=193.149.164.143:4693 , piece_id=XBV4M3XNL5ZMSG6U4O6IQQ4DTVIPVFVNN3WCBPYEFQOZPPLW3XIA, seg_pos={0 0}, upload=210384]: Done uploading piece. err: <nil> Sep 16 12:51:38.562221978 (239h23m14.601795108s) [noise=true , address=145.79.227.24:4601 , piece_id=AYJZH4ALGDUGJUIG2KEL4G5LCUP4DRB5GGRYTHBIQREOUICWYOWA, seg_pos={0 0}, upload=210384]: Done uploading piece. err: <nil> Sep 16 12:51:51.374957211 (239h23m27.414530351s) [noise=true , address=145.79.227.15:4878 , piece_id=7ZASGCHV3RXMCWPY3O425YYCKHXQSIF4ELAPCIYTWJYBGI7JKHCA, seg_pos={0 0}, upload=210384]: Done uploading piece. err: <nil> Sep 16 12:51:52.515108106 (239h23m28.554681237s) [noise=true , address=145.79.227.17:4990 , piece_id=HYLV2QFQ25SDFLZNZ6PEIGUTARUENROXYXTIT4XW7SJ5LX4EOI5Q, seg_pos={0 0}, upload=210384]: Done uploading piece. err: <nil> Sep 16 12:51:59.368417591 (239h23m35.407990721s) [noise=true , address=145.79.227.49:4346 , piece_id=2CJH5TYVWWMJIFNWOSO4MLEDJNJ7QI7RGTWBBBG25FR7XNJPB4KQ, seg_pos={0 0}, upload=210384]: Done uploading piece. err: <nil> Sep 16 12:52:03.126341043 (239h23m39.165914173s) [noise=true , address=145.79.227.25:4626 , piece_id=74QFKEFTWK4EKYNEYW2WFKITVW3SUNVPR4YAZY2OKHSX7WEVAGJQ, seg_pos={0 0}, upload=210384]: Done uploading piece. err: <nil> Sep 16 12:52:04.679361068 (239h23m40.718934198s) [noise=true , address=145.79.227.26:4664 , piece_id=F7ULPDMCQ24ZXSWV4PTI6ZNZDO4G6MMQNZMC7EVGB75CGNVNMMPQ, seg_pos={0 0}, upload=210384]: Done uploading piece. err: <nil> Sep 16 12:52:05.303946552 (239h23m41.343519673s) [noise=true , address=145.79.227.33:4870 , piece_id=N5Q5K2O3G4BSW63WMS7YFAMOTNXVHM7BHMKCFEVGAU52XOM6YQSA, seg_pos={0 0}, upload=210384]: Done uploading piece. err: <nil> Sep 16 12:52:12.155054019 (239h23m48.194627149s) [noise=true , address=145.79.227.23:4553 , piece_id=TZLXSXAJKDG4P4UMFODZHUNHRLG2RYILRYGH2A6WLOVSCBR5WJSQ, seg_pos={0 0}, upload=210384]: Done uploading piece. err: <nil> Sep 16 12:52:13.787842141 (239h23m49.827415271s) [noise=true , address=145.79.227.14:4842 , piece_id=FKVLYJHGPVIHR5WE427V6I4VMDSCAIOPMIVWLIAON22WJEZVVP3A, seg_pos={0 0}, upload=210384]: Done uploading piece. err: <nil> Sep 16 12:52:23.425001959 (239h23m59.464575089s) [noise=true , address=145.79.227.46:4603 , piece_id=BCGHC3BUBKWCWYZVU3HA2RQ6EAUDRXMOLLJK77YJUAIV3MVEGW4A, seg_pos={0 0}, upload=210384]: Done uploading piece. err: <nil> Sep 16 12:52:27.523163685 (239h24m3.562736815s) [noise=true , address=145.79.227.51:4419 , piece_id=VUHPHPKXZAKBBDPAUKNRJLFHQZZA5AOJKSZTLGYQ3MJSIGQOJAKA, seg_pos={0 0}, upload=210384]: Done uploading piece. err: ecclient: upload failed (node:12SUeS7dkCCLwuiEW1U8X4vkbeejj7votE3hhKdgbBo1mUEa3Dd, address:145.79.227.51:4419): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:52:27.523286600 (239h24m3.56285973s) [noise=true , address=145.79.227.22:4543 , piece_id=DDNSFIZTHWR3PYBJJFI2AN24LVTILV2SMKDWD3M5IT3K5M25JQ3Q, seg_pos={0 0}, upload=210384]: Done uploading piece. err: ecclient: upload failed (node:19iUYyo8cGDLGDnvdNo2Qfj1K6tp6EJWF5U6rXD4gJ7Hv7Gsch, address:145.79.227.22:4543): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:52:27.523405446 (239h24m3.562978576s) [noise=true , address=145.79.227.11:4755 , piece_id=WA66EV6SJHKGSDVBOXYKQ4E7TEFCJHVFA2P2WPONLKJCCP4GOLLA, seg_pos={0 0}, upload=210384]: Done uploading piece. err: ecclient: upload failed (node:1NesDEUEmNTHsmSYb1V6esyDAryke6A7NmRnPE6mwPknTfUFF3, address:145.79.227.11:4755): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:52:27.523440472 (239h24m3.563013733s) [noise=true , address=145.79.227.12:4792 , piece_id=QJKOIRJDY65G4DTLUP6RTMDQNPHN6ZXXTPHOSXFX4VUPRANDMNYA, seg_pos={0 0}, upload=210384]: Done uploading piece. err: ecclient: upload failed (node:1fokaL7frEkFdVZRGmqaq3TmZVNYpt4agWCJZ8ABHfsYwkjAuv, address:145.79.227.12:4792): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:52:27.523468666 (239h24m3.563041887s) [noise=true , address=145.79.227.29:4965 , piece_id=DAWVFEH5CO3PDOMTZGUS57VYECEXUXXLFS5HU6Q5LZV4UZGWWIEA, seg_pos={0 0}, upload=210384]: Done uploading piece. err: ecclient: upload failed (node:1ToFTqjRAWvpRQzf6vyHKDpforPyb4LbDGcCVhRhkwiBGKihnD, address:145.79.227.29:4965): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:52:27.523481811 (239h24m3.563055021s) [noise=true , address=145.79.227.16:4941 , piece_id=YOL5HQFDFQUZVEJWCC5CRWEOKEBVBJIGWEX35QVN7VHKOF2DLE2A, seg_pos={0 0}, upload=210384]: Done uploading piece. err: ecclient: upload failed (node:1BebKvzH8vE3TKRu28NYW5u3DHMiFMmXnyo5TY5yUDHM86pbYP, address:145.79.227.16:4941): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:52:27.523553758 (239h24m3.563126888s) [noise=true , address=145.79.227.48:4306 , piece_id=HAGFEDNQEDZHFOVF7SC2WZ6K7M3TWJM5L72RSMAIWCQRZII4PDEA, seg_pos={0 0}, upload=210384]: Done uploading piece. err: ecclient: upload failed (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw, address:145.79.227.48:4306): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:52:27.523594475 (239h24m3.563167595s) [seg_pos={0 0}, upload=210384]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 16 12:52:27.780593094 (239h24m3.820166214s) [upload=210384]: Done uploading segments... Sep 16 12:52:27.780624284 (239h24m3.820197414s) [upload=210384]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 1m0.260011906s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 20 out of 60 is failed (threshold=3) [....................X......X.X.......XXXX.XX.XXXXXX..XX.XXX.] duration: 7.217776643s FAIL (2025-09-16 12:52:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 0 (239h22m50.55604104s) [upload=210382]: Starting upload Sep 16 12:51:14.516573461 (239h22m50.556146601s) [upload=210382]: Done starting upload Sep 16 12:51:14.516790153 (239h22m50.556363283s) [upload=210382]: Uploading segments... Sep 16 12:51:14.516914108 (239h22m50.556487239s) [upload=210382]: Got next segment. Inline: false Sep 16 12:51:14.516950108 (239h22m50.556523228s) [upload=210382]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 16 12:51:14.516955648 (239h22m50.556528778s) [upload=210382]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 16 12:51:14.788843105 (239h22m50.828416236s) [seg_pos={0 0}, upload=210382]: Begin upload segment... Sep 16 12:51:14.788914832 (239h22m50.828487962s) [seg_pos={0 0}, upload=210382]: Done begin upload segment. Sep 16 12:51:14.788950410 (239h22m50.82852354s) [noise=true , address=77.90.31.15:4698 , piece_id=U3XLXQJ42QH5MC654CHPLFT3X7YRWAF5HRMCTNSE6MA5SXSX5URA, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.788980187 (239h22m50.828553307s) [noise=true , address=45.91.116.6:4975 , piece_id=QE7XHPZOM3MQDQ24W4KB4JURZDZPFLMRAZCDT2PMD52SQ76LU6MQ, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.789358187 (239h22m50.828931317s) [noise=true , address=145.79.227.18:4006 , piece_id=7QW4UNEZXXM2HP27NP7FAYWNMHYB62K4BGWH37YMROSULS7RCDUA, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.789569429 (239h22m50.829142549s) [noise=true , address=45.91.116.4:4937 , piece_id=37WC6YJY6NNAWGPQQBWWC4SQAH6VV62JN3TIMBIE3OFJP5GHDUOA, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.789630175 (239h22m50.829203305s) [noise=true , address=77.90.31.19:4842 , piece_id=N47XG62BNBQZVEBJ3UUGOHUL225GGLGP24UZOTZFPZX5E56XQFCQ, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.789977867 (239h22m50.829550987s) [noise=true , address=145.79.227.3:4150 , piece_id=THV34WXXSRZIR6DVOD32QX26TEIHYUPUNNAUWIIV4YCEZ7AM2DVQ, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.790224496 (239h22m50.829797626s) [noise=true , address=45.91.116.12:4227 , piece_id=3XMQVSP7NUPWYWA3NUBOATAQXALJJNOI6IFNFURL6NKBVY7LX4DA, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.790527824 (239h22m50.830100954s) [noise=true , address=145.79.227.18:4005 , piece_id=AHEVEZ7HSQATBMIMC73Q72XGFRID24FAZ4RGCXZQ5FUP7Z54JBMQ, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.790832453 (239h22m50.830405583s) [noise=true , address=45.91.116.8:4048 , piece_id=U22Z3HVK64HFS25OCBPQDOGQEOURFJ3K4NMZT7SAK6DA5X2NVQGA, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.791082470 (239h22m50.8306556s) [noise=true , address=145.79.227.11:4732 , piece_id=T7N55LHKKEK342HK7QFFWRMG6OFYWHJ3ZIDTWNJBTZGWGYJBS4HA, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.791356271 (239h22m50.830929401s) [noise=true , address=45.91.116.9:4262 , piece_id=ETMESVAMJ7ZADS6PVHSLPHH262FLOPCW5ZTCZVGO4ZUXKNIPECZQ, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.791604925 (239h22m50.831178045s) [noise=true , address=145.79.227.17:4971 , piece_id=3N7CZRZAYA5M5Z7OLICRR33V5Z7PD73IGCF5VKG7OHCPYFKCVMDA, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.791849751 (239h22m50.831422881s) [noise=true , address=45.91.116.6:4973 , piece_id=O5QMBYT2RHMQTM2Y3OSGJCL4N7KJNK2OUQI7CSLXGJC5OYKSAKAQ, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.792128222 (239h22m50.831701352s) [noise=true , address=45.91.116.10:4082 , piece_id=LFEUX4XUVFWLZWG2E2DS2TBB6QDN7Q2JDVUSWRERDSW4MBQNWLBA, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.792433633 (239h22m50.832006763s) [noise=true , address=45.91.116.5:4297 , piece_id=SGD6ZWO3NDSX2JGJZ3PM7ORYGBPRS2JHZIAM4F4S2OY7MHIOI2QA, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:14.792710871 (239h22m50.832284001s) [noise=true , address=45.91.116.8:4045 , piece_id=4RTCTN7XDE22A4A2G6MQWAR2ZDIJHLGMVJXHSIXDMRH7J5GLMFLQ, seg_pos={0 0}, upload=210382]: Uploading piece... Sep 16 12:51:16.606369374 (239h22m52.645942504s) [upload=210382]: Next returned nil segment Sep 16 12:51:16.606397248 (239h22m52.645970378s) [upload=210382]: Waiting for error group managing segments... Sep 16 12:51:16.913944410 (239h22m52.95351754s) [noise=true , address=45.91.116.5:4297 , piece_id=SGD6ZWO3NDSX2JGJZ3PM7ORYGBPRS2JHZIAM4F4S2OY7MHIOI2QA, seg_pos={0 0}, upload=210382]: Done uploading piece. err: <nil> Sep 16 12:51:16.959591073 (239h22m52.999164203s) [noise=true , address=45.91.116.9:4262 , piece_id=ETMESVAMJ7ZADS6PVHSLPHH262FLOPCW5ZTCZVGO4ZUXKNIPECZQ, seg_pos={0 0}, upload=210382]: Done uploading piece. err: <nil> Sep 16 12:51:16.996049500 (239h22m53.03562263s) [noise=true , address=77.90.31.15:4698 , piece_id=U3XLXQJ42QH5MC654CHPLFT3X7YRWAF5HRMCTNSE6MA5SXSX5URA, seg_pos={0 0}, upload=210382]: Done uploading piece. err: <nil> Sep 16 12:51:17.027758413 (239h22m53.067331543s) [noise=true , address=45.91.116.6:4975 , piece_id=QE7XHPZOM3MQDQ24W4KB4JURZDZPFLMRAZCDT2PMD52SQ76LU6MQ, seg_pos={0 0}, upload=210382]: Done uploading piece. err: <nil> Sep 16 12:51:17.028581160 (239h22m53.06815429s) [noise=true , address=45.91.116.4:4937 , piece_id=37WC6YJY6NNAWGPQQBWWC4SQAH6VV62JN3TIMBIE3OFJP5GHDUOA, seg_pos={0 0}, upload=210382]: Done uploading piece. err: <nil> Sep 16 12:51:17.031439863 (239h22m53.071012993s) [noise=true , address=45.91.116.6:4973 , piece_id=O5QMBYT2RHMQTM2Y3OSGJCL4N7KJNK2OUQI7CSLXGJC5OYKSAKAQ, seg_pos={0 0}, upload=210382]: Done uploading piece. err: <nil> Sep 16 12:51:17.054400246 (239h22m53.093973376s) [noise=true , address=45.91.116.10:4082 , piece_id=LFEUX4XUVFWLZWG2E2DS2TBB6QDN7Q2JDVUSWRERDSW4MBQNWLBA, seg_pos={0 0}, upload=210382]: Done uploading piece. err: <nil> Sep 16 12:51:17.062225808 (239h22m53.101798938s) [noise=true , address=45.91.116.8:4048 , piece_id=U22Z3HVK64HFS25OCBPQDOGQEOURFJ3K4NMZT7SAK6DA5X2NVQGA, seg_pos={0 0}, upload=210382]: Done uploading piece. err: <nil> Sep 16 12:51:17.064970044 (239h22m53.104543164s) [noise=true , address=45.91.116.12:4227 , piece_id=3XMQVSP7NUPWYWA3NUBOATAQXALJJNOI6IFNFURL6NKBVY7LX4DA, seg_pos={0 0}, upload=210382]: Done uploading piece. err: <nil> Sep 16 12:51:17.079973354 (239h22m53.119546484s) [noise=true , address=45.91.116.8:4045 , piece_id=4RTCTN7XDE22A4A2G6MQWAR2ZDIJHLGMVJXHSIXDMRH7J5GLMFLQ, seg_pos={0 0}, upload=210382]: Done uploading piece. err: <nil> Sep 16 12:51:17.247921362 (239h22m53.287494492s) [noise=true , address=77.90.31.19:4842 , piece_id=N47XG62BNBQZVEBJ3UUGOHUL225GGLGP24UZOTZFPZX5E56XQFCQ, seg_pos={0 0}, upload=210382]: Done uploading piece. err: <nil> Sep 16 12:51:43.787090097 (239h23m19.826663217s) [noise=true , address=145.79.227.17:4971 , piece_id=3N7CZRZAYA5M5Z7OLICRR33V5Z7PD73IGCF5VKG7OHCPYFKCVMDA, seg_pos={0 0}, upload=210382]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: expected piece hash; context deadline exceeded; EOF Sep 16 12:51:43.787233920 (239h23m19.826807051s) [noise=true , address=145.79.227.18:4005 , piece_id=AHEVEZ7HSQATBMIMC73Q72XGFRID24FAZ4RGCXZQ5FUP7Z54JBMQ, seg_pos={0 0}, upload=210382]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: write tcp 188.166.225.170:57784->145.79.227.18:4005: use of closed network connection; write tcp 188.166.225.170:57784->145.79.227.18:4005: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57784->145.79.227.18:4005: use of closed network connection Sep 16 12:51:43.787293905 (239h23m19.826867035s) [noise=true , address=145.79.227.11:4732 , piece_id=T7N55LHKKEK342HK7QFFWRMG6OFYWHJ3ZIDTWNJBTZGWGYJBS4HA, seg_pos={0 0}, upload=210382]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:47776->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:47776->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47776->145.79.227.11:4732: use of closed network connection Sep 16 12:51:43.787413482 (239h23m19.826986612s) [noise=true , address=145.79.227.3:4150 , piece_id=THV34WXXSRZIR6DVOD32QX26TEIHYUPUNNAUWIIV4YCEZ7AM2DVQ, seg_pos={0 0}, upload=210382]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:51686->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:51686->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51686->145.79.227.3:4150: use of closed network connection Sep 16 12:51:43.787508023 (239h23m19.827081143s) [noise=true , address=145.79.227.18:4006 , piece_id=7QW4UNEZXXM2HP27NP7FAYWNMHYB62K4BGWH37YMROSULS7RCDUA, seg_pos={0 0}, upload=210382]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42748->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42748->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42748->145.79.227.18:4006: use of closed network connection Sep 16 12:51:43.787597753 (239h23m19.827170883s) [seg_pos={0 0}, upload=210382]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Sep 16 12:51:44.054541917 (239h23m20.094115047s) [upload=210382]: Done uploading segments... Sep 16 12:51:44.054565252 (239h23m20.094138372s) [upload=210382]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 7.217808634s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)