Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.621200177s FAIL (2025-10-01 16:56:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.621233401s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [.........................X..XX.XXX.XXXXX....................] duration: 5.880518166s FAIL (2025-10-01 16:55:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.880564705s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [..........................X..XX.XXX.XXXXX...................] duration: 6.019150648s FAIL (2025-10-01 16:54:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 6.01918355s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 6.887549301s FAIL (2025-10-01 16:54:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.887582924s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [...........................X..XX.XXX.XXXXX..................] duration: 6.350758002s FAIL (2025-10-01 16:53:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 6.350794762s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 9.601534646s FAIL (2025-10-01 16:53:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 9.601557449s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.255446711s FAIL (2025-10-01 16:53:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 30.255474864s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [............................X..XX.XXX.XXXXX.................] duration: 5.999416161s FAIL (2025-10-01 16:52:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.999447962s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [.............................X..XX.XXX.XXXXX................] duration: 6.009955979s FAIL (2025-10-01 16:52:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 6.009999923s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [..............................X..XX.XXX.XXXXX...............] duration: 5.817333431s FAIL (2025-10-01 16:51:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.817364449s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [...............................X..XX.XXX.XXXXX..............] duration: 6.062471388s FAIL (2025-10-01 16:50:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 6.062508659s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [................................X..XX.XXX.XXXXX.............] duration: 5.892017547s FAIL (2025-10-01 16:50:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.89217706s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [.................................X..XX.XXX.XXXXX............] duration: 5.959394443s FAIL (2025-10-01 16:49:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.959421494s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [..................................X..XX.XXX.XXXXX...........] duration: 5.943386402s FAIL (2025-10-01 16:48:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.943431706s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [...................................X..XX.XXX.XXXXX..........] duration: 6.16956967s FAIL (2025-10-01 16:47:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 6.169601711s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [....................................X..XX.XXX.XXXXX.........] duration: 5.96984937s FAIL (2025-10-01 16:47:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.969884666s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [.....................................X..XX.XXX.XXXXX........] duration: 6.061021138s FAIL (2025-10-01 16:47:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 6.061061444s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [......................................X..XX.XXX.XXXXX.......] duration: 6.285739749s FAIL (2025-10-01 16:46:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 6.285776077s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [.......................................X..XX.XXX.XXXXX......] duration: 6.065821469s FAIL (2025-10-01 16:45:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 6.065851855s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [........................................X..XX.XXX.XXXXX.....] duration: 5.867803256s FAIL (2025-10-01 16:44:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.867837852s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [.........................................X..XX.XXX.XXXXX....] duration: 5.798458592s FAIL (2025-10-01 16:43:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.798491143s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [..........................................X..XX.XXX.XXXXX...] duration: 5.92294756s FAIL (2025-10-01 16:43:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.922978279s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [...........................................X..XX.XXX.XXXXX..] duration: 6.165703643s FAIL (2025-10-01 16:42:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 6.165746435s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [............................................X..XX.XXX.XXXXX.] duration: 5.898361301s FAIL (2025-10-01 16:41:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.898385897s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [.............................................X..XX.XXX.XXXXX] duration: 1m0.16958924s FAIL (2025-10-01 16:40:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 1m0.169609308s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 10 out of 60 is failed (threshold=3) [..............................................X..XX.XXX.XXXX] duration: 1m0.17001034s FAIL (2025-10-01 16:39:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== 1s) [noise=true , address=185.167.204.205:4008 , piece_id=XHW27ARHPSDBM2QKLVZTYT66NZY46QJHY3UTQ5PYD4OUBPJVF3SA, seg_pos={0 0}, upload=171548]: Uploading piece... Oct 1 16:38:58.298671756 (195h7m43.760764229s) [noise=true , address=185.167.204.206:4049 , piece_id=XOP7VWAQVXAQ45GO3UJYWOJFOK6W7JBTBOKMY24TNM34KH6L43JQ, seg_pos={0 0}, upload=171548]: Uploading piece... Oct 1 16:38:58.300184727 (195h7m43.7622772s) [noise=true , address=81.171.14.70:4033 , piece_id=YL24J5NAXIQ4O5H7GG4WXDSZTDES5TI5SYP45RRLFK734DDTVPDQ, seg_pos={0 0}, upload=171548]: Uploading piece... Oct 1 16:38:58.301861039 (195h7m43.763953522s) [noise=true , address=89.149.201.147:4013 , piece_id=YKXANZBNC2PL2KT7R4PM4YIJC6BRXQPF2VPVF5EGATZKFPHDOMCA, seg_pos={0 0}, upload=171548]: Uploading piece... Oct 1 16:38:58.303299708 (195h7m43.765392181s) [noise=true , address=185.167.204.205:4030 , piece_id=2VZHCR6GTF3TQ33LZ7SWGUDVLGDIOAHPBFJGYYCSCGLIF4NLBBHQ, seg_pos={0 0}, upload=171548]: Uploading piece... Oct 1 16:38:58.304795246 (195h7m43.766887729s) [noise=true , address=89.149.201.147:4020 , piece_id=54DX3E42WCASWQDAMMVJFR2TDI4FNXVJRFFACBIHZOR65JYX6A5A, seg_pos={0 0}, upload=171548]: Uploading piece... Oct 1 16:38:58.307609745 (195h7m43.769702228s) [noise=true , address=81.171.14.70:4040 , piece_id=E5K42RWILIW2PFQACYLDUZRJ643PNLKMFVNTENQ5GGFTT7NSHYYQ, seg_pos={0 0}, upload=171548]: Uploading piece... Oct 1 16:38:58.307953901 (195h7m43.770046374s) [noise=true , address=185.167.204.206:4069 , piece_id=HQJUBNUOF2NIFHP3RM7BIWBBIKPKA75HOYO3JRHCY45Q3VKC6KUA, seg_pos={0 0}, upload=171548]: Uploading piece... Oct 1 16:38:58.309541524 (195h7m43.771633997s) [noise=true , address=185.167.204.206:4072 , piece_id=CMGKMAJZ2ZIBJOUBO4NTTLMLPYIOBDGU5723XQLG5HF4VIKNVPQA, seg_pos={0 0}, upload=171548]: Uploading piece... Oct 1 16:38:58.310779020 (195h7m43.772871503s) [noise=true , address=89.149.201.147:4022 , piece_id=RKMPTPM7ZT2UKAM5QTRK7UWHOME5PCJ5KYGSUYR3D7LWNI6ER6TA, seg_pos={0 0}, upload=171548]: Uploading piece... Oct 1 16:38:58.311018977 (195h7m43.77311146s) [noise=true , address=185.167.204.206:4064 , piece_id=JENG3RPD363LJAUL7HDDTQ2SYG6ZKRGTN6WXJMQQ2AXTARV4SNIQ, seg_pos={0 0}, upload=171548]: Uploading piece... Oct 1 16:38:59.127769048 (195h7m44.589861561s) [upload=171548]: Next returned nil segment Oct 1 16:38:59.127798714 (195h7m44.589891197s) [upload=171548]: Waiting for error group managing segments... Oct 1 16:38:59.539355278 (195h7m45.001447751s) [noise=true , address=89.149.201.147:4005 , piece_id=ECNVP5EZCV7NIKCVCSDQRIQIG7CHGNU6Y3GH3M5KANEBHVY57NJQ, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:38:59.561019391 (195h7m45.023111874s) [noise=true , address=81.171.14.70:4040 , piece_id=E5K42RWILIW2PFQACYLDUZRJ643PNLKMFVNTENQ5GGFTT7NSHYYQ, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:38:59.575700817 (195h7m45.0377933s) [noise=true , address=81.171.14.70:4033 , piece_id=YL24J5NAXIQ4O5H7GG4WXDSZTDES5TI5SYP45RRLFK734DDTVPDQ, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:38:59.596707909 (195h7m45.058800392s) [noise=true , address=89.149.201.147:4013 , piece_id=YKXANZBNC2PL2KT7R4PM4YIJC6BRXQPF2VPVF5EGATZKFPHDOMCA, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:38:59.621879089 (195h7m45.083971572s) [noise=true , address=89.149.201.147:4003 , piece_id=SR3DGR5J5WF56RYKJRM7YGSXUAEIOCHDKRDHWJBQHFMMBOR3QHYQ, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:38:59.652992365 (195h7m45.115084839s) [noise=true , address=89.149.201.147:4020 , piece_id=54DX3E42WCASWQDAMMVJFR2TDI4FNXVJRFFACBIHZOR65JYX6A5A, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:39:00.056744969 (195h7m45.518837442s) [noise=true , address=81.171.14.70:4032 , piece_id=HIQX4IXWMTXJPL7TCOJ4ZTO4CJJWSGV5AAVTVJYVCKT35VSFQGBA, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:39:00.065569112 (195h7m45.527661595s) [noise=true , address=81.171.14.70:4038 , piece_id=NATOA3FWYDF57OZ7AA2TUZXOXQY75ZGSVEFIVSK7V6BSHL3DJZ5Q, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:39:00.066442375 (195h7m45.528534848s) [noise=true , address=89.149.201.147:4017 , piece_id=ZJONTCFIK2HGHFH3M5PMTYGUGVHX5NIH7EJUKDD3EJDJKMOVDGUA, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:39:00.102644010 (195h7m45.564736493s) [noise=true , address=89.149.201.147:4023 , piece_id=XPDVRHZZIREWQ7GEZVJC7QS4P6PASNEW75NXJQAPIJT4XCLBK4OQ, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:39:00.104205694 (195h7m45.566298167s) [noise=true , address=89.149.201.147:4022 , piece_id=RKMPTPM7ZT2UKAM5QTRK7UWHOME5PCJ5KYGSUYR3D7LWNI6ER6TA, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:39:00.116173372 (195h7m45.578265845s) [noise=true , address=81.171.14.70:4048 , piece_id=EVAAAMIQ4V6T2LFEQ734YO44ZY4Z5ZVLKXV4YMRFPSA4Z6YJ3X5A, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:39:00.574059487 (195h7m46.036152s) [noise=true , address=185.167.204.206:4050 , piece_id=LHHXKZVI3AUCPGHPJOFBRAYGC4HS2USYPGPF6NWAKBD7WT4A3WOA, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:39:00.586814776 (195h7m46.048907259s) [noise=true , address=185.167.204.205:4026 , piece_id=CNV4GHBMTKE7WO3CM4UN55RFACNNFEWO5KZWAI6ETPHKXTJ2DCDQ, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:39:00.629687062 (195h7m46.091779546s) [noise=true , address=185.167.204.205:4030 , piece_id=2VZHCR6GTF3TQ33LZ7SWGUDVLGDIOAHPBFJGYYCSCGLIF4NLBBHQ, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:39:00.637597807 (195h7m46.09969029s) [noise=true , address=185.167.204.206:4049 , piece_id=XOP7VWAQVXAQ45GO3UJYWOJFOK6W7JBTBOKMY24TNM34KH6L43JQ, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:39:00.640089330 (195h7m46.102181813s) [noise=true , address=185.167.204.205:4022 , piece_id=QW3GHY7RI63PE4UKR775WIQXOQBEFBONZOMUO23ID4CNPQH72FFA, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:39:00.645545921 (195h7m46.107638404s) [noise=true , address=185.167.204.206:4064 , piece_id=JENG3RPD363LJAUL7HDDTQ2SYG6ZKRGTN6WXJMQQ2AXTARV4SNIQ, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:39:00.685196313 (195h7m46.147288786s) [noise=true , address=185.167.204.206:4072 , piece_id=CMGKMAJZ2ZIBJOUBO4NTTLMLPYIOBDGU5723XQLG5HF4VIKNVPQA, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:39:00.725312914 (195h7m46.187405397s) [noise=true , address=185.167.204.205:4014 , piece_id=HLDAK35EINVQNLIYVLOK2IZLNZVTHCSVKYNML26TPQKMQ4WFWXGQ, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:39:00.726158513 (195h7m46.188250997s) [noise=true , address=185.167.204.206:4055 , piece_id=WZGXKK3RKXLEBTUPLBLQWOPH4X3XU6O67QZMZPBYMWUZ3DY5LYCQ, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:39:00.730231689 (195h7m46.192324163s) [noise=true , address=185.167.204.206:4052 , piece_id=HKNLMF66I4DSTDGDPPNRRCRQGIZSPU2SNSTCVDEKSDDZ4ISZZQUA, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:39:00.753385169 (195h7m46.215477652s) [noise=true , address=185.167.204.205:4008 , piece_id=XHW27ARHPSDBM2QKLVZTYT66NZY46QJHY3UTQ5PYD4OUBPJVF3SA, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:39:00.828662361 (195h7m46.290754834s) [noise=true , address=185.167.204.205:4009 , piece_id=NUPHJLBFY3W5YZ3XHULJQBXG7AWGHIUQEV75HZVIP4YPP37RSPYQ, seg_pos={0 0}, upload=171548]: Done uploading piece. err: <nil> Oct 1 16:39:57.635572875 (195h8m43.097665348s) [noise=true , address=185.167.204.205:4031 , piece_id=IA4W3OZT6SNUODQ762W7Q4JSMSOVGLYZ2DLPZWHLXTFXECPGKPDQ, seg_pos={0 0}, upload=171548]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:39:57.635695388 (195h8m43.097787861s) [noise=true , address=185.167.204.205:4005 , piece_id=6EI223J2IZZ2Q2ZUZFC2QPD3JV5OOFGROQSJ6LLDZ2HKHOYHAOWQ, seg_pos={0 0}, upload=171548]: Done uploading piece. err: ecclient: upload failed (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM, address:185.167.204.205:4005): protocol: write tcp 188.166.225.170:35158->185.167.204.205:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:39:57.635712892 (195h8m43.097805365s) [noise=true , address=185.167.204.206:4069 , piece_id=HQJUBNUOF2NIFHP3RM7BIWBBIKPKA75HOYO3JRHCY45Q3VKC6KUA, seg_pos={0 0}, upload=171548]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 188.166.225.170:58140->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:39:57.635733310 (195h8m43.097825823s) [noise=true , address=185.167.204.205:4019 , piece_id=XJBO7AE2MIAODK2I2GWYBDX2DYDPVRM7ANU5ALDXLSM467GKNXIQ, seg_pos={0 0}, upload=171548]: Done uploading piece. err: ecclient: upload failed (node:12CwWyCCjbNNuuSxpk9PhiWxG2yvuT19gDyJhezMfUEez6LrpDj, address:185.167.204.205:4019): protocol: write tcp 188.166.225.170:52810->185.167.204.205:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:39:57.635767605 (195h8m43.097860098s) [seg_pos={0 0}, upload=171548]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:39:57.802810699 (195h8m43.264903192s) [upload=171548]: Done uploading segments... Oct 1 16:39:57.802845645 (195h8m43.264938118s) [upload=171548]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 1m0.170025459s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 9 out of 60 is failed (threshold=3) [...............................................X..XX.XXX.XXX] duration: 1m0.168555875s FAIL (2025-10-01 16:38:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== oise=true , address=185.167.204.205:4006 , piece_id=E2Y34UDRYCYR6RQWSO4BKUO26SCNZERDPDAVRTL6UJN2LZT22JYA, seg_pos={0 0}, upload=171535]: Uploading piece... Oct 1 16:37:57.916263946 (195h6m43.378356419s) [noise=true , address=89.149.201.147:4009 , piece_id=BEOX6XBJBAEWGBIUFKW47QJBJMVJ4O7HD3XK745XV7I3V2CNBRRQ, seg_pos={0 0}, upload=171535]: Uploading piece... Oct 1 16:37:57.916788074 (195h6m43.378880557s) [noise=true , address=185.167.204.206:4052 , piece_id=JPQX2PYC5QK5UO453KHZ3JZG4HQPWMXUTKL4HOUGZQZYTWTFK2NQ, seg_pos={0 0}, upload=171535]: Uploading piece... Oct 1 16:37:57.917031197 (195h6m43.37912368s) [noise=true , address=81.171.14.70:4041 , piece_id=O3DNNJUOGBFUUZDXG6MWXKHWE6VHE5WE324I67ZMNSJHRZB6TWPQ, seg_pos={0 0}, upload=171535]: Uploading piece... Oct 1 16:37:57.917324465 (195h6m43.379416948s) [noise=true , address=185.167.204.206:4039 , piece_id=JQRKKCQPMFW4NHMXUBAOP3GM27WODDQ4E7C66TOOOOWHCKDAPPPA, seg_pos={0 0}, upload=171535]: Uploading piece... Oct 1 16:37:57.917608706 (195h6m43.379701369s) [noise=true , address=185.167.204.205:4013 , piece_id=QNRER4X2RJKQKRX6EKKOAD3P32MGPJY2SW5IATS3V3LTXEBSF24A, seg_pos={0 0}, upload=171535]: Uploading piece... Oct 1 16:37:57.917868351 (195h6m43.379960834s) [noise=true , address=185.167.204.206:4045 , piece_id=OU37VXBFW7YPMOAL3CXWPB3EOOT3MN6W7A6EKPMWZAYO2KBX5XQQ, seg_pos={0 0}, upload=171535]: Uploading piece... Oct 1 16:37:57.918238284 (195h6m43.380330768s) [noise=true , address=81.171.14.70:4048 , piece_id=CSQZAA2C7AHE5CXI7ZNH4HB6VSGAACWMCNDKDISWIYDCGTPPNFUQ, seg_pos={0 0}, upload=171535]: Uploading piece... Oct 1 16:37:57.918375826 (195h6m43.38046831s) [noise=true , address=185.167.204.206:4044 , piece_id=T6VTWLDPVFVXKNYRXCBAXSVVDKEB5OKM6PBZ2LPRIOSRBZRKA7XQ, seg_pos={0 0}, upload=171535]: Uploading piece... Oct 1 16:37:57.918892721 (195h6m43.380985194s) [noise=true , address=185.167.204.205:4033 , piece_id=EY3FUSHZANDXFPPMUIDWLXV7EXYPVRRDVE56SKYLXEZHUBWK2NAA, seg_pos={0 0}, upload=171535]: Uploading piece... Oct 1 16:37:57.918955992 (195h6m43.381048475s) [noise=true , address=185.167.204.205:4017 , piece_id=MXWIGG46QWJWIWCAKTGR7WV46U34RRPOQQHQUR2JEYVNJJTKGHHQ, seg_pos={0 0}, upload=171535]: Uploading piece... Oct 1 16:37:58.745622485 (195h6m44.207714958s) [upload=171535]: Next returned nil segment Oct 1 16:37:58.745641601 (195h6m44.207734084s) [upload=171535]: Waiting for error group managing segments... Oct 1 16:37:59.132852375 (195h6m44.594944869s) [noise=true , address=81.171.14.70:4030 , piece_id=LPGMCADUU7FRVMHQOA6D4QJ7EKNSASXQOBSTAKY46IBCFPQ5BESA, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:37:59.142468746 (195h6m44.604561229s) [noise=true , address=81.171.14.70:4036 , piece_id=B2LMZM7C4RGJWVXS4G6F2X6GYDE6ZOSWFRXXEQZ4BUZZMIA3DBRQ, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:37:59.168172191 (195h6m44.630264684s) [noise=true , address=89.149.201.147:4008 , piece_id=QU5IEP5MQG526GYZX4RIC4RNJ7FHNIW3CUFFQ5YVUXSJCX75OYAA, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:37:59.170211084 (195h6m44.632303567s) [noise=true , address=81.171.14.70:4047 , piece_id=SPG3MAWQ3FXGNOTOMT5K356SF7LYMITMTRUROSPXPZKIAFCCJY6Q, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:37:59.170608991 (195h6m44.632701464s) [noise=true , address=81.171.14.70:4042 , piece_id=4JEWV6QRM4TFYM3G5MKU3PGSWU2HYZ42CH3VOWCHBHKR7KH2ZXUA, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:37:59.179816454 (195h6m44.641908937s) [noise=true , address=81.171.14.70:4027 , piece_id=5TIUEKFD5EQQ7ORHR5YVNR5BQSKDH4V4AWVLKIGSV77MNDAJRSYQ, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:37:59.183095608 (195h6m44.645188702s) [noise=true , address=89.149.201.147:4018 , piece_id=TYJOHXLFM4YO3NUWILY6DZABPXQXC3SCOQSLNUI5M46YUP5IZLQA, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:37:59.187094262 (195h6m44.649186735s) [noise=true , address=81.171.14.70:4048 , piece_id=CSQZAA2C7AHE5CXI7ZNH4HB6VSGAACWMCNDKDISWIYDCGTPPNFUQ, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:37:59.189560418 (195h6m44.651652891s) [noise=true , address=89.149.201.147:4002 , piece_id=NLR4XFFUBXLCI7X7CR67NG4PWUFOYA7XTRY2YANMFZMYRGH65DRQ, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:37:59.209742198 (195h6m44.671834671s) [noise=true , address=81.171.14.70:4041 , piece_id=O3DNNJUOGBFUUZDXG6MWXKHWE6VHE5WE324I67ZMNSJHRZB6TWPQ, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:37:59.218473394 (195h6m44.680565867s) [noise=true , address=89.149.201.147:4017 , piece_id=7447MQQNBHTVWZRGPCIQBLWQ4VBAVRE6MIOOHQF737W7UAEKKEHA, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:37:59.220008557 (195h6m44.68210103s) [noise=true , address=89.149.201.147:4005 , piece_id=JF7PQXLDGESCH4BQ7HGAQWJARINTY7PFCUAVH5Q4JS2YNBZPPZJA, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:37:59.227948828 (195h6m44.690041311s) [noise=true , address=89.149.201.147:4009 , piece_id=BEOX6XBJBAEWGBIUFKW47QJBJMVJ4O7HD3XK745XV7I3V2CNBRRQ, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:37:59.234120219 (195h6m44.696212692s) [noise=true , address=81.171.14.70:4029 , piece_id=W2ZMS2VSXPHZQ4FNKF4HNB2B6CODNZSZDBUO6V6Z73XMR3NPTBBA, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:37:59.616568725 (195h6m45.078661208s) [noise=true , address=81.171.14.70:4033 , piece_id=R2ZDIFGFQRWH3Y7WPGP2P45CJ5A3R2TMJP3CVD47324DCGJPJ7PQ, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:38:00.011375845 (195h6m45.473468328s) [noise=true , address=185.167.204.206:4051 , piece_id=TJV4PSRZP4HGM7T43OGSZRQNR5CKE553JMSAINENXKIVA5ITWO4A, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:38:00.034827701 (195h6m45.496920194s) [noise=true , address=185.167.204.206:4045 , piece_id=OU37VXBFW7YPMOAL3CXWPB3EOOT3MN6W7A6EKPMWZAYO2KBX5XQQ, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:38:00.047440088 (195h6m45.509532581s) [noise=true , address=185.167.204.205:4033 , piece_id=EY3FUSHZANDXFPPMUIDWLXV7EXYPVRRDVE56SKYLXEZHUBWK2NAA, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:38:00.099237029 (195h6m45.561329513s) [noise=true , address=185.167.204.206:4055 , piece_id=3UESJRWZDMMHBGGXZ7MW7GN3NLRRDFMLOPUHXJFOUNRZLDWFXL6Q, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:38:00.102442453 (195h6m45.564534936s) [noise=true , address=185.167.204.206:4069 , piece_id=CRQOZRULUP33PHHPKX4ALNTPXCEF7MBW7YSUQJ7YOGZTXF7SETNA, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:38:00.105961203 (195h6m45.568053686s) [noise=true , address=185.167.204.206:4052 , piece_id=JPQX2PYC5QK5UO453KHZ3JZG4HQPWMXUTKL4HOUGZQZYTWTFK2NQ, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:38:00.284860362 (195h6m45.746952835s) [noise=true , address=185.167.204.205:4006 , piece_id=E2Y34UDRYCYR6RQWSO4BKUO26SCNZERDPDAVRTL6UJN2LZT22JYA, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:38:01.380169924 (195h6m46.842262407s) [noise=true , address=185.167.204.206:4044 , piece_id=T6VTWLDPVFVXKNYRXCBAXSVVDKEB5OKM6PBZ2LPRIOSRBZRKA7XQ, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:38:02.832673512 (195h6m48.294765995s) [noise=true , address=185.167.204.205:4013 , piece_id=QNRER4X2RJKQKRX6EKKOAD3P32MGPJY2SW5IATS3V3LTXEBSF24A, seg_pos={0 0}, upload=171535]: Done uploading piece. err: <nil> Oct 1 16:38:57.251309155 (195h7m42.713401628s) [noise=true , address=185.167.204.206:4037 , piece_id=GS3BCLIUDW5KIT6KHWCGVVSP5NZVNLKBH43QXXVHT6AMFT6XWZOQ, seg_pos={0 0}, upload=171535]: Done uploading piece. err: ecclient: upload failed (node:12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, address:185.167.204.206:4037): protocol: rpc: dial tcp 185.167.204.206:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:38:57.251469460 (195h7m42.713561943s) [noise=true , address=185.167.204.206:4060 , piece_id=PBPV2OKT6KIHORDEUCPXMBJ5AOXOFAG7U6OZK5AAVGLGSIRQL5MA, seg_pos={0 0}, upload=171535]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:46248->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:38:57.251491582 (195h7m42.713584065s) [noise=true , address=185.167.204.206:4039 , piece_id=JQRKKCQPMFW4NHMXUBAOP3GM27WODDQ4E7C66TOOOOWHCKDAPPPA, seg_pos={0 0}, upload=171535]: Done uploading piece. err: ecclient: upload failed (node:12FV1y64fPXx14kCr3Tng2sYqXdsxaPeRJXmNVJLCVKQNkCo3Y9, address:185.167.204.206:4039): protocol: write tcp 188.166.225.170:34260->185.167.204.206:4039: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:38:57.251531187 (195h7m42.71362367s) [noise=true , address=185.167.204.205:4017 , piece_id=MXWIGG46QWJWIWCAKTGR7WV46U34RRPOQQHQUR2JEYVNJJTKGHHQ, seg_pos={0 0}, upload=171535]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: write tcp 188.166.225.170:45294->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:38:57.251561305 (195h7m42.713653788s) [seg_pos={0 0}, upload=171535]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:38:57.417991761 (195h7m42.880084234s) [upload=171535]: Done uploading segments... Oct 1 16:38:57.418018952 (195h7m42.880111445s) [upload=171535]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 1m0.16857373s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 8 out of 60 is failed (threshold=3) [................................................X..XX.XXX.XX] duration: 1m0.202899092s FAIL (2025-10-01 16:37:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== 16:36:57.525765610 (195h5m42.987858093s) [noise=true , address=185.167.204.205:4010 , piece_id=6H53JXX34CLHBY34CKNWEOZ6SSCCLXOBR7UKPOOW3YOFOPFB4KGA, seg_pos={0 0}, upload=171521]: Uploading piece... Oct 1 16:36:57.526253428 (195h5m42.988345902s) [noise=true , address=185.167.204.205:4009 , piece_id=LAMIRJ3GYTESDPFSCHSQEVXIF7ELFJ3YVUVVVFRU723ESNEPITDA, seg_pos={0 0}, upload=171521]: Uploading piece... Oct 1 16:36:57.526562666 (195h5m42.988655139s) [noise=true , address=81.171.14.70:4048 , piece_id=TMSPLD4HTTDQACU2JN2DEKNB6GM6DBD66WY5UTM3FVYAJXRYVGMA, seg_pos={0 0}, upload=171521]: Uploading piece... Oct 1 16:36:57.526854863 (195h5m42.988947346s) [noise=true , address=185.167.204.205:4034 , piece_id=MQ5D3QUI3E5TRGMIYWEC65ZPICDX7QFXNZCSAZMLLLMTP3QQKKLA, seg_pos={0 0}, upload=171521]: Uploading piece... Oct 1 16:36:57.526933082 (195h5m42.989025565s) [noise=true , address=81.171.14.70:4036 , piece_id=Y2ES4QPTUN7HJFIVDEC5NI53HJG5IEQMOUIJTVJOAD3KD5UXQJ3A, seg_pos={0 0}, upload=171521]: Uploading piece... Oct 1 16:36:57.527627374 (195h5m42.989719857s) [noise=true , address=81.171.14.70:4025 , piece_id=66K53XEYDKSNQYJ2OAJXGHEFKBUDGPGGEPB4SDIK7JCJZROMEUYA, seg_pos={0 0}, upload=171521]: Uploading piece... Oct 1 16:36:57.528157954 (195h5m42.990250437s) [noise=true , address=81.171.14.70:4031 , piece_id=54VPIA6A46KLE6IJQEYW7OMPSHREVAU536UFBKLQOONLIHCKHODA, seg_pos={0 0}, upload=171521]: Uploading piece... Oct 1 16:36:57.529105600 (195h5m42.991198083s) [noise=true , address=185.167.204.205:4028 , piece_id=LCNPSNGNSOJYDHQMAWHAWR3RNEPL4OCWS7YAFTBY7VBGUG67Q7GA, seg_pos={0 0}, upload=171521]: Uploading piece... Oct 1 16:36:57.529528675 (195h5m42.991621158s) [noise=true , address=185.167.204.205:4021 , piece_id=QIFQ2DAMMIQGUKEWNV2YAABSETAPWRJFJDFCDBTYTENLHDUMM4RQ, seg_pos={0 0}, upload=171521]: Uploading piece... Oct 1 16:36:57.529987579 (195h5m42.992080062s) [noise=true , address=185.167.204.206:4070 , piece_id=2BTHVTHBXZVQ6XE3C6FBF3ILPVRVQWCTFCNWOIIIX3WKAQI47D2A, seg_pos={0 0}, upload=171521]: Uploading piece... Oct 1 16:36:57.530425081 (195h5m42.992517564s) [noise=true , address=81.171.14.70:4028 , piece_id=RH4SXM46GSVKFKDTM6V33Z7L7ET5SPHCQCXZTRYVQWDDELQVG6MA, seg_pos={0 0}, upload=171521]: Uploading piece... Oct 1 16:36:58.357180814 (195h5m43.819273297s) [upload=171521]: Next returned nil segment Oct 1 16:36:58.357199059 (195h5m43.819291532s) [upload=171521]: Waiting for error group managing segments... Oct 1 16:36:58.727447303 (195h5m44.189539787s) [noise=true , address=81.171.14.70:4041 , piece_id=55WBDXI3WD5QQABVDIL4O3YTRS2K6CJEUTELGRU6Z7HDSOEIAVAQ, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:58.757204947 (195h5m44.21929743s) [noise=true , address=81.171.14.70:4048 , piece_id=TMSPLD4HTTDQACU2JN2DEKNB6GM6DBD66WY5UTM3FVYAJXRYVGMA, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:58.770514461 (195h5m44.232606944s) [noise=true , address=81.171.14.70:4035 , piece_id=ADJ6FWB5P4I7AESAMGGPBJSAY2USC53IC2OJQFGNPTPEMTKNRAOQ, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:58.778682314 (195h5m44.240774797s) [noise=true , address=81.171.14.70:4039 , piece_id=XIKFTFTBX4ZKEJU6J73TNZG3HM7OUR7MXMPB5KXX6UYJX3EQQFNQ, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:58.779100431 (195h5m44.241192914s) [noise=true , address=81.171.14.70:4028 , piece_id=RH4SXM46GSVKFKDTM6V33Z7L7ET5SPHCQCXZTRYVQWDDELQVG6MA, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:58.798147931 (195h5m44.260240414s) [noise=true , address=81.171.14.70:4025 , piece_id=66K53XEYDKSNQYJ2OAJXGHEFKBUDGPGGEPB4SDIK7JCJZROMEUYA, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:58.798356929 (195h5m44.260449412s) [noise=true , address=89.149.201.147:4015 , piece_id=SFVUTFJPMHQBJ5TRBNTHJAVAEKESZC63SAB6G7OFAIHVAZC4X66Q, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:58.807836179 (195h5m44.269928663s) [noise=true , address=81.171.14.70:4036 , piece_id=Y2ES4QPTUN7HJFIVDEC5NI53HJG5IEQMOUIJTVJOAD3KD5UXQJ3A, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:58.829623777 (195h5m44.29171626s) [noise=true , address=89.149.201.147:4024 , piece_id=2IABPQ5DT5HTQERHAXN62CZXO6SBZHILAE6EKPZ24ER6T6Y5MOFA, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:58.830706529 (195h5m44.292799012s) [noise=true , address=89.149.201.147:4005 , piece_id=GALACZAQC25TN3QBPP5SKVDDZYC7VPGISZ5HLHYEPLZAQPL2X6VA, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:59.262827581 (195h5m44.724920054s) [noise=true , address=81.171.14.70:4047 , piece_id=B5QIGYKLX665I4ZYT7GIHLIVJXC6AU4Z4YYY3XHRP6VRZQ23U2BQ, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:59.265782858 (195h5m44.727875331s) [noise=true , address=81.171.14.70:4027 , piece_id=33WVA5PDEI5DAHKKIB52OCQ6PSO3IGU3VQADXCAYSBAXMEVYGJYQ, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:59.278312277 (195h5m44.74040475s) [noise=true , address=81.171.14.70:4031 , piece_id=54VPIA6A46KLE6IJQEYW7OMPSHREVAU536UFBKLQOONLIHCKHODA, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:59.793189393 (195h5m45.255281866s) [noise=true , address=185.167.204.206:4064 , piece_id=5HEGEVGUNDGJMHPETDTBL3GXEFNLHW4MI4ZRAUJ3DZLVDKKO74HQ, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:59.801154419 (195h5m45.263246902s) [noise=true , address=185.167.204.206:4046 , piece_id=ZNQ4ANRTBL2NUQXXNV3PPXM3BFMQCQOAB2T5IT72LZPZ4B6B5TKQ, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:59.802907728 (195h5m45.265000211s) [noise=true , address=185.167.204.206:4039 , piece_id=RGMJTMPIUG7WQ322XGHL33PONGBZTOEUZ6YYPM7ABR6CYD2Q4LNQ, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:59.807477530 (195h5m45.269570013s) [noise=true , address=185.167.204.206:4058 , piece_id=XX3YKMJJDIEX6SYS4BHASDIL22HGCXVTC4DMFA5FQ444VIYTXLOA, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:59.817140791 (195h5m45.279233264s) [noise=true , address=185.167.204.205:4010 , piece_id=6H53JXX34CLHBY34CKNWEOZ6SSCCLXOBR7UKPOOW3YOFOPFB4KGA, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:59.822021564 (195h5m45.284114037s) [noise=true , address=185.167.204.206:4045 , piece_id=C6QCCMIA2E2EAORUY6TNOYI5PT55E5S24TTWHM3C7KLGGPRAUPPA, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:59.843600315 (195h5m45.305692788s) [noise=true , address=185.167.204.205:4004 , piece_id=CPQDL6KAT6WP56PTXKHXJ4HWBDBPHUVSZQLKGG4B3WRV7J5QCVBA, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:59.850185925 (195h5m45.312278398s) [noise=true , address=185.167.204.205:4028 , piece_id=LCNPSNGNSOJYDHQMAWHAWR3RNEPL4OCWS7YAFTBY7VBGUG67Q7GA, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:59.904031648 (195h5m45.366124131s) [noise=true , address=185.167.204.206:4049 , piece_id=6U4YBLTHU67L2TVTP7G3RAZJH7LQCVH76SCQF3U3GE2BRFNRAWMA, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:59.909499780 (195h5m45.371592253s) [noise=true , address=185.167.204.205:4034 , piece_id=MQ5D3QUI3E5TRGMIYWEC65ZPICDX7QFXNZCSAZMLLLMTP3QQKKLA, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:36:59.926264343 (195h5m45.388356816s) [noise=true , address=185.167.204.205:4021 , piece_id=QIFQ2DAMMIQGUKEWNV2YAABSETAPWRJFJDFCDBTYTENLHDUMM4RQ, seg_pos={0 0}, upload=171521]: Done uploading piece. err: <nil> Oct 1 16:37:56.844905189 (195h6m42.306997672s) [noise=true , address=185.167.204.206:4063 , piece_id=LAINLQK3JFXKDFUROZCABQO32YEDSIXJHHUFV5YIDNYNACO6DX7Q, seg_pos={0 0}, upload=171521]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: write tcp 188.166.225.170:41780->185.167.204.206:4063: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:37:56.844990352 (195h6m42.307082835s) [noise=true , address=185.167.204.206:4069 , piece_id=FJTLF477BRYPVVSFQTFKIGWEFTEDZPADRM5M77HGSM3EPFLVJY2Q, seg_pos={0 0}, upload=171521]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 188.166.225.170:46940->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:37:56.845084441 (195h6m42.307176924s) [noise=true , address=185.167.204.205:4009 , piece_id=LAMIRJ3GYTESDPFSCHSQEVXIF7ELFJ3YVUVVVFRU723ESNEPITDA, seg_pos={0 0}, upload=171521]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:37:56.845119117 (195h6m42.30721159s) [noise=true , address=185.167.204.206:4070 , piece_id=2BTHVTHBXZVQ6XE3C6FBF3ILPVRVQWCTFCNWOIIIX3WKAQI47D2A, seg_pos={0 0}, upload=171521]: Done uploading piece. err: ecclient: upload failed (node:1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, address:185.167.204.206:4070): protocol: rpc: dial tcp 185.167.204.206:4070: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:37:56.845157750 (195h6m42.307250223s) [seg_pos={0 0}, upload=171521]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:37:57.044074186 (195h6m42.506166679s) [upload=171521]: Done uploading segments... Oct 1 16:37:57.044107189 (195h6m42.506199672s) [upload=171521]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 1m0.20291903s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 7 out of 60 is failed (threshold=3) [.................................................X..XX.XXX.X] duration: 1m0.169777141s FAIL (2025-10-01 16:36:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ue , address=185.167.204.206:4039 , piece_id=JCDQZ5DFQVTFI6JWWF75YA7RBOVALP4L5ZSGFVRTE7GIDU2IFIUQ, seg_pos={0 0}, upload=171509]: Uploading piece... Oct 1 16:35:57.122869403 (195h4m42.584961876s) [noise=true , address=89.149.201.147:4009 , piece_id=TQER2RZNA446MJT22QXKZNKSQ55Q3EYD42OP47KBRZKWLZCG3YZA, seg_pos={0 0}, upload=171509]: Uploading piece... Oct 1 16:35:57.123263694 (195h4m42.585356177s) [noise=true , address=185.167.204.206:4058 , piece_id=JWBCZEJQTPYZ2BIG3ZK73QG2VINICXAF3EKAAKLHATTHEWRLKGIQ, seg_pos={0 0}, upload=171509]: Uploading piece... Oct 1 16:35:57.123854809 (195h4m42.585947292s) [noise=true , address=89.149.201.147:4020 , piece_id=BUNTWIOHSTUXES2PV7477EXFTRHKIBUCF42OGJKFXXF62MNGVBCQ, seg_pos={0 0}, upload=171509]: Uploading piece... Oct 1 16:35:57.124079588 (195h4m42.586172061s) [noise=true , address=81.171.14.70:4032 , piece_id=6UH3KRHHDXIZFMZEWSBB2HG3PBPDOLOUR3HEAXFWTLQU4RNDT5NQ, seg_pos={0 0}, upload=171509]: Uploading piece... Oct 1 16:35:57.124640796 (195h4m42.586733269s) [noise=true , address=89.149.201.147:4023 , piece_id=YNDJQA2FXJPY6SGDN3B6PET6XR4S2AY7KVDWWJBGCKWTZWBZETXA, seg_pos={0 0}, upload=171509]: Uploading piece... Oct 1 16:35:57.125298398 (195h4m42.587390871s) [noise=true , address=185.167.204.206:4044 , piece_id=AXX6L7BJ7AVE43Z2ROXLGDWPMT2HGCDEYS5PTZJXCWIAFTMYYGEQ, seg_pos={0 0}, upload=171509]: Uploading piece... Oct 1 16:35:57.125572751 (195h4m42.587665224s) [noise=true , address=81.171.14.70:4039 , piece_id=QPR6CCFF7EBTYWTHJN6TGMSPP7VHCLYTTKGQPRTJ6MRYUKXQK5VQ, seg_pos={0 0}, upload=171509]: Uploading piece... Oct 1 16:35:57.126091158 (195h4m42.588183641s) [noise=true , address=185.167.204.205:4019 , piece_id=AZ4DSOUJ7VOMTNRFFZWOMIBGTOYROX76O5XFU4L6F7OVZB2VFD2A, seg_pos={0 0}, upload=171509]: Uploading piece... Oct 1 16:35:57.966961738 (195h4m43.429054211s) [upload=171509]: Next returned nil segment Oct 1 16:35:57.966985764 (195h4m43.429078268s) [upload=171509]: Waiting for error group managing segments... Oct 1 16:35:58.388543532 (195h4m43.850636005s) [noise=true , address=89.149.201.147:4005 , piece_id=M32K7QZ4DYWALB6ENQLJSNOCJQNU6CHIBMF5RJJ5BJZIMICV5OXA, seg_pos={0 0}, upload=171509]: Done uploading piece. err: <nil> Oct 1 16:35:58.388572987 (195h4m43.850665471s) [noise=true , address=89.149.201.147:4014 , piece_id=VCPGWOKYDMS2AV4YQPJBAHZ3DHCQ4B2IIWCFHGGWMTSG3E7DWUJQ, seg_pos={0 0}, upload=171509]: Done uploading piece. err: <nil> Oct 1 16:35:58.403907678 (195h4m43.866000161s) [noise=true , address=89.149.201.147:4017 , piece_id=5E2K3QUP5NCARCJM4POYK25RRTAGHNFF3AHS53UWKISTISVSX45Q, seg_pos={0 0}, upload=171509]: Done uploading piece. err: <nil> Oct 1 16:35:58.418138035 (195h4m43.880230518s) [noise=true , address=81.171.14.70:4034 , piece_id=H4L2QGGKB4OTEI2TMXG6FCKFMKRA6HUUTYKQTRRU2YIVLHWCWMOQ, seg_pos={0 0}, upload=171509]: Done uploading piece. err: <nil> Oct 1 16:35:58.418234389 (195h4m43.880326872s) [noise=true , address=81.171.14.70:4031 , piece_id=ZOXC4E5JMDIOQUP7I3WRRX3F5Y6BZVQKZG5HFX2CWHIVK3YYQIPA, seg_pos={0 0}, upload=171509]: Done uploading piece. err: <nil> Oct 1 16:35:58.430727167 (195h4m43.89281964s) [noise=true , address=89.149.201.147:4009 , piece_id=TQER2RZNA446MJT22QXKZNKSQ55Q3EYD42OP47KBRZKWLZCG3YZA, seg_pos={0 0}, upload=171509]: Done uploading piece. err: <nil> Oct 1 16:35:58.441453172 (195h4m43.903545645s) [noise=true , address=81.171.14.70:4025 , piece_id=O6AP66OBEQ5V44TANRCBF6EMJJCST3W2CIROEUHVYIHRWUMG6DFA, seg_pos={0 0}, upload=171509]: Done uploading piece. err: <nil> Oct 1 16:35:58.454786131 (195h4m43.916878604s) [noise=true , address=89.149.201.147:4024 , piece_id=WVUMOP4EDNCTHFWBIXVUV23RAWHGSJXNORSK4DW2QII4M2FXQ4FQ, seg_pos={0 0}, upload=171509]: Done uploading piece. err: <nil> Oct 1 16:35:58.463187067 (195h4m43.92527955s) [noise=true , address=89.149.201.147:4011 , piece_id=NH2S5GYNWAUI5NCD7TQGC655OIW7WUXJC3POH7MPV2YVIQNYFXLQ, seg_pos={0 0}, upload=171509]: Done uploading piece. err: <nil> Oct 1 16:35:58.474505701 (195h4m43.936598184s) [noise=true , address=89.149.201.147:4023 , piece_id=YNDJQA2FXJPY6SGDN3B6PET6XR4S2AY7KVDWWJBGCKWTZWBZETXA, seg_pos={0 0}, upload=171509]: Done uploading piece. err: <nil> Oct 1 16:35:58.490269458 (195h4m43.952361941s) [noise=true , address=89.149.201.147:4020 , piece_id=BUNTWIOHSTUXES2PV7477EXFTRHKIBUCF42OGJKFXXF62MNGVBCQ, seg_pos={0 0}, upload=171509]: Done uploading piece. err: <nil> Oct 1 16:35:58.862205085 (195h4m44.324297568s) [noise=true , address=81.171.14.70:4039 , piece_id=QPR6CCFF7EBTYWTHJN6TGMSPP7VHCLYTTKGQPRTJ6MRYUKXQK5VQ, seg_pos={0 0}, upload=171509]: Done uploading piece. err: <nil> Oct 1 16:35:58.915192063 (195h4m44.377284546s) [noise=true , address=89.149.201.147:4002 , piece_id=GHL5SAW7BUVWX7TFJFFWUNWXBV4CR47UVZI26BYBR2ZVZ56Q5YAA, seg_pos={0 0}, upload=171509]: Done uploading piece. err: <nil> Oct 1 16:35:58.921640943 (195h4m44.383733426s) [noise=true , address=81.171.14.70:4032 , piece_id=6UH3KRHHDXIZFMZEWSBB2HG3PBPDOLOUR3HEAXFWTLQU4RNDT5NQ, seg_pos={0 0}, upload=171509]: Done uploading piece. err: <nil> Oct 1 16:35:59.612282418 (195h4m45.074374891s) [noise=true , address=185.167.204.206:4058 , piece_id=JWBCZEJQTPYZ2BIG3ZK73QG2VINICXAF3EKAAKLHATTHEWRLKGIQ, seg_pos={0 0}, upload=171509]: Done uploading piece. err: <nil> Oct 1 16:35:59.635406531 (195h4m45.097499014s) [noise=true , address=185.167.204.206:4053 , piece_id=CNFBINJZSCSCFMGDKUFGSJY7BYE6CVY72VNYKF7QPAT6IH2QHXBA, seg_pos={0 0}, upload=171509]: Done uploading piece. err: <nil> Oct 1 16:35:59.649917312 (195h4m45.112009805s) [noise=true , address=185.167.204.205:4024 , piece_id=KMXJJZN4MHPZ666A4TWK2BNFXEBA3AADMJ4F377OPMWTY45TRFAA, seg_pos={0 0}, upload=171509]: Done uploading piece. err: <nil> Oct 1 16:35:59.650473471 (195h4m45.112565944s) [noise=true , address=185.167.204.206:4039 , piece_id=JCDQZ5DFQVTFI6JWWF75YA7RBOVALP4L5ZSGFVRTE7GIDU2IFIUQ, seg_pos={0 0}, upload=171509]: Done uploading piece. err: <nil> Oct 1 16:35:59.655536492 (195h4m45.117628985s) [noise=true , address=185.167.204.205:4015 , piece_id=V2DJEDMUP2JM33CQGRGEZHBMSI2FB2G4EJJ2NMV7U74537VCO3JA, seg_pos={0 0}, upload=171509]: Done uploading piece. err: <nil> Oct 1 16:35:59.663246243 (195h4m45.125338726s) [noise=true , address=185.167.204.205:4029 , piece_id=MMRJD3MBLYPRYS4KGQ6VIQUU27LFC4LE6X3ERKP7F76QGHHZR5EQ, seg_pos={0 0}, upload=171509]: Done uploading piece. err: <nil> Oct 1 16:35:59.674562441 (195h4m45.136654924s) [noise=true , address=185.167.204.206:4043 , piece_id=DBQXXXHFSHIBKAGQLTM4AJECAYMXZOXCK5TRK66ZPOIU3NNAXCBQ, seg_pos={0 0}, upload=171509]: Done uploading piece. err: <nil> Oct 1 16:35:59.705576749 (195h4m45.167669232s) [noise=true , address=185.167.204.205:4025 , piece_id=UY2OXO53PLJ2RRZCCGZZ6CPWEXN4DS65S5QEWS5QA33SMUWVA7PQ, seg_pos={0 0}, upload=171509]: Done uploading piece. err: <nil> Oct 1 16:36:56.465688355 (195h5m41.927780848s) [noise=true , address=185.167.204.205:4019 , piece_id=AZ4DSOUJ7VOMTNRFFZWOMIBGTOYROX76O5XFU4L6F7OVZB2VFD2A, seg_pos={0 0}, upload=171509]: Done uploading piece. err: ecclient: upload failed (node:12CwWyCCjbNNuuSxpk9PhiWxG2yvuT19gDyJhezMfUEez6LrpDj, address:185.167.204.205:4019): protocol: rpc: dial tcp 185.167.204.205:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:36:56.466004327 (195h5m41.92809681s) [noise=true , address=185.167.204.205:4022 , piece_id=TLFQK7MXW3Y2OCUOKRXAG2MJXONIMBYNNEMANWLVFAYCS4HC3APA, seg_pos={0 0}, upload=171509]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:36:56.466103826 (195h5m41.928196309s) [noise=true , address=185.167.204.206:4044 , piece_id=AXX6L7BJ7AVE43Z2ROXLGDWPMT2HGCDEYS5PTZJXCWIAFTMYYGEQ, seg_pos={0 0}, upload=171509]: Done uploading piece. err: ecclient: upload failed (node:1216DSoBdbhQNEkdg1TtfmYRJrUjLxCHKvdkhB1axUiaDNXGrrj, address:185.167.204.206:4044): protocol: rpc: dial tcp 185.167.204.206:4044: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:36:56.466216070 (195h5m41.928308553s) [noise=true , address=185.167.204.206:4038 , piece_id=FIVWWPU43SEDLSQMKVQYFJ44YF7BRIMVMFBZPCD7P637KOJA3AJA, seg_pos={0 0}, upload=171509]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 188.166.225.170:36168->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:36:56.466306111 (195h5m41.928398604s) [noise=true , address=185.167.204.206:4049 , piece_id=KSZZP5J2IKKWYWN5I6C3YVO6TFJALYSMFHWOJRG2NXPMFMQC264A, seg_pos={0 0}, upload=171509]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:36:56.466354333 (195h5m41.928446816s) [noise=true , address=185.167.204.205:4010 , piece_id=EW4OCTMIYD6NRPJ3OUAEPF5M72RQHECOGNCQ2VZEXX7HEIZTOBSA, seg_pos={0 0}, upload=171509]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: write tcp 188.166.225.170:37590->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:36:56.466376254 (195h5m41.928468737s) [seg_pos={0 0}, upload=171509]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Oct 1 16:36:56.632531166 (195h5m42.094623659s) [upload=171509]: Done uploading segments... Oct 1 16:36:56.632564439 (195h5m42.094656912s) [upload=171509]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 1m0.169804652s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 6 out of 60 is failed (threshold=3) [..................................................X..XX.XXX.] duration: 6.15574872s FAIL (2025-10-01 16:35:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== 1 16:34:25.180143608 (195h3m10.642236081s) [noise=true , address=185.167.204.206:4046 , piece_id=Y77FP2XMXGNRBABKHCQ3LFQVECO2JVEINDJMTM4SFU77PJFMJMDQ, seg_pos={0 0}, upload=171485]: Uploading piece... Oct 1 16:34:25.180178254 (195h3m10.642270727s) [noise=true , address=185.167.204.206:4068 , piece_id=WET7VMCW6SVWJRSZSTLT4IRXUGCKOVJ2JVAOXLTM625WT7H75GMQ, seg_pos={0 0}, upload=171485]: Uploading piece... Oct 1 16:34:25.180495149 (195h3m10.642587622s) [noise=true , address=185.167.204.206:4071 , piece_id=WJ54L77IWY2BQDAX335NQQ3LSWW3PBS3GIIQ2NDZFIEYD44OBQLQ, seg_pos={0 0}, upload=171485]: Uploading piece... Oct 1 16:34:25.180553118 (195h3m10.642645591s) [noise=true , address=185.167.204.205:4015 , piece_id=FZGUMGVAK65P2U6X2EEZ3QHIE5H4Q4W4WAXTMOB5J5O73LQ5XWHA, seg_pos={0 0}, upload=171485]: Uploading piece... Oct 1 16:34:25.180813284 (195h3m10.642905757s) [noise=true , address=81.171.14.70:4047 , piece_id=QEBE6KRF4TDEELJKGOM2F5GHACWFP4R3GPG2DLEFGBDWLYK76T4A, seg_pos={0 0}, upload=171485]: Uploading piece... Oct 1 16:34:25.180847269 (195h3m10.642939742s) [noise=true , address=81.171.14.70:4033 , piece_id=TVBTXHRBZRP5J5Y3E6D6FKAUP4KTKP6IXTCJ23GZAQSNICBE3QEA, seg_pos={0 0}, upload=171485]: Uploading piece... Oct 1 16:34:25.181143553 (195h3m10.643236026s) [noise=true , address=185.167.204.206:4062 , piece_id=7DAUEJG4QHGO3V5FYIRSREBO2SWRS6IXO3ROF6VNIGQJEPDAQPKQ, seg_pos={0 0}, upload=171485]: Uploading piece... Oct 1 16:34:25.181518437 (195h3m10.64361091s) [noise=true , address=185.167.204.205:4003 , piece_id=LLGAYYE53G6SVDFJIMH475QN4XXQOOZAU5UM4BNAJFZFSNIEWLFQ, seg_pos={0 0}, upload=171485]: Uploading piece... Oct 1 16:34:25.181885455 (195h3m10.643977928s) [noise=true , address=185.167.204.206:4069 , piece_id=4EEAUNFRDG744TNI7JFIC33UDDHY472XA2ZXU4B5KFUHW5BT6UHA, seg_pos={0 0}, upload=171485]: Uploading piece... Oct 1 16:34:25.182204804 (195h3m10.644297287s) [noise=true , address=185.167.204.205:4007 , piece_id=KUUVGMRZ7R465LPB4V6NWFXCUHH2RG4VTFKNQ6SNIIMQANS7XO5A, seg_pos={0 0}, upload=171485]: Uploading piece... Oct 1 16:34:25.182508031 (195h3m10.644600504s) [noise=true , address=81.171.14.70:4036 , piece_id=GB3AWZ5WBQMOTX2AECRMMQAKJ2TVMAW2DGYPPEUTCSN4CSHM6RXQ, seg_pos={0 0}, upload=171485]: Uploading piece... Oct 1 16:34:26.028753276 (195h3m11.490845759s) [upload=171485]: Next returned nil segment Oct 1 16:34:26.028776871 (195h3m11.490869344s) [upload=171485]: Waiting for error group managing segments... Oct 1 16:34:26.415476753 (195h3m11.877569226s) [noise=true , address=81.171.14.70:4045 , piece_id=UQF2PPK6J5LKRWAGFPY3JHRXWBODXHUYALZJT7DZWOJS7QJYQOWA, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.440775897 (195h3m11.90286838s) [noise=true , address=81.171.14.70:4046 , piece_id=CJLSEECYCDWCSBVDHA7YVTMOYFWN6R5EJVBEYTKJNBY2U545XDZQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.496702061 (195h3m11.958794545s) [noise=true , address=81.171.14.70:4047 , piece_id=QEBE6KRF4TDEELJKGOM2F5GHACWFP4R3GPG2DLEFGBDWLYK76T4A, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.515670310 (195h3m11.977762793s) [noise=true , address=89.149.201.147:4018 , piece_id=4DXB4WO7M3OCX5YVODFA7WB7VYWJATSS6MNV4XXNORRYPDVLFM7Q, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.884304432 (195h3m12.346396915s) [noise=true , address=81.171.14.70:4033 , piece_id=TVBTXHRBZRP5J5Y3E6D6FKAUP4KTKP6IXTCJ23GZAQSNICBE3QEA, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.905256378 (195h3m12.367348861s) [noise=true , address=81.171.14.70:4030 , piece_id=3EOHB6WAZ3DQFLUIWIID67TYC6H4SAVX4EAIRABVFIOC2MRZZ7XA, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.921492183 (195h3m12.383584666s) [noise=true , address=89.149.201.147:4010 , piece_id=APC4KYTWTBXI2RP2VFAWGUJI7SVXXKQECF4JVXZDVJMGDXT6IDAA, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.923688045 (195h3m12.385780528s) [noise=true , address=89.149.201.147:4019 , piece_id=NENNHJRMVDPPXMLGEAERBB5QCS4KZQAVTX5TT63AWPGC2O55MHAQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.931908228 (195h3m12.394000701s) [noise=true , address=81.171.14.70:4036 , piece_id=GB3AWZ5WBQMOTX2AECRMMQAKJ2TVMAW2DGYPPEUTCSN4CSHM6RXQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.937394585 (195h3m12.399487068s) [noise=true , address=89.149.201.147:4011 , piece_id=TLAAQQV5WLN7N3PR6MN47PSV5DCA55ME637BUP3FUTEYI3NEHPWQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.945083336 (195h3m12.407175819s) [noise=true , address=81.171.14.70:4041 , piece_id=UZO5BJIROGSB3WNGBUC4GXWVJKH7PGZCGMH6WQ7LACNRO7KAZCTQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.950022991 (195h3m12.412115474s) [noise=true , address=89.149.201.147:4023 , piece_id=D5WAMRB7CEX5KKDHOFMB6LJABWGACMKXGD4HF7C3E2IEDOIPMOQQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.972490394 (195h3m12.434582877s) [noise=true , address=81.171.14.70:4034 , piece_id=ZL5BO4DMA5IS3MOHYWOLFNJ7WC3QAUDQAAY6Q3NKZSD3M6GLFZIA, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:27.019524126 (195h3m12.481616599s) [noise=true , address=81.171.14.70:4044 , piece_id=KNBWCUBVZCJUCIU3BVGI7JUTITWVMQHSJVXG3LY65BGR2ZOI224Q, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:27.566168794 (195h3m13.028261267s) [noise=true , address=185.167.204.205:4015 , piece_id=FZGUMGVAK65P2U6X2EEZ3QHIE5H4Q4W4WAXTMOB5J5O73LQ5XWHA, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:27.574704908 (195h3m13.036797391s) [noise=true , address=185.167.204.206:4069 , piece_id=4EEAUNFRDG744TNI7JFIC33UDDHY472XA2ZXU4B5KFUHW5BT6UHA, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:27.575326011 (195h3m13.037418494s) [noise=true , address=185.167.204.206:4037 , piece_id=MZXWNKQ57VGTPTNQUEBX5FIZMUZKHGSDW5JHE726VTFLTNJVQUIQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:27.586495199 (195h3m13.048587683s) [noise=true , address=185.167.204.205:4007 , piece_id=KUUVGMRZ7R465LPB4V6NWFXCUHH2RG4VTFKNQ6SNIIMQANS7XO5A, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:27.594458684 (195h3m13.056551167s) [noise=true , address=185.167.204.206:4067 , piece_id=RNSR4J6CHUTKHVGRVODDQ576SHRKICNZI6CLLL4NYHQH5UZFEXBA, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:27.599073951 (195h3m13.061166434s) [noise=true , address=185.167.204.205:4016 , piece_id=GCQ464FTJWHZTXA2IAVOP6XNBCK4E24K3JA655QN274VCGZ7WLXA, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:27.627372848 (195h3m13.089465321s) [noise=true , address=185.167.204.205:4003 , piece_id=LLGAYYE53G6SVDFJIMH475QN4XXQOOZAU5UM4BNAJFZFSNIEWLFQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:27.666771050 (195h3m13.128863534s) [noise=true , address=185.167.204.206:4046 , piece_id=Y77FP2XMXGNRBABKHCQ3LFQVECO2JVEINDJMTM4SFU77PJFMJMDQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:27.697786088 (195h3m13.159878572s) [noise=true , address=185.167.204.206:4062 , piece_id=7DAUEJG4QHGO3V5FYIRSREBO2SWRS6IXO3ROF6VNIGQJEPDAQPKQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:27.747736684 (195h3m13.209829167s) [noise=true , address=185.167.204.205:4018 , piece_id=67NLXUAWEW5EN5M3APCYLZLCXYHEZOTCHTF7BEFNDWAWIEGKLUHA, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:35:24.518000162 (195h4m9.980092635s) [noise=true , address=185.167.204.205:4025 , piece_id=NFCPQROIMLTEMR3S3BJOZS6GZIUMNUSWHIWBNNFXEXV5UTII6DFQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:35:24.518053975 (195h4m9.980146448s) [noise=true , address=185.167.204.206:4071 , piece_id=WJ54L77IWY2BQDAX335NQQ3LSWW3PBS3GIIQ2NDZFIEYD44OBQLQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:35:24.518175376 (195h4m9.980267859s) [noise=true , address=185.167.204.206:4068 , piece_id=WET7VMCW6SVWJRSZSTLT4IRXUGCKOVJ2JVAOXLTM625WT7H75GMQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: write tcp 188.166.225.170:50894->185.167.204.206:4068: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:35:24.518223357 (195h4m9.980315831s) [noise=true , address=185.167.204.206:4057 , piece_id=FQZ4OL3DCR65AVZJYY5BVQ2BEQEPXXCM6BKQ6NFXDLOMNG5K6NFA, seg_pos={0 0}, upload=171485]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: write tcp 188.166.225.170:49424->185.167.204.206:4057: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:35:24.518263604 (195h4m9.980356077s) [seg_pos={0 0}, upload=171485]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:35:24.686424865 (195h4m10.148517358s) [upload=171485]: Done uploading segments... Oct 1 16:35:24.686459040 (195h4m10.148551523s) [upload=171485]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 6.155770631s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 6 out of 60 is failed (threshold=3) [...................................................X..XX.XXX] duration: 1m0.17135759s FAIL (2025-10-01 16:35:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== 1 16:34:25.180143608 (195h3m10.642236081s) [noise=true , address=185.167.204.206:4046 , piece_id=Y77FP2XMXGNRBABKHCQ3LFQVECO2JVEINDJMTM4SFU77PJFMJMDQ, seg_pos={0 0}, upload=171485]: Uploading piece... Oct 1 16:34:25.180178254 (195h3m10.642270727s) [noise=true , address=185.167.204.206:4068 , piece_id=WET7VMCW6SVWJRSZSTLT4IRXUGCKOVJ2JVAOXLTM625WT7H75GMQ, seg_pos={0 0}, upload=171485]: Uploading piece... Oct 1 16:34:25.180495149 (195h3m10.642587622s) [noise=true , address=185.167.204.206:4071 , piece_id=WJ54L77IWY2BQDAX335NQQ3LSWW3PBS3GIIQ2NDZFIEYD44OBQLQ, seg_pos={0 0}, upload=171485]: Uploading piece... Oct 1 16:34:25.180553118 (195h3m10.642645591s) [noise=true , address=185.167.204.205:4015 , piece_id=FZGUMGVAK65P2U6X2EEZ3QHIE5H4Q4W4WAXTMOB5J5O73LQ5XWHA, seg_pos={0 0}, upload=171485]: Uploading piece... Oct 1 16:34:25.180813284 (195h3m10.642905757s) [noise=true , address=81.171.14.70:4047 , piece_id=QEBE6KRF4TDEELJKGOM2F5GHACWFP4R3GPG2DLEFGBDWLYK76T4A, seg_pos={0 0}, upload=171485]: Uploading piece... Oct 1 16:34:25.180847269 (195h3m10.642939742s) [noise=true , address=81.171.14.70:4033 , piece_id=TVBTXHRBZRP5J5Y3E6D6FKAUP4KTKP6IXTCJ23GZAQSNICBE3QEA, seg_pos={0 0}, upload=171485]: Uploading piece... Oct 1 16:34:25.181143553 (195h3m10.643236026s) [noise=true , address=185.167.204.206:4062 , piece_id=7DAUEJG4QHGO3V5FYIRSREBO2SWRS6IXO3ROF6VNIGQJEPDAQPKQ, seg_pos={0 0}, upload=171485]: Uploading piece... Oct 1 16:34:25.181518437 (195h3m10.64361091s) [noise=true , address=185.167.204.205:4003 , piece_id=LLGAYYE53G6SVDFJIMH475QN4XXQOOZAU5UM4BNAJFZFSNIEWLFQ, seg_pos={0 0}, upload=171485]: Uploading piece... Oct 1 16:34:25.181885455 (195h3m10.643977928s) [noise=true , address=185.167.204.206:4069 , piece_id=4EEAUNFRDG744TNI7JFIC33UDDHY472XA2ZXU4B5KFUHW5BT6UHA, seg_pos={0 0}, upload=171485]: Uploading piece... Oct 1 16:34:25.182204804 (195h3m10.644297287s) [noise=true , address=185.167.204.205:4007 , piece_id=KUUVGMRZ7R465LPB4V6NWFXCUHH2RG4VTFKNQ6SNIIMQANS7XO5A, seg_pos={0 0}, upload=171485]: Uploading piece... Oct 1 16:34:25.182508031 (195h3m10.644600504s) [noise=true , address=81.171.14.70:4036 , piece_id=GB3AWZ5WBQMOTX2AECRMMQAKJ2TVMAW2DGYPPEUTCSN4CSHM6RXQ, seg_pos={0 0}, upload=171485]: Uploading piece... Oct 1 16:34:26.028753276 (195h3m11.490845759s) [upload=171485]: Next returned nil segment Oct 1 16:34:26.028776871 (195h3m11.490869344s) [upload=171485]: Waiting for error group managing segments... Oct 1 16:34:26.415476753 (195h3m11.877569226s) [noise=true , address=81.171.14.70:4045 , piece_id=UQF2PPK6J5LKRWAGFPY3JHRXWBODXHUYALZJT7DZWOJS7QJYQOWA, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.440775897 (195h3m11.90286838s) [noise=true , address=81.171.14.70:4046 , piece_id=CJLSEECYCDWCSBVDHA7YVTMOYFWN6R5EJVBEYTKJNBY2U545XDZQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.496702061 (195h3m11.958794545s) [noise=true , address=81.171.14.70:4047 , piece_id=QEBE6KRF4TDEELJKGOM2F5GHACWFP4R3GPG2DLEFGBDWLYK76T4A, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.515670310 (195h3m11.977762793s) [noise=true , address=89.149.201.147:4018 , piece_id=4DXB4WO7M3OCX5YVODFA7WB7VYWJATSS6MNV4XXNORRYPDVLFM7Q, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.884304432 (195h3m12.346396915s) [noise=true , address=81.171.14.70:4033 , piece_id=TVBTXHRBZRP5J5Y3E6D6FKAUP4KTKP6IXTCJ23GZAQSNICBE3QEA, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.905256378 (195h3m12.367348861s) [noise=true , address=81.171.14.70:4030 , piece_id=3EOHB6WAZ3DQFLUIWIID67TYC6H4SAVX4EAIRABVFIOC2MRZZ7XA, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.921492183 (195h3m12.383584666s) [noise=true , address=89.149.201.147:4010 , piece_id=APC4KYTWTBXI2RP2VFAWGUJI7SVXXKQECF4JVXZDVJMGDXT6IDAA, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.923688045 (195h3m12.385780528s) [noise=true , address=89.149.201.147:4019 , piece_id=NENNHJRMVDPPXMLGEAERBB5QCS4KZQAVTX5TT63AWPGC2O55MHAQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.931908228 (195h3m12.394000701s) [noise=true , address=81.171.14.70:4036 , piece_id=GB3AWZ5WBQMOTX2AECRMMQAKJ2TVMAW2DGYPPEUTCSN4CSHM6RXQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.937394585 (195h3m12.399487068s) [noise=true , address=89.149.201.147:4011 , piece_id=TLAAQQV5WLN7N3PR6MN47PSV5DCA55ME637BUP3FUTEYI3NEHPWQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.945083336 (195h3m12.407175819s) [noise=true , address=81.171.14.70:4041 , piece_id=UZO5BJIROGSB3WNGBUC4GXWVJKH7PGZCGMH6WQ7LACNRO7KAZCTQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.950022991 (195h3m12.412115474s) [noise=true , address=89.149.201.147:4023 , piece_id=D5WAMRB7CEX5KKDHOFMB6LJABWGACMKXGD4HF7C3E2IEDOIPMOQQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:26.972490394 (195h3m12.434582877s) [noise=true , address=81.171.14.70:4034 , piece_id=ZL5BO4DMA5IS3MOHYWOLFNJ7WC3QAUDQAAY6Q3NKZSD3M6GLFZIA, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:27.019524126 (195h3m12.481616599s) [noise=true , address=81.171.14.70:4044 , piece_id=KNBWCUBVZCJUCIU3BVGI7JUTITWVMQHSJVXG3LY65BGR2ZOI224Q, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:27.566168794 (195h3m13.028261267s) [noise=true , address=185.167.204.205:4015 , piece_id=FZGUMGVAK65P2U6X2EEZ3QHIE5H4Q4W4WAXTMOB5J5O73LQ5XWHA, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:27.574704908 (195h3m13.036797391s) [noise=true , address=185.167.204.206:4069 , piece_id=4EEAUNFRDG744TNI7JFIC33UDDHY472XA2ZXU4B5KFUHW5BT6UHA, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:27.575326011 (195h3m13.037418494s) [noise=true , address=185.167.204.206:4037 , piece_id=MZXWNKQ57VGTPTNQUEBX5FIZMUZKHGSDW5JHE726VTFLTNJVQUIQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:27.586495199 (195h3m13.048587683s) [noise=true , address=185.167.204.205:4007 , piece_id=KUUVGMRZ7R465LPB4V6NWFXCUHH2RG4VTFKNQ6SNIIMQANS7XO5A, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:27.594458684 (195h3m13.056551167s) [noise=true , address=185.167.204.206:4067 , piece_id=RNSR4J6CHUTKHVGRVODDQ576SHRKICNZI6CLLL4NYHQH5UZFEXBA, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:27.599073951 (195h3m13.061166434s) [noise=true , address=185.167.204.205:4016 , piece_id=GCQ464FTJWHZTXA2IAVOP6XNBCK4E24K3JA655QN274VCGZ7WLXA, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:27.627372848 (195h3m13.089465321s) [noise=true , address=185.167.204.205:4003 , piece_id=LLGAYYE53G6SVDFJIMH475QN4XXQOOZAU5UM4BNAJFZFSNIEWLFQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:27.666771050 (195h3m13.128863534s) [noise=true , address=185.167.204.206:4046 , piece_id=Y77FP2XMXGNRBABKHCQ3LFQVECO2JVEINDJMTM4SFU77PJFMJMDQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:27.697786088 (195h3m13.159878572s) [noise=true , address=185.167.204.206:4062 , piece_id=7DAUEJG4QHGO3V5FYIRSREBO2SWRS6IXO3ROF6VNIGQJEPDAQPKQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:34:27.747736684 (195h3m13.209829167s) [noise=true , address=185.167.204.205:4018 , piece_id=67NLXUAWEW5EN5M3APCYLZLCXYHEZOTCHTF7BEFNDWAWIEGKLUHA, seg_pos={0 0}, upload=171485]: Done uploading piece. err: <nil> Oct 1 16:35:24.518000162 (195h4m9.980092635s) [noise=true , address=185.167.204.205:4025 , piece_id=NFCPQROIMLTEMR3S3BJOZS6GZIUMNUSWHIWBNNFXEXV5UTII6DFQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:35:24.518053975 (195h4m9.980146448s) [noise=true , address=185.167.204.206:4071 , piece_id=WJ54L77IWY2BQDAX335NQQ3LSWW3PBS3GIIQ2NDZFIEYD44OBQLQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:35:24.518175376 (195h4m9.980267859s) [noise=true , address=185.167.204.206:4068 , piece_id=WET7VMCW6SVWJRSZSTLT4IRXUGCKOVJ2JVAOXLTM625WT7H75GMQ, seg_pos={0 0}, upload=171485]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: write tcp 188.166.225.170:50894->185.167.204.206:4068: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:35:24.518223357 (195h4m9.980315831s) [noise=true , address=185.167.204.206:4057 , piece_id=FQZ4OL3DCR65AVZJYY5BVQ2BEQEPXXCM6BKQ6NFXDLOMNG5K6NFA, seg_pos={0 0}, upload=171485]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: write tcp 188.166.225.170:49424->185.167.204.206:4057: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:35:24.518263604 (195h4m9.980356077s) [seg_pos={0 0}, upload=171485]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:35:24.686424865 (195h4m10.148517358s) [upload=171485]: Done uploading segments... Oct 1 16:35:24.686459040 (195h4m10.148551523s) [upload=171485]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 1m0.171374815s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [....................................................X..XX.XX] duration: 1m0.172711341s FAIL (2025-10-01 16:34:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== loading piece... Oct 1 16:33:24.814532899 (195h2m10.276625382s) [noise=true , address=89.149.201.147:4005 , piece_id=DPREVTLFULCWFZFBL3ILOBVZLTHQVMVPWFWZXN6UUMKAW3PNOUQQ, seg_pos={0 0}, upload=171474]: Uploading piece... Oct 1 16:33:24.814922160 (195h2m10.277014643s) [noise=true , address=185.167.204.205:4029 , piece_id=PPFKIBAQ3OTAXDNU2TMEKPHX6ZY4A2EA6CXQKERXTQP7KSAKQPCQ, seg_pos={0 0}, upload=171474]: Uploading piece... Oct 1 16:33:24.814967055 (195h2m10.277059538s) [noise=true , address=185.167.204.205:4014 , piece_id=7YVM7SY5FPBDBFYEQFEICX4FUZOJE2PZQEFZB5UGO6MQWVD7EC5Q, seg_pos={0 0}, upload=171474]: Uploading piece... Oct 1 16:33:24.815289388 (195h2m10.277381871s) [noise=true , address=185.167.204.205:4027 , piece_id=OMA62O3F73L537KNXMGREM6LZWDEU2LHOBFRTFD25ZE4WW6NVESA, seg_pos={0 0}, upload=171474]: Uploading piece... Oct 1 16:33:24.815355434 (195h2m10.277447917s) [noise=true , address=89.149.201.147:4006 , piece_id=72NDIS5MUKV67MY25JJQH2JC4ZLTJWUDSHSKUQLFC744WOXW4XLQ, seg_pos={0 0}, upload=171474]: Uploading piece... Oct 1 16:33:24.815706483 (195h2m10.277798966s) [noise=true , address=185.167.204.205:4015 , piece_id=CYC4FLXGGBZKB7HSAUT4TATAATRIPMJRNWTZ4XDPAAFLWRDYXBYA, seg_pos={0 0}, upload=171474]: Uploading piece... Oct 1 16:33:24.815768481 (195h2m10.277860954s) [noise=true , address=185.167.204.205:4019 , piece_id=RXZHWCJ2MIG7LPZS7VGBMWA2ROXHZO2HI5BJSDQG74B7BTTVUNFQ, seg_pos={0 0}, upload=171474]: Uploading piece... Oct 1 16:33:24.816099331 (195h2m10.278191804s) [noise=true , address=89.149.201.147:4021 , piece_id=CW6MQR5JAKRLI3BK66L2WYTVJKXXO44GRFB7RQGPHQHNZ7D2AFLQ, seg_pos={0 0}, upload=171474]: Uploading piece... Oct 1 16:33:24.816663195 (195h2m10.278755678s) [noise=true , address=185.167.204.205:4001 , piece_id=UH3ZIAXAX3LAJUOF47XOBE7TF52AVWS3ZF5OP4W6MN3ZT7EYZGAA, seg_pos={0 0}, upload=171474]: Uploading piece... Oct 1 16:33:24.817090859 (195h2m10.279183332s) [noise=true , address=185.167.204.206:4037 , piece_id=X5UJ5AWL3TU5XKGWM6ZMJWD4EDJCEFTRV3XJM6KHAMBASHIPL4VQ, seg_pos={0 0}, upload=171474]: Uploading piece... Oct 1 16:33:24.817498846 (195h2m10.279591319s) [noise=true , address=185.167.204.205:4025 , piece_id=5ACL6J7DRFU5TJ7G3K4ZLSHTBPNPGEYX4FTNCMMR62SVHMKG6W7Q, seg_pos={0 0}, upload=171474]: Uploading piece... Oct 1 16:33:25.648891528 (195h2m11.110984001s) [upload=171474]: Next returned nil segment Oct 1 16:33:25.648915775 (195h2m11.111008258s) [upload=171474]: Waiting for error group managing segments... Oct 1 16:33:26.073713852 (195h2m11.535806345s) [noise=true , address=81.171.14.70:4039 , piece_id=BN2GOETB7WC7JCIKLPKYSPUEN332JCL6U6TOJHTRZRPIPY6M7TGQ, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:26.097298863 (195h2m11.559391336s) [noise=true , address=81.171.14.70:4032 , piece_id=XUHULYOBIJB3RBIIIEXMDJFVALLZTXNRW5PTFAI3W7WTVW2I5NMA, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:26.111331494 (195h2m11.573423977s) [noise=true , address=81.171.14.70:4033 , piece_id=PSXHORN6RWDFJ2H5YWAH3IZECSSI2VGWMGORHMSTRGBRJU35WFYA, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:26.113638948 (195h2m11.575731431s) [noise=true , address=81.171.14.70:4040 , piece_id=YS4Z67QEWK43XFMZTTKYISDOSTHXWZ4DSM5FFJXNFRYIFD6ZFXDQ, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:26.124709438 (195h2m11.586801921s) [noise=true , address=81.171.14.70:4038 , piece_id=VSA6NG3Z2TJ5WAIXPJUESIWSNC5JP52H6KYYCLZVTM32PU7CHEMQ, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:26.150282714 (195h2m11.612375197s) [noise=true , address=89.149.201.147:4005 , piece_id=DPREVTLFULCWFZFBL3ILOBVZLTHQVMVPWFWZXN6UUMKAW3PNOUQQ, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:26.176749743 (195h2m11.638842226s) [noise=true , address=89.149.201.147:4020 , piece_id=VILYKNEM3VHGNAIQWUBXOANUJVW7K6KCHMRPZNLM2XM62RYSQIPA, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:26.189253563 (195h2m11.651346056s) [noise=true , address=89.149.201.147:4009 , piece_id=YWPVOMKAJLOS34NOX4SGGE4Y5ZWHRKEBKRVWAM6XGLYIW7LC25LQ, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:26.525321942 (195h2m11.987414425s) [noise=true , address=81.171.14.70:4047 , piece_id=WFJJFYCK6B5IE2WOEBACGJXYINNBXR2DSYAZESPVLBRUILAT6YGA, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:26.538403662 (195h2m12.000496135s) [noise=true , address=89.149.201.147:4018 , piece_id=VPAWTOW7UFMCRYDHHKWP325QKMW6JI3H3Y74M7GUSHGA5DKSQQ4Q, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:26.555073224 (195h2m12.017165707s) [noise=true , address=81.171.14.70:4026 , piece_id=4MSORKK4CY65TAUZ6D6UL5W6OBUBQH6XB6KQTPV67V7MSWM5XRPQ, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:26.577733394 (195h2m12.039825877s) [noise=true , address=89.149.201.147:4006 , piece_id=72NDIS5MUKV67MY25JJQH2JC4ZLTJWUDSHSKUQLFC744WOXW4XLQ, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:26.603289487 (195h2m12.06538196s) [noise=true , address=81.171.14.70:4042 , piece_id=2YXEI4P7AF4P3CBKI75JQJ5MNXDMZB4CBNBE5OAMW4CULQXYUK3Q, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:26.628106874 (195h2m12.090199347s) [noise=true , address=89.149.201.147:4021 , piece_id=CW6MQR5JAKRLI3BK66L2WYTVJKXXO44GRFB7RQGPHQHNZ7D2AFLQ, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:27.390055352 (195h2m12.852147835s) [noise=true , address=185.167.204.205:4015 , piece_id=CYC4FLXGGBZKB7HSAUT4TATAATRIPMJRNWTZ4XDPAAFLWRDYXBYA, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:27.390341406 (195h2m12.852433889s) [noise=true , address=185.167.204.205:4025 , piece_id=5ACL6J7DRFU5TJ7G3K4ZLSHTBPNPGEYX4FTNCMMR62SVHMKG6W7Q, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:27.391253553 (195h2m12.853346036s) [noise=true , address=185.167.204.205:4018 , piece_id=F3APYSKPIRSYKC7DGVYQDHTQEKFM5OEXUY2TBWOUQ6O5NUEVF37A, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:27.402868842 (195h2m12.864961325s) [noise=true , address=185.167.204.205:4019 , piece_id=RXZHWCJ2MIG7LPZS7VGBMWA2ROXHZO2HI5BJSDQG74B7BTTVUNFQ, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:27.410095071 (195h2m12.872187554s) [noise=true , address=185.167.204.206:4049 , piece_id=QXNYJVD2T2WEGOJ7USUYXIOWZ6SXO7HVPT773TLUGGOAEYS63SVA, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:27.427165847 (195h2m12.88925833s) [noise=true , address=185.167.204.206:4047 , piece_id=GYYY3GPZG5YQUC7NFGPMBXMJ3V7BNVVVVIP7FK572YVKJZ2UULCA, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:27.452738723 (195h2m12.914831196s) [noise=true , address=185.167.204.205:4027 , piece_id=OMA62O3F73L537KNXMGREM6LZWDEU2LHOBFRTFD25ZE4WW6NVESA, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:27.463261270 (195h2m12.925353753s) [noise=true , address=185.167.204.205:4014 , piece_id=7YVM7SY5FPBDBFYEQFEICX4FUZOJE2PZQEFZB5UGO6MQWVD7EC5Q, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:27.484750700 (195h2m12.946843173s) [noise=true , address=185.167.204.205:4001 , piece_id=UH3ZIAXAX3LAJUOF47XOBE7TF52AVWS3ZF5OP4W6MN3ZT7EYZGAA, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:33:27.577975538 (195h2m13.040068031s) [noise=true , address=185.167.204.205:4035 , piece_id=GLGDWCIAEZV5MHPH4S5O6XSSKQI2Q6ANVZPNPWUBMQDMXSYTOOLQ, seg_pos={0 0}, upload=171474]: Done uploading piece. err: <nil> Oct 1 16:34:24.150143889 (195h3m9.612236362s) [noise=true , address=185.167.204.206:4037 , piece_id=X5UJ5AWL3TU5XKGWM6ZMJWD4EDJCEFTRV3XJM6KHAMBASHIPL4VQ, seg_pos={0 0}, upload=171474]: Done uploading piece. err: ecclient: upload failed (node:12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, address:185.167.204.206:4037): protocol: write tcp 188.166.225.170:50574->185.167.204.206:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:34:24.150267034 (195h3m9.612359517s) [noise=true , address=185.167.204.205:4029 , piece_id=PPFKIBAQ3OTAXDNU2TMEKPHX6ZY4A2EA6CXQKERXTQP7KSAKQPCQ, seg_pos={0 0}, upload=171474]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:48604->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:34:24.150461203 (195h3m9.612553686s) [noise=true , address=185.167.204.206:4043 , piece_id=S75GQF6MIBW6OSDVJRQK7CUMVTNPEYRI2A2YSZAFO2TEDCAWJP5Q, seg_pos={0 0}, upload=171474]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:56202->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:34:24.150599386 (195h3m9.612691879s) [noise=true , address=185.167.204.205:4034 , piece_id=SZYB5YAX4D5JBKDJ32NB2QHPQSBSFTV44V52DGW3NBJR73LLQK5A, seg_pos={0 0}, upload=171474]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:34:24.150627480 (195h3m9.612719953s) [seg_pos={0 0}, upload=171474]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:34:24.320582207 (195h3m9.78267468s) [upload=171474]: Done uploading segments... Oct 1 16:34:24.320619648 (195h3m9.782712131s) [upload=171474]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 1m0.172727893s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.....................................................X..XX.X] duration: 1m0.170379098s FAIL (2025-10-01 16:33:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 62]: Uploading piece... Oct 1 16:32:24.439895905 (195h1m9.901988378s) [noise=true , address=185.167.204.206:4037 , piece_id=OFRPYAIV7Y5MPYUBB4QYOFX7JSJFL7TDVBB5CPLQDLABUP425VGA, seg_pos={0 0}, upload=171462]: Uploading piece... Oct 1 16:32:24.440199713 (195h1m9.902292196s) [noise=true , address=89.149.201.147:4011 , piece_id=APKO7JZIFKILUUSEDOEXY7C4TF472WLCX4W5YUBSWUTIHUTKFOFA, seg_pos={0 0}, upload=171462]: Uploading piece... Oct 1 16:32:24.440492972 (195h1m9.902585445s) [noise=true , address=81.171.14.70:4030 , piece_id=DROV4YFXGJ4MFWUHRCZ3TYTL6M6OLD6AASQ3MU6553SAEBUSJIYA, seg_pos={0 0}, upload=171462]: Uploading piece... Oct 1 16:32:24.442042212 (195h1m9.904134695s) [noise=true , address=185.167.204.205:4028 , piece_id=MIISBZTSYTGXHG5A23H7H63I74CBX7IVTO3CTOIJ6YANAKXKQMVQ, seg_pos={0 0}, upload=171462]: Uploading piece... Oct 1 16:32:24.442597900 (195h1m9.904690373s) [noise=true , address=81.171.14.70:4041 , piece_id=EXTKUW46XPRCJDJQHPTMYNKD2UJKPL2YW2VP3ZEBUGTTOITHWASQ, seg_pos={0 0}, upload=171462]: Uploading piece... Oct 1 16:32:24.443057625 (195h1m9.905150108s) [noise=true , address=185.167.204.205:4002 , piece_id=JILUKS7UKHSS75DFPPDH7AASAQGOUKKXTTT4DQQNACFSZCUYURPA, seg_pos={0 0}, upload=171462]: Uploading piece... Oct 1 16:32:24.443824596 (195h1m9.905917069s) [noise=true , address=185.167.204.206:4061 , piece_id=M25WOGXWGTX3EAWGNUQ44HQQM3WKOJHFNY2HETRC6QXAKUN6RNOQ, seg_pos={0 0}, upload=171462]: Uploading piece... Oct 1 16:32:24.444605684 (195h1m9.906698157s) [noise=true , address=185.167.204.206:4062 , piece_id=N2C3IC53CTI4N4DMO2W3E4YBIFEKROERAJU65ACS4S6UTKEXDGZQ, seg_pos={0 0}, upload=171462]: Uploading piece... Oct 1 16:32:24.445010764 (195h1m9.907103247s) [noise=true , address=89.149.201.147:4014 , piece_id=NEMRCA6JNW3S6GH6XXQ6QLHEZE7VLBGUKH52WUEJVG27DTLAMVPQ, seg_pos={0 0}, upload=171462]: Uploading piece... Oct 1 16:32:24.445485839 (195h1m9.907578322s) [noise=true , address=89.149.201.147:4022 , piece_id=GSSJSD4MD355V2UVQVNGKRG5RZY23ATNQ3KV25MH6VA3XPLYGKKA, seg_pos={0 0}, upload=171462]: Uploading piece... Oct 1 16:32:24.445954120 (195h1m9.908046604s) [noise=true , address=89.149.201.147:4010 , piece_id=7PY35C7IKPRZYN5G6QUQ7ERDXBBBAE367V6LCYQHD2ZNQ34QSMSA, seg_pos={0 0}, upload=171462]: Uploading piece... Oct 1 16:32:24.446522854 (195h1m9.908615327s) [noise=true , address=185.167.204.206:4055 , piece_id=TQJN7SJNQRVPAZWWE2LM4TC2DDP6Q43VQH6MJFPJJM25O2ELDIAA, seg_pos={0 0}, upload=171462]: Uploading piece... Oct 1 16:32:24.447228588 (195h1m9.909321071s) [noise=true , address=89.149.201.147:4016 , piece_id=QX6AIQNFXV7GJDDWERODZM7IDAS63PTH2TLD6KXXVYDAB77D3THQ, seg_pos={0 0}, upload=171462]: Uploading piece... Oct 1 16:32:25.274921877 (195h1m10.73701435s) [upload=171462]: Next returned nil segment Oct 1 16:32:25.274975288 (195h1m10.737067801s) [upload=171462]: Waiting for error group managing segments... Oct 1 16:32:25.696131191 (195h1m11.158223664s) [noise=true , address=81.171.14.70:4030 , piece_id=DROV4YFXGJ4MFWUHRCZ3TYTL6M6OLD6AASQ3MU6553SAEBUSJIYA, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:25.707498576 (195h1m11.169591059s) [noise=true , address=89.149.201.147:4005 , piece_id=5B6HVFA26RO4HPIEVZLFXF34H5LXRYCU2W3775BX7OQFZRQ2GTIQ, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:25.711729222 (195h1m11.173821695s) [noise=true , address=89.149.201.147:4011 , piece_id=APKO7JZIFKILUUSEDOEXY7C4TF472WLCX4W5YUBSWUTIHUTKFOFA, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:25.721364720 (195h1m11.183457203s) [noise=true , address=81.171.14.70:4032 , piece_id=P4D2GCMUTV4KJ7Z2ZDJHC4QZOLSGDQCV22TRFEJZUMFTOP3WCKYQ, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:25.725095864 (195h1m11.187188348s) [noise=true , address=81.171.14.70:4041 , piece_id=EXTKUW46XPRCJDJQHPTMYNKD2UJKPL2YW2VP3ZEBUGTTOITHWASQ, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:25.749180948 (195h1m11.211273421s) [noise=true , address=81.171.14.70:4025 , piece_id=ADNQD34QOUNTSML2JUQDB6SRA2O75WJMAOYWB6NHLSTNEDRPT3AQ, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:25.778224492 (195h1m11.240316975s) [noise=true , address=89.149.201.147:4022 , piece_id=GSSJSD4MD355V2UVQVNGKRG5RZY23ATNQ3KV25MH6VA3XPLYGKKA, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:25.781773590 (195h1m11.243866064s) [noise=true , address=89.149.201.147:4018 , piece_id=NIATW37CXWTZPRUABBOZGTBTXNOKHBDSV6SGLWSHHQFEAXSYLVJA, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:25.792265609 (195h1m11.254358092s) [noise=true , address=89.149.201.147:4010 , piece_id=7PY35C7IKPRZYN5G6QUQ7ERDXBBBAE367V6LCYQHD2ZNQ34QSMSA, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:26.129101150 (195h1m11.591193633s) [noise=true , address=81.171.14.70:4034 , piece_id=KW3GFKICIEXC36EU3ZFDLYW6UUUS73ITUXTKGH7W5B2PANY6WTVQ, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:26.194796385 (195h1m11.656888868s) [noise=true , address=81.171.14.70:4035 , piece_id=U4X4II2Y5UTYC7HZAVC2MWFS52P22DYTOBTIJVVQF46DHVKNRDHA, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:26.202665479 (195h1m11.664757952s) [noise=true , address=89.149.201.147:4014 , piece_id=NEMRCA6JNW3S6GH6XXQ6QLHEZE7VLBGUKH52WUEJVG27DTLAMVPQ, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:26.239619307 (195h1m11.70171178s) [noise=true , address=89.149.201.147:4016 , piece_id=QX6AIQNFXV7GJDDWERODZM7IDAS63PTH2TLD6KXXVYDAB77D3THQ, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:26.256833046 (195h1m11.718925519s) [noise=true , address=89.149.201.147:4012 , piece_id=PWZANICS26K6WTLYUPUCMWSR7LXN4H4EAGXCSFSDLQ7PGNNXKR2Q, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:26.657605895 (195h1m12.119698368s) [noise=true , address=185.167.204.205:4030 , piece_id=3WSUHEGDQSZ7TXO4OCCXBKKAPMR446RTKQ5RV4TRCEMGC5NLDWAQ, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:26.659319708 (195h1m12.121412181s) [noise=true , address=185.167.204.205:4026 , piece_id=WBRVPEOJISUWCIFTC4HBIC37FDM7FI3WPBSRATF4HJFJYN3N6CJA, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:26.661160693 (195h1m12.123253176s) [noise=true , address=185.167.204.206:4064 , piece_id=7NWCY5WQSM37Z56XEZ6K4YLWLZM7ZCWPQ2HQJUPDN3Z4H3YD3IVA, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:26.665159558 (195h1m12.127252031s) [noise=true , address=185.167.204.205:4033 , piece_id=CBGIDWTBMPULV6DLVW776BCJ6X2HDKCOOZIDVIPRBSSP7IMTGR4A, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:26.671630740 (195h1m12.133723213s) [noise=true , address=185.167.204.206:4056 , piece_id=HKDZEJP64RHE5BBTAKKENXUM275AV4WMAZN4KSBMNZ6TT7OAZHSA, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:26.672508311 (195h1m12.134600794s) [noise=true , address=185.167.204.206:4039 , piece_id=ZIM72TKD5WTOJQFYTRAYHXY64BRCTT6PFJGIOHVL2YYRKA67KUHQ, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:26.687692925 (195h1m12.149785398s) [noise=true , address=185.167.204.206:4062 , piece_id=N2C3IC53CTI4N4DMO2W3E4YBIFEKROERAJU65ACS4S6UTKEXDGZQ, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:26.725028029 (195h1m12.187120502s) [noise=true , address=185.167.204.205:4001 , piece_id=CQRYAOQUL2C3FLTRM4BDUVDYVUT5PWAVHXXCQQYMVGW66VGM6CRA, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:26.730962450 (195h1m12.193054933s) [noise=true , address=185.167.204.205:4002 , piece_id=JILUKS7UKHSS75DFPPDH7AASAQGOUKKXTTT4DQQNACFSZCUYURPA, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:26.742701302 (195h1m12.204793785s) [noise=true , address=185.167.204.206:4061 , piece_id=M25WOGXWGTX3EAWGNUQ44HQQM3WKOJHFNY2HETRC6QXAKUN6RNOQ, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:32:26.788257200 (195h1m12.250349673s) [noise=true , address=185.167.204.206:4037 , piece_id=OFRPYAIV7Y5MPYUBB4QYOFX7JSJFL7TDVBB5CPLQDLABUP425VGA, seg_pos={0 0}, upload=171462]: Done uploading piece. err: <nil> Oct 1 16:33:23.774613571 (195h2m9.236706044s) [noise=true , address=185.167.204.205:4018 , piece_id=P6TUPCSYOZKEQKLNTJZERNQI5ATDRSZJ7LAORYQI7CEDL6F2ZUTA, seg_pos={0 0}, upload=171462]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:33:23.774686530 (195h2m9.236779003s) [noise=true , address=185.167.204.206:4055 , piece_id=TQJN7SJNQRVPAZWWE2LM4TC2DDP6Q43VQH6MJFPJJM25O2ELDIAA, seg_pos={0 0}, upload=171462]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:33:23.774752245 (195h2m9.236844728s) [noise=true , address=185.167.204.205:4028 , piece_id=MIISBZTSYTGXHG5A23H7H63I74CBX7IVTO3CTOIJ6YANAKXKQMVQ, seg_pos={0 0}, upload=171462]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:33:23.774776943 (195h2m9.236869426s) [seg_pos={0 0}, upload=171462]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Oct 1 16:33:23.941911189 (195h2m9.404003682s) [upload=171462]: Done uploading segments... Oct 1 16:33:23.941944973 (195h2m9.404037446s) [upload=171462]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 1m0.170488406s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [......................................................X..XX.] duration: 5.843262677s FAIL (2025-10-01 16:32:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.296021302 (194h59m43.758113785s) [noise=true , address=89.149.201.147:4011 , piece_id=DBS2R6BONC7UZRGSETOAN76MNRT77KPRWDAIOF2TDLLGSB64EPHQ, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.297631288 (194h59m43.759723771s) [noise=true , address=185.167.204.206:4037 , piece_id=ELFBBVHHYECKDPFXN3WCLHDRATQZ4W5M6YUP77PUUTOY4Q5VPU7A, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.297961667 (194h59m43.760054161s) [noise=true , address=185.167.204.205:4016 , piece_id=LZCMNV72UT3DXT35WQDSFOYN7LGLFMPBZQPNEN5BWEHXQTXD4PSA, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.299867696 (194h59m43.761960179s) [noise=true , address=185.167.204.205:4021 , piece_id=VLBYPS7QCOBDV3HKUAMXXQSSTAOQ3EZBDNPYBGFLH34PM77IRFEA, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.300144974 (194h59m43.762237457s) [noise=true , address=81.171.14.70:4026 , piece_id=Y24C4APQB67MWDM6BDW4252RTYNGKXL5S6REGF7VY7ERI6JHND6Q, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.301885538 (194h59m43.763978021s) [noise=true , address=89.149.201.147:4010 , piece_id=THMIQRBHGNZ2CC5TBG3LFBUTOENCPMPKQ5KPPQTHR2FCPJOMHDPQ, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.302443591 (194h59m43.764536074s) [noise=true , address=89.149.201.147:4007 , piece_id=INQHJ26CWXSZMFXNDWWSS3EA2R66MXDH7XHA4YTR37QF7LSYO77Q, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.303900335 (194h59m43.765992818s) [noise=true , address=185.167.204.205:4010 , piece_id=Q7LG2J5X4LML3Z27XHMO2MTB6635GTKNDB5ZKVI3XBNNWHAUDIHA, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.305961810 (194h59m43.768054293s) [noise=true , address=81.171.14.70:4035 , piece_id=MR3OOJBBFLRZ7VVVN5PVD6ZGJOXB6CXUVPNVMBYJWOG7NA6XVAPQ, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.307910892 (194h59m43.770003375s) [noise=true , address=89.149.201.147:4001 , piece_id=J3EA6HXJYJFYLL57J5P6GGVFVVE52ENTSPFPF6BYGFZSCVUWULRA, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.313977093 (194h59m43.776069587s) [noise=true , address=185.167.204.205:4028 , piece_id=RNQME5AM5QS7W3B26F7L5BUFDETG6B363PWNGOXEHOLNYBOGLJAQ, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.332056941 (194h59m43.794149424s) [noise=true , address=89.149.201.147:4024 , piece_id=QKGPIHHQLAPPAKMILA2ZESC4T5P52S5TZAVPRNCLI546B3VPITWQ, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:59.157245990 (194h59m44.619338463s) [upload=171440]: Next returned nil segment Oct 1 16:30:59.157271058 (194h59m44.619363531s) [upload=171440]: Waiting for error group managing segments... Oct 1 16:30:59.553089894 (194h59m45.015182377s) [noise=true , address=81.171.14.70:4034 , piece_id=VGIN633T2VB3TDQGLHXRN3KUZPQVEJJFRUVEYFE244A4RQXQ5YEQ, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:30:59.571514648 (194h59m45.033607131s) [noise=true , address=81.171.14.70:4039 , piece_id=LX4GRLKRLIZ6RJ4AWU2F3YCBVBSAXNUFIMWDOCVDL7OR27MBF6SA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:30:59.614639266 (194h59m45.076731749s) [noise=true , address=81.171.14.70:4025 , piece_id=TXBJK5B3DB6IS6MDV5Z7F5CEQGXPBZNWPSMEY7UUAFOKD2E3MJMA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:30:59.618748611 (194h59m45.080841094s) [noise=true , address=89.149.201.147:4007 , piece_id=INQHJ26CWXSZMFXNDWWSS3EA2R66MXDH7XHA4YTR37QF7LSYO77Q, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:30:59.619521713 (194h59m45.081614196s) [noise=true , address=81.171.14.70:4035 , piece_id=MR3OOJBBFLRZ7VVVN5PVD6ZGJOXB6CXUVPNVMBYJWOG7NA6XVAPQ, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:30:59.619937705 (194h59m45.082030188s) [noise=true , address=89.149.201.147:4009 , piece_id=4W5RQCDSMW5AHDYEZ4555QCIMRTH3XYZDW3Z57CPBFSJJMLSHNVA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:30:59.666510519 (194h59m45.128603002s) [noise=true , address=89.149.201.147:4011 , piece_id=DBS2R6BONC7UZRGSETOAN76MNRT77KPRWDAIOF2TDLLGSB64EPHQ, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:30:59.685211880 (194h59m45.147304363s) [noise=true , address=89.149.201.147:4024 , piece_id=QKGPIHHQLAPPAKMILA2ZESC4T5P52S5TZAVPRNCLI546B3VPITWQ, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:30:59.688540908 (194h59m45.150633392s) [noise=true , address=89.149.201.147:4001 , piece_id=J3EA6HXJYJFYLL57J5P6GGVFVVE52ENTSPFPF6BYGFZSCVUWULRA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.038323974 (194h59m45.500416467s) [noise=true , address=81.171.14.70:4026 , piece_id=Y24C4APQB67MWDM6BDW4252RTYNGKXL5S6REGF7VY7ERI6JHND6Q, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.067023172 (194h59m45.529115656s) [noise=true , address=89.149.201.147:4015 , piece_id=EOBH2OITVOAFSQ7U6WQSPJI35C7FSNM5JQKBGUS2L3ASKADIY76A, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.071024291 (194h59m45.533116764s) [noise=true , address=89.149.201.147:4010 , piece_id=THMIQRBHGNZ2CC5TBG3LFBUTOENCPMPKQ5KPPQTHR2FCPJOMHDPQ, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.096708368 (194h59m45.558800841s) [noise=true , address=81.171.14.70:4046 , piece_id=T6YFBG2IOAUJDTP4NMWOZPVAYBSBTTGNRT3V5CNJ6BL5X7QBHG3Q, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.496126629 (194h59m45.958219112s) [noise=true , address=185.167.204.205:4015 , piece_id=LBYVDNNJJQR3MGALJ6E3H32SWOUKEJOQRV74NPFD2JKGESFUIFVQ, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.529238340 (194h59m45.991330823s) [noise=true , address=185.167.204.205:4023 , piece_id=67M2PNL3DXNULA4QBU7ZAN4PAARR6QTZDDJPPIPWM5QPXNSF4F3A, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.529467937 (194h59m45.99156041s) [noise=true , address=185.167.204.205:4003 , piece_id=XK4BUAEXQ3H65GH2PY22RL47SM6HSGPE6IC5Y6WUJ2VMQEXGCMPA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.558440957 (194h59m46.02053344s) [noise=true , address=185.167.204.205:4034 , piece_id=YZFJKXYH6PIESHUU3KZOFGN54QP2KJDZSDB7JDLJSGFOZXGE6COA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.602370167 (194h59m46.06446265s) [noise=true , address=185.167.204.205:4029 , piece_id=QGLAUP6E6JKOCMB33WF7PNUZMMKF2RIQSPNZNVHCHTJPSE53R5TA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.615192884 (194h59m46.077285367s) [noise=true , address=185.167.204.205:4001 , piece_id=7Z4F4XQP6YM4NQRC5LAL7JIKAAHCKOX6BA5Z3IJVJKG5DA3YIMYQ, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.621979717 (194h59m46.0840722s) [noise=true , address=185.167.204.205:4010 , piece_id=Q7LG2J5X4LML3Z27XHMO2MTB6635GTKNDB5ZKVI3XBNNWHAUDIHA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.654792389 (194h59m46.116884872s) [noise=true , address=185.167.204.205:4021 , piece_id=VLBYPS7QCOBDV3HKUAMXXQSSTAOQ3EZBDNPYBGFLH34PM77IRFEA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.655998927 (194h59m46.11809141s) [noise=true , address=185.167.204.206:4053 , piece_id=E2UFU4JA6JGKXDTSIR4SJTIZULFS7KGESYVPBAG6MZHNW5JG722Q, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.672017739 (194h59m46.134110212s) [noise=true , address=185.167.204.205:4033 , piece_id=D26MDFWBWQ7U35KZBP676XLAZUGLEO6FMLFJ66JVAE7K7YB5YLLQ, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.730314047 (194h59m46.19240653s) [noise=true , address=185.167.204.205:4036 , piece_id=J4KSOF6XWSTMUBOOQNMPGWAAUAX27SSKVTM2HHU77CKQNXSYOAZA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.933488180 (194h59m46.395580653s) [noise=true , address=185.167.204.205:4016 , piece_id=LZCMNV72UT3DXT35WQDSFOYN7LGLFMPBZQPNEN5BWEHXQTXD4PSA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:57.612850907 (195h0m43.07494338s) [noise=true , address=185.167.204.205:4028 , piece_id=RNQME5AM5QS7W3B26F7L5BUFDETG6B363PWNGOXEHOLNYBOGLJAQ, seg_pos={0 0}, upload=171440]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: write tcp 188.166.225.170:49716->185.167.204.205:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:31:57.612880934 (195h0m43.074973427s) [noise=true , address=185.167.204.206:4066 , piece_id=EBXO4QBMLYB25LIDZDQDVGM3XVF5OLOHLLNSAS3BWXZ7CRS42ZHA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: write tcp 188.166.225.170:49352->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:31:57.612968631 (195h0m43.075061114s) [noise=true , address=185.167.204.206:4037 , piece_id=ELFBBVHHYECKDPFXN3WCLHDRATQZ4W5M6YUP77PUUTOY4Q5VPU7A, seg_pos={0 0}, upload=171440]: Done uploading piece. err: ecclient: upload failed (node:12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, address:185.167.204.206:4037): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:31:57.612993038 (195h0m43.075085511s) [seg_pos={0 0}, upload=171440]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Oct 1 16:31:57.780990968 (195h0m43.243083461s) [upload=171440]: Done uploading segments... Oct 1 16:31:57.781028088 (195h0m43.243120561s) [upload=171440]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.843284567s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.......................................................X..XX] duration: 1m0.170718422s FAIL (2025-10-01 16:31:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.296021302 (194h59m43.758113785s) [noise=true , address=89.149.201.147:4011 , piece_id=DBS2R6BONC7UZRGSETOAN76MNRT77KPRWDAIOF2TDLLGSB64EPHQ, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.297631288 (194h59m43.759723771s) [noise=true , address=185.167.204.206:4037 , piece_id=ELFBBVHHYECKDPFXN3WCLHDRATQZ4W5M6YUP77PUUTOY4Q5VPU7A, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.297961667 (194h59m43.760054161s) [noise=true , address=185.167.204.205:4016 , piece_id=LZCMNV72UT3DXT35WQDSFOYN7LGLFMPBZQPNEN5BWEHXQTXD4PSA, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.299867696 (194h59m43.761960179s) [noise=true , address=185.167.204.205:4021 , piece_id=VLBYPS7QCOBDV3HKUAMXXQSSTAOQ3EZBDNPYBGFLH34PM77IRFEA, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.300144974 (194h59m43.762237457s) [noise=true , address=81.171.14.70:4026 , piece_id=Y24C4APQB67MWDM6BDW4252RTYNGKXL5S6REGF7VY7ERI6JHND6Q, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.301885538 (194h59m43.763978021s) [noise=true , address=89.149.201.147:4010 , piece_id=THMIQRBHGNZ2CC5TBG3LFBUTOENCPMPKQ5KPPQTHR2FCPJOMHDPQ, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.302443591 (194h59m43.764536074s) [noise=true , address=89.149.201.147:4007 , piece_id=INQHJ26CWXSZMFXNDWWSS3EA2R66MXDH7XHA4YTR37QF7LSYO77Q, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.303900335 (194h59m43.765992818s) [noise=true , address=185.167.204.205:4010 , piece_id=Q7LG2J5X4LML3Z27XHMO2MTB6635GTKNDB5ZKVI3XBNNWHAUDIHA, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.305961810 (194h59m43.768054293s) [noise=true , address=81.171.14.70:4035 , piece_id=MR3OOJBBFLRZ7VVVN5PVD6ZGJOXB6CXUVPNVMBYJWOG7NA6XVAPQ, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.307910892 (194h59m43.770003375s) [noise=true , address=89.149.201.147:4001 , piece_id=J3EA6HXJYJFYLL57J5P6GGVFVVE52ENTSPFPF6BYGFZSCVUWULRA, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.313977093 (194h59m43.776069587s) [noise=true , address=185.167.204.205:4028 , piece_id=RNQME5AM5QS7W3B26F7L5BUFDETG6B363PWNGOXEHOLNYBOGLJAQ, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:58.332056941 (194h59m43.794149424s) [noise=true , address=89.149.201.147:4024 , piece_id=QKGPIHHQLAPPAKMILA2ZESC4T5P52S5TZAVPRNCLI546B3VPITWQ, seg_pos={0 0}, upload=171440]: Uploading piece... Oct 1 16:30:59.157245990 (194h59m44.619338463s) [upload=171440]: Next returned nil segment Oct 1 16:30:59.157271058 (194h59m44.619363531s) [upload=171440]: Waiting for error group managing segments... Oct 1 16:30:59.553089894 (194h59m45.015182377s) [noise=true , address=81.171.14.70:4034 , piece_id=VGIN633T2VB3TDQGLHXRN3KUZPQVEJJFRUVEYFE244A4RQXQ5YEQ, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:30:59.571514648 (194h59m45.033607131s) [noise=true , address=81.171.14.70:4039 , piece_id=LX4GRLKRLIZ6RJ4AWU2F3YCBVBSAXNUFIMWDOCVDL7OR27MBF6SA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:30:59.614639266 (194h59m45.076731749s) [noise=true , address=81.171.14.70:4025 , piece_id=TXBJK5B3DB6IS6MDV5Z7F5CEQGXPBZNWPSMEY7UUAFOKD2E3MJMA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:30:59.618748611 (194h59m45.080841094s) [noise=true , address=89.149.201.147:4007 , piece_id=INQHJ26CWXSZMFXNDWWSS3EA2R66MXDH7XHA4YTR37QF7LSYO77Q, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:30:59.619521713 (194h59m45.081614196s) [noise=true , address=81.171.14.70:4035 , piece_id=MR3OOJBBFLRZ7VVVN5PVD6ZGJOXB6CXUVPNVMBYJWOG7NA6XVAPQ, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:30:59.619937705 (194h59m45.082030188s) [noise=true , address=89.149.201.147:4009 , piece_id=4W5RQCDSMW5AHDYEZ4555QCIMRTH3XYZDW3Z57CPBFSJJMLSHNVA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:30:59.666510519 (194h59m45.128603002s) [noise=true , address=89.149.201.147:4011 , piece_id=DBS2R6BONC7UZRGSETOAN76MNRT77KPRWDAIOF2TDLLGSB64EPHQ, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:30:59.685211880 (194h59m45.147304363s) [noise=true , address=89.149.201.147:4024 , piece_id=QKGPIHHQLAPPAKMILA2ZESC4T5P52S5TZAVPRNCLI546B3VPITWQ, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:30:59.688540908 (194h59m45.150633392s) [noise=true , address=89.149.201.147:4001 , piece_id=J3EA6HXJYJFYLL57J5P6GGVFVVE52ENTSPFPF6BYGFZSCVUWULRA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.038323974 (194h59m45.500416467s) [noise=true , address=81.171.14.70:4026 , piece_id=Y24C4APQB67MWDM6BDW4252RTYNGKXL5S6REGF7VY7ERI6JHND6Q, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.067023172 (194h59m45.529115656s) [noise=true , address=89.149.201.147:4015 , piece_id=EOBH2OITVOAFSQ7U6WQSPJI35C7FSNM5JQKBGUS2L3ASKADIY76A, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.071024291 (194h59m45.533116764s) [noise=true , address=89.149.201.147:4010 , piece_id=THMIQRBHGNZ2CC5TBG3LFBUTOENCPMPKQ5KPPQTHR2FCPJOMHDPQ, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.096708368 (194h59m45.558800841s) [noise=true , address=81.171.14.70:4046 , piece_id=T6YFBG2IOAUJDTP4NMWOZPVAYBSBTTGNRT3V5CNJ6BL5X7QBHG3Q, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.496126629 (194h59m45.958219112s) [noise=true , address=185.167.204.205:4015 , piece_id=LBYVDNNJJQR3MGALJ6E3H32SWOUKEJOQRV74NPFD2JKGESFUIFVQ, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.529238340 (194h59m45.991330823s) [noise=true , address=185.167.204.205:4023 , piece_id=67M2PNL3DXNULA4QBU7ZAN4PAARR6QTZDDJPPIPWM5QPXNSF4F3A, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.529467937 (194h59m45.99156041s) [noise=true , address=185.167.204.205:4003 , piece_id=XK4BUAEXQ3H65GH2PY22RL47SM6HSGPE6IC5Y6WUJ2VMQEXGCMPA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.558440957 (194h59m46.02053344s) [noise=true , address=185.167.204.205:4034 , piece_id=YZFJKXYH6PIESHUU3KZOFGN54QP2KJDZSDB7JDLJSGFOZXGE6COA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.602370167 (194h59m46.06446265s) [noise=true , address=185.167.204.205:4029 , piece_id=QGLAUP6E6JKOCMB33WF7PNUZMMKF2RIQSPNZNVHCHTJPSE53R5TA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.615192884 (194h59m46.077285367s) [noise=true , address=185.167.204.205:4001 , piece_id=7Z4F4XQP6YM4NQRC5LAL7JIKAAHCKOX6BA5Z3IJVJKG5DA3YIMYQ, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.621979717 (194h59m46.0840722s) [noise=true , address=185.167.204.205:4010 , piece_id=Q7LG2J5X4LML3Z27XHMO2MTB6635GTKNDB5ZKVI3XBNNWHAUDIHA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.654792389 (194h59m46.116884872s) [noise=true , address=185.167.204.205:4021 , piece_id=VLBYPS7QCOBDV3HKUAMXXQSSTAOQ3EZBDNPYBGFLH34PM77IRFEA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.655998927 (194h59m46.11809141s) [noise=true , address=185.167.204.206:4053 , piece_id=E2UFU4JA6JGKXDTSIR4SJTIZULFS7KGESYVPBAG6MZHNW5JG722Q, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.672017739 (194h59m46.134110212s) [noise=true , address=185.167.204.205:4033 , piece_id=D26MDFWBWQ7U35KZBP676XLAZUGLEO6FMLFJ66JVAE7K7YB5YLLQ, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.730314047 (194h59m46.19240653s) [noise=true , address=185.167.204.205:4036 , piece_id=J4KSOF6XWSTMUBOOQNMPGWAAUAX27SSKVTM2HHU77CKQNXSYOAZA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:00.933488180 (194h59m46.395580653s) [noise=true , address=185.167.204.205:4016 , piece_id=LZCMNV72UT3DXT35WQDSFOYN7LGLFMPBZQPNEN5BWEHXQTXD4PSA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: <nil> Oct 1 16:31:57.612850907 (195h0m43.07494338s) [noise=true , address=185.167.204.205:4028 , piece_id=RNQME5AM5QS7W3B26F7L5BUFDETG6B363PWNGOXEHOLNYBOGLJAQ, seg_pos={0 0}, upload=171440]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: write tcp 188.166.225.170:49716->185.167.204.205:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:31:57.612880934 (195h0m43.074973427s) [noise=true , address=185.167.204.206:4066 , piece_id=EBXO4QBMLYB25LIDZDQDVGM3XVF5OLOHLLNSAS3BWXZ7CRS42ZHA, seg_pos={0 0}, upload=171440]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: write tcp 188.166.225.170:49352->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:31:57.612968631 (195h0m43.075061114s) [noise=true , address=185.167.204.206:4037 , piece_id=ELFBBVHHYECKDPFXN3WCLHDRATQZ4W5M6YUP77PUUTOY4Q5VPU7A, seg_pos={0 0}, upload=171440]: Done uploading piece. err: ecclient: upload failed (node:12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, address:185.167.204.206:4037): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:31:57.612993038 (195h0m43.075085511s) [seg_pos={0 0}, upload=171440]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Oct 1 16:31:57.780990968 (195h0m43.243083461s) [upload=171440]: Done uploading segments... Oct 1 16:31:57.781028088 (195h0m43.243120561s) [upload=171440]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 1m0.170738571s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [........................................................X..X] duration: 1m0.170242186s FAIL (2025-10-01 16:30:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 16:29:57.906904628 (194h58m43.368997122s) [noise=true , address=81.171.14.70:4035 , piece_id=SDGFJCDXQQ5Y4YZCVOPJX7CWD2M7YEJOG37RPZYF73LIVKDDUVQQ, seg_pos={0 0}, upload=171425]: Uploading piece... Oct 1 16:29:57.908526957 (194h58m43.37061943s) [noise=true , address=81.171.14.70:4033 , piece_id=53KYTWT6RC6QEXDP7L2BRPPWUBCZQ2IXCQJ5D6UXNZBIRTYMF5ZQ, seg_pos={0 0}, upload=171425]: Uploading piece... Oct 1 16:29:57.910978275 (194h58m43.373070758s) [noise=true , address=185.167.204.205:4019 , piece_id=DT7VU6JIQLEZSFWA7GKK3JXCHHCBVH3AVQRK5W7OKROU3PHAXPQQ, seg_pos={0 0}, upload=171425]: Uploading piece... Oct 1 16:29:57.912327714 (194h58m43.374420197s) [noise=true , address=185.167.204.206:4040 , piece_id=WQECS7VH3HEE4LEHWFW5KGRY3MGYORAJJWBGF64YH73ASI6V6VVQ, seg_pos={0 0}, upload=171425]: Uploading piece... Oct 1 16:29:57.913951446 (194h58m43.376043919s) [noise=true , address=185.167.204.205:4024 , piece_id=ZBYJ7OKQF6QRAFEIYOUHSXJTR3BOBKUNKZCT5QEW4KX2NDQD7KJA, seg_pos={0 0}, upload=171425]: Uploading piece... Oct 1 16:29:57.915242124 (194h58m43.377334607s) [noise=true , address=81.171.14.70:4032 , piece_id=4SS6UC6IE63TVNJPXQ2KA3TK4HO6LEUOIP6S3BHI4IGJIDRMWZXA, seg_pos={0 0}, upload=171425]: Uploading piece... Oct 1 16:29:58.752805527 (194h58m44.21489802s) [upload=171425]: Next returned nil segment Oct 1 16:29:58.752881963 (194h58m44.214974446s) [upload=171425]: Waiting for error group managing segments... Oct 1 16:29:59.114545110 (194h58m44.576637593s) [noise=true , address=81.171.14.70:4046 , piece_id=RYHCGKVADGKQBJ5DYQZD5YTVHFD4H3F4QHSD5IKXWEE4AVLOCORQ, seg_pos={0 0}, upload=171425]: Done uploading piece. err: <nil> Oct 1 16:29:59.123528786 (194h58m44.585621259s) [noise=true , address=81.171.14.70:4034 , piece_id=63APN7JA6MTHZABFN7HTKXU5EKWT6C3W3D7PEW5GLPMNK7OJ5EPQ, seg_pos={0 0}, upload=171425]: Done uploading piece. err: <nil> Oct 1 16:29:59.132881476 (194h58m44.594973959s) [noise=true , address=81.171.14.70:4030 , piece_id=6DS5QJLNJRL5PK4QIBZHLF3IQX57LXYL4XAUI3J2XCPUH7EP47LQ, seg_pos={0 0}, upload=171425]: Done uploading piece. err: <nil> Oct 1 16:29:59.136839082 (194h58m44.598931555s) [noise=true , address=81.171.14.70:4039 , piece_id=TMR4OOS6NWE4DNGY25KRLCGYY4C5QZ7WQAKPX7DJCQ7ZVDAAEWPQ, seg_pos={0 0}, upload=171425]: Done uploading piece. err: <nil> Oct 1 16:29:59.149431560 (194h58m44.611524043s) [noise=true , address=81.171.14.70:4035 , piece_id=SDGFJCDXQQ5Y4YZCVOPJX7CWD2M7YEJOG37RPZYF73LIVKDDUVQQ, seg_pos={0 0}, upload=171425]: Done uploading piece. err: <nil> Oct 1 16:29:59.199701284 (194h58m44.661793757s) [noise=true , address=89.149.201.147:4008 , piece_id=5NNMTXFO4ZBR462KC2ZSMPG7XNXEJ3MRKBDCY4D5V4XWPZMHFKKA, seg_pos={0 0}, upload=171425]: Done uploading piece. err: <nil> Oct 1 16:29:59.203184145 (194h58m44.665276619s) [noise=true , address=89.149.201.147:4019 , piece_id=CO6OVOPZY3DUIAPEOXW2MSIQ3UASPVYUGH7E2KSCZQQBAABDCSTQ, seg_pos={0 0}, upload=171425]: Done uploading piece. err: <nil> Oct 1 16:29:59.203703094 (194h58m44.665795577s) [noise=true , address=89.149.201.147:4005 , piece_id=VH4NSDEF45UECWAITM67PIU4KPVLUOJQPFPHWAESFUOC3U2IUFYQ, seg_pos={0 0}, upload=171425]: Done uploading piece. err: <nil> Oct 1 16:29:59.218699840 (194h58m44.680792313s) [noise=true , address=81.171.14.70:4033 , piece_id=53KYTWT6RC6QEXDP7L2BRPPWUBCZQ2IXCQJ5D6UXNZBIRTYMF5ZQ, seg_pos={0 0}, upload=171425]: Done uploading piece. err: <nil> Oct 1 16:29:59.228866279 (194h58m44.690958772s) [noise=true , address=89.149.201.147:4003 , piece_id=WUC7XTFR3BFAP7T7UNZP7XU3FOUI7UXLZMRVVOVYTAZGQEDVJCYA, seg_pos={0 0}, upload=171425]: Done uploading piece. err: <nil> Oct 1 16:29:59.695612663 (194h58m45.157705147s) [noise=true , address=81.171.14.70:4032 , piece_id=4SS6UC6IE63TVNJPXQ2KA3TK4HO6LEUOIP6S3BHI4IGJIDRMWZXA, seg_pos={0 0}, upload=171425]: Done uploading piece. err: <nil> Oct 1 16:29:59.697744403 (194h58m45.159836907s) [noise=true , address=89.149.201.147:4013 , piece_id=6UNVB567PFBNEMTZC5UUXVGHDZRYY2Z3K634LWSDIN5XAQYEG5WQ, seg_pos={0 0}, upload=171425]: Done uploading piece. err: <nil> Oct 1 16:29:59.746256760 (194h58m45.208349243s) [noise=true , address=89.149.201.147:4007 , piece_id=NTVSJXLDZWMXXTHUV2N7R35VYHGMIQUUJINQWPYZJAGNTOPYTUDA, seg_pos={0 0}, upload=171425]: Done uploading piece. err: <nil> Oct 1 16:30:00.188334112 (194h58m45.650426595s) [noise=true , address=185.167.204.205:4004 , piece_id=BMDI6ENAYHWXRJ7P4S456QYER5RFIGHMXOAZCRQGPXIGOXKEMJZA, seg_pos={0 0}, upload=171425]: Done uploading piece. err: <nil> Oct 1 16:30:00.193914708 (194h58m45.656007181s) [noise=true , address=185.167.204.205:4020 , piece_id=Q7I7PL3BVAK4N6YUETCEBIGWSIQ34WHE3F2NUCMLBR5WEOWHQQRA, seg_pos={0 0}, upload=171425]: Done uploading piece. err: <nil> Oct 1 16:30:00.203401874 (194h58m45.665494347s) [noise=true , address=185.167.204.206:4043 , piece_id=USE4TIRZKITMH4W5TTKU4L7ESJN7IBZXRDB5GM4PK6VL6YRAAJQA, seg_pos={0 0}, upload=171425]: Done uploading piece. err: <nil> Oct 1 16:30:00.216160909 (194h58m45.678253383s) [noise=true , address=185.167.204.205:4022 , piece_id=EAQVMYWX3WPGQDMPGGV2V43Q2PUEZJFFWQAHAJZPBCJ344GPILPA, seg_pos={0 0}, upload=171425]: Done uploading piece. err: <nil> Oct 1 16:30:00.233758408 (194h58m45.695850881s) [noise=true , address=185.167.204.206:4041 , piece_id=Z5NYKSWG62ZZ63G2N4BDEOHPKUDTRP4G2UR5FMNQ2Y72VSO7BXJA, seg_pos={0 0}, upload=171425]: Done uploading piece. err: <nil> Oct 1 16:30:00.248023672 (194h58m45.710116155s) [noise=true , address=185.167.204.205:4019 , piece_id=DT7VU6JIQLEZSFWA7GKK3JXCHHCBVH3AVQRK5W7OKROU3PHAXPQQ, seg_pos={0 0}, upload=171425]: Done uploading piece. err: <nil> Oct 1 16:30:00.319048528 (194h58m45.781141011s) [noise=true , address=185.167.204.205:4012 , piece_id=SP45AM62EGOHXDWIXRKIBBECPI6GF4S6I347RWPYINJNDS5J5SLA, seg_pos={0 0}, upload=171425]: Done uploading piece. err: <nil> Oct 1 16:30:57.225497107 (194h59m42.68758959s) [noise=true , address=185.167.204.205:4016 , piece_id=HVHGYW43YVXKMC67YMCR6SMV7HWG2A7BCEEYO5HTFJM4HXMYPJEQ, seg_pos={0 0}, upload=171425]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: write tcp 188.166.225.170:48036->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:30:57.225585255 (194h59m42.687677728s) [noise=true , address=185.167.204.205:4024 , piece_id=ZBYJ7OKQF6QRAFEIYOUHSXJTR3BOBKUNKZCT5QEW4KX2NDQD7KJA, seg_pos={0 0}, upload=171425]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 188.166.225.170:59492->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:30:57.225651881 (194h59m42.687744355s) [noise=true , address=185.167.204.206:4038 , piece_id=AQ33QQMWQTETJ55FX2H73AYJYPBDJNL347NOKWHWTN7M4IS2IGLQ, seg_pos={0 0}, upload=171425]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: rpc: dial tcp 185.167.204.206:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:30:57.225704582 (194h59m42.687797065s) [noise=true , address=185.167.204.205:4033 , piece_id=CY5HHVPZZOVFI277D6LEFSZCMTHWDHKJQWGWNGVPXWDJ23TW26TA, seg_pos={0 0}, upload=171425]: Done uploading piece. err: ecclient: upload failed (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, address:185.167.204.205:4033): protocol: write tcp 188.166.225.170:57262->185.167.204.205:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:30:57.225775056 (194h59m42.68786754s) [noise=true , address=185.167.204.205:4032 , piece_id=PY5TALHANM3KZKFDQUDSLFWHNH2FN7CC2B2WAGELSY5TISWX7ESQ, seg_pos={0 0}, upload=171425]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: write tcp 188.166.225.170:39106->185.167.204.205:4032: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:30:57.225852404 (194h59m42.687944887s) [noise=true , address=185.167.204.205:4008 , piece_id=OE2QDYW57VSBKXYMWSZSMYSBT3G5GQYIKW4CWFXI5PVUUPVPZDAA, seg_pos={0 0}, upload=171425]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded Oct 1 16:30:57.225911086 (194h59m42.688003569s) [noise=true , address=185.167.204.206:4040 , piece_id=WQECS7VH3HEE4LEHWFW5KGRY3MGYORAJJWBGF64YH73ASI6V6VVQ, seg_pos={0 0}, upload=171425]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:60088->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:30:57.225980358 (194h59m42.688072831s) [noise=true , address=185.167.204.205:4026 , piece_id=GMKMSFVLWZZW3BIWQUIGORG4UW75CMRIUCLM55UECS6TDELN6PTQ, seg_pos={0 0}, upload=171425]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:30:57.226003521 (194h59m42.688096004s) [seg_pos={0 0}, upload=171425]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Oct 1 16:30:57.393670604 (194h59m42.855763087s) [upload=171425]: Done uploading segments... Oct 1 16:30:57.393705480 (194h59m42.855797963s) [upload=171425]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 1m0.170268627s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.211226001s FAIL (2025-10-01 16:29:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== oise=true , address=185.167.204.205:4009 , piece_id=KES7GDUHYADJYWX3UOMHON4V2AO7BLQZ7ULMQ4V5GONYGYOWLF5Q, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.791002394 (194h56m0.253094877s) [noise=true , address=89.149.201.147:4015 , piece_id=J5URNNLS3LZ7IXVWRSD5CHO2XOY6XSCG5V5C6DCPWGTOXM5OU2OA, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.791433054 (194h56m0.253525527s) [noise=true , address=81.171.14.70:4041 , piece_id=6EXFVMCWLDYXQIAGLN6QZMZYRRNODCTUZHFDGAPJGNSPIY53SMBQ, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.791862021 (194h56m0.253954504s) [noise=true , address=185.167.204.205:4005 , piece_id=Q2HECJ3RQ25RS2LP2L27MLE24ZLPFMSHONGDBV2NNTVQSIBV55IA, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.791916264 (194h56m0.254008747s) [noise=true , address=81.171.14.70:4045 , piece_id=EWOJXB3LYXTJXDX5GR27ZAIDBUIMHGGSZREHNRW5OBOW6CGDRJCQ, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.792242436 (194h56m0.254334909s) [noise=true , address=89.149.201.147:4021 , piece_id=PG2WFE5KE6UWK6CECKWKGYMSC3I37HIXFQ3UAHQRFPN2YENVSX6A, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.792426486 (194h56m0.254518969s) [noise=true , address=89.149.201.147:4016 , piece_id=3LQJLTPLFOPJP6RK7RRBMFNI6OJKO2YPW7OFUTE4XUELWXNYXUPA, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.792739632 (194h56m0.254832115s) [noise=true , address=185.167.204.206:4046 , piece_id=3AQYIPSOAHBX5D3Y3JQGMTO2G6JWFHPAYZ6OAIGESYIQUTZBKFKQ, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.792892633 (194h56m0.254985116s) [noise=true , address=89.149.201.147:4019 , piece_id=NIOK34O32CRS2X7AHI7Q4MAUHURS2SYADBCG6F3XNFCY5AC6IPNQ, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.793368009 (194h56m0.255460492s) [noise=true , address=185.167.204.205:4008 , piece_id=XMCMG7MWIMYJPZCLLLVXGAPI6L5ZY6LQIC6ZMI54F325HKTN3E3A, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.793744145 (194h56m0.255836618s) [noise=true , address=185.167.204.206:4053 , piece_id=VYEFX7UO3BIZP6ZTIBDL4LAONPLATMEQV33N6EDC3TVREC27SQXQ, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:15.663414777 (194h56m1.12550726s) [upload=171382]: Next returned nil segment Oct 1 16:27:15.663446057 (194h56m1.12553855s) [upload=171382]: Waiting for error group managing segments... Oct 1 16:27:16.051570181 (194h56m1.513662664s) [noise=true , address=81.171.14.70:4041 , piece_id=6EXFVMCWLDYXQIAGLN6QZMZYRRNODCTUZHFDGAPJGNSPIY53SMBQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.078955959 (194h56m1.541048442s) [noise=true , address=89.149.201.147:4005 , piece_id=5P4SQKZDXHMLR7W2YSID6SFX4PH5HOOHJBRY4Z3FODV5XU45LB7Q, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.083062659 (194h56m1.545155142s) [noise=true , address=81.171.14.70:4038 , piece_id=H3EGPRGN6ACASMNH2556R5PS5X7WFFJRWKXLF25JOFJRTRHMQE3Q, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.095376347 (194h56m1.55746883s) [noise=true , address=89.149.201.147:4021 , piece_id=PG2WFE5KE6UWK6CECKWKGYMSC3I37HIXFQ3UAHQRFPN2YENVSX6A, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.096206638 (194h56m1.558299131s) [noise=true , address=89.149.201.147:4014 , piece_id=KMVAOGOBRI5FVGX452S2ONPVDD5Y7JLC77SGHM5ZMJNGNVHKC6ZQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.119248904 (194h56m1.581341378s) [noise=true , address=89.149.201.147:4015 , piece_id=J5URNNLS3LZ7IXVWRSD5CHO2XOY6XSCG5V5C6DCPWGTOXM5OU2OA, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.125486933 (194h56m1.587579416s) [noise=true , address=89.149.201.147:4019 , piece_id=NIOK34O32CRS2X7AHI7Q4MAUHURS2SYADBCG6F3XNFCY5AC6IPNQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.138491736 (194h56m1.600584219s) [noise=true , address=89.149.201.147:4022 , piece_id=XMANQQOOIFX7IAYG3OG7N7CLSRKUMOLI53SHUDNO6OTVMHCNYPNQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.153573285 (194h56m1.615665768s) [noise=true , address=89.149.201.147:4010 , piece_id=EQCOPF45JWQYERVOORVUA6YGD2TUCWASJKPATXHDCF2T655BAFGQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.554445583 (194h56m2.016538066s) [noise=true , address=89.149.201.147:4016 , piece_id=3LQJLTPLFOPJP6RK7RRBMFNI6OJKO2YPW7OFUTE4XUELWXNYXUPA, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.579196534 (194h56m2.041289017s) [noise=true , address=81.171.14.70:4045 , piece_id=EWOJXB3LYXTJXDX5GR27ZAIDBUIMHGGSZREHNRW5OBOW6CGDRJCQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.584090483 (194h56m2.046182966s) [noise=true , address=81.171.14.70:4027 , piece_id=HDG2JKBEFW52YHRTBO4KX4V3JQLLD6NCZESKFIB2ZDXFZ2XCG6HQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.603391876 (194h56m2.065484369s) [noise=true , address=89.149.201.147:4003 , piece_id=CP3VL55SEJGJDA6BN4D2E4SALZ4BVOFQTLVSDWGEDDY4U6GXD5WA, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.608989515 (194h56m2.071081989s) [noise=true , address=81.171.14.70:4028 , piece_id=7SZ5FXTNOQ2327YZMK2ML74KPGO3QMF4PGQCCQE6JFMCVKRXWK5Q, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.672257270 (194h56m2.134349743s) [noise=true , address=185.167.204.206:4059 , piece_id=BS7HL4VZQXTKTGTV6OURHE6OZYG2WHH3VX5RSEZDTCMM3JAY4QRQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.722112273 (194h56m2.184204756s) [noise=true , address=185.167.204.205:4035 , piece_id=UHI3BVEBIZSUIGTWOEHTMFQZGFM5WEYQYUROEFPBAY2GNRA25DIQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.733206539 (194h56m2.195299022s) [noise=true , address=185.167.204.206:4046 , piece_id=3AQYIPSOAHBX5D3Y3JQGMTO2G6JWFHPAYZ6OAIGESYIQUTZBKFKQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.752334743 (194h56m2.214427216s) [noise=true , address=185.167.204.205:4010 , piece_id=Y63Z3LYXMOEEWWNE4EWMBAXVJON7VVO3O4RYSFIQX6HGKBNQ2P6A, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.763385917 (194h56m2.2254784s) [noise=true , address=185.167.204.205:4008 , piece_id=XMCMG7MWIMYJPZCLLLVXGAPI6L5ZY6LQIC6ZMI54F325HKTN3E3A, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.766844703 (194h56m2.228937186s) [noise=true , address=185.167.204.205:4005 , piece_id=Q2HECJ3RQ25RS2LP2L27MLE24ZLPFMSHONGDBV2NNTVQSIBV55IA, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.768272632 (194h56m2.230365115s) [noise=true , address=185.167.204.205:4002 , piece_id=ZPFMUFLAO4YXCMXLC44HCSG2SDVN2Q7KDRDBG72PDFHT76YW6Q2A, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.842894177 (194h56m2.30498666s) [noise=true , address=185.167.204.206:4053 , piece_id=VYEFX7UO3BIZP6ZTIBDL4LAONPLATMEQV33N6EDC3TVREC27SQXQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.844236352 (194h56m2.306328825s) [noise=true , address=185.167.204.205:4024 , piece_id=LMFDK5SU3NB4LZE4FEL6TFRGBMJ75TUDLJGFSBYUEMRZKDYVYTJQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.851987642 (194h56m2.314080115s) [noise=true , address=185.167.204.205:4030 , piece_id=QONQCBYKT7CBGUKGK5SVBWVO2FFXYFQLPNL2MKXVCKUICP2D6P5Q, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:28:14.126441542 (194h56m59.588534015s) [noise=true , address=185.167.204.205:4018 , piece_id=6WJ7UU55NOQYI3TWIE2AQLO42HVSWWSQAFVKQLE4FY3RIIJYI27A, seg_pos={0 0}, upload=171382]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:51116->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:28:14.126532335 (194h56m59.588624818s) [noise=true , address=185.167.204.205:4009 , piece_id=KES7GDUHYADJYWX3UOMHON4V2AO7BLQZ7ULMQ4V5GONYGYOWLF5Q, seg_pos={0 0}, upload=171382]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47100->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:28:14.126639619 (194h56m59.588732092s) [noise=true , address=185.167.204.206:4064 , piece_id=TL6CKCIP5BGAYFGYBCMJV6CUPMDZ6KBEB2GIMDSCGEPEIZW36A4A, seg_pos={0 0}, upload=171382]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:28:14.126670358 (194h56m59.588762841s) [noise=true , address=185.167.204.205:4022 , piece_id=4X2RVFYW5YY2NN2M727LNMIPZTZBNWUDWLQTHXLKJPK7DC5M2P6A, seg_pos={0 0}, upload=171382]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: write tcp 188.166.225.170:56766->185.167.204.205:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:28:14.126698602 (194h56m59.588791075s) [seg_pos={0 0}, upload=171382]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:28:14.293082097 (194h56m59.7551746s) [upload=171382]: Done uploading segments... Oct 1 16:28:14.293116763 (194h56m59.755209266s) [upload=171382]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.211261559s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.007690383s FAIL (2025-10-01 16:28:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== oise=true , address=185.167.204.205:4009 , piece_id=KES7GDUHYADJYWX3UOMHON4V2AO7BLQZ7ULMQ4V5GONYGYOWLF5Q, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.791002394 (194h56m0.253094877s) [noise=true , address=89.149.201.147:4015 , piece_id=J5URNNLS3LZ7IXVWRSD5CHO2XOY6XSCG5V5C6DCPWGTOXM5OU2OA, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.791433054 (194h56m0.253525527s) [noise=true , address=81.171.14.70:4041 , piece_id=6EXFVMCWLDYXQIAGLN6QZMZYRRNODCTUZHFDGAPJGNSPIY53SMBQ, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.791862021 (194h56m0.253954504s) [noise=true , address=185.167.204.205:4005 , piece_id=Q2HECJ3RQ25RS2LP2L27MLE24ZLPFMSHONGDBV2NNTVQSIBV55IA, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.791916264 (194h56m0.254008747s) [noise=true , address=81.171.14.70:4045 , piece_id=EWOJXB3LYXTJXDX5GR27ZAIDBUIMHGGSZREHNRW5OBOW6CGDRJCQ, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.792242436 (194h56m0.254334909s) [noise=true , address=89.149.201.147:4021 , piece_id=PG2WFE5KE6UWK6CECKWKGYMSC3I37HIXFQ3UAHQRFPN2YENVSX6A, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.792426486 (194h56m0.254518969s) [noise=true , address=89.149.201.147:4016 , piece_id=3LQJLTPLFOPJP6RK7RRBMFNI6OJKO2YPW7OFUTE4XUELWXNYXUPA, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.792739632 (194h56m0.254832115s) [noise=true , address=185.167.204.206:4046 , piece_id=3AQYIPSOAHBX5D3Y3JQGMTO2G6JWFHPAYZ6OAIGESYIQUTZBKFKQ, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.792892633 (194h56m0.254985116s) [noise=true , address=89.149.201.147:4019 , piece_id=NIOK34O32CRS2X7AHI7Q4MAUHURS2SYADBCG6F3XNFCY5AC6IPNQ, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.793368009 (194h56m0.255460492s) [noise=true , address=185.167.204.205:4008 , piece_id=XMCMG7MWIMYJPZCLLLVXGAPI6L5ZY6LQIC6ZMI54F325HKTN3E3A, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.793744145 (194h56m0.255836618s) [noise=true , address=185.167.204.206:4053 , piece_id=VYEFX7UO3BIZP6ZTIBDL4LAONPLATMEQV33N6EDC3TVREC27SQXQ, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:15.663414777 (194h56m1.12550726s) [upload=171382]: Next returned nil segment Oct 1 16:27:15.663446057 (194h56m1.12553855s) [upload=171382]: Waiting for error group managing segments... Oct 1 16:27:16.051570181 (194h56m1.513662664s) [noise=true , address=81.171.14.70:4041 , piece_id=6EXFVMCWLDYXQIAGLN6QZMZYRRNODCTUZHFDGAPJGNSPIY53SMBQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.078955959 (194h56m1.541048442s) [noise=true , address=89.149.201.147:4005 , piece_id=5P4SQKZDXHMLR7W2YSID6SFX4PH5HOOHJBRY4Z3FODV5XU45LB7Q, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.083062659 (194h56m1.545155142s) [noise=true , address=81.171.14.70:4038 , piece_id=H3EGPRGN6ACASMNH2556R5PS5X7WFFJRWKXLF25JOFJRTRHMQE3Q, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.095376347 (194h56m1.55746883s) [noise=true , address=89.149.201.147:4021 , piece_id=PG2WFE5KE6UWK6CECKWKGYMSC3I37HIXFQ3UAHQRFPN2YENVSX6A, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.096206638 (194h56m1.558299131s) [noise=true , address=89.149.201.147:4014 , piece_id=KMVAOGOBRI5FVGX452S2ONPVDD5Y7JLC77SGHM5ZMJNGNVHKC6ZQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.119248904 (194h56m1.581341378s) [noise=true , address=89.149.201.147:4015 , piece_id=J5URNNLS3LZ7IXVWRSD5CHO2XOY6XSCG5V5C6DCPWGTOXM5OU2OA, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.125486933 (194h56m1.587579416s) [noise=true , address=89.149.201.147:4019 , piece_id=NIOK34O32CRS2X7AHI7Q4MAUHURS2SYADBCG6F3XNFCY5AC6IPNQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.138491736 (194h56m1.600584219s) [noise=true , address=89.149.201.147:4022 , piece_id=XMANQQOOIFX7IAYG3OG7N7CLSRKUMOLI53SHUDNO6OTVMHCNYPNQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.153573285 (194h56m1.615665768s) [noise=true , address=89.149.201.147:4010 , piece_id=EQCOPF45JWQYERVOORVUA6YGD2TUCWASJKPATXHDCF2T655BAFGQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.554445583 (194h56m2.016538066s) [noise=true , address=89.149.201.147:4016 , piece_id=3LQJLTPLFOPJP6RK7RRBMFNI6OJKO2YPW7OFUTE4XUELWXNYXUPA, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.579196534 (194h56m2.041289017s) [noise=true , address=81.171.14.70:4045 , piece_id=EWOJXB3LYXTJXDX5GR27ZAIDBUIMHGGSZREHNRW5OBOW6CGDRJCQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.584090483 (194h56m2.046182966s) [noise=true , address=81.171.14.70:4027 , piece_id=HDG2JKBEFW52YHRTBO4KX4V3JQLLD6NCZESKFIB2ZDXFZ2XCG6HQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.603391876 (194h56m2.065484369s) [noise=true , address=89.149.201.147:4003 , piece_id=CP3VL55SEJGJDA6BN4D2E4SALZ4BVOFQTLVSDWGEDDY4U6GXD5WA, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.608989515 (194h56m2.071081989s) [noise=true , address=81.171.14.70:4028 , piece_id=7SZ5FXTNOQ2327YZMK2ML74KPGO3QMF4PGQCCQE6JFMCVKRXWK5Q, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.672257270 (194h56m2.134349743s) [noise=true , address=185.167.204.206:4059 , piece_id=BS7HL4VZQXTKTGTV6OURHE6OZYG2WHH3VX5RSEZDTCMM3JAY4QRQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.722112273 (194h56m2.184204756s) [noise=true , address=185.167.204.205:4035 , piece_id=UHI3BVEBIZSUIGTWOEHTMFQZGFM5WEYQYUROEFPBAY2GNRA25DIQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.733206539 (194h56m2.195299022s) [noise=true , address=185.167.204.206:4046 , piece_id=3AQYIPSOAHBX5D3Y3JQGMTO2G6JWFHPAYZ6OAIGESYIQUTZBKFKQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.752334743 (194h56m2.214427216s) [noise=true , address=185.167.204.205:4010 , piece_id=Y63Z3LYXMOEEWWNE4EWMBAXVJON7VVO3O4RYSFIQX6HGKBNQ2P6A, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.763385917 (194h56m2.2254784s) [noise=true , address=185.167.204.205:4008 , piece_id=XMCMG7MWIMYJPZCLLLVXGAPI6L5ZY6LQIC6ZMI54F325HKTN3E3A, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.766844703 (194h56m2.228937186s) [noise=true , address=185.167.204.205:4005 , piece_id=Q2HECJ3RQ25RS2LP2L27MLE24ZLPFMSHONGDBV2NNTVQSIBV55IA, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.768272632 (194h56m2.230365115s) [noise=true , address=185.167.204.205:4002 , piece_id=ZPFMUFLAO4YXCMXLC44HCSG2SDVN2Q7KDRDBG72PDFHT76YW6Q2A, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.842894177 (194h56m2.30498666s) [noise=true , address=185.167.204.206:4053 , piece_id=VYEFX7UO3BIZP6ZTIBDL4LAONPLATMEQV33N6EDC3TVREC27SQXQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.844236352 (194h56m2.306328825s) [noise=true , address=185.167.204.205:4024 , piece_id=LMFDK5SU3NB4LZE4FEL6TFRGBMJ75TUDLJGFSBYUEMRZKDYVYTJQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.851987642 (194h56m2.314080115s) [noise=true , address=185.167.204.205:4030 , piece_id=QONQCBYKT7CBGUKGK5SVBWVO2FFXYFQLPNL2MKXVCKUICP2D6P5Q, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:28:14.126441542 (194h56m59.588534015s) [noise=true , address=185.167.204.205:4018 , piece_id=6WJ7UU55NOQYI3TWIE2AQLO42HVSWWSQAFVKQLE4FY3RIIJYI27A, seg_pos={0 0}, upload=171382]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:51116->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:28:14.126532335 (194h56m59.588624818s) [noise=true , address=185.167.204.205:4009 , piece_id=KES7GDUHYADJYWX3UOMHON4V2AO7BLQZ7ULMQ4V5GONYGYOWLF5Q, seg_pos={0 0}, upload=171382]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47100->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:28:14.126639619 (194h56m59.588732092s) [noise=true , address=185.167.204.206:4064 , piece_id=TL6CKCIP5BGAYFGYBCMJV6CUPMDZ6KBEB2GIMDSCGEPEIZW36A4A, seg_pos={0 0}, upload=171382]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:28:14.126670358 (194h56m59.588762841s) [noise=true , address=185.167.204.205:4022 , piece_id=4X2RVFYW5YY2NN2M727LNMIPZTZBNWUDWLQTHXLKJPK7DC5M2P6A, seg_pos={0 0}, upload=171382]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: write tcp 188.166.225.170:56766->185.167.204.205:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:28:14.126698602 (194h56m59.588791075s) [seg_pos={0 0}, upload=171382]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:28:14.293082097 (194h56m59.7551746s) [upload=171382]: Done uploading segments... Oct 1 16:28:14.293116763 (194h56m59.755209266s) [upload=171382]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.007712685s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.170504675s FAIL (2025-10-01 16:28:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== oise=true , address=185.167.204.205:4009 , piece_id=KES7GDUHYADJYWX3UOMHON4V2AO7BLQZ7ULMQ4V5GONYGYOWLF5Q, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.791002394 (194h56m0.253094877s) [noise=true , address=89.149.201.147:4015 , piece_id=J5URNNLS3LZ7IXVWRSD5CHO2XOY6XSCG5V5C6DCPWGTOXM5OU2OA, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.791433054 (194h56m0.253525527s) [noise=true , address=81.171.14.70:4041 , piece_id=6EXFVMCWLDYXQIAGLN6QZMZYRRNODCTUZHFDGAPJGNSPIY53SMBQ, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.791862021 (194h56m0.253954504s) [noise=true , address=185.167.204.205:4005 , piece_id=Q2HECJ3RQ25RS2LP2L27MLE24ZLPFMSHONGDBV2NNTVQSIBV55IA, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.791916264 (194h56m0.254008747s) [noise=true , address=81.171.14.70:4045 , piece_id=EWOJXB3LYXTJXDX5GR27ZAIDBUIMHGGSZREHNRW5OBOW6CGDRJCQ, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.792242436 (194h56m0.254334909s) [noise=true , address=89.149.201.147:4021 , piece_id=PG2WFE5KE6UWK6CECKWKGYMSC3I37HIXFQ3UAHQRFPN2YENVSX6A, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.792426486 (194h56m0.254518969s) [noise=true , address=89.149.201.147:4016 , piece_id=3LQJLTPLFOPJP6RK7RRBMFNI6OJKO2YPW7OFUTE4XUELWXNYXUPA, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.792739632 (194h56m0.254832115s) [noise=true , address=185.167.204.206:4046 , piece_id=3AQYIPSOAHBX5D3Y3JQGMTO2G6JWFHPAYZ6OAIGESYIQUTZBKFKQ, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.792892633 (194h56m0.254985116s) [noise=true , address=89.149.201.147:4019 , piece_id=NIOK34O32CRS2X7AHI7Q4MAUHURS2SYADBCG6F3XNFCY5AC6IPNQ, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.793368009 (194h56m0.255460492s) [noise=true , address=185.167.204.205:4008 , piece_id=XMCMG7MWIMYJPZCLLLVXGAPI6L5ZY6LQIC6ZMI54F325HKTN3E3A, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:14.793744145 (194h56m0.255836618s) [noise=true , address=185.167.204.206:4053 , piece_id=VYEFX7UO3BIZP6ZTIBDL4LAONPLATMEQV33N6EDC3TVREC27SQXQ, seg_pos={0 0}, upload=171382]: Uploading piece... Oct 1 16:27:15.663414777 (194h56m1.12550726s) [upload=171382]: Next returned nil segment Oct 1 16:27:15.663446057 (194h56m1.12553855s) [upload=171382]: Waiting for error group managing segments... Oct 1 16:27:16.051570181 (194h56m1.513662664s) [noise=true , address=81.171.14.70:4041 , piece_id=6EXFVMCWLDYXQIAGLN6QZMZYRRNODCTUZHFDGAPJGNSPIY53SMBQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.078955959 (194h56m1.541048442s) [noise=true , address=89.149.201.147:4005 , piece_id=5P4SQKZDXHMLR7W2YSID6SFX4PH5HOOHJBRY4Z3FODV5XU45LB7Q, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.083062659 (194h56m1.545155142s) [noise=true , address=81.171.14.70:4038 , piece_id=H3EGPRGN6ACASMNH2556R5PS5X7WFFJRWKXLF25JOFJRTRHMQE3Q, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.095376347 (194h56m1.55746883s) [noise=true , address=89.149.201.147:4021 , piece_id=PG2WFE5KE6UWK6CECKWKGYMSC3I37HIXFQ3UAHQRFPN2YENVSX6A, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.096206638 (194h56m1.558299131s) [noise=true , address=89.149.201.147:4014 , piece_id=KMVAOGOBRI5FVGX452S2ONPVDD5Y7JLC77SGHM5ZMJNGNVHKC6ZQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.119248904 (194h56m1.581341378s) [noise=true , address=89.149.201.147:4015 , piece_id=J5URNNLS3LZ7IXVWRSD5CHO2XOY6XSCG5V5C6DCPWGTOXM5OU2OA, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.125486933 (194h56m1.587579416s) [noise=true , address=89.149.201.147:4019 , piece_id=NIOK34O32CRS2X7AHI7Q4MAUHURS2SYADBCG6F3XNFCY5AC6IPNQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.138491736 (194h56m1.600584219s) [noise=true , address=89.149.201.147:4022 , piece_id=XMANQQOOIFX7IAYG3OG7N7CLSRKUMOLI53SHUDNO6OTVMHCNYPNQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.153573285 (194h56m1.615665768s) [noise=true , address=89.149.201.147:4010 , piece_id=EQCOPF45JWQYERVOORVUA6YGD2TUCWASJKPATXHDCF2T655BAFGQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.554445583 (194h56m2.016538066s) [noise=true , address=89.149.201.147:4016 , piece_id=3LQJLTPLFOPJP6RK7RRBMFNI6OJKO2YPW7OFUTE4XUELWXNYXUPA, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.579196534 (194h56m2.041289017s) [noise=true , address=81.171.14.70:4045 , piece_id=EWOJXB3LYXTJXDX5GR27ZAIDBUIMHGGSZREHNRW5OBOW6CGDRJCQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.584090483 (194h56m2.046182966s) [noise=true , address=81.171.14.70:4027 , piece_id=HDG2JKBEFW52YHRTBO4KX4V3JQLLD6NCZESKFIB2ZDXFZ2XCG6HQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.603391876 (194h56m2.065484369s) [noise=true , address=89.149.201.147:4003 , piece_id=CP3VL55SEJGJDA6BN4D2E4SALZ4BVOFQTLVSDWGEDDY4U6GXD5WA, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.608989515 (194h56m2.071081989s) [noise=true , address=81.171.14.70:4028 , piece_id=7SZ5FXTNOQ2327YZMK2ML74KPGO3QMF4PGQCCQE6JFMCVKRXWK5Q, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.672257270 (194h56m2.134349743s) [noise=true , address=185.167.204.206:4059 , piece_id=BS7HL4VZQXTKTGTV6OURHE6OZYG2WHH3VX5RSEZDTCMM3JAY4QRQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.722112273 (194h56m2.184204756s) [noise=true , address=185.167.204.205:4035 , piece_id=UHI3BVEBIZSUIGTWOEHTMFQZGFM5WEYQYUROEFPBAY2GNRA25DIQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.733206539 (194h56m2.195299022s) [noise=true , address=185.167.204.206:4046 , piece_id=3AQYIPSOAHBX5D3Y3JQGMTO2G6JWFHPAYZ6OAIGESYIQUTZBKFKQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.752334743 (194h56m2.214427216s) [noise=true , address=185.167.204.205:4010 , piece_id=Y63Z3LYXMOEEWWNE4EWMBAXVJON7VVO3O4RYSFIQX6HGKBNQ2P6A, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.763385917 (194h56m2.2254784s) [noise=true , address=185.167.204.205:4008 , piece_id=XMCMG7MWIMYJPZCLLLVXGAPI6L5ZY6LQIC6ZMI54F325HKTN3E3A, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.766844703 (194h56m2.228937186s) [noise=true , address=185.167.204.205:4005 , piece_id=Q2HECJ3RQ25RS2LP2L27MLE24ZLPFMSHONGDBV2NNTVQSIBV55IA, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.768272632 (194h56m2.230365115s) [noise=true , address=185.167.204.205:4002 , piece_id=ZPFMUFLAO4YXCMXLC44HCSG2SDVN2Q7KDRDBG72PDFHT76YW6Q2A, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.842894177 (194h56m2.30498666s) [noise=true , address=185.167.204.206:4053 , piece_id=VYEFX7UO3BIZP6ZTIBDL4LAONPLATMEQV33N6EDC3TVREC27SQXQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.844236352 (194h56m2.306328825s) [noise=true , address=185.167.204.205:4024 , piece_id=LMFDK5SU3NB4LZE4FEL6TFRGBMJ75TUDLJGFSBYUEMRZKDYVYTJQ, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:27:16.851987642 (194h56m2.314080115s) [noise=true , address=185.167.204.205:4030 , piece_id=QONQCBYKT7CBGUKGK5SVBWVO2FFXYFQLPNL2MKXVCKUICP2D6P5Q, seg_pos={0 0}, upload=171382]: Done uploading piece. err: <nil> Oct 1 16:28:14.126441542 (194h56m59.588534015s) [noise=true , address=185.167.204.205:4018 , piece_id=6WJ7UU55NOQYI3TWIE2AQLO42HVSWWSQAFVKQLE4FY3RIIJYI27A, seg_pos={0 0}, upload=171382]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:51116->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:28:14.126532335 (194h56m59.588624818s) [noise=true , address=185.167.204.205:4009 , piece_id=KES7GDUHYADJYWX3UOMHON4V2AO7BLQZ7ULMQ4V5GONYGYOWLF5Q, seg_pos={0 0}, upload=171382]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47100->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:28:14.126639619 (194h56m59.588732092s) [noise=true , address=185.167.204.206:4064 , piece_id=TL6CKCIP5BGAYFGYBCMJV6CUPMDZ6KBEB2GIMDSCGEPEIZW36A4A, seg_pos={0 0}, upload=171382]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:28:14.126670358 (194h56m59.588762841s) [noise=true , address=185.167.204.205:4022 , piece_id=4X2RVFYW5YY2NN2M727LNMIPZTZBNWUDWLQTHXLKJPK7DC5M2P6A, seg_pos={0 0}, upload=171382]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: write tcp 188.166.225.170:56766->185.167.204.205:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:28:14.126698602 (194h56m59.588791075s) [seg_pos={0 0}, upload=171382]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:28:14.293082097 (194h56m59.7551746s) [upload=171382]: Done uploading segments... Oct 1 16:28:14.293116763 (194h56m59.755209266s) [upload=171382]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 1m0.170552005s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 7.544082642s FAIL (2025-10-01 14:46:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 1 14:00:46.620268370 (192h29m32.082360843s) [upload=169246]: Starting upload Oct 1 14:00:46.620346831 (192h29m32.082439324s) [upload=169246]: Done starting upload Oct 1 14:00:46.620466167 (192h29m32.08255865s) [upload=169246]: Uploading segments... Oct 1 14:00:46.620605262 (192h29m32.082697745s) [upload=169246]: Got next segment. Inline: false Oct 1 14:00:46.620643114 (192h29m32.082735597s) [upload=169246]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 14:00:46.620648935 (192h29m32.082741418s) [upload=169246]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 14:00:46.905480589 (192h29m32.367573083s) [seg_pos={0 0}, upload=169246]: Begin upload segment... Oct 1 14:00:46.905540744 (192h29m32.367633227s) [seg_pos={0 0}, upload=169246]: Done begin upload segment. Oct 1 14:00:46.905585639 (192h29m32.367678123s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.906499660 (192h29m32.368592644s) [noise=true , address=45.91.116.5:4297 , piece_id=ZUII3WBJP2GZTY7TJ6RY4H7IN6LCJMBMMBVRW4CKAVDDSIKUQRBA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.907139889 (192h29m32.369232362s) [noise=true , address=77.90.31.16:4734 , piece_id=JHLMHHA255AJB7CAUDV6NPSITTNS4RE2KGWCAMGPZYRG6P3BIODA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.907536574 (192h29m32.369629047s) [noise=true , address=145.79.227.16:4909 , piece_id=DCXMBJ4PSP4V2NYXRYRTYC4LF26S5WL5MDV3FXLW26FH23KJM5BQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.908164872 (192h29m32.370257355s) [noise=true , address=45.91.116.6:4974 , piece_id=TLA3S3E6EIEKOLRWIVI2LY22XN5E7HSO3HOT72WOLCVFJHBDQZAA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.908616101 (192h29m32.370708584s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.909195704 (192h29m32.371288207s) [noise=true , address=145.79.227.14:4840 , piece_id=TJ3V34WEIZEH3GHSCYCULOO64RDBUJSEIURPMLJKO2MXTMVGBORA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.909594123 (192h29m32.371686606s) [noise=true , address=77.90.31.21:4877 , piece_id=CIIAT4HGOKAYLTYCAREITNZGBDXUSNFVJJUGSEGP2Z3HJUIWYZ3A, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.912412530 (192h29m32.374505053s) [noise=true , address=45.91.116.14:4191 , piece_id=5XU743VBBYSMYMR3VRNFTOD5EZCANYDZGGKH3LOIQQVIOLPP4TLQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.912948871 (192h29m32.375041354s) [noise=true , address=145.79.227.18:4007 , piece_id=LIS4XOQWGTR5FU2B4E54EPTNJTVQSEXVLZ5NIUKO3O76533UX6GA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.913340867 (192h29m32.37543335s) [noise=true , address=45.91.116.10:4082 , piece_id=JIQIADADLFTFH2NVESTQ5L36Q23NC6VNSRXOJRRYRO7AYLKH4SVA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.913725519 (192h29m32.375818002s) [noise=true , address=45.91.116.4:4940 , piece_id=UQMNSPS45CULMBOQRA4VGHNM2OTLGX7MMBL6YJUDS2E27TUEPSYQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.914143846 (192h29m32.376236329s) [noise=true , address=45.91.116.13:4154 , piece_id=UAWB5SUXUMNCZ2LWEJLHXUQY7QM2XHTHJE4QAFEGDVFERB7VN6RA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.915559241 (192h29m32.377651724s) [noise=true , address=77.90.31.11:4554 , piece_id=4LPKK7WLUKTMGKMVMVTZDTQJKTBPFNKMFNOXENWYICR7QCP5O6DA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.916044856 (192h29m32.378137329s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.916466349 (192h29m32.378558832s) [noise=true , address=45.91.116.11:4119 , piece_id=7XPWFPGQX2HTUHFRHAAB42H6NBPH26IDYXBWVD33PM72BGUM4QDA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:48.753862534 (192h29m34.215955017s) [upload=169246]: Next returned nil segment Oct 1 14:00:48.753875889 (192h29m34.215968372s) [upload=169246]: Waiting for error group managing segments... Oct 1 14:00:49.106561440 (192h29m34.568653923s) [noise=true , address=45.91.116.13:4154 , piece_id=UAWB5SUXUMNCZ2LWEJLHXUQY7QM2XHTHJE4QAFEGDVFERB7VN6RA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.117617624 (192h29m34.579710107s) [noise=true , address=77.90.31.21:4877 , piece_id=CIIAT4HGOKAYLTYCAREITNZGBDXUSNFVJJUGSEGP2Z3HJUIWYZ3A, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.170896797 (192h29m34.63298928s) [noise=true , address=45.91.116.11:4119 , piece_id=7XPWFPGQX2HTUHFRHAAB42H6NBPH26IDYXBWVD33PM72BGUM4QDA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.184475364 (192h29m34.646567837s) [noise=true , address=45.91.116.4:4940 , piece_id=UQMNSPS45CULMBOQRA4VGHNM2OTLGX7MMBL6YJUDS2E27TUEPSYQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.188173746 (192h29m34.650266219s) [noise=true , address=45.91.116.6:4974 , piece_id=TLA3S3E6EIEKOLRWIVI2LY22XN5E7HSO3HOT72WOLCVFJHBDQZAA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.190647626 (192h29m34.6527401s) [noise=true , address=77.90.31.11:4554 , piece_id=4LPKK7WLUKTMGKMVMVTZDTQJKTBPFNKMFNOXENWYICR7QCP5O6DA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.194161728 (192h29m34.656254221s) [noise=true , address=45.91.116.5:4297 , piece_id=ZUII3WBJP2GZTY7TJ6RY4H7IN6LCJMBMMBVRW4CKAVDDSIKUQRBA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.219965013 (192h29m34.682057496s) [noise=true , address=45.91.116.14:4191 , piece_id=5XU743VBBYSMYMR3VRNFTOD5EZCANYDZGGKH3LOIQQVIOLPP4TLQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.741068004 (192h29m35.203160487s) [noise=true , address=145.79.227.16:4909 , piece_id=DCXMBJ4PSP4V2NYXRYRTYC4LF26S5WL5MDV3FXLW26FH23KJM5BQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.749777739 (192h29m35.211870242s) [noise=true , address=145.79.227.14:4840 , piece_id=TJ3V34WEIZEH3GHSCYCULOO64RDBUJSEIURPMLJKO2MXTMVGBORA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.891342956 (192h29m35.353435439s) [noise=true , address=77.90.31.16:4734 , piece_id=JHLMHHA255AJB7CAUDV6NPSITTNS4RE2KGWCAMGPZYRG6P3BIODA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.948800075 (192h29m35.410892548s) [noise=true , address=45.91.116.10:4082 , piece_id=JIQIADADLFTFH2NVESTQ5L36Q23NC6VNSRXOJRRYRO7AYLKH4SVA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:50.510984642 (192h29m35.973077125s) [noise=true , address=145.79.227.18:4007 , piece_id=LIS4XOQWGTR5FU2B4E54EPTNJTVQSEXVLZ5NIUKO3O76533UX6GA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:50.511045428 (192h29m35.973137911s) [seg_pos={0 0}, upload=169246]: Segment reached optimal threshold of 13 pieces. Oct 1 14:00:50.511239789 (192h29m35.973332302s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511253995 (192h29m35.973346478s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511370106 (192h29m35.973462589s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511377550 (192h29m35.973470033s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511522286 (192h29m35.973614769s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511531313 (192h29m35.973623796s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511554007 (192h29m35.97364649s) [seg_pos={0 0}, upload=169246]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 14:00:50.511706777 (192h29m35.97379926s) [upload=169246]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 14:00:50.511714452 (192h29m35.973806925s) [upload=169246]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 14:00:51.013026667 (192h29m36.47511916s) [upload=169246]: Done uploading segments... Oct 1 14:00:51.013052837 (192h29m36.47514532s) [upload=169246]: Upload finished. err: <nil> Duration: 7.544112768s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 13.55922747s FAIL (2025-10-01 14:45:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 1 14:00:46.620268370 (192h29m32.082360843s) [upload=169246]: Starting upload Oct 1 14:00:46.620346831 (192h29m32.082439324s) [upload=169246]: Done starting upload Oct 1 14:00:46.620466167 (192h29m32.08255865s) [upload=169246]: Uploading segments... Oct 1 14:00:46.620605262 (192h29m32.082697745s) [upload=169246]: Got next segment. Inline: false Oct 1 14:00:46.620643114 (192h29m32.082735597s) [upload=169246]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 14:00:46.620648935 (192h29m32.082741418s) [upload=169246]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 14:00:46.905480589 (192h29m32.367573083s) [seg_pos={0 0}, upload=169246]: Begin upload segment... Oct 1 14:00:46.905540744 (192h29m32.367633227s) [seg_pos={0 0}, upload=169246]: Done begin upload segment. Oct 1 14:00:46.905585639 (192h29m32.367678123s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.906499660 (192h29m32.368592644s) [noise=true , address=45.91.116.5:4297 , piece_id=ZUII3WBJP2GZTY7TJ6RY4H7IN6LCJMBMMBVRW4CKAVDDSIKUQRBA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.907139889 (192h29m32.369232362s) [noise=true , address=77.90.31.16:4734 , piece_id=JHLMHHA255AJB7CAUDV6NPSITTNS4RE2KGWCAMGPZYRG6P3BIODA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.907536574 (192h29m32.369629047s) [noise=true , address=145.79.227.16:4909 , piece_id=DCXMBJ4PSP4V2NYXRYRTYC4LF26S5WL5MDV3FXLW26FH23KJM5BQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.908164872 (192h29m32.370257355s) [noise=true , address=45.91.116.6:4974 , piece_id=TLA3S3E6EIEKOLRWIVI2LY22XN5E7HSO3HOT72WOLCVFJHBDQZAA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.908616101 (192h29m32.370708584s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.909195704 (192h29m32.371288207s) [noise=true , address=145.79.227.14:4840 , piece_id=TJ3V34WEIZEH3GHSCYCULOO64RDBUJSEIURPMLJKO2MXTMVGBORA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.909594123 (192h29m32.371686606s) [noise=true , address=77.90.31.21:4877 , piece_id=CIIAT4HGOKAYLTYCAREITNZGBDXUSNFVJJUGSEGP2Z3HJUIWYZ3A, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.912412530 (192h29m32.374505053s) [noise=true , address=45.91.116.14:4191 , piece_id=5XU743VBBYSMYMR3VRNFTOD5EZCANYDZGGKH3LOIQQVIOLPP4TLQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.912948871 (192h29m32.375041354s) [noise=true , address=145.79.227.18:4007 , piece_id=LIS4XOQWGTR5FU2B4E54EPTNJTVQSEXVLZ5NIUKO3O76533UX6GA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.913340867 (192h29m32.37543335s) [noise=true , address=45.91.116.10:4082 , piece_id=JIQIADADLFTFH2NVESTQ5L36Q23NC6VNSRXOJRRYRO7AYLKH4SVA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.913725519 (192h29m32.375818002s) [noise=true , address=45.91.116.4:4940 , piece_id=UQMNSPS45CULMBOQRA4VGHNM2OTLGX7MMBL6YJUDS2E27TUEPSYQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.914143846 (192h29m32.376236329s) [noise=true , address=45.91.116.13:4154 , piece_id=UAWB5SUXUMNCZ2LWEJLHXUQY7QM2XHTHJE4QAFEGDVFERB7VN6RA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.915559241 (192h29m32.377651724s) [noise=true , address=77.90.31.11:4554 , piece_id=4LPKK7WLUKTMGKMVMVTZDTQJKTBPFNKMFNOXENWYICR7QCP5O6DA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.916044856 (192h29m32.378137329s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.916466349 (192h29m32.378558832s) [noise=true , address=45.91.116.11:4119 , piece_id=7XPWFPGQX2HTUHFRHAAB42H6NBPH26IDYXBWVD33PM72BGUM4QDA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:48.753862534 (192h29m34.215955017s) [upload=169246]: Next returned nil segment Oct 1 14:00:48.753875889 (192h29m34.215968372s) [upload=169246]: Waiting for error group managing segments... Oct 1 14:00:49.106561440 (192h29m34.568653923s) [noise=true , address=45.91.116.13:4154 , piece_id=UAWB5SUXUMNCZ2LWEJLHXUQY7QM2XHTHJE4QAFEGDVFERB7VN6RA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.117617624 (192h29m34.579710107s) [noise=true , address=77.90.31.21:4877 , piece_id=CIIAT4HGOKAYLTYCAREITNZGBDXUSNFVJJUGSEGP2Z3HJUIWYZ3A, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.170896797 (192h29m34.63298928s) [noise=true , address=45.91.116.11:4119 , piece_id=7XPWFPGQX2HTUHFRHAAB42H6NBPH26IDYXBWVD33PM72BGUM4QDA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.184475364 (192h29m34.646567837s) [noise=true , address=45.91.116.4:4940 , piece_id=UQMNSPS45CULMBOQRA4VGHNM2OTLGX7MMBL6YJUDS2E27TUEPSYQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.188173746 (192h29m34.650266219s) [noise=true , address=45.91.116.6:4974 , piece_id=TLA3S3E6EIEKOLRWIVI2LY22XN5E7HSO3HOT72WOLCVFJHBDQZAA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.190647626 (192h29m34.6527401s) [noise=true , address=77.90.31.11:4554 , piece_id=4LPKK7WLUKTMGKMVMVTZDTQJKTBPFNKMFNOXENWYICR7QCP5O6DA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.194161728 (192h29m34.656254221s) [noise=true , address=45.91.116.5:4297 , piece_id=ZUII3WBJP2GZTY7TJ6RY4H7IN6LCJMBMMBVRW4CKAVDDSIKUQRBA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.219965013 (192h29m34.682057496s) [noise=true , address=45.91.116.14:4191 , piece_id=5XU743VBBYSMYMR3VRNFTOD5EZCANYDZGGKH3LOIQQVIOLPP4TLQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.741068004 (192h29m35.203160487s) [noise=true , address=145.79.227.16:4909 , piece_id=DCXMBJ4PSP4V2NYXRYRTYC4LF26S5WL5MDV3FXLW26FH23KJM5BQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.749777739 (192h29m35.211870242s) [noise=true , address=145.79.227.14:4840 , piece_id=TJ3V34WEIZEH3GHSCYCULOO64RDBUJSEIURPMLJKO2MXTMVGBORA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.891342956 (192h29m35.353435439s) [noise=true , address=77.90.31.16:4734 , piece_id=JHLMHHA255AJB7CAUDV6NPSITTNS4RE2KGWCAMGPZYRG6P3BIODA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.948800075 (192h29m35.410892548s) [noise=true , address=45.91.116.10:4082 , piece_id=JIQIADADLFTFH2NVESTQ5L36Q23NC6VNSRXOJRRYRO7AYLKH4SVA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:50.510984642 (192h29m35.973077125s) [noise=true , address=145.79.227.18:4007 , piece_id=LIS4XOQWGTR5FU2B4E54EPTNJTVQSEXVLZ5NIUKO3O76533UX6GA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:50.511045428 (192h29m35.973137911s) [seg_pos={0 0}, upload=169246]: Segment reached optimal threshold of 13 pieces. Oct 1 14:00:50.511239789 (192h29m35.973332302s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511253995 (192h29m35.973346478s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511370106 (192h29m35.973462589s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511377550 (192h29m35.973470033s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511522286 (192h29m35.973614769s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511531313 (192h29m35.973623796s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511554007 (192h29m35.97364649s) [seg_pos={0 0}, upload=169246]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 14:00:50.511706777 (192h29m35.97379926s) [upload=169246]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 14:00:50.511714452 (192h29m35.973806925s) [upload=169246]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 14:00:51.013026667 (192h29m36.47511916s) [upload=169246]: Done uploading segments... Oct 1 14:00:51.013052837 (192h29m36.47514532s) [upload=169246]: Upload finished. err: <nil> Duration: 13.559259761s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 7.439810831s FAIL (2025-10-01 14:44:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 1 14:00:46.620268370 (192h29m32.082360843s) [upload=169246]: Starting upload Oct 1 14:00:46.620346831 (192h29m32.082439324s) [upload=169246]: Done starting upload Oct 1 14:00:46.620466167 (192h29m32.08255865s) [upload=169246]: Uploading segments... Oct 1 14:00:46.620605262 (192h29m32.082697745s) [upload=169246]: Got next segment. Inline: false Oct 1 14:00:46.620643114 (192h29m32.082735597s) [upload=169246]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 14:00:46.620648935 (192h29m32.082741418s) [upload=169246]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 14:00:46.905480589 (192h29m32.367573083s) [seg_pos={0 0}, upload=169246]: Begin upload segment... Oct 1 14:00:46.905540744 (192h29m32.367633227s) [seg_pos={0 0}, upload=169246]: Done begin upload segment. Oct 1 14:00:46.905585639 (192h29m32.367678123s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.906499660 (192h29m32.368592644s) [noise=true , address=45.91.116.5:4297 , piece_id=ZUII3WBJP2GZTY7TJ6RY4H7IN6LCJMBMMBVRW4CKAVDDSIKUQRBA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.907139889 (192h29m32.369232362s) [noise=true , address=77.90.31.16:4734 , piece_id=JHLMHHA255AJB7CAUDV6NPSITTNS4RE2KGWCAMGPZYRG6P3BIODA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.907536574 (192h29m32.369629047s) [noise=true , address=145.79.227.16:4909 , piece_id=DCXMBJ4PSP4V2NYXRYRTYC4LF26S5WL5MDV3FXLW26FH23KJM5BQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.908164872 (192h29m32.370257355s) [noise=true , address=45.91.116.6:4974 , piece_id=TLA3S3E6EIEKOLRWIVI2LY22XN5E7HSO3HOT72WOLCVFJHBDQZAA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.908616101 (192h29m32.370708584s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.909195704 (192h29m32.371288207s) [noise=true , address=145.79.227.14:4840 , piece_id=TJ3V34WEIZEH3GHSCYCULOO64RDBUJSEIURPMLJKO2MXTMVGBORA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.909594123 (192h29m32.371686606s) [noise=true , address=77.90.31.21:4877 , piece_id=CIIAT4HGOKAYLTYCAREITNZGBDXUSNFVJJUGSEGP2Z3HJUIWYZ3A, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.912412530 (192h29m32.374505053s) [noise=true , address=45.91.116.14:4191 , piece_id=5XU743VBBYSMYMR3VRNFTOD5EZCANYDZGGKH3LOIQQVIOLPP4TLQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.912948871 (192h29m32.375041354s) [noise=true , address=145.79.227.18:4007 , piece_id=LIS4XOQWGTR5FU2B4E54EPTNJTVQSEXVLZ5NIUKO3O76533UX6GA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.913340867 (192h29m32.37543335s) [noise=true , address=45.91.116.10:4082 , piece_id=JIQIADADLFTFH2NVESTQ5L36Q23NC6VNSRXOJRRYRO7AYLKH4SVA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.913725519 (192h29m32.375818002s) [noise=true , address=45.91.116.4:4940 , piece_id=UQMNSPS45CULMBOQRA4VGHNM2OTLGX7MMBL6YJUDS2E27TUEPSYQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.914143846 (192h29m32.376236329s) [noise=true , address=45.91.116.13:4154 , piece_id=UAWB5SUXUMNCZ2LWEJLHXUQY7QM2XHTHJE4QAFEGDVFERB7VN6RA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.915559241 (192h29m32.377651724s) [noise=true , address=77.90.31.11:4554 , piece_id=4LPKK7WLUKTMGKMVMVTZDTQJKTBPFNKMFNOXENWYICR7QCP5O6DA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.916044856 (192h29m32.378137329s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.916466349 (192h29m32.378558832s) [noise=true , address=45.91.116.11:4119 , piece_id=7XPWFPGQX2HTUHFRHAAB42H6NBPH26IDYXBWVD33PM72BGUM4QDA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:48.753862534 (192h29m34.215955017s) [upload=169246]: Next returned nil segment Oct 1 14:00:48.753875889 (192h29m34.215968372s) [upload=169246]: Waiting for error group managing segments... Oct 1 14:00:49.106561440 (192h29m34.568653923s) [noise=true , address=45.91.116.13:4154 , piece_id=UAWB5SUXUMNCZ2LWEJLHXUQY7QM2XHTHJE4QAFEGDVFERB7VN6RA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.117617624 (192h29m34.579710107s) [noise=true , address=77.90.31.21:4877 , piece_id=CIIAT4HGOKAYLTYCAREITNZGBDXUSNFVJJUGSEGP2Z3HJUIWYZ3A, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.170896797 (192h29m34.63298928s) [noise=true , address=45.91.116.11:4119 , piece_id=7XPWFPGQX2HTUHFRHAAB42H6NBPH26IDYXBWVD33PM72BGUM4QDA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.184475364 (192h29m34.646567837s) [noise=true , address=45.91.116.4:4940 , piece_id=UQMNSPS45CULMBOQRA4VGHNM2OTLGX7MMBL6YJUDS2E27TUEPSYQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.188173746 (192h29m34.650266219s) [noise=true , address=45.91.116.6:4974 , piece_id=TLA3S3E6EIEKOLRWIVI2LY22XN5E7HSO3HOT72WOLCVFJHBDQZAA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.190647626 (192h29m34.6527401s) [noise=true , address=77.90.31.11:4554 , piece_id=4LPKK7WLUKTMGKMVMVTZDTQJKTBPFNKMFNOXENWYICR7QCP5O6DA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.194161728 (192h29m34.656254221s) [noise=true , address=45.91.116.5:4297 , piece_id=ZUII3WBJP2GZTY7TJ6RY4H7IN6LCJMBMMBVRW4CKAVDDSIKUQRBA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.219965013 (192h29m34.682057496s) [noise=true , address=45.91.116.14:4191 , piece_id=5XU743VBBYSMYMR3VRNFTOD5EZCANYDZGGKH3LOIQQVIOLPP4TLQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.741068004 (192h29m35.203160487s) [noise=true , address=145.79.227.16:4909 , piece_id=DCXMBJ4PSP4V2NYXRYRTYC4LF26S5WL5MDV3FXLW26FH23KJM5BQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.749777739 (192h29m35.211870242s) [noise=true , address=145.79.227.14:4840 , piece_id=TJ3V34WEIZEH3GHSCYCULOO64RDBUJSEIURPMLJKO2MXTMVGBORA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.891342956 (192h29m35.353435439s) [noise=true , address=77.90.31.16:4734 , piece_id=JHLMHHA255AJB7CAUDV6NPSITTNS4RE2KGWCAMGPZYRG6P3BIODA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.948800075 (192h29m35.410892548s) [noise=true , address=45.91.116.10:4082 , piece_id=JIQIADADLFTFH2NVESTQ5L36Q23NC6VNSRXOJRRYRO7AYLKH4SVA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:50.510984642 (192h29m35.973077125s) [noise=true , address=145.79.227.18:4007 , piece_id=LIS4XOQWGTR5FU2B4E54EPTNJTVQSEXVLZ5NIUKO3O76533UX6GA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:50.511045428 (192h29m35.973137911s) [seg_pos={0 0}, upload=169246]: Segment reached optimal threshold of 13 pieces. Oct 1 14:00:50.511239789 (192h29m35.973332302s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511253995 (192h29m35.973346478s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511370106 (192h29m35.973462589s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511377550 (192h29m35.973470033s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511522286 (192h29m35.973614769s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511531313 (192h29m35.973623796s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511554007 (192h29m35.97364649s) [seg_pos={0 0}, upload=169246]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 14:00:50.511706777 (192h29m35.97379926s) [upload=169246]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 14:00:50.511714452 (192h29m35.973806925s) [upload=169246]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 14:00:51.013026667 (192h29m36.47511916s) [upload=169246]: Done uploading segments... Oct 1 14:00:51.013052837 (192h29m36.47514532s) [upload=169246]: Upload finished. err: <nil> Duration: 7.439860024s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 7.970480991s FAIL (2025-10-01 14:43:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 1 14:00:46.620268370 (192h29m32.082360843s) [upload=169246]: Starting upload Oct 1 14:00:46.620346831 (192h29m32.082439324s) [upload=169246]: Done starting upload Oct 1 14:00:46.620466167 (192h29m32.08255865s) [upload=169246]: Uploading segments... Oct 1 14:00:46.620605262 (192h29m32.082697745s) [upload=169246]: Got next segment. Inline: false Oct 1 14:00:46.620643114 (192h29m32.082735597s) [upload=169246]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 14:00:46.620648935 (192h29m32.082741418s) [upload=169246]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 14:00:46.905480589 (192h29m32.367573083s) [seg_pos={0 0}, upload=169246]: Begin upload segment... Oct 1 14:00:46.905540744 (192h29m32.367633227s) [seg_pos={0 0}, upload=169246]: Done begin upload segment. Oct 1 14:00:46.905585639 (192h29m32.367678123s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.906499660 (192h29m32.368592644s) [noise=true , address=45.91.116.5:4297 , piece_id=ZUII3WBJP2GZTY7TJ6RY4H7IN6LCJMBMMBVRW4CKAVDDSIKUQRBA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.907139889 (192h29m32.369232362s) [noise=true , address=77.90.31.16:4734 , piece_id=JHLMHHA255AJB7CAUDV6NPSITTNS4RE2KGWCAMGPZYRG6P3BIODA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.907536574 (192h29m32.369629047s) [noise=true , address=145.79.227.16:4909 , piece_id=DCXMBJ4PSP4V2NYXRYRTYC4LF26S5WL5MDV3FXLW26FH23KJM5BQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.908164872 (192h29m32.370257355s) [noise=true , address=45.91.116.6:4974 , piece_id=TLA3S3E6EIEKOLRWIVI2LY22XN5E7HSO3HOT72WOLCVFJHBDQZAA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.908616101 (192h29m32.370708584s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.909195704 (192h29m32.371288207s) [noise=true , address=145.79.227.14:4840 , piece_id=TJ3V34WEIZEH3GHSCYCULOO64RDBUJSEIURPMLJKO2MXTMVGBORA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.909594123 (192h29m32.371686606s) [noise=true , address=77.90.31.21:4877 , piece_id=CIIAT4HGOKAYLTYCAREITNZGBDXUSNFVJJUGSEGP2Z3HJUIWYZ3A, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.912412530 (192h29m32.374505053s) [noise=true , address=45.91.116.14:4191 , piece_id=5XU743VBBYSMYMR3VRNFTOD5EZCANYDZGGKH3LOIQQVIOLPP4TLQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.912948871 (192h29m32.375041354s) [noise=true , address=145.79.227.18:4007 , piece_id=LIS4XOQWGTR5FU2B4E54EPTNJTVQSEXVLZ5NIUKO3O76533UX6GA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.913340867 (192h29m32.37543335s) [noise=true , address=45.91.116.10:4082 , piece_id=JIQIADADLFTFH2NVESTQ5L36Q23NC6VNSRXOJRRYRO7AYLKH4SVA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.913725519 (192h29m32.375818002s) [noise=true , address=45.91.116.4:4940 , piece_id=UQMNSPS45CULMBOQRA4VGHNM2OTLGX7MMBL6YJUDS2E27TUEPSYQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.914143846 (192h29m32.376236329s) [noise=true , address=45.91.116.13:4154 , piece_id=UAWB5SUXUMNCZ2LWEJLHXUQY7QM2XHTHJE4QAFEGDVFERB7VN6RA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.915559241 (192h29m32.377651724s) [noise=true , address=77.90.31.11:4554 , piece_id=4LPKK7WLUKTMGKMVMVTZDTQJKTBPFNKMFNOXENWYICR7QCP5O6DA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.916044856 (192h29m32.378137329s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.916466349 (192h29m32.378558832s) [noise=true , address=45.91.116.11:4119 , piece_id=7XPWFPGQX2HTUHFRHAAB42H6NBPH26IDYXBWVD33PM72BGUM4QDA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:48.753862534 (192h29m34.215955017s) [upload=169246]: Next returned nil segment Oct 1 14:00:48.753875889 (192h29m34.215968372s) [upload=169246]: Waiting for error group managing segments... Oct 1 14:00:49.106561440 (192h29m34.568653923s) [noise=true , address=45.91.116.13:4154 , piece_id=UAWB5SUXUMNCZ2LWEJLHXUQY7QM2XHTHJE4QAFEGDVFERB7VN6RA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.117617624 (192h29m34.579710107s) [noise=true , address=77.90.31.21:4877 , piece_id=CIIAT4HGOKAYLTYCAREITNZGBDXUSNFVJJUGSEGP2Z3HJUIWYZ3A, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.170896797 (192h29m34.63298928s) [noise=true , address=45.91.116.11:4119 , piece_id=7XPWFPGQX2HTUHFRHAAB42H6NBPH26IDYXBWVD33PM72BGUM4QDA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.184475364 (192h29m34.646567837s) [noise=true , address=45.91.116.4:4940 , piece_id=UQMNSPS45CULMBOQRA4VGHNM2OTLGX7MMBL6YJUDS2E27TUEPSYQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.188173746 (192h29m34.650266219s) [noise=true , address=45.91.116.6:4974 , piece_id=TLA3S3E6EIEKOLRWIVI2LY22XN5E7HSO3HOT72WOLCVFJHBDQZAA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.190647626 (192h29m34.6527401s) [noise=true , address=77.90.31.11:4554 , piece_id=4LPKK7WLUKTMGKMVMVTZDTQJKTBPFNKMFNOXENWYICR7QCP5O6DA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.194161728 (192h29m34.656254221s) [noise=true , address=45.91.116.5:4297 , piece_id=ZUII3WBJP2GZTY7TJ6RY4H7IN6LCJMBMMBVRW4CKAVDDSIKUQRBA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.219965013 (192h29m34.682057496s) [noise=true , address=45.91.116.14:4191 , piece_id=5XU743VBBYSMYMR3VRNFTOD5EZCANYDZGGKH3LOIQQVIOLPP4TLQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.741068004 (192h29m35.203160487s) [noise=true , address=145.79.227.16:4909 , piece_id=DCXMBJ4PSP4V2NYXRYRTYC4LF26S5WL5MDV3FXLW26FH23KJM5BQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.749777739 (192h29m35.211870242s) [noise=true , address=145.79.227.14:4840 , piece_id=TJ3V34WEIZEH3GHSCYCULOO64RDBUJSEIURPMLJKO2MXTMVGBORA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.891342956 (192h29m35.353435439s) [noise=true , address=77.90.31.16:4734 , piece_id=JHLMHHA255AJB7CAUDV6NPSITTNS4RE2KGWCAMGPZYRG6P3BIODA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.948800075 (192h29m35.410892548s) [noise=true , address=45.91.116.10:4082 , piece_id=JIQIADADLFTFH2NVESTQ5L36Q23NC6VNSRXOJRRYRO7AYLKH4SVA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:50.510984642 (192h29m35.973077125s) [noise=true , address=145.79.227.18:4007 , piece_id=LIS4XOQWGTR5FU2B4E54EPTNJTVQSEXVLZ5NIUKO3O76533UX6GA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:50.511045428 (192h29m35.973137911s) [seg_pos={0 0}, upload=169246]: Segment reached optimal threshold of 13 pieces. Oct 1 14:00:50.511239789 (192h29m35.973332302s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511253995 (192h29m35.973346478s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511370106 (192h29m35.973462589s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511377550 (192h29m35.973470033s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511522286 (192h29m35.973614769s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511531313 (192h29m35.973623796s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511554007 (192h29m35.97364649s) [seg_pos={0 0}, upload=169246]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 14:00:50.511706777 (192h29m35.97379926s) [upload=169246]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 14:00:50.511714452 (192h29m35.973806925s) [upload=169246]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 14:00:51.013026667 (192h29m36.47511916s) [upload=169246]: Done uploading segments... Oct 1 14:00:51.013052837 (192h29m36.47514532s) [upload=169246]: Upload finished. err: <nil> Duration: 7.970516779s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 19.129999624s FAIL (2025-10-01 14:43:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 1 14:00:46.620268370 (192h29m32.082360843s) [upload=169246]: Starting upload Oct 1 14:00:46.620346831 (192h29m32.082439324s) [upload=169246]: Done starting upload Oct 1 14:00:46.620466167 (192h29m32.08255865s) [upload=169246]: Uploading segments... Oct 1 14:00:46.620605262 (192h29m32.082697745s) [upload=169246]: Got next segment. Inline: false Oct 1 14:00:46.620643114 (192h29m32.082735597s) [upload=169246]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 14:00:46.620648935 (192h29m32.082741418s) [upload=169246]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 14:00:46.905480589 (192h29m32.367573083s) [seg_pos={0 0}, upload=169246]: Begin upload segment... Oct 1 14:00:46.905540744 (192h29m32.367633227s) [seg_pos={0 0}, upload=169246]: Done begin upload segment. Oct 1 14:00:46.905585639 (192h29m32.367678123s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.906499660 (192h29m32.368592644s) [noise=true , address=45.91.116.5:4297 , piece_id=ZUII3WBJP2GZTY7TJ6RY4H7IN6LCJMBMMBVRW4CKAVDDSIKUQRBA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.907139889 (192h29m32.369232362s) [noise=true , address=77.90.31.16:4734 , piece_id=JHLMHHA255AJB7CAUDV6NPSITTNS4RE2KGWCAMGPZYRG6P3BIODA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.907536574 (192h29m32.369629047s) [noise=true , address=145.79.227.16:4909 , piece_id=DCXMBJ4PSP4V2NYXRYRTYC4LF26S5WL5MDV3FXLW26FH23KJM5BQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.908164872 (192h29m32.370257355s) [noise=true , address=45.91.116.6:4974 , piece_id=TLA3S3E6EIEKOLRWIVI2LY22XN5E7HSO3HOT72WOLCVFJHBDQZAA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.908616101 (192h29m32.370708584s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.909195704 (192h29m32.371288207s) [noise=true , address=145.79.227.14:4840 , piece_id=TJ3V34WEIZEH3GHSCYCULOO64RDBUJSEIURPMLJKO2MXTMVGBORA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.909594123 (192h29m32.371686606s) [noise=true , address=77.90.31.21:4877 , piece_id=CIIAT4HGOKAYLTYCAREITNZGBDXUSNFVJJUGSEGP2Z3HJUIWYZ3A, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.912412530 (192h29m32.374505053s) [noise=true , address=45.91.116.14:4191 , piece_id=5XU743VBBYSMYMR3VRNFTOD5EZCANYDZGGKH3LOIQQVIOLPP4TLQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.912948871 (192h29m32.375041354s) [noise=true , address=145.79.227.18:4007 , piece_id=LIS4XOQWGTR5FU2B4E54EPTNJTVQSEXVLZ5NIUKO3O76533UX6GA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.913340867 (192h29m32.37543335s) [noise=true , address=45.91.116.10:4082 , piece_id=JIQIADADLFTFH2NVESTQ5L36Q23NC6VNSRXOJRRYRO7AYLKH4SVA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.913725519 (192h29m32.375818002s) [noise=true , address=45.91.116.4:4940 , piece_id=UQMNSPS45CULMBOQRA4VGHNM2OTLGX7MMBL6YJUDS2E27TUEPSYQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.914143846 (192h29m32.376236329s) [noise=true , address=45.91.116.13:4154 , piece_id=UAWB5SUXUMNCZ2LWEJLHXUQY7QM2XHTHJE4QAFEGDVFERB7VN6RA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.915559241 (192h29m32.377651724s) [noise=true , address=77.90.31.11:4554 , piece_id=4LPKK7WLUKTMGKMVMVTZDTQJKTBPFNKMFNOXENWYICR7QCP5O6DA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.916044856 (192h29m32.378137329s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.916466349 (192h29m32.378558832s) [noise=true , address=45.91.116.11:4119 , piece_id=7XPWFPGQX2HTUHFRHAAB42H6NBPH26IDYXBWVD33PM72BGUM4QDA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:48.753862534 (192h29m34.215955017s) [upload=169246]: Next returned nil segment Oct 1 14:00:48.753875889 (192h29m34.215968372s) [upload=169246]: Waiting for error group managing segments... Oct 1 14:00:49.106561440 (192h29m34.568653923s) [noise=true , address=45.91.116.13:4154 , piece_id=UAWB5SUXUMNCZ2LWEJLHXUQY7QM2XHTHJE4QAFEGDVFERB7VN6RA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.117617624 (192h29m34.579710107s) [noise=true , address=77.90.31.21:4877 , piece_id=CIIAT4HGOKAYLTYCAREITNZGBDXUSNFVJJUGSEGP2Z3HJUIWYZ3A, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.170896797 (192h29m34.63298928s) [noise=true , address=45.91.116.11:4119 , piece_id=7XPWFPGQX2HTUHFRHAAB42H6NBPH26IDYXBWVD33PM72BGUM4QDA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.184475364 (192h29m34.646567837s) [noise=true , address=45.91.116.4:4940 , piece_id=UQMNSPS45CULMBOQRA4VGHNM2OTLGX7MMBL6YJUDS2E27TUEPSYQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.188173746 (192h29m34.650266219s) [noise=true , address=45.91.116.6:4974 , piece_id=TLA3S3E6EIEKOLRWIVI2LY22XN5E7HSO3HOT72WOLCVFJHBDQZAA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.190647626 (192h29m34.6527401s) [noise=true , address=77.90.31.11:4554 , piece_id=4LPKK7WLUKTMGKMVMVTZDTQJKTBPFNKMFNOXENWYICR7QCP5O6DA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.194161728 (192h29m34.656254221s) [noise=true , address=45.91.116.5:4297 , piece_id=ZUII3WBJP2GZTY7TJ6RY4H7IN6LCJMBMMBVRW4CKAVDDSIKUQRBA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.219965013 (192h29m34.682057496s) [noise=true , address=45.91.116.14:4191 , piece_id=5XU743VBBYSMYMR3VRNFTOD5EZCANYDZGGKH3LOIQQVIOLPP4TLQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.741068004 (192h29m35.203160487s) [noise=true , address=145.79.227.16:4909 , piece_id=DCXMBJ4PSP4V2NYXRYRTYC4LF26S5WL5MDV3FXLW26FH23KJM5BQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.749777739 (192h29m35.211870242s) [noise=true , address=145.79.227.14:4840 , piece_id=TJ3V34WEIZEH3GHSCYCULOO64RDBUJSEIURPMLJKO2MXTMVGBORA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.891342956 (192h29m35.353435439s) [noise=true , address=77.90.31.16:4734 , piece_id=JHLMHHA255AJB7CAUDV6NPSITTNS4RE2KGWCAMGPZYRG6P3BIODA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.948800075 (192h29m35.410892548s) [noise=true , address=45.91.116.10:4082 , piece_id=JIQIADADLFTFH2NVESTQ5L36Q23NC6VNSRXOJRRYRO7AYLKH4SVA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:50.510984642 (192h29m35.973077125s) [noise=true , address=145.79.227.18:4007 , piece_id=LIS4XOQWGTR5FU2B4E54EPTNJTVQSEXVLZ5NIUKO3O76533UX6GA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:50.511045428 (192h29m35.973137911s) [seg_pos={0 0}, upload=169246]: Segment reached optimal threshold of 13 pieces. Oct 1 14:00:50.511239789 (192h29m35.973332302s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511253995 (192h29m35.973346478s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511370106 (192h29m35.973462589s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511377550 (192h29m35.973470033s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511522286 (192h29m35.973614769s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511531313 (192h29m35.973623796s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511554007 (192h29m35.97364649s) [seg_pos={0 0}, upload=169246]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 14:00:50.511706777 (192h29m35.97379926s) [upload=169246]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 14:00:50.511714452 (192h29m35.973806925s) [upload=169246]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 14:00:51.013026667 (192h29m36.47511916s) [upload=169246]: Done uploading segments... Oct 1 14:00:51.013052837 (192h29m36.47514532s) [upload=169246]: Upload finished. err: <nil> Duration: 19.130031776s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 6.684794794s FAIL (2025-10-01 14:42:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 1 14:00:46.620268370 (192h29m32.082360843s) [upload=169246]: Starting upload Oct 1 14:00:46.620346831 (192h29m32.082439324s) [upload=169246]: Done starting upload Oct 1 14:00:46.620466167 (192h29m32.08255865s) [upload=169246]: Uploading segments... Oct 1 14:00:46.620605262 (192h29m32.082697745s) [upload=169246]: Got next segment. Inline: false Oct 1 14:00:46.620643114 (192h29m32.082735597s) [upload=169246]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 14:00:46.620648935 (192h29m32.082741418s) [upload=169246]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 14:00:46.905480589 (192h29m32.367573083s) [seg_pos={0 0}, upload=169246]: Begin upload segment... Oct 1 14:00:46.905540744 (192h29m32.367633227s) [seg_pos={0 0}, upload=169246]: Done begin upload segment. Oct 1 14:00:46.905585639 (192h29m32.367678123s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.906499660 (192h29m32.368592644s) [noise=true , address=45.91.116.5:4297 , piece_id=ZUII3WBJP2GZTY7TJ6RY4H7IN6LCJMBMMBVRW4CKAVDDSIKUQRBA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.907139889 (192h29m32.369232362s) [noise=true , address=77.90.31.16:4734 , piece_id=JHLMHHA255AJB7CAUDV6NPSITTNS4RE2KGWCAMGPZYRG6P3BIODA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.907536574 (192h29m32.369629047s) [noise=true , address=145.79.227.16:4909 , piece_id=DCXMBJ4PSP4V2NYXRYRTYC4LF26S5WL5MDV3FXLW26FH23KJM5BQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.908164872 (192h29m32.370257355s) [noise=true , address=45.91.116.6:4974 , piece_id=TLA3S3E6EIEKOLRWIVI2LY22XN5E7HSO3HOT72WOLCVFJHBDQZAA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.908616101 (192h29m32.370708584s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.909195704 (192h29m32.371288207s) [noise=true , address=145.79.227.14:4840 , piece_id=TJ3V34WEIZEH3GHSCYCULOO64RDBUJSEIURPMLJKO2MXTMVGBORA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.909594123 (192h29m32.371686606s) [noise=true , address=77.90.31.21:4877 , piece_id=CIIAT4HGOKAYLTYCAREITNZGBDXUSNFVJJUGSEGP2Z3HJUIWYZ3A, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.912412530 (192h29m32.374505053s) [noise=true , address=45.91.116.14:4191 , piece_id=5XU743VBBYSMYMR3VRNFTOD5EZCANYDZGGKH3LOIQQVIOLPP4TLQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.912948871 (192h29m32.375041354s) [noise=true , address=145.79.227.18:4007 , piece_id=LIS4XOQWGTR5FU2B4E54EPTNJTVQSEXVLZ5NIUKO3O76533UX6GA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.913340867 (192h29m32.37543335s) [noise=true , address=45.91.116.10:4082 , piece_id=JIQIADADLFTFH2NVESTQ5L36Q23NC6VNSRXOJRRYRO7AYLKH4SVA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.913725519 (192h29m32.375818002s) [noise=true , address=45.91.116.4:4940 , piece_id=UQMNSPS45CULMBOQRA4VGHNM2OTLGX7MMBL6YJUDS2E27TUEPSYQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.914143846 (192h29m32.376236329s) [noise=true , address=45.91.116.13:4154 , piece_id=UAWB5SUXUMNCZ2LWEJLHXUQY7QM2XHTHJE4QAFEGDVFERB7VN6RA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.915559241 (192h29m32.377651724s) [noise=true , address=77.90.31.11:4554 , piece_id=4LPKK7WLUKTMGKMVMVTZDTQJKTBPFNKMFNOXENWYICR7QCP5O6DA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.916044856 (192h29m32.378137329s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.916466349 (192h29m32.378558832s) [noise=true , address=45.91.116.11:4119 , piece_id=7XPWFPGQX2HTUHFRHAAB42H6NBPH26IDYXBWVD33PM72BGUM4QDA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:48.753862534 (192h29m34.215955017s) [upload=169246]: Next returned nil segment Oct 1 14:00:48.753875889 (192h29m34.215968372s) [upload=169246]: Waiting for error group managing segments... Oct 1 14:00:49.106561440 (192h29m34.568653923s) [noise=true , address=45.91.116.13:4154 , piece_id=UAWB5SUXUMNCZ2LWEJLHXUQY7QM2XHTHJE4QAFEGDVFERB7VN6RA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.117617624 (192h29m34.579710107s) [noise=true , address=77.90.31.21:4877 , piece_id=CIIAT4HGOKAYLTYCAREITNZGBDXUSNFVJJUGSEGP2Z3HJUIWYZ3A, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.170896797 (192h29m34.63298928s) [noise=true , address=45.91.116.11:4119 , piece_id=7XPWFPGQX2HTUHFRHAAB42H6NBPH26IDYXBWVD33PM72BGUM4QDA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.184475364 (192h29m34.646567837s) [noise=true , address=45.91.116.4:4940 , piece_id=UQMNSPS45CULMBOQRA4VGHNM2OTLGX7MMBL6YJUDS2E27TUEPSYQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.188173746 (192h29m34.650266219s) [noise=true , address=45.91.116.6:4974 , piece_id=TLA3S3E6EIEKOLRWIVI2LY22XN5E7HSO3HOT72WOLCVFJHBDQZAA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.190647626 (192h29m34.6527401s) [noise=true , address=77.90.31.11:4554 , piece_id=4LPKK7WLUKTMGKMVMVTZDTQJKTBPFNKMFNOXENWYICR7QCP5O6DA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.194161728 (192h29m34.656254221s) [noise=true , address=45.91.116.5:4297 , piece_id=ZUII3WBJP2GZTY7TJ6RY4H7IN6LCJMBMMBVRW4CKAVDDSIKUQRBA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.219965013 (192h29m34.682057496s) [noise=true , address=45.91.116.14:4191 , piece_id=5XU743VBBYSMYMR3VRNFTOD5EZCANYDZGGKH3LOIQQVIOLPP4TLQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.741068004 (192h29m35.203160487s) [noise=true , address=145.79.227.16:4909 , piece_id=DCXMBJ4PSP4V2NYXRYRTYC4LF26S5WL5MDV3FXLW26FH23KJM5BQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.749777739 (192h29m35.211870242s) [noise=true , address=145.79.227.14:4840 , piece_id=TJ3V34WEIZEH3GHSCYCULOO64RDBUJSEIURPMLJKO2MXTMVGBORA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.891342956 (192h29m35.353435439s) [noise=true , address=77.90.31.16:4734 , piece_id=JHLMHHA255AJB7CAUDV6NPSITTNS4RE2KGWCAMGPZYRG6P3BIODA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.948800075 (192h29m35.410892548s) [noise=true , address=45.91.116.10:4082 , piece_id=JIQIADADLFTFH2NVESTQ5L36Q23NC6VNSRXOJRRYRO7AYLKH4SVA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:50.510984642 (192h29m35.973077125s) [noise=true , address=145.79.227.18:4007 , piece_id=LIS4XOQWGTR5FU2B4E54EPTNJTVQSEXVLZ5NIUKO3O76533UX6GA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:50.511045428 (192h29m35.973137911s) [seg_pos={0 0}, upload=169246]: Segment reached optimal threshold of 13 pieces. Oct 1 14:00:50.511239789 (192h29m35.973332302s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511253995 (192h29m35.973346478s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511370106 (192h29m35.973462589s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511377550 (192h29m35.973470033s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511522286 (192h29m35.973614769s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511531313 (192h29m35.973623796s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511554007 (192h29m35.97364649s) [seg_pos={0 0}, upload=169246]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 14:00:50.511706777 (192h29m35.97379926s) [upload=169246]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 14:00:50.511714452 (192h29m35.973806925s) [upload=169246]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 14:00:51.013026667 (192h29m36.47511916s) [upload=169246]: Done uploading segments... Oct 1 14:00:51.013052837 (192h29m36.47514532s) [upload=169246]: Upload finished. err: <nil> Duration: 6.684832014s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 8.015403635s FAIL (2025-10-01 14:40:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 1 14:00:46.620268370 (192h29m32.082360843s) [upload=169246]: Starting upload Oct 1 14:00:46.620346831 (192h29m32.082439324s) [upload=169246]: Done starting upload Oct 1 14:00:46.620466167 (192h29m32.08255865s) [upload=169246]: Uploading segments... Oct 1 14:00:46.620605262 (192h29m32.082697745s) [upload=169246]: Got next segment. Inline: false Oct 1 14:00:46.620643114 (192h29m32.082735597s) [upload=169246]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 14:00:46.620648935 (192h29m32.082741418s) [upload=169246]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 14:00:46.905480589 (192h29m32.367573083s) [seg_pos={0 0}, upload=169246]: Begin upload segment... Oct 1 14:00:46.905540744 (192h29m32.367633227s) [seg_pos={0 0}, upload=169246]: Done begin upload segment. Oct 1 14:00:46.905585639 (192h29m32.367678123s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.906499660 (192h29m32.368592644s) [noise=true , address=45.91.116.5:4297 , piece_id=ZUII3WBJP2GZTY7TJ6RY4H7IN6LCJMBMMBVRW4CKAVDDSIKUQRBA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.907139889 (192h29m32.369232362s) [noise=true , address=77.90.31.16:4734 , piece_id=JHLMHHA255AJB7CAUDV6NPSITTNS4RE2KGWCAMGPZYRG6P3BIODA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.907536574 (192h29m32.369629047s) [noise=true , address=145.79.227.16:4909 , piece_id=DCXMBJ4PSP4V2NYXRYRTYC4LF26S5WL5MDV3FXLW26FH23KJM5BQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.908164872 (192h29m32.370257355s) [noise=true , address=45.91.116.6:4974 , piece_id=TLA3S3E6EIEKOLRWIVI2LY22XN5E7HSO3HOT72WOLCVFJHBDQZAA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.908616101 (192h29m32.370708584s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.909195704 (192h29m32.371288207s) [noise=true , address=145.79.227.14:4840 , piece_id=TJ3V34WEIZEH3GHSCYCULOO64RDBUJSEIURPMLJKO2MXTMVGBORA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.909594123 (192h29m32.371686606s) [noise=true , address=77.90.31.21:4877 , piece_id=CIIAT4HGOKAYLTYCAREITNZGBDXUSNFVJJUGSEGP2Z3HJUIWYZ3A, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.912412530 (192h29m32.374505053s) [noise=true , address=45.91.116.14:4191 , piece_id=5XU743VBBYSMYMR3VRNFTOD5EZCANYDZGGKH3LOIQQVIOLPP4TLQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.912948871 (192h29m32.375041354s) [noise=true , address=145.79.227.18:4007 , piece_id=LIS4XOQWGTR5FU2B4E54EPTNJTVQSEXVLZ5NIUKO3O76533UX6GA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.913340867 (192h29m32.37543335s) [noise=true , address=45.91.116.10:4082 , piece_id=JIQIADADLFTFH2NVESTQ5L36Q23NC6VNSRXOJRRYRO7AYLKH4SVA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.913725519 (192h29m32.375818002s) [noise=true , address=45.91.116.4:4940 , piece_id=UQMNSPS45CULMBOQRA4VGHNM2OTLGX7MMBL6YJUDS2E27TUEPSYQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.914143846 (192h29m32.376236329s) [noise=true , address=45.91.116.13:4154 , piece_id=UAWB5SUXUMNCZ2LWEJLHXUQY7QM2XHTHJE4QAFEGDVFERB7VN6RA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.915559241 (192h29m32.377651724s) [noise=true , address=77.90.31.11:4554 , piece_id=4LPKK7WLUKTMGKMVMVTZDTQJKTBPFNKMFNOXENWYICR7QCP5O6DA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.916044856 (192h29m32.378137329s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.916466349 (192h29m32.378558832s) [noise=true , address=45.91.116.11:4119 , piece_id=7XPWFPGQX2HTUHFRHAAB42H6NBPH26IDYXBWVD33PM72BGUM4QDA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:48.753862534 (192h29m34.215955017s) [upload=169246]: Next returned nil segment Oct 1 14:00:48.753875889 (192h29m34.215968372s) [upload=169246]: Waiting for error group managing segments... Oct 1 14:00:49.106561440 (192h29m34.568653923s) [noise=true , address=45.91.116.13:4154 , piece_id=UAWB5SUXUMNCZ2LWEJLHXUQY7QM2XHTHJE4QAFEGDVFERB7VN6RA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.117617624 (192h29m34.579710107s) [noise=true , address=77.90.31.21:4877 , piece_id=CIIAT4HGOKAYLTYCAREITNZGBDXUSNFVJJUGSEGP2Z3HJUIWYZ3A, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.170896797 (192h29m34.63298928s) [noise=true , address=45.91.116.11:4119 , piece_id=7XPWFPGQX2HTUHFRHAAB42H6NBPH26IDYXBWVD33PM72BGUM4QDA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.184475364 (192h29m34.646567837s) [noise=true , address=45.91.116.4:4940 , piece_id=UQMNSPS45CULMBOQRA4VGHNM2OTLGX7MMBL6YJUDS2E27TUEPSYQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.188173746 (192h29m34.650266219s) [noise=true , address=45.91.116.6:4974 , piece_id=TLA3S3E6EIEKOLRWIVI2LY22XN5E7HSO3HOT72WOLCVFJHBDQZAA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.190647626 (192h29m34.6527401s) [noise=true , address=77.90.31.11:4554 , piece_id=4LPKK7WLUKTMGKMVMVTZDTQJKTBPFNKMFNOXENWYICR7QCP5O6DA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.194161728 (192h29m34.656254221s) [noise=true , address=45.91.116.5:4297 , piece_id=ZUII3WBJP2GZTY7TJ6RY4H7IN6LCJMBMMBVRW4CKAVDDSIKUQRBA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.219965013 (192h29m34.682057496s) [noise=true , address=45.91.116.14:4191 , piece_id=5XU743VBBYSMYMR3VRNFTOD5EZCANYDZGGKH3LOIQQVIOLPP4TLQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.741068004 (192h29m35.203160487s) [noise=true , address=145.79.227.16:4909 , piece_id=DCXMBJ4PSP4V2NYXRYRTYC4LF26S5WL5MDV3FXLW26FH23KJM5BQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.749777739 (192h29m35.211870242s) [noise=true , address=145.79.227.14:4840 , piece_id=TJ3V34WEIZEH3GHSCYCULOO64RDBUJSEIURPMLJKO2MXTMVGBORA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.891342956 (192h29m35.353435439s) [noise=true , address=77.90.31.16:4734 , piece_id=JHLMHHA255AJB7CAUDV6NPSITTNS4RE2KGWCAMGPZYRG6P3BIODA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.948800075 (192h29m35.410892548s) [noise=true , address=45.91.116.10:4082 , piece_id=JIQIADADLFTFH2NVESTQ5L36Q23NC6VNSRXOJRRYRO7AYLKH4SVA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:50.510984642 (192h29m35.973077125s) [noise=true , address=145.79.227.18:4007 , piece_id=LIS4XOQWGTR5FU2B4E54EPTNJTVQSEXVLZ5NIUKO3O76533UX6GA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:50.511045428 (192h29m35.973137911s) [seg_pos={0 0}, upload=169246]: Segment reached optimal threshold of 13 pieces. Oct 1 14:00:50.511239789 (192h29m35.973332302s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511253995 (192h29m35.973346478s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511370106 (192h29m35.973462589s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511377550 (192h29m35.973470033s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511522286 (192h29m35.973614769s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511531313 (192h29m35.973623796s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511554007 (192h29m35.97364649s) [seg_pos={0 0}, upload=169246]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 14:00:50.511706777 (192h29m35.97379926s) [upload=169246]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 14:00:50.511714452 (192h29m35.973806925s) [upload=169246]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 14:00:51.013026667 (192h29m36.47511916s) [upload=169246]: Done uploading segments... Oct 1 14:00:51.013052837 (192h29m36.47514532s) [upload=169246]: Upload finished. err: <nil> Duration: 8.015437289s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 19.662488997s FAIL (2025-10-01 14:40:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 1 14:00:46.620268370 (192h29m32.082360843s) [upload=169246]: Starting upload Oct 1 14:00:46.620346831 (192h29m32.082439324s) [upload=169246]: Done starting upload Oct 1 14:00:46.620466167 (192h29m32.08255865s) [upload=169246]: Uploading segments... Oct 1 14:00:46.620605262 (192h29m32.082697745s) [upload=169246]: Got next segment. Inline: false Oct 1 14:00:46.620643114 (192h29m32.082735597s) [upload=169246]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 14:00:46.620648935 (192h29m32.082741418s) [upload=169246]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 14:00:46.905480589 (192h29m32.367573083s) [seg_pos={0 0}, upload=169246]: Begin upload segment... Oct 1 14:00:46.905540744 (192h29m32.367633227s) [seg_pos={0 0}, upload=169246]: Done begin upload segment. Oct 1 14:00:46.905585639 (192h29m32.367678123s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.906499660 (192h29m32.368592644s) [noise=true , address=45.91.116.5:4297 , piece_id=ZUII3WBJP2GZTY7TJ6RY4H7IN6LCJMBMMBVRW4CKAVDDSIKUQRBA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.907139889 (192h29m32.369232362s) [noise=true , address=77.90.31.16:4734 , piece_id=JHLMHHA255AJB7CAUDV6NPSITTNS4RE2KGWCAMGPZYRG6P3BIODA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.907536574 (192h29m32.369629047s) [noise=true , address=145.79.227.16:4909 , piece_id=DCXMBJ4PSP4V2NYXRYRTYC4LF26S5WL5MDV3FXLW26FH23KJM5BQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.908164872 (192h29m32.370257355s) [noise=true , address=45.91.116.6:4974 , piece_id=TLA3S3E6EIEKOLRWIVI2LY22XN5E7HSO3HOT72WOLCVFJHBDQZAA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.908616101 (192h29m32.370708584s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.909195704 (192h29m32.371288207s) [noise=true , address=145.79.227.14:4840 , piece_id=TJ3V34WEIZEH3GHSCYCULOO64RDBUJSEIURPMLJKO2MXTMVGBORA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.909594123 (192h29m32.371686606s) [noise=true , address=77.90.31.21:4877 , piece_id=CIIAT4HGOKAYLTYCAREITNZGBDXUSNFVJJUGSEGP2Z3HJUIWYZ3A, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.912412530 (192h29m32.374505053s) [noise=true , address=45.91.116.14:4191 , piece_id=5XU743VBBYSMYMR3VRNFTOD5EZCANYDZGGKH3LOIQQVIOLPP4TLQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.912948871 (192h29m32.375041354s) [noise=true , address=145.79.227.18:4007 , piece_id=LIS4XOQWGTR5FU2B4E54EPTNJTVQSEXVLZ5NIUKO3O76533UX6GA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.913340867 (192h29m32.37543335s) [noise=true , address=45.91.116.10:4082 , piece_id=JIQIADADLFTFH2NVESTQ5L36Q23NC6VNSRXOJRRYRO7AYLKH4SVA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.913725519 (192h29m32.375818002s) [noise=true , address=45.91.116.4:4940 , piece_id=UQMNSPS45CULMBOQRA4VGHNM2OTLGX7MMBL6YJUDS2E27TUEPSYQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.914143846 (192h29m32.376236329s) [noise=true , address=45.91.116.13:4154 , piece_id=UAWB5SUXUMNCZ2LWEJLHXUQY7QM2XHTHJE4QAFEGDVFERB7VN6RA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.915559241 (192h29m32.377651724s) [noise=true , address=77.90.31.11:4554 , piece_id=4LPKK7WLUKTMGKMVMVTZDTQJKTBPFNKMFNOXENWYICR7QCP5O6DA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.916044856 (192h29m32.378137329s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.916466349 (192h29m32.378558832s) [noise=true , address=45.91.116.11:4119 , piece_id=7XPWFPGQX2HTUHFRHAAB42H6NBPH26IDYXBWVD33PM72BGUM4QDA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:48.753862534 (192h29m34.215955017s) [upload=169246]: Next returned nil segment Oct 1 14:00:48.753875889 (192h29m34.215968372s) [upload=169246]: Waiting for error group managing segments... Oct 1 14:00:49.106561440 (192h29m34.568653923s) [noise=true , address=45.91.116.13:4154 , piece_id=UAWB5SUXUMNCZ2LWEJLHXUQY7QM2XHTHJE4QAFEGDVFERB7VN6RA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.117617624 (192h29m34.579710107s) [noise=true , address=77.90.31.21:4877 , piece_id=CIIAT4HGOKAYLTYCAREITNZGBDXUSNFVJJUGSEGP2Z3HJUIWYZ3A, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.170896797 (192h29m34.63298928s) [noise=true , address=45.91.116.11:4119 , piece_id=7XPWFPGQX2HTUHFRHAAB42H6NBPH26IDYXBWVD33PM72BGUM4QDA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.184475364 (192h29m34.646567837s) [noise=true , address=45.91.116.4:4940 , piece_id=UQMNSPS45CULMBOQRA4VGHNM2OTLGX7MMBL6YJUDS2E27TUEPSYQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.188173746 (192h29m34.650266219s) [noise=true , address=45.91.116.6:4974 , piece_id=TLA3S3E6EIEKOLRWIVI2LY22XN5E7HSO3HOT72WOLCVFJHBDQZAA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.190647626 (192h29m34.6527401s) [noise=true , address=77.90.31.11:4554 , piece_id=4LPKK7WLUKTMGKMVMVTZDTQJKTBPFNKMFNOXENWYICR7QCP5O6DA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.194161728 (192h29m34.656254221s) [noise=true , address=45.91.116.5:4297 , piece_id=ZUII3WBJP2GZTY7TJ6RY4H7IN6LCJMBMMBVRW4CKAVDDSIKUQRBA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.219965013 (192h29m34.682057496s) [noise=true , address=45.91.116.14:4191 , piece_id=5XU743VBBYSMYMR3VRNFTOD5EZCANYDZGGKH3LOIQQVIOLPP4TLQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.741068004 (192h29m35.203160487s) [noise=true , address=145.79.227.16:4909 , piece_id=DCXMBJ4PSP4V2NYXRYRTYC4LF26S5WL5MDV3FXLW26FH23KJM5BQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.749777739 (192h29m35.211870242s) [noise=true , address=145.79.227.14:4840 , piece_id=TJ3V34WEIZEH3GHSCYCULOO64RDBUJSEIURPMLJKO2MXTMVGBORA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.891342956 (192h29m35.353435439s) [noise=true , address=77.90.31.16:4734 , piece_id=JHLMHHA255AJB7CAUDV6NPSITTNS4RE2KGWCAMGPZYRG6P3BIODA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.948800075 (192h29m35.410892548s) [noise=true , address=45.91.116.10:4082 , piece_id=JIQIADADLFTFH2NVESTQ5L36Q23NC6VNSRXOJRRYRO7AYLKH4SVA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:50.510984642 (192h29m35.973077125s) [noise=true , address=145.79.227.18:4007 , piece_id=LIS4XOQWGTR5FU2B4E54EPTNJTVQSEXVLZ5NIUKO3O76533UX6GA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:50.511045428 (192h29m35.973137911s) [seg_pos={0 0}, upload=169246]: Segment reached optimal threshold of 13 pieces. Oct 1 14:00:50.511239789 (192h29m35.973332302s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511253995 (192h29m35.973346478s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511370106 (192h29m35.973462589s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511377550 (192h29m35.973470033s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511522286 (192h29m35.973614769s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511531313 (192h29m35.973623796s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511554007 (192h29m35.97364649s) [seg_pos={0 0}, upload=169246]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 14:00:50.511706777 (192h29m35.97379926s) [upload=169246]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 14:00:50.511714452 (192h29m35.973806925s) [upload=169246]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 14:00:51.013026667 (192h29m36.47511916s) [upload=169246]: Done uploading segments... Oct 1 14:00:51.013052837 (192h29m36.47514532s) [upload=169246]: Upload finished. err: <nil> Duration: 19.66253745s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 12.679732371s FAIL (2025-10-01 14:39:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 1 14:00:46.620268370 (192h29m32.082360843s) [upload=169246]: Starting upload Oct 1 14:00:46.620346831 (192h29m32.082439324s) [upload=169246]: Done starting upload Oct 1 14:00:46.620466167 (192h29m32.08255865s) [upload=169246]: Uploading segments... Oct 1 14:00:46.620605262 (192h29m32.082697745s) [upload=169246]: Got next segment. Inline: false Oct 1 14:00:46.620643114 (192h29m32.082735597s) [upload=169246]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 14:00:46.620648935 (192h29m32.082741418s) [upload=169246]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 14:00:46.905480589 (192h29m32.367573083s) [seg_pos={0 0}, upload=169246]: Begin upload segment... Oct 1 14:00:46.905540744 (192h29m32.367633227s) [seg_pos={0 0}, upload=169246]: Done begin upload segment. Oct 1 14:00:46.905585639 (192h29m32.367678123s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.906499660 (192h29m32.368592644s) [noise=true , address=45.91.116.5:4297 , piece_id=ZUII3WBJP2GZTY7TJ6RY4H7IN6LCJMBMMBVRW4CKAVDDSIKUQRBA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.907139889 (192h29m32.369232362s) [noise=true , address=77.90.31.16:4734 , piece_id=JHLMHHA255AJB7CAUDV6NPSITTNS4RE2KGWCAMGPZYRG6P3BIODA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.907536574 (192h29m32.369629047s) [noise=true , address=145.79.227.16:4909 , piece_id=DCXMBJ4PSP4V2NYXRYRTYC4LF26S5WL5MDV3FXLW26FH23KJM5BQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.908164872 (192h29m32.370257355s) [noise=true , address=45.91.116.6:4974 , piece_id=TLA3S3E6EIEKOLRWIVI2LY22XN5E7HSO3HOT72WOLCVFJHBDQZAA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.908616101 (192h29m32.370708584s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.909195704 (192h29m32.371288207s) [noise=true , address=145.79.227.14:4840 , piece_id=TJ3V34WEIZEH3GHSCYCULOO64RDBUJSEIURPMLJKO2MXTMVGBORA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.909594123 (192h29m32.371686606s) [noise=true , address=77.90.31.21:4877 , piece_id=CIIAT4HGOKAYLTYCAREITNZGBDXUSNFVJJUGSEGP2Z3HJUIWYZ3A, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.912412530 (192h29m32.374505053s) [noise=true , address=45.91.116.14:4191 , piece_id=5XU743VBBYSMYMR3VRNFTOD5EZCANYDZGGKH3LOIQQVIOLPP4TLQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.912948871 (192h29m32.375041354s) [noise=true , address=145.79.227.18:4007 , piece_id=LIS4XOQWGTR5FU2B4E54EPTNJTVQSEXVLZ5NIUKO3O76533UX6GA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.913340867 (192h29m32.37543335s) [noise=true , address=45.91.116.10:4082 , piece_id=JIQIADADLFTFH2NVESTQ5L36Q23NC6VNSRXOJRRYRO7AYLKH4SVA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.913725519 (192h29m32.375818002s) [noise=true , address=45.91.116.4:4940 , piece_id=UQMNSPS45CULMBOQRA4VGHNM2OTLGX7MMBL6YJUDS2E27TUEPSYQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.914143846 (192h29m32.376236329s) [noise=true , address=45.91.116.13:4154 , piece_id=UAWB5SUXUMNCZ2LWEJLHXUQY7QM2XHTHJE4QAFEGDVFERB7VN6RA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.915559241 (192h29m32.377651724s) [noise=true , address=77.90.31.11:4554 , piece_id=4LPKK7WLUKTMGKMVMVTZDTQJKTBPFNKMFNOXENWYICR7QCP5O6DA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.916044856 (192h29m32.378137329s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.916466349 (192h29m32.378558832s) [noise=true , address=45.91.116.11:4119 , piece_id=7XPWFPGQX2HTUHFRHAAB42H6NBPH26IDYXBWVD33PM72BGUM4QDA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:48.753862534 (192h29m34.215955017s) [upload=169246]: Next returned nil segment Oct 1 14:00:48.753875889 (192h29m34.215968372s) [upload=169246]: Waiting for error group managing segments... Oct 1 14:00:49.106561440 (192h29m34.568653923s) [noise=true , address=45.91.116.13:4154 , piece_id=UAWB5SUXUMNCZ2LWEJLHXUQY7QM2XHTHJE4QAFEGDVFERB7VN6RA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.117617624 (192h29m34.579710107s) [noise=true , address=77.90.31.21:4877 , piece_id=CIIAT4HGOKAYLTYCAREITNZGBDXUSNFVJJUGSEGP2Z3HJUIWYZ3A, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.170896797 (192h29m34.63298928s) [noise=true , address=45.91.116.11:4119 , piece_id=7XPWFPGQX2HTUHFRHAAB42H6NBPH26IDYXBWVD33PM72BGUM4QDA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.184475364 (192h29m34.646567837s) [noise=true , address=45.91.116.4:4940 , piece_id=UQMNSPS45CULMBOQRA4VGHNM2OTLGX7MMBL6YJUDS2E27TUEPSYQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.188173746 (192h29m34.650266219s) [noise=true , address=45.91.116.6:4974 , piece_id=TLA3S3E6EIEKOLRWIVI2LY22XN5E7HSO3HOT72WOLCVFJHBDQZAA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.190647626 (192h29m34.6527401s) [noise=true , address=77.90.31.11:4554 , piece_id=4LPKK7WLUKTMGKMVMVTZDTQJKTBPFNKMFNOXENWYICR7QCP5O6DA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.194161728 (192h29m34.656254221s) [noise=true , address=45.91.116.5:4297 , piece_id=ZUII3WBJP2GZTY7TJ6RY4H7IN6LCJMBMMBVRW4CKAVDDSIKUQRBA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.219965013 (192h29m34.682057496s) [noise=true , address=45.91.116.14:4191 , piece_id=5XU743VBBYSMYMR3VRNFTOD5EZCANYDZGGKH3LOIQQVIOLPP4TLQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.741068004 (192h29m35.203160487s) [noise=true , address=145.79.227.16:4909 , piece_id=DCXMBJ4PSP4V2NYXRYRTYC4LF26S5WL5MDV3FXLW26FH23KJM5BQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.749777739 (192h29m35.211870242s) [noise=true , address=145.79.227.14:4840 , piece_id=TJ3V34WEIZEH3GHSCYCULOO64RDBUJSEIURPMLJKO2MXTMVGBORA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.891342956 (192h29m35.353435439s) [noise=true , address=77.90.31.16:4734 , piece_id=JHLMHHA255AJB7CAUDV6NPSITTNS4RE2KGWCAMGPZYRG6P3BIODA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.948800075 (192h29m35.410892548s) [noise=true , address=45.91.116.10:4082 , piece_id=JIQIADADLFTFH2NVESTQ5L36Q23NC6VNSRXOJRRYRO7AYLKH4SVA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:50.510984642 (192h29m35.973077125s) [noise=true , address=145.79.227.18:4007 , piece_id=LIS4XOQWGTR5FU2B4E54EPTNJTVQSEXVLZ5NIUKO3O76533UX6GA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:50.511045428 (192h29m35.973137911s) [seg_pos={0 0}, upload=169246]: Segment reached optimal threshold of 13 pieces. Oct 1 14:00:50.511239789 (192h29m35.973332302s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511253995 (192h29m35.973346478s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511370106 (192h29m35.973462589s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511377550 (192h29m35.973470033s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511522286 (192h29m35.973614769s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511531313 (192h29m35.973623796s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511554007 (192h29m35.97364649s) [seg_pos={0 0}, upload=169246]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 14:00:50.511706777 (192h29m35.97379926s) [upload=169246]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 14:00:50.511714452 (192h29m35.973806925s) [upload=169246]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 14:00:51.013026667 (192h29m36.47511916s) [upload=169246]: Done uploading segments... Oct 1 14:00:51.013052837 (192h29m36.47514532s) [upload=169246]: Upload finished. err: <nil> Duration: 12.679764812s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 11.033571075s FAIL (2025-10-01 14:38:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 1 14:00:46.620268370 (192h29m32.082360843s) [upload=169246]: Starting upload Oct 1 14:00:46.620346831 (192h29m32.082439324s) [upload=169246]: Done starting upload Oct 1 14:00:46.620466167 (192h29m32.08255865s) [upload=169246]: Uploading segments... Oct 1 14:00:46.620605262 (192h29m32.082697745s) [upload=169246]: Got next segment. Inline: false Oct 1 14:00:46.620643114 (192h29m32.082735597s) [upload=169246]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 14:00:46.620648935 (192h29m32.082741418s) [upload=169246]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 14:00:46.905480589 (192h29m32.367573083s) [seg_pos={0 0}, upload=169246]: Begin upload segment... Oct 1 14:00:46.905540744 (192h29m32.367633227s) [seg_pos={0 0}, upload=169246]: Done begin upload segment. Oct 1 14:00:46.905585639 (192h29m32.367678123s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.906499660 (192h29m32.368592644s) [noise=true , address=45.91.116.5:4297 , piece_id=ZUII3WBJP2GZTY7TJ6RY4H7IN6LCJMBMMBVRW4CKAVDDSIKUQRBA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.907139889 (192h29m32.369232362s) [noise=true , address=77.90.31.16:4734 , piece_id=JHLMHHA255AJB7CAUDV6NPSITTNS4RE2KGWCAMGPZYRG6P3BIODA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.907536574 (192h29m32.369629047s) [noise=true , address=145.79.227.16:4909 , piece_id=DCXMBJ4PSP4V2NYXRYRTYC4LF26S5WL5MDV3FXLW26FH23KJM5BQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.908164872 (192h29m32.370257355s) [noise=true , address=45.91.116.6:4974 , piece_id=TLA3S3E6EIEKOLRWIVI2LY22XN5E7HSO3HOT72WOLCVFJHBDQZAA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.908616101 (192h29m32.370708584s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.909195704 (192h29m32.371288207s) [noise=true , address=145.79.227.14:4840 , piece_id=TJ3V34WEIZEH3GHSCYCULOO64RDBUJSEIURPMLJKO2MXTMVGBORA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.909594123 (192h29m32.371686606s) [noise=true , address=77.90.31.21:4877 , piece_id=CIIAT4HGOKAYLTYCAREITNZGBDXUSNFVJJUGSEGP2Z3HJUIWYZ3A, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.912412530 (192h29m32.374505053s) [noise=true , address=45.91.116.14:4191 , piece_id=5XU743VBBYSMYMR3VRNFTOD5EZCANYDZGGKH3LOIQQVIOLPP4TLQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.912948871 (192h29m32.375041354s) [noise=true , address=145.79.227.18:4007 , piece_id=LIS4XOQWGTR5FU2B4E54EPTNJTVQSEXVLZ5NIUKO3O76533UX6GA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.913340867 (192h29m32.37543335s) [noise=true , address=45.91.116.10:4082 , piece_id=JIQIADADLFTFH2NVESTQ5L36Q23NC6VNSRXOJRRYRO7AYLKH4SVA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.913725519 (192h29m32.375818002s) [noise=true , address=45.91.116.4:4940 , piece_id=UQMNSPS45CULMBOQRA4VGHNM2OTLGX7MMBL6YJUDS2E27TUEPSYQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.914143846 (192h29m32.376236329s) [noise=true , address=45.91.116.13:4154 , piece_id=UAWB5SUXUMNCZ2LWEJLHXUQY7QM2XHTHJE4QAFEGDVFERB7VN6RA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.915559241 (192h29m32.377651724s) [noise=true , address=77.90.31.11:4554 , piece_id=4LPKK7WLUKTMGKMVMVTZDTQJKTBPFNKMFNOXENWYICR7QCP5O6DA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.916044856 (192h29m32.378137329s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.916466349 (192h29m32.378558832s) [noise=true , address=45.91.116.11:4119 , piece_id=7XPWFPGQX2HTUHFRHAAB42H6NBPH26IDYXBWVD33PM72BGUM4QDA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:48.753862534 (192h29m34.215955017s) [upload=169246]: Next returned nil segment Oct 1 14:00:48.753875889 (192h29m34.215968372s) [upload=169246]: Waiting for error group managing segments... Oct 1 14:00:49.106561440 (192h29m34.568653923s) [noise=true , address=45.91.116.13:4154 , piece_id=UAWB5SUXUMNCZ2LWEJLHXUQY7QM2XHTHJE4QAFEGDVFERB7VN6RA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.117617624 (192h29m34.579710107s) [noise=true , address=77.90.31.21:4877 , piece_id=CIIAT4HGOKAYLTYCAREITNZGBDXUSNFVJJUGSEGP2Z3HJUIWYZ3A, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.170896797 (192h29m34.63298928s) [noise=true , address=45.91.116.11:4119 , piece_id=7XPWFPGQX2HTUHFRHAAB42H6NBPH26IDYXBWVD33PM72BGUM4QDA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.184475364 (192h29m34.646567837s) [noise=true , address=45.91.116.4:4940 , piece_id=UQMNSPS45CULMBOQRA4VGHNM2OTLGX7MMBL6YJUDS2E27TUEPSYQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.188173746 (192h29m34.650266219s) [noise=true , address=45.91.116.6:4974 , piece_id=TLA3S3E6EIEKOLRWIVI2LY22XN5E7HSO3HOT72WOLCVFJHBDQZAA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.190647626 (192h29m34.6527401s) [noise=true , address=77.90.31.11:4554 , piece_id=4LPKK7WLUKTMGKMVMVTZDTQJKTBPFNKMFNOXENWYICR7QCP5O6DA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.194161728 (192h29m34.656254221s) [noise=true , address=45.91.116.5:4297 , piece_id=ZUII3WBJP2GZTY7TJ6RY4H7IN6LCJMBMMBVRW4CKAVDDSIKUQRBA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.219965013 (192h29m34.682057496s) [noise=true , address=45.91.116.14:4191 , piece_id=5XU743VBBYSMYMR3VRNFTOD5EZCANYDZGGKH3LOIQQVIOLPP4TLQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.741068004 (192h29m35.203160487s) [noise=true , address=145.79.227.16:4909 , piece_id=DCXMBJ4PSP4V2NYXRYRTYC4LF26S5WL5MDV3FXLW26FH23KJM5BQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.749777739 (192h29m35.211870242s) [noise=true , address=145.79.227.14:4840 , piece_id=TJ3V34WEIZEH3GHSCYCULOO64RDBUJSEIURPMLJKO2MXTMVGBORA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.891342956 (192h29m35.353435439s) [noise=true , address=77.90.31.16:4734 , piece_id=JHLMHHA255AJB7CAUDV6NPSITTNS4RE2KGWCAMGPZYRG6P3BIODA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.948800075 (192h29m35.410892548s) [noise=true , address=45.91.116.10:4082 , piece_id=JIQIADADLFTFH2NVESTQ5L36Q23NC6VNSRXOJRRYRO7AYLKH4SVA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:50.510984642 (192h29m35.973077125s) [noise=true , address=145.79.227.18:4007 , piece_id=LIS4XOQWGTR5FU2B4E54EPTNJTVQSEXVLZ5NIUKO3O76533UX6GA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:50.511045428 (192h29m35.973137911s) [seg_pos={0 0}, upload=169246]: Segment reached optimal threshold of 13 pieces. Oct 1 14:00:50.511239789 (192h29m35.973332302s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511253995 (192h29m35.973346478s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511370106 (192h29m35.973462589s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511377550 (192h29m35.973470033s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511522286 (192h29m35.973614769s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511531313 (192h29m35.973623796s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511554007 (192h29m35.97364649s) [seg_pos={0 0}, upload=169246]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 14:00:50.511706777 (192h29m35.97379926s) [upload=169246]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 14:00:50.511714452 (192h29m35.973806925s) [upload=169246]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 14:00:51.013026667 (192h29m36.47511916s) [upload=169246]: Done uploading segments... Oct 1 14:00:51.013052837 (192h29m36.47514532s) [upload=169246]: Upload finished. err: <nil> Duration: 11.033607956s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 18.523406573s FAIL (2025-10-01 14:38:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 1 14:00:46.620268370 (192h29m32.082360843s) [upload=169246]: Starting upload Oct 1 14:00:46.620346831 (192h29m32.082439324s) [upload=169246]: Done starting upload Oct 1 14:00:46.620466167 (192h29m32.08255865s) [upload=169246]: Uploading segments... Oct 1 14:00:46.620605262 (192h29m32.082697745s) [upload=169246]: Got next segment. Inline: false Oct 1 14:00:46.620643114 (192h29m32.082735597s) [upload=169246]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 14:00:46.620648935 (192h29m32.082741418s) [upload=169246]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 14:00:46.905480589 (192h29m32.367573083s) [seg_pos={0 0}, upload=169246]: Begin upload segment... Oct 1 14:00:46.905540744 (192h29m32.367633227s) [seg_pos={0 0}, upload=169246]: Done begin upload segment. Oct 1 14:00:46.905585639 (192h29m32.367678123s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.906499660 (192h29m32.368592644s) [noise=true , address=45.91.116.5:4297 , piece_id=ZUII3WBJP2GZTY7TJ6RY4H7IN6LCJMBMMBVRW4CKAVDDSIKUQRBA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.907139889 (192h29m32.369232362s) [noise=true , address=77.90.31.16:4734 , piece_id=JHLMHHA255AJB7CAUDV6NPSITTNS4RE2KGWCAMGPZYRG6P3BIODA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.907536574 (192h29m32.369629047s) [noise=true , address=145.79.227.16:4909 , piece_id=DCXMBJ4PSP4V2NYXRYRTYC4LF26S5WL5MDV3FXLW26FH23KJM5BQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.908164872 (192h29m32.370257355s) [noise=true , address=45.91.116.6:4974 , piece_id=TLA3S3E6EIEKOLRWIVI2LY22XN5E7HSO3HOT72WOLCVFJHBDQZAA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.908616101 (192h29m32.370708584s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.909195704 (192h29m32.371288207s) [noise=true , address=145.79.227.14:4840 , piece_id=TJ3V34WEIZEH3GHSCYCULOO64RDBUJSEIURPMLJKO2MXTMVGBORA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.909594123 (192h29m32.371686606s) [noise=true , address=77.90.31.21:4877 , piece_id=CIIAT4HGOKAYLTYCAREITNZGBDXUSNFVJJUGSEGP2Z3HJUIWYZ3A, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.912412530 (192h29m32.374505053s) [noise=true , address=45.91.116.14:4191 , piece_id=5XU743VBBYSMYMR3VRNFTOD5EZCANYDZGGKH3LOIQQVIOLPP4TLQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.912948871 (192h29m32.375041354s) [noise=true , address=145.79.227.18:4007 , piece_id=LIS4XOQWGTR5FU2B4E54EPTNJTVQSEXVLZ5NIUKO3O76533UX6GA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.913340867 (192h29m32.37543335s) [noise=true , address=45.91.116.10:4082 , piece_id=JIQIADADLFTFH2NVESTQ5L36Q23NC6VNSRXOJRRYRO7AYLKH4SVA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.913725519 (192h29m32.375818002s) [noise=true , address=45.91.116.4:4940 , piece_id=UQMNSPS45CULMBOQRA4VGHNM2OTLGX7MMBL6YJUDS2E27TUEPSYQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.914143846 (192h29m32.376236329s) [noise=true , address=45.91.116.13:4154 , piece_id=UAWB5SUXUMNCZ2LWEJLHXUQY7QM2XHTHJE4QAFEGDVFERB7VN6RA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.915559241 (192h29m32.377651724s) [noise=true , address=77.90.31.11:4554 , piece_id=4LPKK7WLUKTMGKMVMVTZDTQJKTBPFNKMFNOXENWYICR7QCP5O6DA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.916044856 (192h29m32.378137329s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:46.916466349 (192h29m32.378558832s) [noise=true , address=45.91.116.11:4119 , piece_id=7XPWFPGQX2HTUHFRHAAB42H6NBPH26IDYXBWVD33PM72BGUM4QDA, seg_pos={0 0}, upload=169246]: Uploading piece... Oct 1 14:00:48.753862534 (192h29m34.215955017s) [upload=169246]: Next returned nil segment Oct 1 14:00:48.753875889 (192h29m34.215968372s) [upload=169246]: Waiting for error group managing segments... Oct 1 14:00:49.106561440 (192h29m34.568653923s) [noise=true , address=45.91.116.13:4154 , piece_id=UAWB5SUXUMNCZ2LWEJLHXUQY7QM2XHTHJE4QAFEGDVFERB7VN6RA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.117617624 (192h29m34.579710107s) [noise=true , address=77.90.31.21:4877 , piece_id=CIIAT4HGOKAYLTYCAREITNZGBDXUSNFVJJUGSEGP2Z3HJUIWYZ3A, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.170896797 (192h29m34.63298928s) [noise=true , address=45.91.116.11:4119 , piece_id=7XPWFPGQX2HTUHFRHAAB42H6NBPH26IDYXBWVD33PM72BGUM4QDA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.184475364 (192h29m34.646567837s) [noise=true , address=45.91.116.4:4940 , piece_id=UQMNSPS45CULMBOQRA4VGHNM2OTLGX7MMBL6YJUDS2E27TUEPSYQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.188173746 (192h29m34.650266219s) [noise=true , address=45.91.116.6:4974 , piece_id=TLA3S3E6EIEKOLRWIVI2LY22XN5E7HSO3HOT72WOLCVFJHBDQZAA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.190647626 (192h29m34.6527401s) [noise=true , address=77.90.31.11:4554 , piece_id=4LPKK7WLUKTMGKMVMVTZDTQJKTBPFNKMFNOXENWYICR7QCP5O6DA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.194161728 (192h29m34.656254221s) [noise=true , address=45.91.116.5:4297 , piece_id=ZUII3WBJP2GZTY7TJ6RY4H7IN6LCJMBMMBVRW4CKAVDDSIKUQRBA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.219965013 (192h29m34.682057496s) [noise=true , address=45.91.116.14:4191 , piece_id=5XU743VBBYSMYMR3VRNFTOD5EZCANYDZGGKH3LOIQQVIOLPP4TLQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.741068004 (192h29m35.203160487s) [noise=true , address=145.79.227.16:4909 , piece_id=DCXMBJ4PSP4V2NYXRYRTYC4LF26S5WL5MDV3FXLW26FH23KJM5BQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.749777739 (192h29m35.211870242s) [noise=true , address=145.79.227.14:4840 , piece_id=TJ3V34WEIZEH3GHSCYCULOO64RDBUJSEIURPMLJKO2MXTMVGBORA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.891342956 (192h29m35.353435439s) [noise=true , address=77.90.31.16:4734 , piece_id=JHLMHHA255AJB7CAUDV6NPSITTNS4RE2KGWCAMGPZYRG6P3BIODA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:49.948800075 (192h29m35.410892548s) [noise=true , address=45.91.116.10:4082 , piece_id=JIQIADADLFTFH2NVESTQ5L36Q23NC6VNSRXOJRRYRO7AYLKH4SVA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:50.510984642 (192h29m35.973077125s) [noise=true , address=145.79.227.18:4007 , piece_id=LIS4XOQWGTR5FU2B4E54EPTNJTVQSEXVLZ5NIUKO3O76533UX6GA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: <nil> Oct 1 14:00:50.511045428 (192h29m35.973137911s) [seg_pos={0 0}, upload=169246]: Segment reached optimal threshold of 13 pieces. Oct 1 14:00:50.511239789 (192h29m35.973332302s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511253995 (192h29m35.973346478s) [noise=true , address=145.79.227.12:4767 , piece_id=WYGJROYL75F7O2VJ7GOKLPVUUCNOQ5BSQKT57HF6TUOTVFCIRBQQ, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511370106 (192h29m35.973462589s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511377550 (192h29m35.973470033s) [noise=true , address=145.79.227.7:4294 , piece_id=4LOO6YJKTM3RC43E23335LYYP7D4LCB67NXIIJFZFIXSZ446OPMA, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511522286 (192h29m35.973614769s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Oct 1 14:00:50.511531313 (192h29m35.973623796s) [noise=true , address=145.79.227.19:4077 , piece_id=JUHYQJSRO7HYMGMHO3RF6GMJT3BPIPRBW3EGNJ3CT66LX4RTT3GA, seg_pos={0 0}, upload=169246]: Long tail cancellation due to optimal threshold Oct 1 14:00:50.511554007 (192h29m35.97364649s) [seg_pos={0 0}, upload=169246]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 14:00:50.511706777 (192h29m35.97379926s) [upload=169246]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 14:00:50.511714452 (192h29m35.973806925s) [upload=169246]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 14:00:51.013026667 (192h29m36.47511916s) [upload=169246]: Done uploading segments... Oct 1 14:00:51.013052837 (192h29m36.47514532s) [upload=169246]: Upload finished. err: <nil> Duration: 18.52343729s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)