Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.981805382s FAIL (2025-10-19 19:09:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.981839586s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 6.124353403s FAIL (2025-10-19 19:08:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.124384412s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 6.269789133s FAIL (2025-10-19 19:07:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.269822688s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 6.017927893s FAIL (2025-10-19 19:07:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.017960866s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.129921122s FAIL (2025-10-19 19:07:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.129955045s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.150097072s FAIL (2025-10-19 19:06:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.150133671s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 6.155057078s FAIL (2025-10-19 19:06:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.155091093s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.089026661s FAIL (2025-10-19 19:05:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.089061868s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 6.097035318s FAIL (2025-10-19 19:04:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.097069833s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 6.061797355s FAIL (2025-10-19 19:03:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.061828515s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.184575682s FAIL (2025-10-19 19:03:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.184618143s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 6.06962111s FAIL (2025-10-19 19:02:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.069655975s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 6.033848291s FAIL (2025-10-19 19:01:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.03388453s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 6.424114196s FAIL (2025-10-19 19:00:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.424141028s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 6.154948276s FAIL (2025-10-19 18:59:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.154979075s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 6.076248287s FAIL (2025-10-19 18:58:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.076281631s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 6.054837299s FAIL (2025-10-19 18:57:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.05486873s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.901629391s FAIL (2025-10-19 18:57:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.901668306s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.934321743s FAIL (2025-10-19 18:56:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.934382969s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.966538601s FAIL (2025-10-19 18:56:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.966574319s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 6.347711475s FAIL (2025-10-19 18:55:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.347744097s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.796434026s FAIL (2025-10-19 18:54:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.796464223s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 6.470189545s FAIL (2025-10-19 18:53:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.470218551s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 6.426311905s FAIL (2025-10-19 18:52:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.426333896s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 6.381329008s FAIL (2025-10-19 18:51:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.381385565s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.926098721s FAIL (2025-10-19 18:50:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.926138808s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 6.055169492s FAIL (2025-10-19 18:49:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.055206744s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 6.209142121s FAIL (2025-10-19 18:49:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.209185985s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 6.562706753s FAIL (2025-10-19 18:48:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.562737861s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.976113487s FAIL (2025-10-19 18:47:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.976150418s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.987037882s FAIL (2025-10-19 18:45:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.987079622s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 6.130207938s FAIL (2025-10-19 18:45:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.130240289s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.187251596s FAIL (2025-10-19 18:44:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.187295571s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 6.199549724s FAIL (2025-10-19 18:44:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.199597285s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.046252307s FAIL (2025-10-19 18:43:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.046304046s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 6.208572479s FAIL (2025-10-19 18:41:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.208603567s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.977710068s FAIL (2025-10-19 18:40:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.977734716s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 6.373022743s FAIL (2025-10-19 18:40:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.373057488s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 6.256528525s FAIL (2025-10-19 18:39:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.256565535s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 6.36496254s FAIL (2025-10-19 18:38:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.364994059s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.280558724s FAIL (2025-10-19 18:37:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.280591787s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 6.244468179s FAIL (2025-10-19 18:36:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.24448861s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 6.45080032s FAIL (2025-10-19 18:36:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.450831899s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.260145186s FAIL (2025-10-19 18:36:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== ise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.036586942 (629h4m18.498679425s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037250595 (629h4m18.499343068s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.037767289 (629h4m18.499859772s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038222085 (629h4m18.500314558s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038656051 (629h4m18.500748524s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.038959800 (629h4m18.501052273s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039271113 (629h4m18.501363586s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039597424 (629h4m18.501689897s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.039918586 (629h4m18.502011069s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.041196769 (629h4m18.503289242s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.042526161 (629h4m18.504618674s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.043780159 (629h4m18.505872642s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.044954816 (629h4m18.507047309s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.046298554 (629h4m18.508391037s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:33.047496396 (629h4m18.509588879s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Uploading piece... Oct 19 18:35:34.709975582 (629h4m20.172068055s) [upload=553457]: Next returned nil segment Oct 19 18:35:34.709997383 (629h4m20.172089856s) [upload=553457]: Waiting for error group managing segments... Oct 19 18:35:34.985328199 (629h4m20.447420672s) [noise=true , address=145.79.227.4:4187 , piece_id=WHEUJZ7CJGBHGYVJPST5FGZXOB5S2QITCRQJLXIMFZA4XB6XVXNA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.007306921 (629h4m20.469399404s) [noise=true , address=145.79.227.11:4732 , piece_id=CZTMB3BB637GDSLPNJJCFZYE74ECGUJJT7I3YFGETOGT6VO4TZUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.188007943 (629h4m20.650100416s) [noise=true , address=145.79.227.12:4765 , piece_id=VUKLHA6FTH4O3WTZ7ZGZJKLRDCGKA4QIIXR2W5URHOIMP4Z7TDFQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.233956739 (629h4m20.696049222s) [noise=true , address=145.79.227.17:4970 , piece_id=WCCTQFETSSKDSEXCP34HICB7ZQK4TKDZEOICNCC67ETJ53SDBWZA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.309468910 (629h4m20.771561393s) [noise=true , address=145.79.227.6:4257 , piece_id=QEUMAFNWWPQODAPRNMU6VTPQD32GEYY4AMY4KSO4HCXIL6SXKUMA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.315497268 (629h4m20.777589752s) [noise=true , address=145.79.227.16:4911 , piece_id=SICZRCPW2Z52EUDZIPNB36LIG3F62E5YNYVZZRWXOA5C67C5KTNQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.380650454 (629h4m20.842742947s) [noise=true , address=145.79.227.18:4006 , piece_id=JZGDLTO3TEOG7MY34XELOMAOIFYNBLMD2GD5EJQ43RPENYDPE3BA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:35:35.451168493 (629h4m20.913260977s) [noise=true , address=145.79.227.14:4839 , piece_id=ISIC7NO7BUXHVBEBQA7I2B6NC5ZQG7UPJQZO4L3GC5ZWRCJMBYHA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:00.917983945 (629h4m46.380076428s) [noise=true , address=45.91.116.8:4047 , piece_id=2AZYJ7T7UT4HGWY6REL6LJNHS3S2S7HYNZYN2TYGQD2XNNIQOFHQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: <nil> Oct 19 18:36:02.057330282 (629h4m47.519422785s) [noise=true , address=77.90.31.19:4842 , piece_id=SKYUQDAO37UAWXMDSU7WQK7SD63AICZZWXILB3C77Q44IEO4LFPA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47382->77.90.31.19:4842: use of closed network connection Oct 19 18:36:02.057639892 (629h4m47.519732385s) [noise=true , address=45.91.116.14:4189 , piece_id=BYHB66SJJZVHCEALWZYWITQX63W7GWDRYJWUQ6CW3KUQEXJ7YTAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48326->45.91.116.14:4189: use of closed network connection Oct 19 18:36:02.057741676 (629h4m47.519834159s) [noise=true , address=45.91.116.5:4299 , piece_id=UU73PZDZVC626L2OVOU4CE4NUQK6WXYCB5YWHZDKLZBTWF7BOC6A, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44290->45.91.116.5:4299: use of closed network connection Oct 19 18:36:02.057910437 (629h4m47.52000292s) [noise=true , address=45.91.116.11:4119 , piece_id=CYZATFHUSRFGRKLXBD6J4HSRZIFN7OPDKWQDXLPOYUSGD3VYQSUQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58982->45.91.116.11:4119: use of closed network connection Oct 19 18:36:02.057936457 (629h4m47.52002894s) [noise=true , address=77.90.31.15:4698 , piece_id=SSG44QWSHC654P5BL4J3L7ESSJTVKEXOC5K34YNB2D5GFZ67E2WQ, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49834->77.90.31.15:4698: use of closed network connection Oct 19 18:36:02.058127550 (629h4m47.520220043s) [noise=true , address=77.90.31.13:4628 , piece_id=MZKHBG7X3XKCAXHNYLXPL4HXE7QNXLKGINUTKO5TOOX4KOXCOKKA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:35616->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 19 18:36:02.058183247 (629h4m47.52027573s) [noise=true , address=77.90.31.17:4772 , piece_id=NLUQVEQCPXYCKSIA4C74255DKCNPC7KLRKH2NVDTGX5E4DD6ZLAA, seg_pos={0 0}, upload=553457]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42794->77.90.31.17:4772: use of closed network connection Oct 19 18:36:02.058233211 (629h4m47.520325695s) [seg_pos={0 0}, upload=553457]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 19 18:36:02.314508332 (629h4m47.776600825s) [upload=553457]: Done uploading segments... Oct 19 18:36:02.314566082 (629h4m47.776658565s) [upload=553457]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 30.260181825s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.350035881s FAIL (2025-10-19 18:15:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Oct 19 17:26:12.329355622 (627h54m57.791448095s) [upload=552445]: Starting upload Oct 19 17:26:12.329439111 (627h54m57.791531594s) [upload=552445]: Done starting upload Oct 19 17:26:12.329750644 (627h54m57.791843127s) [upload=552445]: Uploading segments... Oct 19 17:26:12.329851596 (627h54m57.791944069s) [upload=552445]: Got next segment. Inline: false Oct 19 17:26:12.329885401 (627h54m57.791977884s) [upload=552445]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 19 17:26:12.329891191 (627h54m57.791983674s) [upload=552445]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 19 17:26:12.602430951 (627h54m58.064523434s) [seg_pos={0 0}, upload=552445]: Begin upload segment... Oct 19 17:26:12.602492017 (627h54m58.064584501s) [seg_pos={0 0}, upload=552445]: Done begin upload segment. Oct 19 17:26:12.602516074 (627h54m58.064608557s) [noise=true , address=145.79.227.2:4115 , piece_id=I23Z2KX6D4DQO4OOA4CDVOKRLKJSO6KSHYI7SNK5HEE55ZGTKWUA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.602592719 (627h54m58.064685192s) [noise=true , address=145.79.227.18:4005 , piece_id=TPIABP5BKTC6P24QP5YPGZZDS5XVRA2CXM3LEPGLUOK2XQJYHORQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.603085628 (627h54m58.065178111s) [noise=true , address=145.79.227.13:4802 , piece_id=URSKHZVGMTEQA2MLKCNWXKPNFG4EVUUOWJAYH6UG4TPOCK6KO6YA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.603477094 (627h54m58.065569577s) [noise=true , address=145.79.227.4:4187 , piece_id=YPV2NOEX63GN2B2EUU3SVJZPZOC27MXCRVP45ZZ5LGJ3VLUASGSQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.603915658 (627h54m58.066008142s) [noise=true , address=77.90.31.17:4771 , piece_id=CXFEAFBSD56UQ7ZR3GITECMY2E2HEG4OYWYZSHL6PAV7N2PW4GFA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.604556960 (627h54m58.066649443s) [noise=true , address=77.90.31.10:4517 , piece_id=QA32SFTSNB4KSTP2GEDAV7CYE2NL7MKYELZI7B2XOFW55F3PEETQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.605057282 (627h54m58.067149766s) [noise=true , address=145.79.227.16:4910 , piece_id=I57EMG737FWSQNXPNHRUTF55NO3NWO7KGX7ZPZMO5K5DTGT2VNWA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.606445276 (627h54m58.068537759s) [noise=true , address=145.79.227.19:4077 , piece_id=PXIANCKIDFILAQGVY333JJ5VZFGHDQTRPRIWFPDZQ6VIUFLWF6DA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.607064605 (627h54m58.069157088s) [noise=true , address=77.90.31.15:4698 , piece_id=CRJS5YC2HQACT3O3W7T62H6VEJIK3QY5RNNBS2YWQQ7MEPLAM6HA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.607658917 (627h54m58.06975139s) [noise=true , address=45.91.116.12:4227 , piece_id=NXGC2I6EA3YSFQEOO5ZEVLEBMLTP5S7VLZMJ4TFYD7ZMFYZZSFLA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.608181482 (627h54m58.070273965s) [noise=true , address=77.90.31.11:4553 , piece_id=FEKERHMCD34UKKUC2Q3LPTBFL3XGRPNYMNR6DFCP7GIHHOK5354A, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.608722000 (627h54m58.070814484s) [noise=true , address=145.79.227.12:4765 , piece_id=XPSYN77WK5I2IJGZMKFY5NVOO2T5B7CIGWLPXYDTYZJXICJ7FONA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.609276907 (627h54m58.07136939s) [noise=true , address=145.79.227.18:4007 , piece_id=CNCPFTHTSO2D67KV4IQBWWXEEN4YDT4L7GBABRAMTWER3JKXZLAQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.609854608 (627h54m58.071947111s) [noise=true , address=45.91.116.13:4155 , piece_id=KDTPA5H722QTM2JF4RP3GL42K4BC2FDMR6FSPXM44VBMK5NT4KQA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.610351514 (627h54m58.072443997s) [noise=true , address=45.91.116.5:4299 , piece_id=NH7JFLS674NTY2S6EIZEVX2PEMNJNVUQKC5YPHYLVDCPFQWE6BJA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.621035998 (627h54m58.083128551s) [noise=true , address=77.90.31.15:4697 , piece_id=DTCYXVHGF5IKZZQRS7O6DMGSQQKT2VIX4LA3EV3SOKILTZSVYULQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:14.366298371 (627h54m59.828390864s) [upload=552445]: Next returned nil segment Oct 19 17:26:14.366321866 (627h54m59.828414359s) [upload=552445]: Waiting for error group managing segments... Oct 19 17:26:14.732643772 (627h55m0.194736265s) [noise=true , address=77.90.31.11:4553 , piece_id=FEKERHMCD34UKKUC2Q3LPTBFL3XGRPNYMNR6DFCP7GIHHOK5354A, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.741223479 (627h55m0.203315962s) [noise=true , address=45.91.116.13:4155 , piece_id=KDTPA5H722QTM2JF4RP3GL42K4BC2FDMR6FSPXM44VBMK5NT4KQA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.744825398 (627h55m0.206917881s) [noise=true , address=45.91.116.5:4299 , piece_id=NH7JFLS674NTY2S6EIZEVX2PEMNJNVUQKC5YPHYLVDCPFQWE6BJA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.750983403 (627h55m0.213075886s) [noise=true , address=77.90.31.15:4697 , piece_id=DTCYXVHGF5IKZZQRS7O6DMGSQQKT2VIX4LA3EV3SOKILTZSVYULQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.763241314 (627h55m0.225333797s) [noise=true , address=45.91.116.12:4227 , piece_id=NXGC2I6EA3YSFQEOO5ZEVLEBMLTP5S7VLZMJ4TFYD7ZMFYZZSFLA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.782496369 (627h55m0.244588852s) [noise=true , address=77.90.31.17:4771 , piece_id=CXFEAFBSD56UQ7ZR3GITECMY2E2HEG4OYWYZSHL6PAV7N2PW4GFA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.840659891 (627h55m0.302752384s) [noise=true , address=77.90.31.15:4698 , piece_id=CRJS5YC2HQACT3O3W7T62H6VEJIK3QY5RNNBS2YWQQ7MEPLAM6HA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.881498194 (627h55m0.343590677s) [noise=true , address=77.90.31.10:4517 , piece_id=QA32SFTSNB4KSTP2GEDAV7CYE2NL7MKYELZI7B2XOFW55F3PEETQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:28.531767556 (627h55m13.993860039s) [noise=true , address=145.79.227.2:4115 , piece_id=I23Z2KX6D4DQO4OOA4CDVOKRLKJSO6KSHYI7SNK5HEE55ZGTKWUA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:31.749165630 (627h55m17.211258113s) [noise=true , address=145.79.227.16:4910 , piece_id=I57EMG737FWSQNXPNHRUTF55NO3NWO7KGX7ZPZMO5K5DTGT2VNWA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:31.817302824 (627h55m17.279395307s) [noise=true , address=145.79.227.18:4005 , piece_id=TPIABP5BKTC6P24QP5YPGZZDS5XVRA2CXM3LEPGLUOK2XQJYHORQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:34.467866944 (627h55m19.929959427s) [noise=true , address=145.79.227.12:4765 , piece_id=XPSYN77WK5I2IJGZMKFY5NVOO2T5B7CIGWLPXYDTYZJXICJ7FONA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:41.640436503 (627h55m27.102528986s) [noise=true , address=145.79.227.4:4187 , piece_id=YPV2NOEX63GN2B2EUU3SVJZPZOC27MXCRVP45ZZ5LGJ3VLUASGSQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: write tcp 188.166.225.170:51872->145.79.227.4:4187: use of closed network connection; write tcp 188.166.225.170:51872->145.79.227.4:4187: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51872->145.79.227.4:4187: use of closed network connection Oct 19 17:26:41.640555269 (627h55m27.102647752s) [noise=true , address=145.79.227.18:4007 , piece_id=CNCPFTHTSO2D67KV4IQBWWXEEN4YDT4L7GBABRAMTWER3JKXZLAQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:55240->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:55240->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55240->145.79.227.18:4007: use of closed network connection Oct 19 17:26:41.640626374 (627h55m27.102718857s) [noise=true , address=145.79.227.13:4802 , piece_id=URSKHZVGMTEQA2MLKCNWXKPNFG4EVUUOWJAYH6UG4TPOCK6KO6YA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:36480->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:36480->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36480->145.79.227.13:4802: use of closed network connection Oct 19 17:26:41.640699023 (627h55m27.102791497s) [noise=true , address=145.79.227.19:4077 , piece_id=PXIANCKIDFILAQGVY333JJ5VZFGHDQTRPRIWFPDZQ6VIUFLWF6DA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:37482->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:37482->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37482->145.79.227.19:4077: use of closed network connection Oct 19 17:26:41.640724601 (627h55m27.102817084s) [seg_pos={0 0}, upload=552445]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Oct 19 17:26:41.884159793 (627h55m27.346252286s) [upload=552445]: Done uploading segments... Oct 19 17:26:41.884195260 (627h55m27.346287734s) [upload=552445]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.350071559s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.019345484s FAIL (2025-10-19 18:14:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Oct 19 17:26:12.329355622 (627h54m57.791448095s) [upload=552445]: Starting upload Oct 19 17:26:12.329439111 (627h54m57.791531594s) [upload=552445]: Done starting upload Oct 19 17:26:12.329750644 (627h54m57.791843127s) [upload=552445]: Uploading segments... Oct 19 17:26:12.329851596 (627h54m57.791944069s) [upload=552445]: Got next segment. Inline: false Oct 19 17:26:12.329885401 (627h54m57.791977884s) [upload=552445]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 19 17:26:12.329891191 (627h54m57.791983674s) [upload=552445]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 19 17:26:12.602430951 (627h54m58.064523434s) [seg_pos={0 0}, upload=552445]: Begin upload segment... Oct 19 17:26:12.602492017 (627h54m58.064584501s) [seg_pos={0 0}, upload=552445]: Done begin upload segment. Oct 19 17:26:12.602516074 (627h54m58.064608557s) [noise=true , address=145.79.227.2:4115 , piece_id=I23Z2KX6D4DQO4OOA4CDVOKRLKJSO6KSHYI7SNK5HEE55ZGTKWUA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.602592719 (627h54m58.064685192s) [noise=true , address=145.79.227.18:4005 , piece_id=TPIABP5BKTC6P24QP5YPGZZDS5XVRA2CXM3LEPGLUOK2XQJYHORQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.603085628 (627h54m58.065178111s) [noise=true , address=145.79.227.13:4802 , piece_id=URSKHZVGMTEQA2MLKCNWXKPNFG4EVUUOWJAYH6UG4TPOCK6KO6YA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.603477094 (627h54m58.065569577s) [noise=true , address=145.79.227.4:4187 , piece_id=YPV2NOEX63GN2B2EUU3SVJZPZOC27MXCRVP45ZZ5LGJ3VLUASGSQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.603915658 (627h54m58.066008142s) [noise=true , address=77.90.31.17:4771 , piece_id=CXFEAFBSD56UQ7ZR3GITECMY2E2HEG4OYWYZSHL6PAV7N2PW4GFA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.604556960 (627h54m58.066649443s) [noise=true , address=77.90.31.10:4517 , piece_id=QA32SFTSNB4KSTP2GEDAV7CYE2NL7MKYELZI7B2XOFW55F3PEETQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.605057282 (627h54m58.067149766s) [noise=true , address=145.79.227.16:4910 , piece_id=I57EMG737FWSQNXPNHRUTF55NO3NWO7KGX7ZPZMO5K5DTGT2VNWA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.606445276 (627h54m58.068537759s) [noise=true , address=145.79.227.19:4077 , piece_id=PXIANCKIDFILAQGVY333JJ5VZFGHDQTRPRIWFPDZQ6VIUFLWF6DA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.607064605 (627h54m58.069157088s) [noise=true , address=77.90.31.15:4698 , piece_id=CRJS5YC2HQACT3O3W7T62H6VEJIK3QY5RNNBS2YWQQ7MEPLAM6HA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.607658917 (627h54m58.06975139s) [noise=true , address=45.91.116.12:4227 , piece_id=NXGC2I6EA3YSFQEOO5ZEVLEBMLTP5S7VLZMJ4TFYD7ZMFYZZSFLA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.608181482 (627h54m58.070273965s) [noise=true , address=77.90.31.11:4553 , piece_id=FEKERHMCD34UKKUC2Q3LPTBFL3XGRPNYMNR6DFCP7GIHHOK5354A, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.608722000 (627h54m58.070814484s) [noise=true , address=145.79.227.12:4765 , piece_id=XPSYN77WK5I2IJGZMKFY5NVOO2T5B7CIGWLPXYDTYZJXICJ7FONA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.609276907 (627h54m58.07136939s) [noise=true , address=145.79.227.18:4007 , piece_id=CNCPFTHTSO2D67KV4IQBWWXEEN4YDT4L7GBABRAMTWER3JKXZLAQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.609854608 (627h54m58.071947111s) [noise=true , address=45.91.116.13:4155 , piece_id=KDTPA5H722QTM2JF4RP3GL42K4BC2FDMR6FSPXM44VBMK5NT4KQA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.610351514 (627h54m58.072443997s) [noise=true , address=45.91.116.5:4299 , piece_id=NH7JFLS674NTY2S6EIZEVX2PEMNJNVUQKC5YPHYLVDCPFQWE6BJA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.621035998 (627h54m58.083128551s) [noise=true , address=77.90.31.15:4697 , piece_id=DTCYXVHGF5IKZZQRS7O6DMGSQQKT2VIX4LA3EV3SOKILTZSVYULQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:14.366298371 (627h54m59.828390864s) [upload=552445]: Next returned nil segment Oct 19 17:26:14.366321866 (627h54m59.828414359s) [upload=552445]: Waiting for error group managing segments... Oct 19 17:26:14.732643772 (627h55m0.194736265s) [noise=true , address=77.90.31.11:4553 , piece_id=FEKERHMCD34UKKUC2Q3LPTBFL3XGRPNYMNR6DFCP7GIHHOK5354A, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.741223479 (627h55m0.203315962s) [noise=true , address=45.91.116.13:4155 , piece_id=KDTPA5H722QTM2JF4RP3GL42K4BC2FDMR6FSPXM44VBMK5NT4KQA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.744825398 (627h55m0.206917881s) [noise=true , address=45.91.116.5:4299 , piece_id=NH7JFLS674NTY2S6EIZEVX2PEMNJNVUQKC5YPHYLVDCPFQWE6BJA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.750983403 (627h55m0.213075886s) [noise=true , address=77.90.31.15:4697 , piece_id=DTCYXVHGF5IKZZQRS7O6DMGSQQKT2VIX4LA3EV3SOKILTZSVYULQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.763241314 (627h55m0.225333797s) [noise=true , address=45.91.116.12:4227 , piece_id=NXGC2I6EA3YSFQEOO5ZEVLEBMLTP5S7VLZMJ4TFYD7ZMFYZZSFLA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.782496369 (627h55m0.244588852s) [noise=true , address=77.90.31.17:4771 , piece_id=CXFEAFBSD56UQ7ZR3GITECMY2E2HEG4OYWYZSHL6PAV7N2PW4GFA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.840659891 (627h55m0.302752384s) [noise=true , address=77.90.31.15:4698 , piece_id=CRJS5YC2HQACT3O3W7T62H6VEJIK3QY5RNNBS2YWQQ7MEPLAM6HA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.881498194 (627h55m0.343590677s) [noise=true , address=77.90.31.10:4517 , piece_id=QA32SFTSNB4KSTP2GEDAV7CYE2NL7MKYELZI7B2XOFW55F3PEETQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:28.531767556 (627h55m13.993860039s) [noise=true , address=145.79.227.2:4115 , piece_id=I23Z2KX6D4DQO4OOA4CDVOKRLKJSO6KSHYI7SNK5HEE55ZGTKWUA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:31.749165630 (627h55m17.211258113s) [noise=true , address=145.79.227.16:4910 , piece_id=I57EMG737FWSQNXPNHRUTF55NO3NWO7KGX7ZPZMO5K5DTGT2VNWA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:31.817302824 (627h55m17.279395307s) [noise=true , address=145.79.227.18:4005 , piece_id=TPIABP5BKTC6P24QP5YPGZZDS5XVRA2CXM3LEPGLUOK2XQJYHORQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:34.467866944 (627h55m19.929959427s) [noise=true , address=145.79.227.12:4765 , piece_id=XPSYN77WK5I2IJGZMKFY5NVOO2T5B7CIGWLPXYDTYZJXICJ7FONA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:41.640436503 (627h55m27.102528986s) [noise=true , address=145.79.227.4:4187 , piece_id=YPV2NOEX63GN2B2EUU3SVJZPZOC27MXCRVP45ZZ5LGJ3VLUASGSQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: write tcp 188.166.225.170:51872->145.79.227.4:4187: use of closed network connection; write tcp 188.166.225.170:51872->145.79.227.4:4187: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51872->145.79.227.4:4187: use of closed network connection Oct 19 17:26:41.640555269 (627h55m27.102647752s) [noise=true , address=145.79.227.18:4007 , piece_id=CNCPFTHTSO2D67KV4IQBWWXEEN4YDT4L7GBABRAMTWER3JKXZLAQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:55240->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:55240->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55240->145.79.227.18:4007: use of closed network connection Oct 19 17:26:41.640626374 (627h55m27.102718857s) [noise=true , address=145.79.227.13:4802 , piece_id=URSKHZVGMTEQA2MLKCNWXKPNFG4EVUUOWJAYH6UG4TPOCK6KO6YA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:36480->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:36480->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36480->145.79.227.13:4802: use of closed network connection Oct 19 17:26:41.640699023 (627h55m27.102791497s) [noise=true , address=145.79.227.19:4077 , piece_id=PXIANCKIDFILAQGVY333JJ5VZFGHDQTRPRIWFPDZQ6VIUFLWF6DA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:37482->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:37482->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37482->145.79.227.19:4077: use of closed network connection Oct 19 17:26:41.640724601 (627h55m27.102817084s) [seg_pos={0 0}, upload=552445]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Oct 19 17:26:41.884159793 (627h55m27.346252286s) [upload=552445]: Done uploading segments... Oct 19 17:26:41.884195260 (627h55m27.346287734s) [upload=552445]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.019379531s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 6.257252006s FAIL (2025-10-19 18:13:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Oct 19 17:26:12.329355622 (627h54m57.791448095s) [upload=552445]: Starting upload Oct 19 17:26:12.329439111 (627h54m57.791531594s) [upload=552445]: Done starting upload Oct 19 17:26:12.329750644 (627h54m57.791843127s) [upload=552445]: Uploading segments... Oct 19 17:26:12.329851596 (627h54m57.791944069s) [upload=552445]: Got next segment. Inline: false Oct 19 17:26:12.329885401 (627h54m57.791977884s) [upload=552445]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 19 17:26:12.329891191 (627h54m57.791983674s) [upload=552445]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 19 17:26:12.602430951 (627h54m58.064523434s) [seg_pos={0 0}, upload=552445]: Begin upload segment... Oct 19 17:26:12.602492017 (627h54m58.064584501s) [seg_pos={0 0}, upload=552445]: Done begin upload segment. Oct 19 17:26:12.602516074 (627h54m58.064608557s) [noise=true , address=145.79.227.2:4115 , piece_id=I23Z2KX6D4DQO4OOA4CDVOKRLKJSO6KSHYI7SNK5HEE55ZGTKWUA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.602592719 (627h54m58.064685192s) [noise=true , address=145.79.227.18:4005 , piece_id=TPIABP5BKTC6P24QP5YPGZZDS5XVRA2CXM3LEPGLUOK2XQJYHORQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.603085628 (627h54m58.065178111s) [noise=true , address=145.79.227.13:4802 , piece_id=URSKHZVGMTEQA2MLKCNWXKPNFG4EVUUOWJAYH6UG4TPOCK6KO6YA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.603477094 (627h54m58.065569577s) [noise=true , address=145.79.227.4:4187 , piece_id=YPV2NOEX63GN2B2EUU3SVJZPZOC27MXCRVP45ZZ5LGJ3VLUASGSQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.603915658 (627h54m58.066008142s) [noise=true , address=77.90.31.17:4771 , piece_id=CXFEAFBSD56UQ7ZR3GITECMY2E2HEG4OYWYZSHL6PAV7N2PW4GFA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.604556960 (627h54m58.066649443s) [noise=true , address=77.90.31.10:4517 , piece_id=QA32SFTSNB4KSTP2GEDAV7CYE2NL7MKYELZI7B2XOFW55F3PEETQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.605057282 (627h54m58.067149766s) [noise=true , address=145.79.227.16:4910 , piece_id=I57EMG737FWSQNXPNHRUTF55NO3NWO7KGX7ZPZMO5K5DTGT2VNWA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.606445276 (627h54m58.068537759s) [noise=true , address=145.79.227.19:4077 , piece_id=PXIANCKIDFILAQGVY333JJ5VZFGHDQTRPRIWFPDZQ6VIUFLWF6DA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.607064605 (627h54m58.069157088s) [noise=true , address=77.90.31.15:4698 , piece_id=CRJS5YC2HQACT3O3W7T62H6VEJIK3QY5RNNBS2YWQQ7MEPLAM6HA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.607658917 (627h54m58.06975139s) [noise=true , address=45.91.116.12:4227 , piece_id=NXGC2I6EA3YSFQEOO5ZEVLEBMLTP5S7VLZMJ4TFYD7ZMFYZZSFLA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.608181482 (627h54m58.070273965s) [noise=true , address=77.90.31.11:4553 , piece_id=FEKERHMCD34UKKUC2Q3LPTBFL3XGRPNYMNR6DFCP7GIHHOK5354A, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.608722000 (627h54m58.070814484s) [noise=true , address=145.79.227.12:4765 , piece_id=XPSYN77WK5I2IJGZMKFY5NVOO2T5B7CIGWLPXYDTYZJXICJ7FONA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.609276907 (627h54m58.07136939s) [noise=true , address=145.79.227.18:4007 , piece_id=CNCPFTHTSO2D67KV4IQBWWXEEN4YDT4L7GBABRAMTWER3JKXZLAQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.609854608 (627h54m58.071947111s) [noise=true , address=45.91.116.13:4155 , piece_id=KDTPA5H722QTM2JF4RP3GL42K4BC2FDMR6FSPXM44VBMK5NT4KQA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.610351514 (627h54m58.072443997s) [noise=true , address=45.91.116.5:4299 , piece_id=NH7JFLS674NTY2S6EIZEVX2PEMNJNVUQKC5YPHYLVDCPFQWE6BJA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.621035998 (627h54m58.083128551s) [noise=true , address=77.90.31.15:4697 , piece_id=DTCYXVHGF5IKZZQRS7O6DMGSQQKT2VIX4LA3EV3SOKILTZSVYULQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:14.366298371 (627h54m59.828390864s) [upload=552445]: Next returned nil segment Oct 19 17:26:14.366321866 (627h54m59.828414359s) [upload=552445]: Waiting for error group managing segments... Oct 19 17:26:14.732643772 (627h55m0.194736265s) [noise=true , address=77.90.31.11:4553 , piece_id=FEKERHMCD34UKKUC2Q3LPTBFL3XGRPNYMNR6DFCP7GIHHOK5354A, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.741223479 (627h55m0.203315962s) [noise=true , address=45.91.116.13:4155 , piece_id=KDTPA5H722QTM2JF4RP3GL42K4BC2FDMR6FSPXM44VBMK5NT4KQA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.744825398 (627h55m0.206917881s) [noise=true , address=45.91.116.5:4299 , piece_id=NH7JFLS674NTY2S6EIZEVX2PEMNJNVUQKC5YPHYLVDCPFQWE6BJA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.750983403 (627h55m0.213075886s) [noise=true , address=77.90.31.15:4697 , piece_id=DTCYXVHGF5IKZZQRS7O6DMGSQQKT2VIX4LA3EV3SOKILTZSVYULQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.763241314 (627h55m0.225333797s) [noise=true , address=45.91.116.12:4227 , piece_id=NXGC2I6EA3YSFQEOO5ZEVLEBMLTP5S7VLZMJ4TFYD7ZMFYZZSFLA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.782496369 (627h55m0.244588852s) [noise=true , address=77.90.31.17:4771 , piece_id=CXFEAFBSD56UQ7ZR3GITECMY2E2HEG4OYWYZSHL6PAV7N2PW4GFA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.840659891 (627h55m0.302752384s) [noise=true , address=77.90.31.15:4698 , piece_id=CRJS5YC2HQACT3O3W7T62H6VEJIK3QY5RNNBS2YWQQ7MEPLAM6HA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.881498194 (627h55m0.343590677s) [noise=true , address=77.90.31.10:4517 , piece_id=QA32SFTSNB4KSTP2GEDAV7CYE2NL7MKYELZI7B2XOFW55F3PEETQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:28.531767556 (627h55m13.993860039s) [noise=true , address=145.79.227.2:4115 , piece_id=I23Z2KX6D4DQO4OOA4CDVOKRLKJSO6KSHYI7SNK5HEE55ZGTKWUA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:31.749165630 (627h55m17.211258113s) [noise=true , address=145.79.227.16:4910 , piece_id=I57EMG737FWSQNXPNHRUTF55NO3NWO7KGX7ZPZMO5K5DTGT2VNWA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:31.817302824 (627h55m17.279395307s) [noise=true , address=145.79.227.18:4005 , piece_id=TPIABP5BKTC6P24QP5YPGZZDS5XVRA2CXM3LEPGLUOK2XQJYHORQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:34.467866944 (627h55m19.929959427s) [noise=true , address=145.79.227.12:4765 , piece_id=XPSYN77WK5I2IJGZMKFY5NVOO2T5B7CIGWLPXYDTYZJXICJ7FONA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:41.640436503 (627h55m27.102528986s) [noise=true , address=145.79.227.4:4187 , piece_id=YPV2NOEX63GN2B2EUU3SVJZPZOC27MXCRVP45ZZ5LGJ3VLUASGSQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: write tcp 188.166.225.170:51872->145.79.227.4:4187: use of closed network connection; write tcp 188.166.225.170:51872->145.79.227.4:4187: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51872->145.79.227.4:4187: use of closed network connection Oct 19 17:26:41.640555269 (627h55m27.102647752s) [noise=true , address=145.79.227.18:4007 , piece_id=CNCPFTHTSO2D67KV4IQBWWXEEN4YDT4L7GBABRAMTWER3JKXZLAQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:55240->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:55240->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55240->145.79.227.18:4007: use of closed network connection Oct 19 17:26:41.640626374 (627h55m27.102718857s) [noise=true , address=145.79.227.13:4802 , piece_id=URSKHZVGMTEQA2MLKCNWXKPNFG4EVUUOWJAYH6UG4TPOCK6KO6YA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:36480->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:36480->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36480->145.79.227.13:4802: use of closed network connection Oct 19 17:26:41.640699023 (627h55m27.102791497s) [noise=true , address=145.79.227.19:4077 , piece_id=PXIANCKIDFILAQGVY333JJ5VZFGHDQTRPRIWFPDZQ6VIUFLWF6DA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:37482->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:37482->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37482->145.79.227.19:4077: use of closed network connection Oct 19 17:26:41.640724601 (627h55m27.102817084s) [seg_pos={0 0}, upload=552445]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Oct 19 17:26:41.884159793 (627h55m27.346252286s) [upload=552445]: Done uploading segments... Oct 19 17:26:41.884195260 (627h55m27.346287734s) [upload=552445]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.257286873s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 6.479372302s FAIL (2025-10-19 18:12:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Oct 19 17:26:12.329355622 (627h54m57.791448095s) [upload=552445]: Starting upload Oct 19 17:26:12.329439111 (627h54m57.791531594s) [upload=552445]: Done starting upload Oct 19 17:26:12.329750644 (627h54m57.791843127s) [upload=552445]: Uploading segments... Oct 19 17:26:12.329851596 (627h54m57.791944069s) [upload=552445]: Got next segment. Inline: false Oct 19 17:26:12.329885401 (627h54m57.791977884s) [upload=552445]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 19 17:26:12.329891191 (627h54m57.791983674s) [upload=552445]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 19 17:26:12.602430951 (627h54m58.064523434s) [seg_pos={0 0}, upload=552445]: Begin upload segment... Oct 19 17:26:12.602492017 (627h54m58.064584501s) [seg_pos={0 0}, upload=552445]: Done begin upload segment. Oct 19 17:26:12.602516074 (627h54m58.064608557s) [noise=true , address=145.79.227.2:4115 , piece_id=I23Z2KX6D4DQO4OOA4CDVOKRLKJSO6KSHYI7SNK5HEE55ZGTKWUA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.602592719 (627h54m58.064685192s) [noise=true , address=145.79.227.18:4005 , piece_id=TPIABP5BKTC6P24QP5YPGZZDS5XVRA2CXM3LEPGLUOK2XQJYHORQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.603085628 (627h54m58.065178111s) [noise=true , address=145.79.227.13:4802 , piece_id=URSKHZVGMTEQA2MLKCNWXKPNFG4EVUUOWJAYH6UG4TPOCK6KO6YA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.603477094 (627h54m58.065569577s) [noise=true , address=145.79.227.4:4187 , piece_id=YPV2NOEX63GN2B2EUU3SVJZPZOC27MXCRVP45ZZ5LGJ3VLUASGSQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.603915658 (627h54m58.066008142s) [noise=true , address=77.90.31.17:4771 , piece_id=CXFEAFBSD56UQ7ZR3GITECMY2E2HEG4OYWYZSHL6PAV7N2PW4GFA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.604556960 (627h54m58.066649443s) [noise=true , address=77.90.31.10:4517 , piece_id=QA32SFTSNB4KSTP2GEDAV7CYE2NL7MKYELZI7B2XOFW55F3PEETQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.605057282 (627h54m58.067149766s) [noise=true , address=145.79.227.16:4910 , piece_id=I57EMG737FWSQNXPNHRUTF55NO3NWO7KGX7ZPZMO5K5DTGT2VNWA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.606445276 (627h54m58.068537759s) [noise=true , address=145.79.227.19:4077 , piece_id=PXIANCKIDFILAQGVY333JJ5VZFGHDQTRPRIWFPDZQ6VIUFLWF6DA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.607064605 (627h54m58.069157088s) [noise=true , address=77.90.31.15:4698 , piece_id=CRJS5YC2HQACT3O3W7T62H6VEJIK3QY5RNNBS2YWQQ7MEPLAM6HA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.607658917 (627h54m58.06975139s) [noise=true , address=45.91.116.12:4227 , piece_id=NXGC2I6EA3YSFQEOO5ZEVLEBMLTP5S7VLZMJ4TFYD7ZMFYZZSFLA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.608181482 (627h54m58.070273965s) [noise=true , address=77.90.31.11:4553 , piece_id=FEKERHMCD34UKKUC2Q3LPTBFL3XGRPNYMNR6DFCP7GIHHOK5354A, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.608722000 (627h54m58.070814484s) [noise=true , address=145.79.227.12:4765 , piece_id=XPSYN77WK5I2IJGZMKFY5NVOO2T5B7CIGWLPXYDTYZJXICJ7FONA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.609276907 (627h54m58.07136939s) [noise=true , address=145.79.227.18:4007 , piece_id=CNCPFTHTSO2D67KV4IQBWWXEEN4YDT4L7GBABRAMTWER3JKXZLAQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.609854608 (627h54m58.071947111s) [noise=true , address=45.91.116.13:4155 , piece_id=KDTPA5H722QTM2JF4RP3GL42K4BC2FDMR6FSPXM44VBMK5NT4KQA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.610351514 (627h54m58.072443997s) [noise=true , address=45.91.116.5:4299 , piece_id=NH7JFLS674NTY2S6EIZEVX2PEMNJNVUQKC5YPHYLVDCPFQWE6BJA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.621035998 (627h54m58.083128551s) [noise=true , address=77.90.31.15:4697 , piece_id=DTCYXVHGF5IKZZQRS7O6DMGSQQKT2VIX4LA3EV3SOKILTZSVYULQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:14.366298371 (627h54m59.828390864s) [upload=552445]: Next returned nil segment Oct 19 17:26:14.366321866 (627h54m59.828414359s) [upload=552445]: Waiting for error group managing segments... Oct 19 17:26:14.732643772 (627h55m0.194736265s) [noise=true , address=77.90.31.11:4553 , piece_id=FEKERHMCD34UKKUC2Q3LPTBFL3XGRPNYMNR6DFCP7GIHHOK5354A, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.741223479 (627h55m0.203315962s) [noise=true , address=45.91.116.13:4155 , piece_id=KDTPA5H722QTM2JF4RP3GL42K4BC2FDMR6FSPXM44VBMK5NT4KQA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.744825398 (627h55m0.206917881s) [noise=true , address=45.91.116.5:4299 , piece_id=NH7JFLS674NTY2S6EIZEVX2PEMNJNVUQKC5YPHYLVDCPFQWE6BJA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.750983403 (627h55m0.213075886s) [noise=true , address=77.90.31.15:4697 , piece_id=DTCYXVHGF5IKZZQRS7O6DMGSQQKT2VIX4LA3EV3SOKILTZSVYULQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.763241314 (627h55m0.225333797s) [noise=true , address=45.91.116.12:4227 , piece_id=NXGC2I6EA3YSFQEOO5ZEVLEBMLTP5S7VLZMJ4TFYD7ZMFYZZSFLA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.782496369 (627h55m0.244588852s) [noise=true , address=77.90.31.17:4771 , piece_id=CXFEAFBSD56UQ7ZR3GITECMY2E2HEG4OYWYZSHL6PAV7N2PW4GFA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.840659891 (627h55m0.302752384s) [noise=true , address=77.90.31.15:4698 , piece_id=CRJS5YC2HQACT3O3W7T62H6VEJIK3QY5RNNBS2YWQQ7MEPLAM6HA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.881498194 (627h55m0.343590677s) [noise=true , address=77.90.31.10:4517 , piece_id=QA32SFTSNB4KSTP2GEDAV7CYE2NL7MKYELZI7B2XOFW55F3PEETQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:28.531767556 (627h55m13.993860039s) [noise=true , address=145.79.227.2:4115 , piece_id=I23Z2KX6D4DQO4OOA4CDVOKRLKJSO6KSHYI7SNK5HEE55ZGTKWUA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:31.749165630 (627h55m17.211258113s) [noise=true , address=145.79.227.16:4910 , piece_id=I57EMG737FWSQNXPNHRUTF55NO3NWO7KGX7ZPZMO5K5DTGT2VNWA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:31.817302824 (627h55m17.279395307s) [noise=true , address=145.79.227.18:4005 , piece_id=TPIABP5BKTC6P24QP5YPGZZDS5XVRA2CXM3LEPGLUOK2XQJYHORQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:34.467866944 (627h55m19.929959427s) [noise=true , address=145.79.227.12:4765 , piece_id=XPSYN77WK5I2IJGZMKFY5NVOO2T5B7CIGWLPXYDTYZJXICJ7FONA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:41.640436503 (627h55m27.102528986s) [noise=true , address=145.79.227.4:4187 , piece_id=YPV2NOEX63GN2B2EUU3SVJZPZOC27MXCRVP45ZZ5LGJ3VLUASGSQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: write tcp 188.166.225.170:51872->145.79.227.4:4187: use of closed network connection; write tcp 188.166.225.170:51872->145.79.227.4:4187: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51872->145.79.227.4:4187: use of closed network connection Oct 19 17:26:41.640555269 (627h55m27.102647752s) [noise=true , address=145.79.227.18:4007 , piece_id=CNCPFTHTSO2D67KV4IQBWWXEEN4YDT4L7GBABRAMTWER3JKXZLAQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:55240->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:55240->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55240->145.79.227.18:4007: use of closed network connection Oct 19 17:26:41.640626374 (627h55m27.102718857s) [noise=true , address=145.79.227.13:4802 , piece_id=URSKHZVGMTEQA2MLKCNWXKPNFG4EVUUOWJAYH6UG4TPOCK6KO6YA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:36480->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:36480->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36480->145.79.227.13:4802: use of closed network connection Oct 19 17:26:41.640699023 (627h55m27.102791497s) [noise=true , address=145.79.227.19:4077 , piece_id=PXIANCKIDFILAQGVY333JJ5VZFGHDQTRPRIWFPDZQ6VIUFLWF6DA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:37482->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:37482->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37482->145.79.227.19:4077: use of closed network connection Oct 19 17:26:41.640724601 (627h55m27.102817084s) [seg_pos={0 0}, upload=552445]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Oct 19 17:26:41.884159793 (627h55m27.346252286s) [upload=552445]: Done uploading segments... Oct 19 17:26:41.884195260 (627h55m27.346287734s) [upload=552445]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.479404834s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 6.275726443s FAIL (2025-10-19 18:12:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Oct 19 17:26:12.329355622 (627h54m57.791448095s) [upload=552445]: Starting upload Oct 19 17:26:12.329439111 (627h54m57.791531594s) [upload=552445]: Done starting upload Oct 19 17:26:12.329750644 (627h54m57.791843127s) [upload=552445]: Uploading segments... Oct 19 17:26:12.329851596 (627h54m57.791944069s) [upload=552445]: Got next segment. Inline: false Oct 19 17:26:12.329885401 (627h54m57.791977884s) [upload=552445]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 19 17:26:12.329891191 (627h54m57.791983674s) [upload=552445]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 19 17:26:12.602430951 (627h54m58.064523434s) [seg_pos={0 0}, upload=552445]: Begin upload segment... Oct 19 17:26:12.602492017 (627h54m58.064584501s) [seg_pos={0 0}, upload=552445]: Done begin upload segment. Oct 19 17:26:12.602516074 (627h54m58.064608557s) [noise=true , address=145.79.227.2:4115 , piece_id=I23Z2KX6D4DQO4OOA4CDVOKRLKJSO6KSHYI7SNK5HEE55ZGTKWUA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.602592719 (627h54m58.064685192s) [noise=true , address=145.79.227.18:4005 , piece_id=TPIABP5BKTC6P24QP5YPGZZDS5XVRA2CXM3LEPGLUOK2XQJYHORQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.603085628 (627h54m58.065178111s) [noise=true , address=145.79.227.13:4802 , piece_id=URSKHZVGMTEQA2MLKCNWXKPNFG4EVUUOWJAYH6UG4TPOCK6KO6YA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.603477094 (627h54m58.065569577s) [noise=true , address=145.79.227.4:4187 , piece_id=YPV2NOEX63GN2B2EUU3SVJZPZOC27MXCRVP45ZZ5LGJ3VLUASGSQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.603915658 (627h54m58.066008142s) [noise=true , address=77.90.31.17:4771 , piece_id=CXFEAFBSD56UQ7ZR3GITECMY2E2HEG4OYWYZSHL6PAV7N2PW4GFA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.604556960 (627h54m58.066649443s) [noise=true , address=77.90.31.10:4517 , piece_id=QA32SFTSNB4KSTP2GEDAV7CYE2NL7MKYELZI7B2XOFW55F3PEETQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.605057282 (627h54m58.067149766s) [noise=true , address=145.79.227.16:4910 , piece_id=I57EMG737FWSQNXPNHRUTF55NO3NWO7KGX7ZPZMO5K5DTGT2VNWA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.606445276 (627h54m58.068537759s) [noise=true , address=145.79.227.19:4077 , piece_id=PXIANCKIDFILAQGVY333JJ5VZFGHDQTRPRIWFPDZQ6VIUFLWF6DA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.607064605 (627h54m58.069157088s) [noise=true , address=77.90.31.15:4698 , piece_id=CRJS5YC2HQACT3O3W7T62H6VEJIK3QY5RNNBS2YWQQ7MEPLAM6HA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.607658917 (627h54m58.06975139s) [noise=true , address=45.91.116.12:4227 , piece_id=NXGC2I6EA3YSFQEOO5ZEVLEBMLTP5S7VLZMJ4TFYD7ZMFYZZSFLA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.608181482 (627h54m58.070273965s) [noise=true , address=77.90.31.11:4553 , piece_id=FEKERHMCD34UKKUC2Q3LPTBFL3XGRPNYMNR6DFCP7GIHHOK5354A, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.608722000 (627h54m58.070814484s) [noise=true , address=145.79.227.12:4765 , piece_id=XPSYN77WK5I2IJGZMKFY5NVOO2T5B7CIGWLPXYDTYZJXICJ7FONA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.609276907 (627h54m58.07136939s) [noise=true , address=145.79.227.18:4007 , piece_id=CNCPFTHTSO2D67KV4IQBWWXEEN4YDT4L7GBABRAMTWER3JKXZLAQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.609854608 (627h54m58.071947111s) [noise=true , address=45.91.116.13:4155 , piece_id=KDTPA5H722QTM2JF4RP3GL42K4BC2FDMR6FSPXM44VBMK5NT4KQA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.610351514 (627h54m58.072443997s) [noise=true , address=45.91.116.5:4299 , piece_id=NH7JFLS674NTY2S6EIZEVX2PEMNJNVUQKC5YPHYLVDCPFQWE6BJA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.621035998 (627h54m58.083128551s) [noise=true , address=77.90.31.15:4697 , piece_id=DTCYXVHGF5IKZZQRS7O6DMGSQQKT2VIX4LA3EV3SOKILTZSVYULQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:14.366298371 (627h54m59.828390864s) [upload=552445]: Next returned nil segment Oct 19 17:26:14.366321866 (627h54m59.828414359s) [upload=552445]: Waiting for error group managing segments... Oct 19 17:26:14.732643772 (627h55m0.194736265s) [noise=true , address=77.90.31.11:4553 , piece_id=FEKERHMCD34UKKUC2Q3LPTBFL3XGRPNYMNR6DFCP7GIHHOK5354A, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.741223479 (627h55m0.203315962s) [noise=true , address=45.91.116.13:4155 , piece_id=KDTPA5H722QTM2JF4RP3GL42K4BC2FDMR6FSPXM44VBMK5NT4KQA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.744825398 (627h55m0.206917881s) [noise=true , address=45.91.116.5:4299 , piece_id=NH7JFLS674NTY2S6EIZEVX2PEMNJNVUQKC5YPHYLVDCPFQWE6BJA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.750983403 (627h55m0.213075886s) [noise=true , address=77.90.31.15:4697 , piece_id=DTCYXVHGF5IKZZQRS7O6DMGSQQKT2VIX4LA3EV3SOKILTZSVYULQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.763241314 (627h55m0.225333797s) [noise=true , address=45.91.116.12:4227 , piece_id=NXGC2I6EA3YSFQEOO5ZEVLEBMLTP5S7VLZMJ4TFYD7ZMFYZZSFLA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.782496369 (627h55m0.244588852s) [noise=true , address=77.90.31.17:4771 , piece_id=CXFEAFBSD56UQ7ZR3GITECMY2E2HEG4OYWYZSHL6PAV7N2PW4GFA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.840659891 (627h55m0.302752384s) [noise=true , address=77.90.31.15:4698 , piece_id=CRJS5YC2HQACT3O3W7T62H6VEJIK3QY5RNNBS2YWQQ7MEPLAM6HA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.881498194 (627h55m0.343590677s) [noise=true , address=77.90.31.10:4517 , piece_id=QA32SFTSNB4KSTP2GEDAV7CYE2NL7MKYELZI7B2XOFW55F3PEETQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:28.531767556 (627h55m13.993860039s) [noise=true , address=145.79.227.2:4115 , piece_id=I23Z2KX6D4DQO4OOA4CDVOKRLKJSO6KSHYI7SNK5HEE55ZGTKWUA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:31.749165630 (627h55m17.211258113s) [noise=true , address=145.79.227.16:4910 , piece_id=I57EMG737FWSQNXPNHRUTF55NO3NWO7KGX7ZPZMO5K5DTGT2VNWA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:31.817302824 (627h55m17.279395307s) [noise=true , address=145.79.227.18:4005 , piece_id=TPIABP5BKTC6P24QP5YPGZZDS5XVRA2CXM3LEPGLUOK2XQJYHORQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:34.467866944 (627h55m19.929959427s) [noise=true , address=145.79.227.12:4765 , piece_id=XPSYN77WK5I2IJGZMKFY5NVOO2T5B7CIGWLPXYDTYZJXICJ7FONA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:41.640436503 (627h55m27.102528986s) [noise=true , address=145.79.227.4:4187 , piece_id=YPV2NOEX63GN2B2EUU3SVJZPZOC27MXCRVP45ZZ5LGJ3VLUASGSQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: write tcp 188.166.225.170:51872->145.79.227.4:4187: use of closed network connection; write tcp 188.166.225.170:51872->145.79.227.4:4187: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51872->145.79.227.4:4187: use of closed network connection Oct 19 17:26:41.640555269 (627h55m27.102647752s) [noise=true , address=145.79.227.18:4007 , piece_id=CNCPFTHTSO2D67KV4IQBWWXEEN4YDT4L7GBABRAMTWER3JKXZLAQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:55240->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:55240->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55240->145.79.227.18:4007: use of closed network connection Oct 19 17:26:41.640626374 (627h55m27.102718857s) [noise=true , address=145.79.227.13:4802 , piece_id=URSKHZVGMTEQA2MLKCNWXKPNFG4EVUUOWJAYH6UG4TPOCK6KO6YA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:36480->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:36480->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36480->145.79.227.13:4802: use of closed network connection Oct 19 17:26:41.640699023 (627h55m27.102791497s) [noise=true , address=145.79.227.19:4077 , piece_id=PXIANCKIDFILAQGVY333JJ5VZFGHDQTRPRIWFPDZQ6VIUFLWF6DA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:37482->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:37482->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37482->145.79.227.19:4077: use of closed network connection Oct 19 17:26:41.640724601 (627h55m27.102817084s) [seg_pos={0 0}, upload=552445]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Oct 19 17:26:41.884159793 (627h55m27.346252286s) [upload=552445]: Done uploading segments... Oct 19 17:26:41.884195260 (627h55m27.346287734s) [upload=552445]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.275758575s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [X....X......................................................] duration: 6.52491393s FAIL (2025-10-19 18:11:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Oct 19 17:26:12.329355622 (627h54m57.791448095s) [upload=552445]: Starting upload Oct 19 17:26:12.329439111 (627h54m57.791531594s) [upload=552445]: Done starting upload Oct 19 17:26:12.329750644 (627h54m57.791843127s) [upload=552445]: Uploading segments... Oct 19 17:26:12.329851596 (627h54m57.791944069s) [upload=552445]: Got next segment. Inline: false Oct 19 17:26:12.329885401 (627h54m57.791977884s) [upload=552445]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 19 17:26:12.329891191 (627h54m57.791983674s) [upload=552445]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 19 17:26:12.602430951 (627h54m58.064523434s) [seg_pos={0 0}, upload=552445]: Begin upload segment... Oct 19 17:26:12.602492017 (627h54m58.064584501s) [seg_pos={0 0}, upload=552445]: Done begin upload segment. Oct 19 17:26:12.602516074 (627h54m58.064608557s) [noise=true , address=145.79.227.2:4115 , piece_id=I23Z2KX6D4DQO4OOA4CDVOKRLKJSO6KSHYI7SNK5HEE55ZGTKWUA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.602592719 (627h54m58.064685192s) [noise=true , address=145.79.227.18:4005 , piece_id=TPIABP5BKTC6P24QP5YPGZZDS5XVRA2CXM3LEPGLUOK2XQJYHORQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.603085628 (627h54m58.065178111s) [noise=true , address=145.79.227.13:4802 , piece_id=URSKHZVGMTEQA2MLKCNWXKPNFG4EVUUOWJAYH6UG4TPOCK6KO6YA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.603477094 (627h54m58.065569577s) [noise=true , address=145.79.227.4:4187 , piece_id=YPV2NOEX63GN2B2EUU3SVJZPZOC27MXCRVP45ZZ5LGJ3VLUASGSQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.603915658 (627h54m58.066008142s) [noise=true , address=77.90.31.17:4771 , piece_id=CXFEAFBSD56UQ7ZR3GITECMY2E2HEG4OYWYZSHL6PAV7N2PW4GFA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.604556960 (627h54m58.066649443s) [noise=true , address=77.90.31.10:4517 , piece_id=QA32SFTSNB4KSTP2GEDAV7CYE2NL7MKYELZI7B2XOFW55F3PEETQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.605057282 (627h54m58.067149766s) [noise=true , address=145.79.227.16:4910 , piece_id=I57EMG737FWSQNXPNHRUTF55NO3NWO7KGX7ZPZMO5K5DTGT2VNWA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.606445276 (627h54m58.068537759s) [noise=true , address=145.79.227.19:4077 , piece_id=PXIANCKIDFILAQGVY333JJ5VZFGHDQTRPRIWFPDZQ6VIUFLWF6DA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.607064605 (627h54m58.069157088s) [noise=true , address=77.90.31.15:4698 , piece_id=CRJS5YC2HQACT3O3W7T62H6VEJIK3QY5RNNBS2YWQQ7MEPLAM6HA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.607658917 (627h54m58.06975139s) [noise=true , address=45.91.116.12:4227 , piece_id=NXGC2I6EA3YSFQEOO5ZEVLEBMLTP5S7VLZMJ4TFYD7ZMFYZZSFLA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.608181482 (627h54m58.070273965s) [noise=true , address=77.90.31.11:4553 , piece_id=FEKERHMCD34UKKUC2Q3LPTBFL3XGRPNYMNR6DFCP7GIHHOK5354A, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.608722000 (627h54m58.070814484s) [noise=true , address=145.79.227.12:4765 , piece_id=XPSYN77WK5I2IJGZMKFY5NVOO2T5B7CIGWLPXYDTYZJXICJ7FONA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.609276907 (627h54m58.07136939s) [noise=true , address=145.79.227.18:4007 , piece_id=CNCPFTHTSO2D67KV4IQBWWXEEN4YDT4L7GBABRAMTWER3JKXZLAQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.609854608 (627h54m58.071947111s) [noise=true , address=45.91.116.13:4155 , piece_id=KDTPA5H722QTM2JF4RP3GL42K4BC2FDMR6FSPXM44VBMK5NT4KQA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.610351514 (627h54m58.072443997s) [noise=true , address=45.91.116.5:4299 , piece_id=NH7JFLS674NTY2S6EIZEVX2PEMNJNVUQKC5YPHYLVDCPFQWE6BJA, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:12.621035998 (627h54m58.083128551s) [noise=true , address=77.90.31.15:4697 , piece_id=DTCYXVHGF5IKZZQRS7O6DMGSQQKT2VIX4LA3EV3SOKILTZSVYULQ, seg_pos={0 0}, upload=552445]: Uploading piece... Oct 19 17:26:14.366298371 (627h54m59.828390864s) [upload=552445]: Next returned nil segment Oct 19 17:26:14.366321866 (627h54m59.828414359s) [upload=552445]: Waiting for error group managing segments... Oct 19 17:26:14.732643772 (627h55m0.194736265s) [noise=true , address=77.90.31.11:4553 , piece_id=FEKERHMCD34UKKUC2Q3LPTBFL3XGRPNYMNR6DFCP7GIHHOK5354A, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.741223479 (627h55m0.203315962s) [noise=true , address=45.91.116.13:4155 , piece_id=KDTPA5H722QTM2JF4RP3GL42K4BC2FDMR6FSPXM44VBMK5NT4KQA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.744825398 (627h55m0.206917881s) [noise=true , address=45.91.116.5:4299 , piece_id=NH7JFLS674NTY2S6EIZEVX2PEMNJNVUQKC5YPHYLVDCPFQWE6BJA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.750983403 (627h55m0.213075886s) [noise=true , address=77.90.31.15:4697 , piece_id=DTCYXVHGF5IKZZQRS7O6DMGSQQKT2VIX4LA3EV3SOKILTZSVYULQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.763241314 (627h55m0.225333797s) [noise=true , address=45.91.116.12:4227 , piece_id=NXGC2I6EA3YSFQEOO5ZEVLEBMLTP5S7VLZMJ4TFYD7ZMFYZZSFLA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.782496369 (627h55m0.244588852s) [noise=true , address=77.90.31.17:4771 , piece_id=CXFEAFBSD56UQ7ZR3GITECMY2E2HEG4OYWYZSHL6PAV7N2PW4GFA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.840659891 (627h55m0.302752384s) [noise=true , address=77.90.31.15:4698 , piece_id=CRJS5YC2HQACT3O3W7T62H6VEJIK3QY5RNNBS2YWQQ7MEPLAM6HA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:14.881498194 (627h55m0.343590677s) [noise=true , address=77.90.31.10:4517 , piece_id=QA32SFTSNB4KSTP2GEDAV7CYE2NL7MKYELZI7B2XOFW55F3PEETQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:28.531767556 (627h55m13.993860039s) [noise=true , address=145.79.227.2:4115 , piece_id=I23Z2KX6D4DQO4OOA4CDVOKRLKJSO6KSHYI7SNK5HEE55ZGTKWUA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:31.749165630 (627h55m17.211258113s) [noise=true , address=145.79.227.16:4910 , piece_id=I57EMG737FWSQNXPNHRUTF55NO3NWO7KGX7ZPZMO5K5DTGT2VNWA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:31.817302824 (627h55m17.279395307s) [noise=true , address=145.79.227.18:4005 , piece_id=TPIABP5BKTC6P24QP5YPGZZDS5XVRA2CXM3LEPGLUOK2XQJYHORQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:34.467866944 (627h55m19.929959427s) [noise=true , address=145.79.227.12:4765 , piece_id=XPSYN77WK5I2IJGZMKFY5NVOO2T5B7CIGWLPXYDTYZJXICJ7FONA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: <nil> Oct 19 17:26:41.640436503 (627h55m27.102528986s) [noise=true , address=145.79.227.4:4187 , piece_id=YPV2NOEX63GN2B2EUU3SVJZPZOC27MXCRVP45ZZ5LGJ3VLUASGSQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: write tcp 188.166.225.170:51872->145.79.227.4:4187: use of closed network connection; write tcp 188.166.225.170:51872->145.79.227.4:4187: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51872->145.79.227.4:4187: use of closed network connection Oct 19 17:26:41.640555269 (627h55m27.102647752s) [noise=true , address=145.79.227.18:4007 , piece_id=CNCPFTHTSO2D67KV4IQBWWXEEN4YDT4L7GBABRAMTWER3JKXZLAQ, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:55240->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:55240->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55240->145.79.227.18:4007: use of closed network connection Oct 19 17:26:41.640626374 (627h55m27.102718857s) [noise=true , address=145.79.227.13:4802 , piece_id=URSKHZVGMTEQA2MLKCNWXKPNFG4EVUUOWJAYH6UG4TPOCK6KO6YA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:36480->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:36480->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36480->145.79.227.13:4802: use of closed network connection Oct 19 17:26:41.640699023 (627h55m27.102791497s) [noise=true , address=145.79.227.19:4077 , piece_id=PXIANCKIDFILAQGVY333JJ5VZFGHDQTRPRIWFPDZQ6VIUFLWF6DA, seg_pos={0 0}, upload=552445]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:37482->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:37482->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37482->145.79.227.19:4077: use of closed network connection Oct 19 17:26:41.640724601 (627h55m27.102817084s) [seg_pos={0 0}, upload=552445]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Oct 19 17:26:41.884159793 (627h55m27.346252286s) [upload=552445]: Done uploading segments... Oct 19 17:26:41.884195260 (627h55m27.346287734s) [upload=552445]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.524943907s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)