Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [...............................XXXXXXXXXXXXXXXXX.XXXXXXX....] duration: 8.588171848s FAIL (2025-10-07 16:39:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 8.588192979s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [................................XXXXXXXXXXXXXXXXX.XXXXXXX...] duration: 27.993118737s FAIL (2025-10-07 16:39:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 27.993158863s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [.........................................XXXXX.XXXXXXXXX....] duration: 7.128909656s FAIL (2025-10-07 16:39:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 7.128941135s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [..........................................XXXXX.XXXXXXXXX...] duration: 10.180786696s FAIL (2025-10-07 16:38:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 10.180829668s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [.................................XXXXXXXXXXXXXXXXX.XXXXXXX..] duration: 6.28870887s FAIL (2025-10-07 16:38:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.288744827s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [...........................................XXXXX.XXXXXXXXX..] duration: 8.4886305s FAIL (2025-10-07 16:38:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 8.488651459s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [............................................XXXXX.XXXXXXXXX.] duration: 21.486666719s FAIL (2025-10-07 16:38:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 21.486687989s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [..................................XXXXXXXXXXXXXXXXX.XXXXXXX.] duration: 6.237273908s FAIL (2025-10-07 16:38:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.237310277s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [.............................................XXXXX.XXXXXXXXX] duration: 1m0.242380414s FAIL (2025-10-07 16:37:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 1m0.242396274s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [...................................XXXXXXXXXXXXXXXXX.XXXXXXX] duration: 30.248681026s FAIL (2025-10-07 16:37:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 30.24869943s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 23 out of 60 is failed (threshold=3) [....................................XXXXXXXXXXXXXXXXX.XXXXXX] duration: 30.279910243s FAIL (2025-10-07 16:37:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Oct 7 16:36:43.785042097 (339h5m29.24713458s) [upload=298383]: Starting upload Oct 7 16:36:43.785250935 (339h5m29.247343458s) [upload=298383]: Done starting upload Oct 7 16:36:43.785361645 (339h5m29.247454128s) [upload=298383]: Uploading segments... Oct 7 16:36:43.785452939 (339h5m29.247545412s) [upload=298383]: Got next segment. Inline: false Oct 7 16:36:43.785482426 (339h5m29.247574909s) [upload=298383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 16:36:43.785486844 (339h5m29.247579317s) [upload=298383]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 16:36:44.037493875 (339h5m29.499586348s) [seg_pos={0 0}, upload=298383]: Begin upload segment... Oct 7 16:36:44.037547227 (339h5m29.4996397s) [seg_pos={0 0}, upload=298383]: Done begin upload segment. Oct 7 16:36:44.037570151 (339h5m29.499662624s) [noise=true , address=45.91.116.11:4117 , piece_id=TDM6O3AHBNRYGRXDIRCUFXZHNUMXZXCVU4LQCONT3BWCU74K3MWA, seg_pos={0 0}, upload=298383]: Uploading piece... Oct 7 16:36:44.037639653 (339h5m29.499732126s) [noise=true , address=77.90.31.14:4662 , piece_id=WIE4VREJH7D76SKQ2Z5ID42GETBY5CFOYRWQVW2LRJCS3F5Y7V4A, seg_pos={0 0}, upload=298383]: Uploading piece... Oct 7 16:36:44.038223574 (339h5m29.500316057s) [noise=true , address=145.79.227.6:4257 , piece_id=IFN4PFQBNDE3PQQBE7DCJRIY6DKBC3OFSDO7GBYUTP62NDQFXFOA, seg_pos={0 0}, upload=298383]: Uploading piece... Oct 7 16:36:44.038621392 (339h5m29.500713875s) [noise=true , address=77.90.31.18:4807 , piece_id=2XMWTRSNGWIRW6XPWCPNDM6FU6UZA5JTFKQKEH2LGWG3LX7RMGHA, seg_pos={0 0}, upload=298383]: Uploading piece... Oct 7 16:36:44.038631050 (339h5m29.500723533s) [noise=true , address=77.90.31.10:4517 , piece_id=F4E5XRFMJ2QRSOKYORML5DSE4D4MBYF4I3HYETANCE5YPISNNCRQ, seg_pos={0 0}, upload=298383]: Uploading piece... Oct 7 16:36:44.038910893 (339h5m29.501003366s) [noise=true , address=77.90.31.21:4879 , piece_id=JSHKGHRV4BJGFCC725IIO3NSZQBUVWXPD346CRN6VXU4LLN7L3MA, seg_pos={0 0}, upload=298383]: Uploading piece... Oct 7 16:36:44.039038707 (339h5m29.50113118s) [noise=true , address=77.90.31.11:4555 , piece_id=HFNPSZBAQ6QGWPH556GLN4PP645UIDFQBEMNOUZCJ4PXMIFWFNPQ, seg_pos={0 0}, upload=298383]: Uploading piece... Oct 7 16:36:44.039182921 (339h5m29.501275394s) [noise=true , address=145.79.227.5:4223 , piece_id=AUNJODO44NHG7W77KX5ANOI5FMQ43DDYTX5WQOCPATABEU6SFHHQ, seg_pos={0 0}, upload=298383]: Uploading piece... Oct 7 16:36:44.039400095 (339h5m29.501492578s) [noise=true , address=145.79.227.13:4804 , piece_id=4EVRQA22SRNO6FSR2QRONK55O76SXMG3RQWDL2RDI3DXQHH5GGOQ, seg_pos={0 0}, upload=298383]: Uploading piece... Oct 7 16:36:44.039467984 (339h5m29.501560467s) [noise=true , address=45.91.116.10:4082 , piece_id=ELLKUECM3YZHSXG2LNFHG5WVET4MFNZFSTZKP3CRX3NX2VKUC4BA, seg_pos={0 0}, upload=298383]: Uploading piece... Oct 7 16:36:44.039794767 (339h5m29.50188724s) [noise=true , address=45.91.116.14:4189 , piece_id=KZ4AMKD3H2FVHITESGLDPRTLLNBALQ5DPDYSEVHD6JD2REH5JYNA, seg_pos={0 0}, upload=298383]: Uploading piece... Oct 7 16:36:44.039800327 (339h5m29.50189281s) [noise=true , address=145.79.227.18:4007 , piece_id=GV3AWOH5GDH2AFT3VU7UJMMLCKZLA4TFEBKOMN2G7QUYSXEA7AVA, seg_pos={0 0}, upload=298383]: Uploading piece... Oct 7 16:36:44.040129293 (339h5m29.502221776s) [noise=true , address=45.91.116.8:4047 , piece_id=BWA3HFIRLVOXMB7B7O2CLB6QJWZ47FQBPSFCD25SHLW3SOIHC5YQ, seg_pos={0 0}, upload=298383]: Uploading piece... Oct 7 16:36:44.040160743 (339h5m29.502253226s) [noise=true , address=77.90.31.19:4843 , piece_id=2BLXRGRKFM4YYYBT6LIX7RKXOW5LFDQWMYZZO2HIAM356VY5JENQ, seg_pos={0 0}, upload=298383]: Uploading piece... Oct 7 16:36:44.040514757 (339h5m29.50260724s) [noise=true , address=145.79.227.7:4295 , piece_id=EIEUYM544IND5Q65HWXXAHCKZL6FP24X3A4VLBFUQKZZE7J7NWQQ, seg_pos={0 0}, upload=298383]: Uploading piece... Oct 7 16:36:44.040822593 (339h5m29.502915066s) [noise=true , address=77.90.31.12:4590 , piece_id=42BZ7KV3DHPBGYJJPV3KS6IGYTSLC2NBJPVL7ACXNLSUGUAQEOWA, seg_pos={0 0}, upload=298383]: Uploading piece... Oct 7 16:36:45.854991684 (339h5m31.317084197s) [upload=298383]: Next returned nil segment Oct 7 16:36:45.855016422 (339h5m31.317108905s) [upload=298383]: Waiting for error group managing segments... Oct 7 16:36:46.137013369 (339h5m31.599105852s) [noise=true , address=45.91.116.10:4082 , piece_id=ELLKUECM3YZHSXG2LNFHG5WVET4MFNZFSTZKP3CRX3NX2VKUC4BA, seg_pos={0 0}, upload=298383]: Done uploading piece. err: <nil> Oct 7 16:36:46.156072521 (339h5m31.618164994s) [noise=true , address=45.91.116.8:4047 , piece_id=BWA3HFIRLVOXMB7B7O2CLB6QJWZ47FQBPSFCD25SHLW3SOIHC5YQ, seg_pos={0 0}, upload=298383]: Done uploading piece. err: <nil> Oct 7 16:36:46.158278551 (339h5m31.620371034s) [noise=true , address=77.90.31.14:4662 , piece_id=WIE4VREJH7D76SKQ2Z5ID42GETBY5CFOYRWQVW2LRJCS3F5Y7V4A, seg_pos={0 0}, upload=298383]: Done uploading piece. err: <nil> Oct 7 16:36:46.176215036 (339h5m31.638307519s) [noise=true , address=77.90.31.10:4517 , piece_id=F4E5XRFMJ2QRSOKYORML5DSE4D4MBYF4I3HYETANCE5YPISNNCRQ, seg_pos={0 0}, upload=298383]: Done uploading piece. err: <nil> Oct 7 16:36:46.178111046 (339h5m31.640203529s) [noise=true , address=45.91.116.11:4117 , piece_id=TDM6O3AHBNRYGRXDIRCUFXZHNUMXZXCVU4LQCONT3BWCU74K3MWA, seg_pos={0 0}, upload=298383]: Done uploading piece. err: <nil> Oct 7 16:36:46.181699890 (339h5m31.643792363s) [noise=true , address=77.90.31.19:4843 , piece_id=2BLXRGRKFM4YYYBT6LIX7RKXOW5LFDQWMYZZO2HIAM356VY5JENQ, seg_pos={0 0}, upload=298383]: Done uploading piece. err: <nil> Oct 7 16:36:46.184576959 (339h5m31.646669442s) [noise=true , address=77.90.31.11:4555 , piece_id=HFNPSZBAQ6QGWPH556GLN4PP645UIDFQBEMNOUZCJ4PXMIFWFNPQ, seg_pos={0 0}, upload=298383]: Done uploading piece. err: <nil> Oct 7 16:36:46.223916439 (339h5m31.686008912s) [noise=true , address=77.90.31.12:4590 , piece_id=42BZ7KV3DHPBGYJJPV3KS6IGYTSLC2NBJPVL7ACXNLSUGUAQEOWA, seg_pos={0 0}, upload=298383]: Done uploading piece. err: <nil> Oct 7 16:36:46.291765185 (339h5m31.753857668s) [noise=true , address=45.91.116.14:4189 , piece_id=KZ4AMKD3H2FVHITESGLDPRTLLNBALQ5DPDYSEVHD6JD2REH5JYNA, seg_pos={0 0}, upload=298383]: Done uploading piece. err: <nil> Oct 7 16:36:46.321612080 (339h5m31.783704564s) [noise=true , address=77.90.31.18:4807 , piece_id=2XMWTRSNGWIRW6XPWCPNDM6FU6UZA5JTFKQKEH2LGWG3LX7RMGHA, seg_pos={0 0}, upload=298383]: Done uploading piece. err: <nil> Oct 7 16:36:46.975430007 (339h5m32.43752249s) [noise=true , address=77.90.31.21:4879 , piece_id=JSHKGHRV4BJGFCC725IIO3NSZQBUVWXPD346CRN6VXU4LLN7L3MA, seg_pos={0 0}, upload=298383]: Done uploading piece. err: <nil> Oct 7 16:37:13.072120865 (339h5m58.534213348s) [noise=true , address=145.79.227.5:4223 , piece_id=AUNJODO44NHG7W77KX5ANOI5FMQ43DDYTX5WQOCPATABEU6SFHHQ, seg_pos={0 0}, upload=298383]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:53404->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:53404->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53404->145.79.227.5:4223: use of closed network connection Oct 7 16:37:13.072218781 (339h5m58.534311264s) [noise=true , address=145.79.227.13:4804 , piece_id=4EVRQA22SRNO6FSR2QRONK55O76SXMG3RQWDL2RDI3DXQHH5GGOQ, seg_pos={0 0}, upload=298383]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: write tcp 188.166.225.170:51184->145.79.227.13:4804: use of closed network connection; write tcp 188.166.225.170:51184->145.79.227.13:4804: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51184->145.79.227.13:4804: use of closed network connection Oct 7 16:37:13.072474879 (339h5m58.534567352s) [noise=true , address=145.79.227.6:4257 , piece_id=IFN4PFQBNDE3PQQBE7DCJRIY6DKBC3OFSDO7GBYUTP62NDQFXFOA, seg_pos={0 0}, upload=298383]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:42378->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.6:4257: use of closed network connection Oct 7 16:37:13.072634763 (339h5m58.534727246s) [noise=true , address=145.79.227.18:4007 , piece_id=GV3AWOH5GDH2AFT3VU7UJMMLCKZLA4TFEBKOMN2G7QUYSXEA7AVA, seg_pos={0 0}, upload=298383]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: read tcp 188.166.225.170:38930->145.79.227.18:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:37:13.072853319 (339h5m58.534945802s) [noise=true , address=145.79.227.7:4295 , piece_id=EIEUYM544IND5Q65HWXXAHCKZL6FP24X3A4VLBFUQKZZE7J7NWQQ, seg_pos={0 0}, upload=298383]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: context deadline exceeded; context deadline exceeded Oct 7 16:37:13.073054382 (339h5m58.535146855s) [seg_pos={0 0}, upload=298383]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 16:37:13.350275986 (339h5m58.81236847s) [upload=298383]: Done uploading segments... Oct 7 16:37:13.350306595 (339h5m58.812399068s) [upload=298383]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 30.279924741s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 13 out of 60 is failed (threshold=3) [..............................................XXXXX.XXXXXXXX] duration: 1m0.260270512s FAIL (2025-10-07 16:36:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== P2IGAWCK5Q5VYWFHBND6J4YLFOUQ, seg_pos={0 0}, upload=298373]: Uploading piece... Oct 7 16:35:57.781382842 (339h4m43.243475315s) [noise=true , address=45.91.116.9:4283 , piece_id=HIXL7HBTZOTN2HMCM5DXH6RUK3N5LGCPENEFVFPL5ZR6XYKIFMYQ, seg_pos={0 0}, upload=298373]: Uploading piece... Oct 7 16:35:57.781477212 (339h4m43.243569695s) [noise=true , address=145.79.227.52:4464 , piece_id=M2JMNYL66X4ICNI6OFVDQ6GHYK4SSWCHFD3VAIC32NX6VAER4JLQ, seg_pos={0 0}, upload=298373]: Uploading piece... Oct 7 16:35:57.781934603 (339h4m43.244027076s) [noise=true , address=145.79.227.39:4021 , piece_id=TJS7J5QPVGCHR75URHRRGGMSEMYN4C7XDH4TOE7AK4FZQPGLEW4A, seg_pos={0 0}, upload=298373]: Uploading piece... Oct 7 16:35:57.781958719 (339h4m43.244051202s) [noise=true , address=45.91.116.8:4049 , piece_id=NNW7YZDSYA7H7TSJRREWFYFARKFPUVP4FSJ7GVBVE5I475HM3N3Q, seg_pos={0 0}, upload=298373]: Uploading piece... Oct 7 16:35:57.782314396 (339h4m43.244406879s) [noise=true , address=145.79.227.20:4441 , piece_id=VVFKBHPEWFUS4MAGL34ZDKXGOSTLS7WISS3NZ65XZ65RUNQ6JCEQ, seg_pos={0 0}, upload=298373]: Uploading piece... Oct 7 16:35:57.782672217 (339h4m43.24476469s) [noise=true , address=77.90.31.14:4678 , piece_id=7E7SEUOYK2JP5CMV36ZVF67GX5P6APNJT26P5W4ENFGWYZHPJ4GQ, seg_pos={0 0}, upload=298373]: Uploading piece... Oct 7 16:35:57.782992116 (339h4m43.245084599s) [noise=true , address=145.79.227.28:4728 , piece_id=F7XRZMNS57MUWQD2IXQNTMXWFVUS5AZVGKVPUGFRHPENW5C2BQFA, seg_pos={0 0}, upload=298373]: Uploading piece... Oct 7 16:35:57.783112336 (339h4m43.245204809s) [noise=true , address=45.91.116.4:4945 , piece_id=6VB4GSMJMWNWMXU4Q3MFX4M2KWSK4VZGMC63XQKHPF2UAS44LP5A, seg_pos={0 0}, upload=298373]: Uploading piece... Oct 7 16:35:57.783298380 (339h4m43.245390853s) [noise=true , address=145.79.227.32:4868 , piece_id=J3LR4VLZBCNVCCKDNHT442WAZBSL33XAC7UVAMLK6DMWI3AEHCCQ, seg_pos={0 0}, upload=298373]: Uploading piece... Oct 7 16:35:57.783568304 (339h4m43.245660777s) [noise=true , address=64.49.13.139:4474 , piece_id=XID75XZFHFNUGIJJIZIGA36LQVHOVITDJZRTSESF2V7733SLSI3Q, seg_pos={0 0}, upload=298373]: Uploading piece... Oct 7 16:35:57.783825453 (339h4m43.245917936s) [noise=true , address=77.90.31.14:4686 , piece_id=WMFIIIGCXL4UCHCHDCF6CYVN6XLMGEGSZNB3WEAH66OR4JRWDB5Q, seg_pos={0 0}, upload=298373]: Uploading piece... Oct 7 16:35:57.784367947 (339h4m43.24646042s) [noise=true , address=77.90.31.17:4803 , piece_id=ENQGU36I7RE2YSLGSXWTIIN34QHZS3UF6LLT2KVV4DPGOSWUC42Q, seg_pos={0 0}, upload=298373]: Uploading piece... Oct 7 16:35:57.784948803 (339h4m43.247041276s) [noise=true , address=145.79.227.41:4114 , piece_id=VMJ5GBIXC2C2GMCGVYGHNUQMIOCIEAAWU3JNYXJ4ALOA26LCQNJQ, seg_pos={0 0}, upload=298373]: Uploading piece... Oct 7 16:35:59.171138758 (339h4m44.633231241s) [upload=298373]: Next returned nil segment Oct 7 16:35:59.171161942 (339h4m44.633254425s) [upload=298373]: Waiting for error group managing segments... Oct 7 16:35:59.545562423 (339h4m45.007654896s) [noise=true , address=64.49.13.139:4474 , piece_id=XID75XZFHFNUGIJJIZIGA36LQVHOVITDJZRTSESF2V7733SLSI3Q, seg_pos={0 0}, upload=298373]: Done uploading piece. err: <nil> Oct 7 16:35:59.769671330 (339h4m45.231763814s) [noise=true , address=77.90.31.10:4541 , piece_id=EO7JGFELIPBBVQKDRSC5D5PY37XS6T234KB3425BSYPG7NTZM3EA, seg_pos={0 0}, upload=298373]: Done uploading piece. err: <nil> Oct 7 16:35:59.797027201 (339h4m45.259119684s) [noise=true , address=45.91.116.6:4976 , piece_id=BNNU73FBGEJW4VPA4XEKZBCZ3APU763HU4RZW2EI3X3OQNFEZY5Q, seg_pos={0 0}, upload=298373]: Done uploading piece. err: <nil> Oct 7 16:35:59.798005313 (339h4m45.260097796s) [noise=true , address=45.91.116.8:4049 , piece_id=NNW7YZDSYA7H7TSJRREWFYFARKFPUVP4FSJ7GVBVE5I475HM3N3Q, seg_pos={0 0}, upload=298373]: Done uploading piece. err: <nil> Oct 7 16:35:59.809891828 (339h4m45.271984311s) [noise=true , address=45.91.116.9:4283 , piece_id=HIXL7HBTZOTN2HMCM5DXH6RUK3N5LGCPENEFVFPL5ZR6XYKIFMYQ, seg_pos={0 0}, upload=298373]: Done uploading piece. err: <nil> Oct 7 16:35:59.811394950 (339h4m45.273487433s) [noise=true , address=77.90.31.14:4686 , piece_id=WMFIIIGCXL4UCHCHDCF6CYVN6XLMGEGSZNB3WEAH66OR4JRWDB5Q, seg_pos={0 0}, upload=298373]: Done uploading piece. err: <nil> Oct 7 16:35:59.818513606 (339h4m45.280606079s) [noise=true , address=77.90.31.21:4908 , piece_id=BHAMXZ2VP3DNDPE7VSM44PFMP2IGAWCK5Q5VYWFHBND6J4YLFOUQ, seg_pos={0 0}, upload=298373]: Done uploading piece. err: <nil> Oct 7 16:35:59.829428088 (339h4m45.291520561s) [noise=true , address=77.90.31.17:4803 , piece_id=ENQGU36I7RE2YSLGSXWTIIN34QHZS3UF6LLT2KVV4DPGOSWUC42Q, seg_pos={0 0}, upload=298373]: Done uploading piece. err: <nil> Oct 7 16:35:59.846857076 (339h4m45.308949549s) [noise=true , address=77.90.31.14:4678 , piece_id=7E7SEUOYK2JP5CMV36ZVF67GX5P6APNJT26P5W4ENFGWYZHPJ4GQ, seg_pos={0 0}, upload=298373]: Done uploading piece. err: <nil> Oct 7 16:35:59.868567879 (339h4m45.330660352s) [noise=true , address=45.91.116.4:4945 , piece_id=6VB4GSMJMWNWMXU4Q3MFX4M2KWSK4VZGMC63XQKHPF2UAS44LP5A, seg_pos={0 0}, upload=298373]: Done uploading piece. err: <nil> Oct 7 16:35:59.907415421 (339h4m45.369507904s) [noise=true , address=45.91.116.14:4223 , piece_id=BEPLMGB2X33MFILRU2TR3GVZYWOEB4HTYSV47OB2U7CO2TC6NDQQ, seg_pos={0 0}, upload=298373]: Done uploading piece. err: <nil> Oct 7 16:36:56.768182500 (339h5m42.230274973s) [noise=true , address=145.79.227.52:4464 , piece_id=M2JMNYL66X4ICNI6OFVDQ6GHYK4SSWCHFD3VAIC32NX6VAER4JLQ, seg_pos={0 0}, upload=298373]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:145.79.227.52:4464): protocol: write tcp 188.166.225.170:33466->145.79.227.52:4464: use of closed network connection; write tcp 188.166.225.170:33466->145.79.227.52:4464: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33466->145.79.227.52:4464: use of closed network connection Oct 7 16:36:56.768290977 (339h5m42.23038347s) [noise=true , address=145.79.227.39:4021 , piece_id=TJS7J5QPVGCHR75URHRRGGMSEMYN4C7XDH4TOE7AK4FZQPGLEW4A, seg_pos={0 0}, upload=298373]: Done uploading piece. err: ecclient: upload failed (node:1nz7Gxp4YTWuB1JDnjE5Q9BfVUUvyZ4SMBbZrxVQHrSUvcJbAQ, address:145.79.227.39:4021): protocol: write tcp 188.166.225.170:48762->145.79.227.39:4021: use of closed network connection; write tcp 188.166.225.170:48762->145.79.227.39:4021: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48762->145.79.227.39:4021: use of closed network connection Oct 7 16:36:56.768370137 (339h5m42.23046261s) [noise=true , address=145.79.227.20:4441 , piece_id=VVFKBHPEWFUS4MAGL34ZDKXGOSTLS7WISS3NZ65XZ65RUNQ6JCEQ, seg_pos={0 0}, upload=298373]: Done uploading piece. err: ecclient: upload failed (node:12LjGecRNJE1kq67iMtxZFhWeaUZpUogsGxbz4VXwnHdQtTnbBr, address:145.79.227.20:4441): protocol: write tcp 188.166.225.170:55798->145.79.227.20:4441: use of closed network connection; write tcp 188.166.225.170:55798->145.79.227.20:4441: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55798->145.79.227.20:4441: use of closed network connection Oct 7 16:36:56.768457523 (339h5m42.230550006s) [noise=true , address=145.79.227.25:4651 , piece_id=YOXDFTTWLTADCBTQXNVGJQBAOYFPAQTG4LNH52XATDCG47GKJY4Q, seg_pos={0 0}, upload=298373]: Done uploading piece. err: ecclient: upload failed (node:12tD1Zfi4ZxujF9pVdgW5k2wnejXsa7tf1u25FuucRXeneGP3dz, address:145.79.227.25:4651): protocol: write tcp 188.166.225.170:39292->145.79.227.25:4651: use of closed network connection; write tcp 188.166.225.170:39292->145.79.227.25:4651: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39292->145.79.227.25:4651: use of closed network connection Oct 7 16:36:56.768562633 (339h5m42.230655117s) [noise=true , address=145.79.227.28:4728 , piece_id=F7XRZMNS57MUWQD2IXQNTMXWFVUS5AZVGKVPUGFRHPENW5C2BQFA, seg_pos={0 0}, upload=298373]: Done uploading piece. err: ecclient: upload failed (node:1YoLzpb4mMYZ8TsdxnMocekZZ1gLfTrdCM8mxTDj4tY6khZGvi, address:145.79.227.28:4728): protocol: write tcp 188.166.225.170:53122->145.79.227.28:4728: use of closed network connection; write tcp 188.166.225.170:53122->145.79.227.28:4728: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53122->145.79.227.28:4728: use of closed network connection Oct 7 16:36:56.768634722 (339h5m42.230727195s) [noise=true , address=145.79.227.32:4868 , piece_id=J3LR4VLZBCNVCCKDNHT442WAZBSL33XAC7UVAMLK6DMWI3AEHCCQ, seg_pos={0 0}, upload=298373]: Done uploading piece. err: ecclient: upload failed (node:124LJtYshPwu1uZJwVyjrjUMk3htyVnp9ntnZWSUb7X3bNkwU6t, address:145.79.227.32:4868): protocol: write tcp 188.166.225.170:58936->145.79.227.32:4868: use of closed network connection; write tcp 188.166.225.170:58936->145.79.227.32:4868: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58936->145.79.227.32:4868: use of closed network connection Oct 7 16:36:56.768826015 (339h5m42.230918498s) [noise=true , address=145.79.227.41:4114 , piece_id=VMJ5GBIXC2C2GMCGVYGHNUQMIOCIEAAWU3JNYXJ4ALOA26LCQNJQ, seg_pos={0 0}, upload=298373]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: read tcp 188.166.225.170:56448->145.79.227.41:4114: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:36:56.768851765 (339h5m42.230944238s) [seg_pos={0 0}, upload=298373]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Oct 7 16:36:57.026924083 (339h5m42.489016556s) [upload=298373]: Done uploading segments... Oct 7 16:36:57.026960843 (339h5m42.489053326s) [upload=298373]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 1m0.260298236s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 22 out of 60 is failed (threshold=3) [.....................................XXXXXXXXXXXXXXXXX.XXXXX] duration: 30.253332236s FAIL (2025-10-07 16:36:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Oct 7 16:36:13.328286801 (339h4m58.790379284s) [upload=298375]: Starting upload Oct 7 16:36:13.328382483 (339h4m58.790474956s) [upload=298375]: Done starting upload Oct 7 16:36:13.328644412 (339h4m58.790736885s) [upload=298375]: Uploading segments... Oct 7 16:36:13.328697223 (339h4m58.790789706s) [upload=298375]: Got next segment. Inline: false Oct 7 16:36:13.328731128 (339h4m58.790823611s) [upload=298375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 16:36:13.328736818 (339h4m58.790829291s) [upload=298375]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 16:36:13.587640733 (339h4m59.049733226s) [seg_pos={0 0}, upload=298375]: Begin upload segment... Oct 7 16:36:13.587717008 (339h4m59.049809491s) [seg_pos={0 0}, upload=298375]: Done begin upload segment. Oct 7 16:36:13.587753327 (339h4m59.04984581s) [noise=true , address=145.79.227.6:4258 , piece_id=PSFSHW2DMU2W3WHY2CP55JFNQVH7BBA64LQI4QFDNXHI3N22NJPA, seg_pos={0 0}, upload=298375]: Uploading piece... Oct 7 16:36:13.587850612 (339h4m59.049943085s) [noise=true , address=77.90.31.11:4553 , piece_id=KC2QIKHBHJEGFQ3G54RXLKIHAQSPQ7O6LATZJZ7HNIMDCDL6D2FA, seg_pos={0 0}, upload=298375]: Uploading piece... Oct 7 16:36:13.588415558 (339h4m59.050508041s) [noise=true , address=77.90.31.12:4589 , piece_id=QDRVTVGX73J7I6ZDCTDRVCUPVEBJ5RBP4FY25ZIMIFQ4UE3STIQQ, seg_pos={0 0}, upload=298375]: Uploading piece... Oct 7 16:36:13.588866516 (339h4m59.050959s) [noise=true , address=45.91.116.5:4298 , piece_id=YGKXCLLKH2ZNTAHV4HD3C7HLOUJTZJEBTD5U4QJHIOTPUTLIB3CA, seg_pos={0 0}, upload=298375]: Uploading piece... Oct 7 16:36:13.589550179 (339h4m59.051642662s) [noise=true , address=45.91.116.9:4262 , piece_id=BUWWSFBHAUD6PXSCFGW7PKFU7TAGCOHRE2GC76WMIGHGU67RVHQA, seg_pos={0 0}, upload=298375]: Uploading piece... Oct 7 16:36:13.590070529 (339h4m59.052163013s) [noise=true , address=77.90.31.19:4841 , piece_id=GC2BG4NBBWEKDCAV6L5F7L32VXL6F3QKLFMWPVR3R5I32CTEQJ6A, seg_pos={0 0}, upload=298375]: Uploading piece... Oct 7 16:36:13.590088343 (339h4m59.052180826s) [noise=true , address=77.90.31.21:4878 , piece_id=244ELBYJQFFNI7KUQ5MYKOYC7E655OQA3LKUS26FQ3WAARIN2YJA, seg_pos={0 0}, upload=298375]: Uploading piece... Oct 7 16:36:13.590499636 (339h4m59.052592109s) [noise=true , address=45.91.116.4:4938 , piece_id=WNAZNK4LYMQANZ5FEX3ONPLVJNLEV6WSZVZA2VPY6BFSOPTAWEVA, seg_pos={0 0}, upload=298375]: Uploading piece... Oct 7 16:36:13.590622531 (339h4m59.052715014s) [noise=true , address=45.91.116.6:4973 , piece_id=WNK2TS6BT5DY5TMQC6DAC65GQ45LZIGYLG5LHJMZVL2PXMONUAWA, seg_pos={0 0}, upload=298375]: Uploading piece... Oct 7 16:36:13.590934575 (339h4m59.053027058s) [noise=true , address=45.91.116.14:4189 , piece_id=52GR3DNHT7T3X4G342XIAHOX3RODECRVZEYW6X5WXKLDS4FJBK5Q, seg_pos={0 0}, upload=298375]: Uploading piece... Oct 7 16:36:13.591231901 (339h4m59.053324384s) [noise=true , address=145.79.227.7:4293 , piece_id=CEHKUOTTY7IOLCBDN3PNLHPMSGWT4IKLNOD6Z3GCSLTBC4TF4UCQ, seg_pos={0 0}, upload=298375]: Uploading piece... Oct 7 16:36:13.591287337 (339h4m59.05337981s) [noise=true , address=45.91.116.10:4082 , piece_id=3G5NPB4QHXRM3K3TPKVWU7ZVOLWX55IJF6BMIMFFEZSTHX2VMKDA, seg_pos={0 0}, upload=298375]: Uploading piece... Oct 7 16:36:13.591906104 (339h4m59.053998587s) [noise=true , address=145.79.227.13:4804 , piece_id=5YGL4R4MIIBI2HSOUOHQBNZGBE5MOJQB4VSTYE43W7B4XVMONSHQ, seg_pos={0 0}, upload=298375]: Uploading piece... Oct 7 16:36:13.592103941 (339h4m59.054196414s) [noise=true , address=77.90.31.10:4518 , piece_id=CMIFAL4ZYVWLR3BJCNKDXTWIDXCWFLPCNVY5E44XQXYYWLY2ES7Q, seg_pos={0 0}, upload=298375]: Uploading piece... Oct 7 16:36:13.592571221 (339h4m59.054663714s) [noise=true , address=45.91.116.7:4010 , piece_id=DKHA53YXNTAPBFLL6FYURMDXINB4NSKQSLSLMRR4NDDXHJOVV37A, seg_pos={0 0}, upload=298375]: Uploading piece... Oct 7 16:36:13.593262487 (339h4m59.05535497s) [noise=true , address=145.79.227.18:4007 , piece_id=EMKJM7LZF7GIIYXBAQYJS6IVZCJN3CYBWU4GYCE23M4DMUXFIZPQ, seg_pos={0 0}, upload=298375]: Uploading piece... Oct 7 16:36:15.383328442 (339h5m0.845420925s) [upload=298375]: Next returned nil segment Oct 7 16:36:15.383352447 (339h5m0.84544492s) [upload=298375]: Waiting for error group managing segments... Oct 7 16:36:15.748792816 (339h5m1.210885299s) [noise=true , address=45.91.116.9:4262 , piece_id=BUWWSFBHAUD6PXSCFGW7PKFU7TAGCOHRE2GC76WMIGHGU67RVHQA, seg_pos={0 0}, upload=298375]: Done uploading piece. err: <nil> Oct 7 16:36:15.754011263 (339h5m1.216103746s) [noise=true , address=77.90.31.12:4589 , piece_id=QDRVTVGX73J7I6ZDCTDRVCUPVEBJ5RBP4FY25ZIMIFQ4UE3STIQQ, seg_pos={0 0}, upload=298375]: Done uploading piece. err: <nil> Oct 7 16:36:15.774368617 (339h5m1.23646109s) [noise=true , address=45.91.116.6:4973 , piece_id=WNK2TS6BT5DY5TMQC6DAC65GQ45LZIGYLG5LHJMZVL2PXMONUAWA, seg_pos={0 0}, upload=298375]: Done uploading piece. err: <nil> Oct 7 16:36:15.779364751 (339h5m1.241457224s) [noise=true , address=45.91.116.14:4189 , piece_id=52GR3DNHT7T3X4G342XIAHOX3RODECRVZEYW6X5WXKLDS4FJBK5Q, seg_pos={0 0}, upload=298375]: Done uploading piece. err: <nil> Oct 7 16:36:15.789667519 (339h5m1.251760003s) [noise=true , address=77.90.31.19:4841 , piece_id=GC2BG4NBBWEKDCAV6L5F7L32VXL6F3QKLFMWPVR3R5I32CTEQJ6A, seg_pos={0 0}, upload=298375]: Done uploading piece. err: <nil> Oct 7 16:36:15.790169244 (339h5m1.252261728s) [noise=true , address=45.91.116.5:4298 , piece_id=YGKXCLLKH2ZNTAHV4HD3C7HLOUJTZJEBTD5U4QJHIOTPUTLIB3CA, seg_pos={0 0}, upload=298375]: Done uploading piece. err: <nil> Oct 7 16:36:15.835971160 (339h5m1.298063644s) [noise=true , address=77.90.31.11:4553 , piece_id=KC2QIKHBHJEGFQ3G54RXLKIHAQSPQ7O6LATZJZ7HNIMDCDL6D2FA, seg_pos={0 0}, upload=298375]: Done uploading piece. err: <nil> Oct 7 16:36:15.890732136 (339h5m1.352824619s) [noise=true , address=77.90.31.21:4878 , piece_id=244ELBYJQFFNI7KUQ5MYKOYC7E655OQA3LKUS26FQ3WAARIN2YJA, seg_pos={0 0}, upload=298375]: Done uploading piece. err: <nil> Oct 7 16:36:16.106924458 (339h5m1.569016941s) [noise=true , address=45.91.116.7:4010 , piece_id=DKHA53YXNTAPBFLL6FYURMDXINB4NSKQSLSLMRR4NDDXHJOVV37A, seg_pos={0 0}, upload=298375]: Done uploading piece. err: <nil> Oct 7 16:36:16.306216017 (339h5m1.76830849s) [noise=true , address=77.90.31.10:4518 , piece_id=CMIFAL4ZYVWLR3BJCNKDXTWIDXCWFLPCNVY5E44XQXYYWLY2ES7Q, seg_pos={0 0}, upload=298375]: Done uploading piece. err: <nil> Oct 7 16:36:16.546310123 (339h5m2.008402606s) [noise=true , address=45.91.116.10:4082 , piece_id=3G5NPB4QHXRM3K3TPKVWU7ZVOLWX55IJF6BMIMFFEZSTHX2VMKDA, seg_pos={0 0}, upload=298375]: Done uploading piece. err: <nil> Oct 7 16:36:16.880843811 (339h5m2.342936284s) [noise=true , address=45.91.116.4:4938 , piece_id=WNAZNK4LYMQANZ5FEX3ONPLVJNLEV6WSZVZA2VPY6BFSOPTAWEVA, seg_pos={0 0}, upload=298375]: Done uploading piece. err: <nil> Oct 7 16:36:42.603022903 (339h5m28.065115386s) [noise=true , address=145.79.227.13:4804 , piece_id=5YGL4R4MIIBI2HSOUOHQBNZGBE5MOJQB4VSTYE43W7B4XVMONSHQ, seg_pos={0 0}, upload=298375]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: write tcp 188.166.225.170:33818->145.79.227.13:4804: use of closed network connection; write tcp 188.166.225.170:33818->145.79.227.13:4804: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33818->145.79.227.13:4804: use of closed network connection Oct 7 16:36:42.603067427 (339h5m28.065159911s) [noise=true , address=145.79.227.18:4007 , piece_id=EMKJM7LZF7GIIYXBAQYJS6IVZCJN3CYBWU4GYCE23M4DMUXFIZPQ, seg_pos={0 0}, upload=298375]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:33412->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:33412->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33412->145.79.227.18:4007: use of closed network connection Oct 7 16:36:42.603114146 (339h5m28.065206629s) [noise=true , address=145.79.227.6:4258 , piece_id=PSFSHW2DMU2W3WHY2CP55JFNQVH7BBA64LQI4QFDNXHI3N22NJPA, seg_pos={0 0}, upload=298375]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:36316->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:36316->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36316->145.79.227.6:4258: use of closed network connection Oct 7 16:36:42.603171385 (339h5m28.065263858s) [noise=true , address=145.79.227.7:4293 , piece_id=CEHKUOTTY7IOLCBDN3PNLHPMSGWT4IKLNOD6Z3GCSLTBC4TF4UCQ, seg_pos={0 0}, upload=298375]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 188.166.225.170:57028->145.79.227.7:4293: use of closed network connection; write tcp 188.166.225.170:57028->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57028->145.79.227.7:4293: use of closed network connection Oct 7 16:36:42.603200180 (339h5m28.065292653s) [seg_pos={0 0}, upload=298375]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Oct 7 16:36:42.854195843 (339h5m28.316288326s) [upload=298375]: Done uploading segments... Oct 7 16:36:42.854231631 (339h5m28.316324104s) [upload=298375]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.253360058s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 21 out of 60 is failed (threshold=3) [......................................XXXXXXXXXXXXXXXXX.XXXX] duration: 30.252326875s FAIL (2025-10-07 16:36:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== address=145.79.227.12:4767 , piece_id=HNBLIQHBKY4QRJZKFRNHNCDRPXS37RKJMFY35W4R5U7KPQLPATFQ, seg_pos={0 0}, upload=298367]: Uploading piece... Oct 7 16:35:33.705593482 (339h4m19.167685965s) [noise=true , address=145.79.227.7:4294 , piece_id=Q5ANSI3HNEOG4X5UGE352KIKM7XX2RLPBOPAEN2XOLDR5PI465RQ, seg_pos={0 0}, upload=298367]: Uploading piece... Oct 7 16:35:33.710305225 (339h4m19.172397708s) [noise=true , address=45.91.116.14:4191 , piece_id=5UE4HHJOWNH2IYVXYUZ3IRO4NF7AAFOGWDSG3Y33467AO7T5CHTQ, seg_pos={0 0}, upload=298367]: Uploading piece... Oct 7 16:35:33.711886435 (339h4m19.173978919s) [noise=true , address=45.91.116.12:4225 , piece_id=C5E7ULJSHMCVCREFVKVQRGLYUPSVCBAWLQTRDXPT4TSDOTC52WZQ, seg_pos={0 0}, upload=298367]: Uploading piece... Oct 7 16:35:33.712222386 (339h4m19.174314869s) [noise=true , address=77.90.31.10:4518 , piece_id=JCAA6OYYQI5BEFVRRTGMS5XSUL2PMZ3KJ5P4C7MCSMJZOHXYLNGQ, seg_pos={0 0}, upload=298367]: Uploading piece... Oct 7 16:35:33.713562507 (339h4m19.17565498s) [noise=true , address=145.79.227.13:4802 , piece_id=4QBO7PJM73UKLB6TBJ3P677QGE37NAZGGA6S2NOZF5IZE37RW4LA, seg_pos={0 0}, upload=298367]: Uploading piece... Oct 7 16:35:33.714182227 (339h4m19.1762747s) [noise=true , address=145.79.227.19:4079 , piece_id=NVHOWZMN5YLEFGBPKGN2S7RTXODPPSO3TV4WDRDXXRHN5RM4XXZQ, seg_pos={0 0}, upload=298367]: Uploading piece... Oct 7 16:35:33.714971771 (339h4m19.177064244s) [noise=true , address=77.90.31.18:4806 , piece_id=ZW4QF3VII6MAJ3IUVNZQOU44F2TC76M2QSVOI4TGA5V6IFVC5MDQ, seg_pos={0 0}, upload=298367]: Uploading piece... Oct 7 16:35:33.715800369 (339h4m19.177892882s) [noise=true , address=77.90.31.15:4697 , piece_id=OTIAZ63BJEILMVNLCL3PE3XKDFBBFW74ZZ6MC7TJMEX7Y6E74I3A, seg_pos={0 0}, upload=298367]: Uploading piece... Oct 7 16:35:33.716313987 (339h4m19.17840646s) [noise=true , address=45.91.116.9:4262 , piece_id=XYO34CTEBZKM7LDM6W625YUVXQEBYPIACQGSKF7R6XULQUFDKQQQ, seg_pos={0 0}, upload=298367]: Uploading piece... Oct 7 16:35:33.717578164 (339h4m19.179670647s) [noise=true , address=145.79.227.4:4186 , piece_id=BADC6UDIYIOTWZOVWSGINYQXIWIUSUQHQ7TMIZ3XD4DRCPD3BRDQ, seg_pos={0 0}, upload=298367]: Uploading piece... Oct 7 16:35:33.717834141 (339h4m19.179926624s) [noise=true , address=145.79.227.15:4876 , piece_id=M7G64SWBPFXFPLJWPOCQQG5KV2EXZBQPBYTZCGE3LWRKPPNK5TDA, seg_pos={0 0}, upload=298367]: Uploading piece... Oct 7 16:35:33.718991715 (339h4m19.181084198s) [noise=true , address=145.79.227.18:4007 , piece_id=S4SZDJCCLF4PZHBYSAVLGUX4Z7YJKGWENKQIR2ZET2QHVL66BTXA, seg_pos={0 0}, upload=298367]: Uploading piece... Oct 7 16:35:33.719580426 (339h4m19.181672929s) [noise=true , address=145.79.227.3:4150 , piece_id=SNIBIYD6TRTEJLTPJ4VUM5ACRFNBVFUKQCHOA2QPVIIKX2X563JA, seg_pos={0 0}, upload=298367]: Uploading piece... Oct 7 16:35:33.720519084 (339h4m19.182611567s) [noise=true , address=45.91.116.10:4082 , piece_id=RUUX33LCNL2ZYQXO5PUYEE7A34KSONWASARNSHIAVMGYFUKCFTKQ, seg_pos={0 0}, upload=298367]: Uploading piece... Oct 7 16:35:33.721717997 (339h4m19.18381049s) [noise=true , address=45.91.116.6:4973 , piece_id=3V2PGHPMBVBQG4WXO333MIYNZHWQ7SNTDV74N6RL2GXFLPJ6SKEQ, seg_pos={0 0}, upload=298367]: Uploading piece... Oct 7 16:35:35.519751428 (339h4m20.981843901s) [upload=298367]: Next returned nil segment Oct 7 16:35:35.519771337 (339h4m20.98186382s) [upload=298367]: Waiting for error group managing segments... Oct 7 16:35:35.810251707 (339h4m21.27234418s) [noise=true , address=45.91.116.9:4262 , piece_id=XYO34CTEBZKM7LDM6W625YUVXQEBYPIACQGSKF7R6XULQUFDKQQQ, seg_pos={0 0}, upload=298367]: Done uploading piece. err: <nil> Oct 7 16:35:35.837066057 (339h4m21.29915854s) [noise=true , address=77.90.31.18:4806 , piece_id=ZW4QF3VII6MAJ3IUVNZQOU44F2TC76M2QSVOI4TGA5V6IFVC5MDQ, seg_pos={0 0}, upload=298367]: Done uploading piece. err: <nil> Oct 7 16:35:35.838517321 (339h4m21.300609824s) [noise=true , address=77.90.31.10:4518 , piece_id=JCAA6OYYQI5BEFVRRTGMS5XSUL2PMZ3KJ5P4C7MCSMJZOHXYLNGQ, seg_pos={0 0}, upload=298367]: Done uploading piece. err: <nil> Oct 7 16:35:35.857696561 (339h4m21.319789034s) [noise=true , address=45.91.116.12:4225 , piece_id=C5E7ULJSHMCVCREFVKVQRGLYUPSVCBAWLQTRDXPT4TSDOTC52WZQ, seg_pos={0 0}, upload=298367]: Done uploading piece. err: <nil> Oct 7 16:35:35.900365150 (339h4m21.362457633s) [noise=true , address=77.90.31.15:4697 , piece_id=OTIAZ63BJEILMVNLCL3PE3XKDFBBFW74ZZ6MC7TJMEX7Y6E74I3A, seg_pos={0 0}, upload=298367]: Done uploading piece. err: <nil> Oct 7 16:35:35.936731409 (339h4m21.398823892s) [noise=true , address=45.91.116.14:4191 , piece_id=5UE4HHJOWNH2IYVXYUZ3IRO4NF7AAFOGWDSG3Y33467AO7T5CHTQ, seg_pos={0 0}, upload=298367]: Done uploading piece. err: <nil> Oct 7 16:35:35.953218744 (339h4m21.415311227s) [noise=true , address=45.91.116.6:4973 , piece_id=3V2PGHPMBVBQG4WXO333MIYNZHWQ7SNTDV74N6RL2GXFLPJ6SKEQ, seg_pos={0 0}, upload=298367]: Done uploading piece. err: <nil> Oct 7 16:35:36.070375924 (339h4m21.532468407s) [noise=true , address=45.91.116.10:4082 , piece_id=RUUX33LCNL2ZYQXO5PUYEE7A34KSONWASARNSHIAVMGYFUKCFTKQ, seg_pos={0 0}, upload=298367]: Done uploading piece. err: <nil> Oct 7 16:36:02.722181063 (339h4m48.184273556s) [noise=true , address=145.79.227.3:4150 , piece_id=SNIBIYD6TRTEJLTPJ4VUM5ACRFNBVFUKQCHOA2QPVIIKX2X563JA, seg_pos={0 0}, upload=298367]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:47478->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:47478->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47478->145.79.227.3:4150: use of closed network connection Oct 7 16:36:02.722210519 (339h4m48.184303002s) [noise=true , address=145.79.227.4:4186 , piece_id=BADC6UDIYIOTWZOVWSGINYQXIWIUSUQHQ7TMIZ3XD4DRCPD3BRDQ, seg_pos={0 0}, upload=298367]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: write tcp 188.166.225.170:60198->145.79.227.4:4186: use of closed network connection; write tcp 188.166.225.170:60198->145.79.227.4:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60198->145.79.227.4:4186: use of closed network connection Oct 7 16:36:02.722338974 (339h4m48.184431467s) [noise=true , address=145.79.227.15:4876 , piece_id=M7G64SWBPFXFPLJWPOCQQG5KV2EXZBQPBYTZCGE3LWRKPPNK5TDA, seg_pos={0 0}, upload=298367]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: write tcp 188.166.225.170:39668->145.79.227.15:4876: use of closed network connection; write tcp 188.166.225.170:39668->145.79.227.15:4876: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39668->145.79.227.15:4876: use of closed network connection Oct 7 16:36:02.722551188 (339h4m48.184643681s) [noise=true , address=145.79.227.13:4802 , piece_id=4QBO7PJM73UKLB6TBJ3P677QGE37NAZGGA6S2NOZF5IZE37RW4LA, seg_pos={0 0}, upload=298367]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: read tcp 188.166.225.170:51102->145.79.227.13:4802: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:36:02.722688379 (339h4m48.184780872s) [noise=true , address=145.79.227.7:4294 , piece_id=Q5ANSI3HNEOG4X5UGE352KIKM7XX2RLPBOPAEN2XOLDR5PI465RQ, seg_pos={0 0}, upload=298367]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:43700->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:43700->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43700->145.79.227.7:4294: use of closed network connection Oct 7 16:36:02.722882608 (339h4m48.184975091s) [noise=true , address=145.79.227.12:4767 , piece_id=HNBLIQHBKY4QRJZKFRNHNCDRPXS37RKJMFY35W4R5U7KPQLPATFQ, seg_pos={0 0}, upload=298367]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: read tcp 188.166.225.170:53520->145.79.227.12:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:36:02.723078171 (339h4m48.185170704s) [noise=true , address=145.79.227.19:4079 , piece_id=NVHOWZMN5YLEFGBPKGN2S7RTXODPPSO3TV4WDRDXXRHN5RM4XXZQ, seg_pos={0 0}, upload=298367]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: read tcp 188.166.225.170:36484->145.79.227.19:4079: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:36:02.723142233 (339h4m48.185234746s) [noise=true , address=145.79.227.18:4007 , piece_id=S4SZDJCCLF4PZHBYSAVLGUX4Z7YJKGWENKQIR2ZET2QHVL66BTXA, seg_pos={0 0}, upload=298367]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: read tcp 188.166.225.170:34514->145.79.227.18:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:36:02.723178131 (339h4m48.185270615s) [seg_pos={0 0}, upload=298367]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Oct 7 16:36:02.971949710 (339h4m48.434042193s) [upload=298367]: Done uploading segments... Oct 7 16:36:02.971987161 (339h4m48.434079644s) [upload=298367]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 30.25234487s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 12 out of 60 is failed (threshold=3) [...............................................XXXXX.XXXXXXX] duration: 1m0.252326845s FAIL (2025-10-07 16:35:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== : Uploading piece... Oct 7 16:34:56.682004806 (339h3m42.144097289s) [noise=true , address=145.79.227.27:4724 , piece_id=7FBCWG26AJPLO4IH5AHZCMHYO4OC6NLUVAHGCD4YW6CW4FFPS2LA, seg_pos={0 0}, upload=298356]: Uploading piece... Oct 7 16:34:56.682299278 (339h3m42.144391761s) [noise=true , address=77.90.31.14:4670 , piece_id=A4FSFN2IFBWUTRKOUM7T3HMKRDKR3LBY6W2ZZE42B6OWBCWU64TA, seg_pos={0 0}, upload=298356]: Uploading piece... Oct 7 16:34:56.682554173 (339h3m42.144646646s) [noise=true , address=77.90.31.16:4752 , piece_id=I4OA4V274R4ED2X4NDC4QRJI5PUBG3ZUB3ZSOYGJNHSQZHVPL7ZA, seg_pos={0 0}, upload=298356]: Uploading piece... Oct 7 16:34:56.682846831 (339h3m42.144939304s) [noise=true , address=77.90.31.15:4731 , piece_id=O3QWIB3PV55HXQ2E5NQ4GZTMGB5EMKDKEJQBG73JLAGRT5ETAG4A, seg_pos={0 0}, upload=298356]: Uploading piece... Oct 7 16:34:56.683230772 (339h3m42.145323255s) [noise=true , address=77.90.31.17:4796 , piece_id=NLRMSYSZB22AG7VV7Y2CQGMR3N3GGJ2KAWSMZQYUUET22ZAHY3AA, seg_pos={0 0}, upload=298356]: Uploading piece... Oct 7 16:34:56.683597930 (339h3m42.145690433s) [noise=true , address=77.90.31.13:4648 , piece_id=EUAJPNV7MKXQO3ZRASEUCV27HE6ODRP4BT2T3HLTZOB4425STX4Q, seg_pos={0 0}, upload=298356]: Uploading piece... Oct 7 16:34:56.684006518 (339h3m42.146098992s) [noise=true , address=145.79.227.33:4870 , piece_id=FYPWEND5A2BMGU4Y3WHK5HO7KLE7PLTLSSZA3CHAFORTUPWSJMSQ, seg_pos={0 0}, upload=298356]: Uploading piece... Oct 7 16:34:56.684375522 (339h3m42.146468005s) [noise=true , address=145.79.227.28:4741 , piece_id=BLBZREMQDPSFJDKFN77VSAIWT6P7SS2OQ2DIHRLUM2OHDIFMYI3A, seg_pos={0 0}, upload=298356]: Uploading piece... Oct 7 16:34:56.684715759 (339h3m42.146808242s) [noise=true , address=45.91.116.7:4041 , piece_id=63EQLSL2SPSJKVLT5ZQ474SGAF2ZXBVXPLFAP6UX3GEHOIZ7WCFA, seg_pos={0 0}, upload=298356]: Uploading piece... Oct 7 16:34:56.685000391 (339h3m42.147092864s) [noise=true , address=145.79.227.22:4517 , piece_id=HX3ISG7FDNEE5OZBKBK6MFSN4MUINHB7DGQYNFZG5CSKMUB3X36A, seg_pos={0 0}, upload=298356]: Uploading piece... Oct 7 16:34:56.686325945 (339h3m42.148418429s) [noise=true , address=77.90.31.10:4526 , piece_id=VWJYWBWXBTLZ6HZIGJNRZUEMSYDDJBW3AUGGP43W7XXXQQY74YDA, seg_pos={0 0}, upload=298356]: Uploading piece... Oct 7 16:34:56.686827660 (339h3m42.148920143s) [noise=true , address=145.79.227.51:4416 , piece_id=IVXL7LPTEPALHY6DK6YGSUOMJHZHU727XV5JXUFXSRNYHXUJF6ZQ, seg_pos={0 0}, upload=298356]: Uploading piece... Oct 7 16:34:56.687296734 (339h3m42.149389217s) [noise=true , address=145.79.227.44:4197 , piece_id=QZOG2LB44Y4PVG7QKYT4LZ7J2QOHNZVSJULQAVQT4A6X5FQWTQWQ, seg_pos={0 0}, upload=298356]: Uploading piece... Oct 7 16:34:56.687798409 (339h3m42.149890892s) [noise=true , address=77.90.31.18:4822 , piece_id=X52NYPVDBUNU6X3RCMJ53SVAYYRH6JTSNFGR76KSXNAZR6OPHPNQ, seg_pos={0 0}, upload=298356]: Uploading piece... Oct 7 16:34:56.688272502 (339h3m42.150364985s) [noise=true , address=45.91.116.14:4222 , piece_id=UH6JYBI6LLSMFS22NR2PTWMEE2DETTKHBUIIR3X275V2WTJJRAJQ, seg_pos={0 0}, upload=298356]: Uploading piece... Oct 7 16:34:58.046324613 (339h3m43.508417086s) [upload=298356]: Next returned nil segment Oct 7 16:34:58.046386291 (339h3m43.508478764s) [upload=298356]: Waiting for error group managing segments... Oct 7 16:34:58.387673487 (339h3m43.84976597s) [noise=true , address=64.49.13.140:4508 , piece_id=RGACKGNASOQNE3KJHPHLHZXPB2OVEVGVBZGSPKHC2AMUGI7KH6EQ, seg_pos={0 0}, upload=298356]: Done uploading piece. err: <nil> Oct 7 16:34:58.621459941 (339h3m44.083552424s) [noise=true , address=77.90.31.12:4593 , piece_id=5FL6AQITICKVQLLSBFGWYKY2JHPVLNXYKA7NLFUSHHDLBPGAXB2A, seg_pos={0 0}, upload=298356]: Done uploading piece. err: <nil> Oct 7 16:34:58.659967127 (339h3m44.12205961s) [noise=true , address=77.90.31.17:4796 , piece_id=NLRMSYSZB22AG7VV7Y2CQGMR3N3GGJ2KAWSMZQYUUET22ZAHY3AA, seg_pos={0 0}, upload=298356]: Done uploading piece. err: <nil> Oct 7 16:34:58.676498175 (339h3m44.138590648s) [noise=true , address=45.91.116.14:4222 , piece_id=UH6JYBI6LLSMFS22NR2PTWMEE2DETTKHBUIIR3X275V2WTJJRAJQ, seg_pos={0 0}, upload=298356]: Done uploading piece. err: <nil> Oct 7 16:34:58.677637875 (339h3m44.139730348s) [noise=true , address=77.90.31.16:4752 , piece_id=I4OA4V274R4ED2X4NDC4QRJI5PUBG3ZUB3ZSOYGJNHSQZHVPL7ZA, seg_pos={0 0}, upload=298356]: Done uploading piece. err: <nil> Oct 7 16:34:58.701380306 (339h3m44.163472789s) [noise=true , address=45.91.116.7:4041 , piece_id=63EQLSL2SPSJKVLT5ZQ474SGAF2ZXBVXPLFAP6UX3GEHOIZ7WCFA, seg_pos={0 0}, upload=298356]: Done uploading piece. err: <nil> Oct 7 16:34:58.711159006 (339h3m44.173251489s) [noise=true , address=77.90.31.18:4822 , piece_id=X52NYPVDBUNU6X3RCMJ53SVAYYRH6JTSNFGR76KSXNAZR6OPHPNQ, seg_pos={0 0}, upload=298356]: Done uploading piece. err: <nil> Oct 7 16:34:58.755785373 (339h3m44.217877847s) [noise=true , address=77.90.31.14:4670 , piece_id=A4FSFN2IFBWUTRKOUM7T3HMKRDKR3LBY6W2ZZE42B6OWBCWU64TA, seg_pos={0 0}, upload=298356]: Done uploading piece. err: <nil> Oct 7 16:34:58.768744389 (339h3m44.230836862s) [noise=true , address=77.90.31.13:4648 , piece_id=EUAJPNV7MKXQO3ZRASEUCV27HE6ODRP4BT2T3HLTZOB4425STX4Q, seg_pos={0 0}, upload=298356]: Done uploading piece. err: <nil> Oct 7 16:34:58.848569571 (339h3m44.310662054s) [noise=true , address=77.90.31.10:4526 , piece_id=VWJYWBWXBTLZ6HZIGJNRZUEMSYDDJBW3AUGGP43W7XXXQQY74YDA, seg_pos={0 0}, upload=298356]: Done uploading piece. err: <nil> Oct 7 16:34:58.866514023 (339h3m44.328606506s) [noise=true , address=45.91.116.5:4320 , piece_id=MGDKE2BOFE6SQVDKAGNFH3AFRNCVIPMRSCEX7WEQK4VD4G5PQZVA, seg_pos={0 0}, upload=298356]: Done uploading piece. err: <nil> Oct 7 16:34:59.101494239 (339h3m44.563586722s) [noise=true , address=77.90.31.15:4731 , piece_id=O3QWIB3PV55HXQ2E5NQ4GZTMGB5EMKDKEJQBG73JLAGRT5ETAG4A, seg_pos={0 0}, upload=298356]: Done uploading piece. err: <nil> Oct 7 16:35:55.671097219 (339h4m41.133189702s) [noise=true , address=145.79.227.44:4197 , piece_id=QZOG2LB44Y4PVG7QKYT4LZ7J2QOHNZVSJULQAVQT4A6X5FQWTQWQ, seg_pos={0 0}, upload=298356]: Done uploading piece. err: ecclient: upload failed (node:12niHLkT5pbmYSbarHZGeeCRtwjZRXtvEtHMGAb7ja4a7Xuuvfi, address:145.79.227.44:4197): protocol: write tcp 188.166.225.170:55152->145.79.227.44:4197: use of closed network connection; write tcp 188.166.225.170:55152->145.79.227.44:4197: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55152->145.79.227.44:4197: use of closed network connection Oct 7 16:35:55.671195776 (339h4m41.133288249s) [noise=true , address=145.79.227.27:4724 , piece_id=7FBCWG26AJPLO4IH5AHZCMHYO4OC6NLUVAHGCD4YW6CW4FFPS2LA, seg_pos={0 0}, upload=298356]: Done uploading piece. err: ecclient: upload failed (node:12Sfj1VNcdj6rtvNXzLqgFpuvWpmfSjqYTXHPyFterKDQw48rS8, address:145.79.227.27:4724): protocol: write tcp 188.166.225.170:52288->145.79.227.27:4724: use of closed network connection; write tcp 188.166.225.170:52288->145.79.227.27:4724: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52288->145.79.227.27:4724: use of closed network connection Oct 7 16:35:55.671275037 (339h4m41.13336752s) [noise=true , address=145.79.227.33:4870 , piece_id=FYPWEND5A2BMGU4Y3WHK5HO7KLE7PLTLSSZA3CHAFORTUPWSJMSQ, seg_pos={0 0}, upload=298356]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: expected piece hash; write tcp 188.166.225.170:34410->145.79.227.33:4870: use of closed network connection; write tcp 188.166.225.170:34410->145.79.227.33:4870: use of closed network connection; EOF Oct 7 16:35:55.671348096 (339h4m41.133440569s) [noise=true , address=145.79.227.28:4741 , piece_id=BLBZREMQDPSFJDKFN77VSAIWT6P7SS2OQ2DIHRLUM2OHDIFMYI3A, seg_pos={0 0}, upload=298356]: Done uploading piece. err: ecclient: upload failed (node:12BHrpBwAi3KLWjuDsh4DPSRmaRzzexm9FYgRyJT6mXRMxDMeFY, address:145.79.227.28:4741): protocol: write tcp 188.166.225.170:45288->145.79.227.28:4741: use of closed network connection; write tcp 188.166.225.170:45288->145.79.227.28:4741: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45288->145.79.227.28:4741: use of closed network connection Oct 7 16:35:55.671417238 (339h4m41.133509711s) [noise=true , address=145.79.227.22:4517 , piece_id=HX3ISG7FDNEE5OZBKBK6MFSN4MUINHB7DGQYNFZG5CSKMUB3X36A, seg_pos={0 0}, upload=298356]: Done uploading piece. err: ecclient: upload failed (node:1wSJWmZaz4FNEiar3UGW17tJc6XvaW4erEXbpAsWnE6FvuLRzT, address:145.79.227.22:4517): protocol: write tcp 188.166.225.170:42426->145.79.227.22:4517: use of closed network connection; write tcp 188.166.225.170:42426->145.79.227.22:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42426->145.79.227.22:4517: use of closed network connection Oct 7 16:35:55.671484165 (339h4m41.133576649s) [noise=true , address=145.79.227.51:4416 , piece_id=IVXL7LPTEPALHY6DK6YGSUOMJHZHU727XV5JXUFXSRNYHXUJF6ZQ, seg_pos={0 0}, upload=298356]: Done uploading piece. err: ecclient: upload failed (node:12syasUPsyYf4UstQ6cFAr6qamze3vCyAm9dnobk5e83w4bTz69, address:145.79.227.51:4416): protocol: write tcp 188.166.225.170:42454->145.79.227.51:4416: use of closed network connection; write tcp 188.166.225.170:42454->145.79.227.51:4416: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42454->145.79.227.51:4416: use of closed network connection Oct 7 16:35:55.671512700 (339h4m41.133605183s) [seg_pos={0 0}, upload=298356]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Oct 7 16:35:55.921694786 (339h4m41.383787259s) [upload=298356]: Done uploading segments... Oct 7 16:35:55.921722559 (339h4m41.383815032s) [upload=298356]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 1m0.252348657s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 20 out of 60 is failed (threshold=3) [.......................................XXXXXXXXXXXXXXXXX.XXX] duration: 30.260763466s FAIL (2025-10-07 16:35:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== 875835 (339h3m48.689968318s) [noise=true , address=145.79.227.5:4223 , piece_id=7MO63BXCBUTOO4IGNM2RTTPQ463K2EFXZDB5T7UAL2YKXZLXXWCA, seg_pos={0 0}, upload=298357]: Uploading piece... Oct 7 16:35:03.228318667 (339h3m48.69041115s) [noise=true , address=145.79.227.11:4731 , piece_id=GZUDXUM5PCYF5GTMTYYZYZ355QIQ4E7HXNVHDTRLHMBMHUX7VZ2Q, seg_pos={0 0}, upload=298357]: Uploading piece... Oct 7 16:35:03.228745070 (339h3m48.690837553s) [noise=true , address=77.90.31.16:4734 , piece_id=52S3DXWVFAAAP77WOHCSD2HTQHL4SSMVPYKS2ZN6YDYEGGM7BPAA, seg_pos={0 0}, upload=298357]: Uploading piece... Oct 7 16:35:03.229725687 (339h3m48.69181817s) [noise=true , address=45.91.116.4:4940 , piece_id=ORGWALJZLER4AGTX2UB5XFZECKH453FXJ2O6Q7UPADTCNVHPW7BA, seg_pos={0 0}, upload=298357]: Uploading piece... Oct 7 16:35:03.230290032 (339h3m48.692382515s) [noise=true , address=77.90.31.12:4589 , piece_id=DRGTFB2D24OMDOZCOCD6FLYSQO6COAIX5YTFLYIJOV375V7KW2BQ, seg_pos={0 0}, upload=298357]: Uploading piece... Oct 7 16:35:03.232220218 (339h3m48.694312701s) [noise=true , address=145.79.227.3:4151 , piece_id=6ZWQ2UOHVCWVATAH2D4WRFFFSO2FWSHMJLIFV4AU24S6GA3S33AA, seg_pos={0 0}, upload=298357]: Uploading piece... Oct 7 16:35:03.232592596 (339h3m48.694685089s) [noise=true , address=77.90.31.21:4878 , piece_id=PNQDXWVQNSCTVJHSA2SL3GTKDENONWG7V6K5NZKQPIS5QIRFZV5A, seg_pos={0 0}, upload=298357]: Uploading piece... Oct 7 16:35:03.236850975 (339h3m48.698943458s) [noise=true , address=145.79.227.13:4802 , piece_id=BVDUNFRIPNCBXQ2SQAQUOISXAIBJPCIUKBUKY2YDGQXBQWFVYOVQ, seg_pos={0 0}, upload=298357]: Uploading piece... Oct 7 16:35:03.238938570 (339h3m48.701031064s) [noise=true , address=145.79.227.19:4079 , piece_id=WVJV2SHKEPHNTZ6TRHL4FJMTF3O4GLHJEHVT42Z3NLER2JCC3SJA, seg_pos={0 0}, upload=298357]: Uploading piece... Oct 7 16:35:03.240876159 (339h3m48.702968642s) [noise=true , address=45.91.116.12:4227 , piece_id=UKDD6JNGA6OSJR7RVQOPK7TO2COIHFLB3KILGSHM7FNM6ICSVGUQ, seg_pos={0 0}, upload=298357]: Uploading piece... Oct 7 16:35:03.242614680 (339h3m48.704707163s) [noise=true , address=145.79.227.16:4911 , piece_id=PPITC4TOPLJZOTLOYUN4RBUQYK7PZ7UL734AIBPSGXAF3VMVGYOQ, seg_pos={0 0}, upload=298357]: Uploading piece... Oct 7 16:35:03.244280201 (339h3m48.706372684s) [noise=true , address=145.79.227.12:4767 , piece_id=TUZGTERXKTQ34OWOCRD4AUQLSKXW32GH252AY5YXYBHXXKFKZFRQ, seg_pos={0 0}, upload=298357]: Uploading piece... Oct 7 16:35:03.270287253 (339h3m48.732379736s) [noise=true , address=45.91.116.13:4154 , piece_id=J5NBRU2KA63TN26GU5DVZ4MXP47JCSJLDP22ELNHW7D6A2EW5MQA, seg_pos={0 0}, upload=298357]: Uploading piece... Oct 7 16:35:04.996640714 (339h3m50.458733197s) [upload=298357]: Next returned nil segment Oct 7 16:35:04.996667404 (339h3m50.458759887s) [upload=298357]: Waiting for error group managing segments... Oct 7 16:35:05.395634434 (339h3m50.857726917s) [noise=true , address=45.91.116.12:4227 , piece_id=UKDD6JNGA6OSJR7RVQOPK7TO2COIHFLB3KILGSHM7FNM6ICSVGUQ, seg_pos={0 0}, upload=298357]: Done uploading piece. err: <nil> Oct 7 16:35:05.407498425 (339h3m50.869590908s) [noise=true , address=77.90.31.16:4734 , piece_id=52S3DXWVFAAAP77WOHCSD2HTQHL4SSMVPYKS2ZN6YDYEGGM7BPAA, seg_pos={0 0}, upload=298357]: Done uploading piece. err: <nil> Oct 7 16:35:05.412681965 (339h3m50.874774449s) [noise=true , address=77.90.31.12:4589 , piece_id=DRGTFB2D24OMDOZCOCD6FLYSQO6COAIX5YTFLYIJOV375V7KW2BQ, seg_pos={0 0}, upload=298357]: Done uploading piece. err: <nil> Oct 7 16:35:05.444945742 (339h3m50.907038225s) [noise=true , address=77.90.31.21:4878 , piece_id=PNQDXWVQNSCTVJHSA2SL3GTKDENONWG7V6K5NZKQPIS5QIRFZV5A, seg_pos={0 0}, upload=298357]: Done uploading piece. err: <nil> Oct 7 16:35:05.446234667 (339h3m50.90832715s) [noise=true , address=45.91.116.4:4940 , piece_id=ORGWALJZLER4AGTX2UB5XFZECKH453FXJ2O6Q7UPADTCNVHPW7BA, seg_pos={0 0}, upload=298357]: Done uploading piece. err: <nil> Oct 7 16:35:06.113601993 (339h3m51.575694476s) [noise=true , address=45.91.116.13:4154 , piece_id=J5NBRU2KA63TN26GU5DVZ4MXP47JCSJLDP22ELNHW7D6A2EW5MQA, seg_pos={0 0}, upload=298357]: Done uploading piece. err: <nil> Oct 7 16:35:32.248124942 (339h4m17.710217425s) [noise=true , address=145.79.227.17:4969 , piece_id=SHMMRSPMKBA5LJACS5ECSI24DVQWUBKQEP6HZP346BHUUJNFYW2A, seg_pos={0 0}, upload=298357]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: write tcp 188.166.225.170:56640->145.79.227.17:4969: use of closed network connection; write tcp 188.166.225.170:56640->145.79.227.17:4969: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56640->145.79.227.17:4969: use of closed network connection Oct 7 16:35:32.248282022 (339h4m17.710374495s) [noise=true , address=145.79.227.16:4911 , piece_id=PPITC4TOPLJZOTLOYUN4RBUQYK7PZ7UL734AIBPSGXAF3VMVGYOQ, seg_pos={0 0}, upload=298357]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:34840->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.16:4911: use of closed network connection Oct 7 16:35:32.248375260 (339h4m17.710467733s) [noise=true , address=145.79.227.13:4802 , piece_id=BVDUNFRIPNCBXQ2SQAQUOISXAIBJPCIUKBUKY2YDGQXBQWFVYOVQ, seg_pos={0 0}, upload=298357]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:35252->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:35252->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35252->145.79.227.13:4802: use of closed network connection Oct 7 16:35:32.248401409 (339h4m17.710493882s) [noise=true , address=145.79.227.3:4150 , piece_id=5V3UVVFXJXLUJC4VFL7TWMVOD5AHYTC6URYGI6FRRMOFW3T3WLKQ, seg_pos={0 0}, upload=298357]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:52906->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:52906->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52906->145.79.227.3:4150: use of closed network connection Oct 7 16:35:32.248589387 (339h4m17.71068186s) [noise=true , address=145.79.227.5:4223 , piece_id=7MO63BXCBUTOO4IGNM2RTTPQ463K2EFXZDB5T7UAL2YKXZLXXWCA, seg_pos={0 0}, upload=298357]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:56440->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:35:32.248622951 (339h4m17.710715424s) [noise=true , address=145.79.227.2:4115 , piece_id=GIO5KOTERS3NQE5IAPA4CUOUY2O3UQD3MKAAC7X5OCC7OH7FJTFQ, seg_pos={0 0}, upload=298357]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 188.166.225.170:55410->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:35:32.248806540 (339h4m17.710899023s) [noise=true , address=145.79.227.11:4731 , piece_id=GZUDXUM5PCYF5GTMTYYZYZ355QIQ4E7HXNVHDTRLHMBMHUX7VZ2Q, seg_pos={0 0}, upload=298357]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:145.79.227.11:4731): protocol: read tcp 188.166.225.170:39386->145.79.227.11:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:35:32.248852277 (339h4m17.71094476s) [noise=true , address=145.79.227.19:4079 , piece_id=WVJV2SHKEPHNTZ6TRHL4FJMTF3O4GLHJEHVT42Z3NLER2JCC3SJA, seg_pos={0 0}, upload=298357]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: read tcp 188.166.225.170:49440->145.79.227.19:4079: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:35:32.248911851 (339h4m17.711004324s) [noise=true , address=145.79.227.3:4151 , piece_id=6ZWQ2UOHVCWVATAH2D4WRFFFSO2FWSHMJLIFV4AU24S6GA3S33AA, seg_pos={0 0}, upload=298357]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:36144->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:36144->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36144->145.79.227.3:4151: use of closed network connection Oct 7 16:35:32.249014637 (339h4m17.71110711s) [noise=true , address=145.79.227.12:4767 , piece_id=TUZGTERXKTQ34OWOCRD4AUQLSKXW32GH252AY5YXYBHXXKFKZFRQ, seg_pos={0 0}, upload=298357]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: context deadline exceeded; context deadline exceeded Oct 7 16:35:32.249047600 (339h4m17.711140083s) [seg_pos={0 0}, upload=298357]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Oct 7 16:35:32.507308668 (339h4m17.969401151s) [upload=298357]: Done uploading segments... Oct 7 16:35:32.507343274 (339h4m17.969435757s) [upload=298357]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration: 30.260793614s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 11 out of 60 is failed (threshold=3) [................................................XXXXX.XXXXXX] duration: 1m0.258516153s FAIL (2025-10-07 16:34:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 3Z2IL3A, seg_pos={0 0}, upload=298343]: Uploading piece... Oct 7 16:33:56.207520049 (339h2m41.669612522s) [noise=true , address=145.79.227.31:4798 , piece_id=SMV2244G2TAQZIW7WMHO3VHDVD2MFMNLRVC464KMNBFZ5BXUCYUQ, seg_pos={0 0}, upload=298343]: Uploading piece... Oct 7 16:33:56.207929769 (339h2m41.670022253s) [noise=true , address=45.91.116.6:4006 , piece_id=L3P2EEHL333KN6F5PQN5KRYRP6HYVKB5Z3JGINFTVD7E4QWPILMQ, seg_pos={0 0}, upload=298343]: Uploading piece... Oct 7 16:33:56.208317808 (339h2m41.670410291s) [noise=true , address=45.91.116.9:4284 , piece_id=SAXUYKAPKDWB7KSYFMIEXXWXSNBEVYCDS23BHV5IXI2GGHYKYTCQ, seg_pos={0 0}, upload=298343]: Uploading piece... Oct 7 16:33:56.208707250 (339h2m41.670799733s) [noise=true , address=77.90.31.11:4557 , piece_id=EWBXN3FEXUPYDRT6VFS45F64OE6U4GTFMMTIUPWXRIY3KXQYKBLQ, seg_pos={0 0}, upload=298343]: Uploading piece... Oct 7 16:33:56.209125085 (339h2m41.671217568s) [noise=true , address=77.90.31.17:4779 , piece_id=FWC3NIMLHNASTBUYVGTY42U5Q7DMVA2U3S2EFBXJK6EBJKPPKZTQ, seg_pos={0 0}, upload=298343]: Uploading piece... Oct 7 16:33:56.213872895 (339h2m41.675965379s) [noise=true , address=64.49.13.139:4471 , piece_id=ZRZ6LGSANWH3IY3NRKX3H7HFTQCXGUMNT3CEBEKS6N4DDVELWKBQ, seg_pos={0 0}, upload=298343]: Uploading piece... Oct 7 16:33:56.214419206 (339h2m41.676511689s) [noise=true , address=77.90.31.14:4694 , piece_id=6UNP6JAEXNAZJRA4ZTIN5YVXL32O4FXGKFUWSL4ZOLLVNFCWJR4A, seg_pos={0 0}, upload=298343]: Uploading piece... Oct 7 16:33:56.214883050 (339h2m41.676975533s) [noise=true , address=77.90.31.18:4837 , piece_id=3DX6Z6QKNBAI7AKT6RX72EVVDIPZWQLJFL5WL3B6FLOG2OJIERTA, seg_pos={0 0}, upload=298343]: Uploading piece... Oct 7 16:33:56.215534169 (339h2m41.677626652s) [noise=true , address=145.79.227.34:4928 , piece_id=X5JJKO3YOY3EW5ODEOZJ2CGPKSQ7UZODS5NOVOV5HWDLUXACEE4A, seg_pos={0 0}, upload=298343]: Uploading piece... Oct 7 16:33:56.217040768 (339h2m41.679133241s) [noise=true , address=45.91.116.8:4069 , piece_id=EOFCYXLAESJBGCFMVBR5WUBKUL5F5IS25YD47NSLG6Y42VMIDMFA, seg_pos={0 0}, upload=298343]: Uploading piece... Oct 7 16:33:56.218440053 (339h2m41.680532536s) [noise=true , address=145.79.227.38:4982 , piece_id=3IYLGOLT2I6EGD6UAGE5364KPFVZ6NXXYUTWUBQDFZPK7USQUSSQ, seg_pos={0 0}, upload=298343]: Uploading piece... Oct 7 16:33:56.219656690 (339h2m41.681749173s) [noise=true , address=45.91.116.4:4960 , piece_id=6DO3ASGVME4JWWHROR5U44LZQUKX6YPTDCO5OBC6M2XJMBTZVQNA, seg_pos={0 0}, upload=298343]: Uploading piece... Oct 7 16:33:57.777994663 (339h2m43.240087146s) [upload=298343]: Next returned nil segment Oct 7 16:33:57.778021645 (339h2m43.240114118s) [upload=298343]: Waiting for error group managing segments... Oct 7 16:33:58.172851397 (339h2m43.63494388s) [noise=true , address=77.90.31.16:4740 , piece_id=ODRRTXTGRFUROIDQCEWF5YI6SOD3OLBZLQFO4DRGSG7CHLMI7BQA, seg_pos={0 0}, upload=298343]: Done uploading piece. err: <nil> Oct 7 16:33:58.195411565 (339h2m43.657504048s) [noise=true , address=77.90.31.18:4837 , piece_id=3DX6Z6QKNBAI7AKT6RX72EVVDIPZWQLJFL5WL3B6FLOG2OJIERTA, seg_pos={0 0}, upload=298343]: Done uploading piece. err: <nil> Oct 7 16:33:58.214971591 (339h2m43.677064064s) [noise=true , address=45.91.116.6:4006 , piece_id=L3P2EEHL333KN6F5PQN5KRYRP6HYVKB5Z3JGINFTVD7E4QWPILMQ, seg_pos={0 0}, upload=298343]: Done uploading piece. err: <nil> Oct 7 16:33:58.261537021 (339h2m43.723629494s) [noise=true , address=77.90.31.11:4557 , piece_id=EWBXN3FEXUPYDRT6VFS45F64OE6U4GTFMMTIUPWXRIY3KXQYKBLQ, seg_pos={0 0}, upload=298343]: Done uploading piece. err: <nil> Oct 7 16:33:58.321045727 (339h2m43.78313821s) [noise=true , address=45.91.116.9:4284 , piece_id=SAXUYKAPKDWB7KSYFMIEXXWXSNBEVYCDS23BHV5IXI2GGHYKYTCQ, seg_pos={0 0}, upload=298343]: Done uploading piece. err: <nil> Oct 7 16:33:58.338642244 (339h2m43.800734727s) [noise=true , address=45.91.116.8:4069 , piece_id=EOFCYXLAESJBGCFMVBR5WUBKUL5F5IS25YD47NSLG6Y42VMIDMFA, seg_pos={0 0}, upload=298343]: Done uploading piece. err: <nil> Oct 7 16:33:58.350382930 (339h2m43.812475413s) [noise=true , address=45.91.116.4:4960 , piece_id=6DO3ASGVME4JWWHROR5U44LZQUKX6YPTDCO5OBC6M2XJMBTZVQNA, seg_pos={0 0}, upload=298343]: Done uploading piece. err: <nil> Oct 7 16:33:58.399275061 (339h2m43.861367544s) [noise=true , address=77.90.31.17:4779 , piece_id=FWC3NIMLHNASTBUYVGTY42U5Q7DMVA2U3S2EFBXJK6EBJKPPKZTQ, seg_pos={0 0}, upload=298343]: Done uploading piece. err: <nil> Oct 7 16:33:58.461689119 (339h2m43.923781602s) [noise=true , address=77.90.31.15:4702 , piece_id=OMFZECQW3MYPNJ3PV5LOMAIJKVYYTKBZUDSBCXICBJEEYMOVJ56Q, seg_pos={0 0}, upload=298343]: Done uploading piece. err: <nil> Oct 7 16:33:59.130260008 (339h2m44.592352481s) [noise=true , address=77.90.31.14:4694 , piece_id=6UNP6JAEXNAZJRA4ZTIN5YVXL32O4FXGKFUWSL4ZOLLVNFCWJR4A, seg_pos={0 0}, upload=298343]: Done uploading piece. err: <nil> Oct 7 16:34:55.191461726 (339h3m40.653554199s) [noise=true , address=145.79.227.30:4772 , piece_id=6I3HBTDDUO7TYSD33BYBXQYALXUNACBCIM4MHZXINFTSXG726MYQ, seg_pos={0 0}, upload=298343]: Done uploading piece. err: ecclient: upload failed (node:1zKCizjMAKNzq6CvZaVBJmjox6abJzywmtbjCUS1dWcDV2qSip, address:145.79.227.30:4772): protocol: write tcp 188.166.225.170:58050->145.79.227.30:4772: use of closed network connection; write tcp 188.166.225.170:58050->145.79.227.30:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58050->145.79.227.30:4772: use of closed network connection Oct 7 16:34:55.191480461 (339h3m40.653572934s) [noise=true , address=145.79.227.22:4541 , piece_id=TQKS7GS7S6EOZJ2TS6NBUWG6TVND7XPGQV3337HYPHCWS3Z2IL3A, seg_pos={0 0}, upload=298343]: Done uploading piece. err: ecclient: upload failed (node:1zupYUhZUbuwMv5gwprk8M3kPYQ6qJiFK8ZsgGg3b1sqH6UwGr, address:145.79.227.22:4541): protocol: write tcp 188.166.225.170:35528->145.79.227.22:4541: use of closed network connection; write tcp 188.166.225.170:35528->145.79.227.22:4541: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35528->145.79.227.22:4541: use of closed network connection Oct 7 16:34:55.191544132 (339h3m40.653636615s) [noise=true , address=145.79.227.15:4893 , piece_id=SQBZLNQWLKQTAGWWYFYEGBHSAB7TDEIS7PFHOTEZS2PUCE76VLIQ, seg_pos={0 0}, upload=298343]: Done uploading piece. err: ecclient: upload failed (node:1259j7aHsLDMPtRwgXpd6u8axPEuaXzhRzqYYSgbpDnDqbhfwzi, address:145.79.227.15:4893): protocol: write tcp 188.166.225.170:37864->145.79.227.15:4893: use of closed network connection; write tcp 188.166.225.170:37864->145.79.227.15:4893: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37864->145.79.227.15:4893: use of closed network connection Oct 7 16:34:55.191605770 (339h3m40.653698253s) [noise=true , address=145.79.227.23:4564 , piece_id=VRKLT5SER4LVM2N6TLOOXKUDMYF45AFBFE27ZCYTPKYD67YCYKXQ, seg_pos={0 0}, upload=298343]: Done uploading piece. err: ecclient: upload failed (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc, address:145.79.227.23:4564): protocol: write tcp 188.166.225.170:35310->145.79.227.23:4564: use of closed network connection; write tcp 188.166.225.170:35310->145.79.227.23:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35310->145.79.227.23:4564: use of closed network connection Oct 7 16:34:55.191650585 (339h3m40.653743068s) [noise=true , address=145.79.227.31:4798 , piece_id=SMV2244G2TAQZIW7WMHO3VHDVD2MFMNLRVC464KMNBFZ5BXUCYUQ, seg_pos={0 0}, upload=298343]: Done uploading piece. err: ecclient: upload failed (node:17Ski7oMzbGroPGgWRrbUiqC1NiLPBBsvYuU4pCZ53xhNKkeBZ, address:145.79.227.31:4798): protocol: write tcp 188.166.225.170:47068->145.79.227.31:4798: use of closed network connection; write tcp 188.166.225.170:47068->145.79.227.31:4798: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47068->145.79.227.31:4798: use of closed network connection Oct 7 16:34:55.191739925 (339h3m40.653832408s) [noise=true , address=145.79.227.34:4928 , piece_id=X5JJKO3YOY3EW5ODEOZJ2CGPKSQ7UZODS5NOVOV5HWDLUXACEE4A, seg_pos={0 0}, upload=298343]: Done uploading piece. err: ecclient: upload failed (node:12B6ymfqNvqiDsAbkF8H4ExxEuYaYb7gYQ45Y5GF4PGAAwmjbyd, address:145.79.227.34:4928): protocol: write tcp 188.166.225.170:39758->145.79.227.34:4928: use of closed network connection; write tcp 188.166.225.170:39758->145.79.227.34:4928: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39758->145.79.227.34:4928: use of closed network connection Oct 7 16:34:55.191770894 (339h3m40.653863367s) [noise=true , address=64.49.13.139:4471 , piece_id=ZRZ6LGSANWH3IY3NRKX3H7HFTQCXGUMNT3CEBEKS6N4DDVELWKBQ, seg_pos={0 0}, upload=298343]: Done uploading piece. err: ecclient: upload failed (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr, address:64.49.13.139:4471): protocol: read tcp 188.166.225.170:50216->64.49.13.139:4471: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:34:55.191861426 (339h3m40.653953899s) [noise=true , address=145.79.227.38:4982 , piece_id=3IYLGOLT2I6EGD6UAGE5364KPFVZ6NXXYUTWUBQDFZPK7USQUSSQ, seg_pos={0 0}, upload=298343]: Done uploading piece. err: ecclient: upload failed (node:1NxoYJXCXmTvQncbkXt6yH7mhEBBrzVdzhgL5J6W5TD4N3pkaG, address:145.79.227.38:4982): protocol: read tcp 188.166.225.170:51576->145.79.227.38:4982: use of closed network connection; context deadline exceeded Oct 7 16:34:55.191907705 (339h3m40.654000178s) [seg_pos={0 0}, upload=298343]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:34:55.447878603 (339h3m40.909971076s) [upload=298343]: Done uploading segments... Oct 7 16:34:55.447914551 (339h3m40.910007034s) [upload=298343]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 1m0.25854114s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 19 out of 60 is failed (threshold=3) [........................................XXXXXXXXXXXXXXXXX.XX] duration: 30.254117215s FAIL (2025-10-07 16:34:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== (339h2m43.926430025s) [upload=298344]: Got next segment. Inline: false Oct 7 16:33:58.464373961 (339h2m43.926466444s) [upload=298344]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 16:33:58.464379391 (339h2m43.926471875s) [upload=298344]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 16:33:58.721041416 (339h2m44.183133919s) [seg_pos={0 0}, upload=298344]: Begin upload segment... Oct 7 16:33:58.721289819 (339h2m44.183382302s) [seg_pos={0 0}, upload=298344]: Done begin upload segment. Oct 7 16:33:58.721347860 (339h2m44.183440333s) [noise=true , address=145.79.227.2:4114 , piece_id=OULX6BG2SVW6GHRGVVP64W2T4GUCW2EJYS5FB52WHYYWAAG62PTQ, seg_pos={0 0}, upload=298344]: Uploading piece... Oct 7 16:33:58.721387936 (339h2m44.183480409s) [noise=true , address=145.79.227.19:4078 , piece_id=ZP44KEG5SGDMKPIRFU42WWPQQMBM6P5JLLSDK7FSA4PFPR3G5EGA, seg_pos={0 0}, upload=298344]: Uploading piece... Oct 7 16:33:58.722017926 (339h2m44.184110409s) [noise=true , address=45.91.116.5:4297 , piece_id=LB535DRDGL5KD7MHVNK36ZG4N52O3UB4RS5NP4H4RBZMQH4XJCUQ, seg_pos={0 0}, upload=298344]: Uploading piece... Oct 7 16:33:58.722480095 (339h2m44.184572578s) [noise=true , address=77.90.31.18:4807 , piece_id=OUCTEREYVAMADUUPWZQAE5K2VLJDFWMZLBOJHXJXDJDI2HR73ZHA, seg_pos={0 0}, upload=298344]: Uploading piece... Oct 7 16:33:58.722928469 (339h2m44.185020952s) [noise=true , address=145.79.227.12:4767 , piece_id=SRRTOYAR7ZHK4CBTTIFAG2RZXESF6JSRP4IEB2SVWNQMVQJRI5YA, seg_pos={0 0}, upload=298344]: Uploading piece... Oct 7 16:33:58.723380099 (339h2m44.185472582s) [noise=true , address=145.79.227.15:4873 , piece_id=HN4YHQDBXO3VAQ4CMIDFEQCDVBPHHNVOIV3BA7MMJ26W6Y7UGLMQ, seg_pos={0 0}, upload=298344]: Uploading piece... Oct 7 16:33:58.723810560 (339h2m44.185903043s) [noise=true , address=45.91.116.7:4011 , piece_id=RJXVWOU2SB5TBC6IQ7KPFHS7MCSUONX2UVOZLSHIBOOITPXEX7XQ, seg_pos={0 0}, upload=298344]: Uploading piece... Oct 7 16:33:58.724343033 (339h2m44.186435516s) [noise=true , address=45.91.116.8:4047 , piece_id=RH2QZPN4LCWDWQP4PCUXPCJO5JLPLLARMZCYK34NFRGU5FUEHI2Q, seg_pos={0 0}, upload=298344]: Uploading piece... Oct 7 16:33:58.725778206 (339h2m44.187870679s) [noise=true , address=45.91.116.8:4045 , piece_id=AEQVMB2U2DW6UOKCB6LN2NZQNV5RME4PNYKWIMYSFGBRUBCQKXCQ, seg_pos={0 0}, upload=298344]: Uploading piece... Oct 7 16:33:58.726133833 (339h2m44.188226316s) [noise=true , address=45.91.116.11:4117 , piece_id=Q4LOCJS2KVXKQUSH5IVP7M4MDVAVGHMRQ4YNUDCNGO2X2JW7OGJA, seg_pos={0 0}, upload=298344]: Uploading piece... Oct 7 16:33:58.727744991 (339h2m44.189837474s) [noise=true , address=145.79.227.3:4151 , piece_id=HZKAEXD6M4E2HH3UCMDG2OKP6XQHHPZQSMVHLALFKPN5H34UGSLA, seg_pos={0 0}, upload=298344]: Uploading piece... Oct 7 16:33:58.729326933 (339h2m44.191419416s) [noise=true , address=77.90.31.17:4771 , piece_id=XXPVI6JOYQMIGMNOQQLTYNQAUILXPBL56W62NC7DCVBB5XGCAYYQ, seg_pos={0 0}, upload=298344]: Uploading piece... Oct 7 16:33:58.731302906 (339h2m44.193395389s) [noise=true , address=145.79.227.4:4185 , piece_id=S66V6NPXVJ3KIJN5VDXYENMTQEJXWKU6FBVQHOBGO7WPEDDGREQQ, seg_pos={0 0}, upload=298344]: Uploading piece... Oct 7 16:33:58.732346874 (339h2m44.194439357s) [noise=true , address=77.90.31.19:4841 , piece_id=NQWJUROU7LGKNKS5XO3V5LECGJATBB7SOOE6AWAYROAXC7N6IH6A, seg_pos={0 0}, upload=298344]: Uploading piece... Oct 7 16:33:58.738419216 (339h2m44.200511709s) [noise=true , address=45.91.116.6:4975 , piece_id=O3JZSOZTDJ6YE7FDMYLYJ6AUBGTIT35JX7MFRLKTR5LCXZ53TJCA, seg_pos={0 0}, upload=298344]: Uploading piece... Oct 7 16:33:58.741173802 (339h2m44.203266285s) [noise=true , address=145.79.227.18:4005 , piece_id=Z3QSX2KUEV3MCQXABWDTFZKUKVBBC4H4MND545QD44ASDC5JISIA, seg_pos={0 0}, upload=298344]: Uploading piece... Oct 7 16:34:00.427547561 (339h2m45.889640044s) [upload=298344]: Next returned nil segment Oct 7 16:34:00.427570364 (339h2m45.889662837s) [upload=298344]: Waiting for error group managing segments... Oct 7 16:34:00.817001066 (339h2m46.279093549s) [noise=true , address=45.91.116.7:4011 , piece_id=RJXVWOU2SB5TBC6IQ7KPFHS7MCSUONX2UVOZLSHIBOOITPXEX7XQ, seg_pos={0 0}, upload=298344]: Done uploading piece. err: <nil> Oct 7 16:34:00.834525456 (339h2m46.296617939s) [noise=true , address=77.90.31.17:4771 , piece_id=XXPVI6JOYQMIGMNOQQLTYNQAUILXPBL56W62NC7DCVBB5XGCAYYQ, seg_pos={0 0}, upload=298344]: Done uploading piece. err: <nil> Oct 7 16:34:00.842692017 (339h2m46.30478449s) [noise=true , address=77.90.31.18:4807 , piece_id=OUCTEREYVAMADUUPWZQAE5K2VLJDFWMZLBOJHXJXDJDI2HR73ZHA, seg_pos={0 0}, upload=298344]: Done uploading piece. err: <nil> Oct 7 16:34:00.855484325 (339h2m46.317576798s) [noise=true , address=45.91.116.8:4045 , piece_id=AEQVMB2U2DW6UOKCB6LN2NZQNV5RME4PNYKWIMYSFGBRUBCQKXCQ, seg_pos={0 0}, upload=298344]: Done uploading piece. err: <nil> Oct 7 16:34:00.882203934 (339h2m46.344296418s) [noise=true , address=45.91.116.11:4117 , piece_id=Q4LOCJS2KVXKQUSH5IVP7M4MDVAVGHMRQ4YNUDCNGO2X2JW7OGJA, seg_pos={0 0}, upload=298344]: Done uploading piece. err: <nil> Oct 7 16:34:00.888328908 (339h2m46.350421391s) [noise=true , address=45.91.116.5:4297 , piece_id=LB535DRDGL5KD7MHVNK36ZG4N52O3UB4RS5NP4H4RBZMQH4XJCUQ, seg_pos={0 0}, upload=298344]: Done uploading piece. err: <nil> Oct 7 16:34:00.916617685 (339h2m46.378710158s) [noise=true , address=45.91.116.8:4047 , piece_id=RH2QZPN4LCWDWQP4PCUXPCJO5JLPLLARMZCYK34NFRGU5FUEHI2Q, seg_pos={0 0}, upload=298344]: Done uploading piece. err: <nil> Oct 7 16:34:00.994176502 (339h2m46.456268985s) [noise=true , address=45.91.116.6:4975 , piece_id=O3JZSOZTDJ6YE7FDMYLYJ6AUBGTIT35JX7MFRLKTR5LCXZ53TJCA, seg_pos={0 0}, upload=298344]: Done uploading piece. err: <nil> Oct 7 16:34:01.031810935 (339h2m46.493903418s) [noise=true , address=77.90.31.19:4841 , piece_id=NQWJUROU7LGKNKS5XO3V5LECGJATBB7SOOE6AWAYROAXC7N6IH6A, seg_pos={0 0}, upload=298344]: Done uploading piece. err: <nil> Oct 7 16:34:27.752338356 (339h3m13.214430859s) [noise=true , address=145.79.227.4:4185 , piece_id=S66V6NPXVJ3KIJN5VDXYENMTQEJXWKU6FBVQHOBGO7WPEDDGREQQ, seg_pos={0 0}, upload=298344]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40408->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40408->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40408->145.79.227.4:4185: use of closed network connection Oct 7 16:34:27.752445670 (339h3m13.214538143s) [noise=true , address=145.79.227.15:4873 , piece_id=HN4YHQDBXO3VAQ4CMIDFEQCDVBPHHNVOIV3BA7MMJ26W6Y7UGLMQ, seg_pos={0 0}, upload=298344]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:47588->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:47588->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47588->145.79.227.15:4873: use of closed network connection Oct 7 16:34:27.752543306 (339h3m13.214635789s) [noise=true , address=145.79.227.12:4767 , piece_id=SRRTOYAR7ZHK4CBTTIFAG2RZXESF6JSRP4IEB2SVWNQMVQJRI5YA, seg_pos={0 0}, upload=298344]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: rpc: dial tcp 145.79.227.12:4767: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:34:27.752691479 (339h3m13.214783952s) [noise=true , address=145.79.227.3:4151 , piece_id=HZKAEXD6M4E2HH3UCMDG2OKP6XQHHPZQSMVHLALFKPN5H34UGSLA, seg_pos={0 0}, upload=298344]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: read tcp 188.166.225.170:57360->145.79.227.3:4151: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:34:27.752846905 (339h3m13.214939378s) [noise=true , address=145.79.227.18:4005 , piece_id=Z3QSX2KUEV3MCQXABWDTFZKUKVBBC4H4MND545QD44ASDC5JISIA, seg_pos={0 0}, upload=298344]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: read tcp 188.166.225.170:32874->145.79.227.18:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:34:27.752923941 (339h3m13.215016414s) [noise=true , address=145.79.227.19:4078 , piece_id=ZP44KEG5SGDMKPIRFU42WWPQQMBM6P5JLLSDK7FSA4PFPR3G5EGA, seg_pos={0 0}, upload=298344]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: read tcp 188.166.225.170:37738->145.79.227.19:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:34:27.752952897 (339h3m13.21504538s) [noise=true , address=145.79.227.2:4114 , piece_id=OULX6BG2SVW6GHRGVVP64W2T4GUCW2EJYS5FB52WHYYWAAG62PTQ, seg_pos={0 0}, upload=298344]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: read tcp 188.166.225.170:41502->145.79.227.2:4114: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:34:27.752983084 (339h3m13.215075567s) [seg_pos={0 0}, upload=298344]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:34:28.004334645 (339h3m13.466427139s) [upload=298344]: Done uploading segments... Oct 7 16:34:28.004367147 (339h3m13.46645962s) [upload=298344]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 30.254142383s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 18 out of 60 is failed (threshold=3) [.........................................XXXXXXXXXXXXXXXXX.X] duration: 30.246478901s FAIL (2025-10-07 16:33:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== 93178732s) [upload=298336]: Uploading segments... Oct 7 16:33:27.031235513 (339h2m12.493328006s) [upload=298336]: Got next segment. Inline: false Oct 7 16:33:27.031272112 (339h2m12.493364596s) [upload=298336]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 16:33:27.031277903 (339h2m12.493370386s) [upload=298336]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 16:33:27.502503829 (339h2m12.964596322s) [seg_pos={0 0}, upload=298336]: Begin upload segment... Oct 7 16:33:27.502575495 (339h2m12.964667979s) [seg_pos={0 0}, upload=298336]: Done begin upload segment. Oct 7 16:33:27.502611364 (339h2m12.964703847s) [noise=true , address=77.90.31.10:4520 , piece_id=IMVKCYLD5HRUW23ZSO6LPLTDI5HKYM7NW2K2S4DMVXILJAH5YJYA, seg_pos={0 0}, upload=298336]: Uploading piece... Oct 7 16:33:27.506021718 (339h2m12.968114201s) [noise=true , address=45.91.116.14:4190 , piece_id=WLWVAHA7DPA55PUD6IJRKVYMKARKMA4V7VQM2Z3MKQGDHNVYNOMA, seg_pos={0 0}, upload=298336]: Uploading piece... Oct 7 16:33:27.506662117 (339h2m12.9687546s) [noise=true , address=145.79.227.12:4767 , piece_id=UFKMKZN4V6WWZJ4GRSFMQITUWAMJHEBJM5TZCTWEGDHVE5U3JVMQ, seg_pos={0 0}, upload=298336]: Uploading piece... Oct 7 16:33:27.507126642 (339h2m12.969219125s) [noise=true , address=145.79.227.15:4876 , piece_id=KNCDGWAKAJUDMNF4V2QZ6KOH7PVDKWEZJG6ZISPGH6MDGEY36FMQ, seg_pos={0 0}, upload=298336]: Uploading piece... Oct 7 16:33:27.507674956 (339h2m12.969767439s) [noise=true , address=45.91.116.12:4226 , piece_id=YFC4VMUJ2LUZJ4IKLYLWZELDFWVOBR242SFTSU7BDH6YH7UTZWGA, seg_pos={0 0}, upload=298336]: Uploading piece... Oct 7 16:33:27.508121626 (339h2m12.970214099s) [noise=true , address=77.90.31.21:4879 , piece_id=NEJBTYSFHAB7GZUW2JDW6OEBFLQIDX4TWCKTMF6JLOUKXRMDEMJA, seg_pos={0 0}, upload=298336]: Uploading piece... Oct 7 16:33:27.508584859 (339h2m12.970677342s) [noise=true , address=45.91.116.11:4118 , piece_id=TBM2N5YYQRDQD2BJ3KI7SCA2PPUFDGJPNGVDLGOQ5EE7LQAZMYOA, seg_pos={0 0}, upload=298336]: Uploading piece... Oct 7 16:33:27.509017232 (339h2m12.971109715s) [noise=true , address=45.91.116.4:4938 , piece_id=OV6VMPD3ZW7WNQJBPJRMWHQERZEAML2UIDHP2ELTH4MFJV4RQCDA, seg_pos={0 0}, upload=298336]: Uploading piece... Oct 7 16:33:27.509477438 (339h2m12.971569921s) [noise=true , address=145.79.227.14:4837 , piece_id=7NT5FVFJTSKN3MD6PM726BN563PGO74PWWYSGDSELJU4LJDAVJDA, seg_pos={0 0}, upload=298336]: Uploading piece... Oct 7 16:33:27.510259898 (339h2m12.972352381s) [noise=true , address=77.90.31.10:4517 , piece_id=IMZDWJA4BU2S5DL7LTQLXNQYRUKN55ZAWP7YPN3A6DX5QTP7PC2Q, seg_pos={0 0}, upload=298336]: Uploading piece... Oct 7 16:33:27.511005538 (339h2m12.973098021s) [noise=true , address=145.79.227.13:4803 , piece_id=3BPKRBKKWKZWXJD72WW52WQS4PWVFYYR3XHNTROM4GOBX4MQOHPA, seg_pos={0 0}, upload=298336]: Uploading piece... Oct 7 16:33:27.511588989 (339h2m12.973681462s) [noise=true , address=145.79.227.19:4077 , piece_id=BLCMNYESVJJLL2XNB7VU5E5CFVA7IYXAGWQE4YB36VFX2SVRCBGQ, seg_pos={0 0}, upload=298336]: Uploading piece... Oct 7 16:33:27.511829196 (339h2m12.973921679s) [noise=true , address=45.91.116.10:4082 , piece_id=5TUKIYGBDDTZNEV767GSWENCYPDS5UTI2RKDNLXI2FNTVPXT44UQ, seg_pos={0 0}, upload=298336]: Uploading piece... Oct 7 16:33:27.512090133 (339h2m12.974182606s) [noise=true , address=45.91.116.9:4262 , piece_id=J7TXRBADHP6U7EQGEMCPOB24CCDFHIS3O2U6S7EMP6BOXATNJ6TQ, seg_pos={0 0}, upload=298336]: Uploading piece... Oct 7 16:33:27.512358915 (339h2m12.974451398s) [noise=true , address=77.90.31.19:4842 , piece_id=5UVI3ILBQVNHQAACWIUXZAOZ2MVK2ETNTWBR7U7EI44DMFWEJIHA, seg_pos={0 0}, upload=298336]: Uploading piece... Oct 7 16:33:27.512778954 (339h2m12.974871438s) [noise=true , address=145.79.227.6:4257 , piece_id=NEL5NT3OGI3QFSKWMTXQUADZYGFQ2OEWKPYVCE7QCDGALVZVFVFA, seg_pos={0 0}, upload=298336]: Uploading piece... Oct 7 16:33:29.170426354 (339h2m14.632518837s) [upload=298336]: Next returned nil segment Oct 7 16:33:29.170454047 (339h2m14.63254652s) [upload=298336]: Waiting for error group managing segments... Oct 7 16:33:29.567947531 (339h2m15.030040004s) [noise=true , address=77.90.31.10:4520 , piece_id=IMVKCYLD5HRUW23ZSO6LPLTDI5HKYM7NW2K2S4DMVXILJAH5YJYA, seg_pos={0 0}, upload=298336]: Done uploading piece. err: <nil> Oct 7 16:33:29.568262621 (339h2m15.030355114s) [noise=true , address=77.90.31.21:4879 , piece_id=NEJBTYSFHAB7GZUW2JDW6OEBFLQIDX4TWCKTMF6JLOUKXRMDEMJA, seg_pos={0 0}, upload=298336]: Done uploading piece. err: <nil> Oct 7 16:33:29.635770259 (339h2m15.097862732s) [noise=true , address=45.91.116.10:4082 , piece_id=5TUKIYGBDDTZNEV767GSWENCYPDS5UTI2RKDNLXI2FNTVPXT44UQ, seg_pos={0 0}, upload=298336]: Done uploading piece. err: <nil> Oct 7 16:33:29.636222530 (339h2m15.098315013s) [noise=true , address=77.90.31.10:4517 , piece_id=IMZDWJA4BU2S5DL7LTQLXNQYRUKN55ZAWP7YPN3A6DX5QTP7PC2Q, seg_pos={0 0}, upload=298336]: Done uploading piece. err: <nil> Oct 7 16:33:29.658188056 (339h2m15.120280539s) [noise=true , address=45.91.116.12:4226 , piece_id=YFC4VMUJ2LUZJ4IKLYLWZELDFWVOBR242SFTSU7BDH6YH7UTZWGA, seg_pos={0 0}, upload=298336]: Done uploading piece. err: <nil> Oct 7 16:33:29.670415880 (339h2m15.132508353s) [noise=true , address=45.91.116.4:4938 , piece_id=OV6VMPD3ZW7WNQJBPJRMWHQERZEAML2UIDHP2ELTH4MFJV4RQCDA, seg_pos={0 0}, upload=298336]: Done uploading piece. err: <nil> Oct 7 16:33:29.703377996 (339h2m15.165470469s) [noise=true , address=45.91.116.11:4118 , piece_id=TBM2N5YYQRDQD2BJ3KI7SCA2PPUFDGJPNGVDLGOQ5EE7LQAZMYOA, seg_pos={0 0}, upload=298336]: Done uploading piece. err: <nil> Oct 7 16:33:29.773397187 (339h2m15.23548966s) [noise=true , address=45.91.116.14:4190 , piece_id=WLWVAHA7DPA55PUD6IJRKVYMKARKMA4V7VQM2Z3MKQGDHNVYNOMA, seg_pos={0 0}, upload=298336]: Done uploading piece. err: <nil> Oct 7 16:33:29.808432801 (339h2m15.270525284s) [noise=true , address=45.91.116.9:4262 , piece_id=J7TXRBADHP6U7EQGEMCPOB24CCDFHIS3O2U6S7EMP6BOXATNJ6TQ, seg_pos={0 0}, upload=298336]: Done uploading piece. err: <nil> Oct 7 16:33:32.768873439 (339h2m18.230965922s) [noise=true , address=77.90.31.19:4842 , piece_id=5UVI3ILBQVNHQAACWIUXZAOZ2MVK2ETNTWBR7U7EI44DMFWEJIHA, seg_pos={0 0}, upload=298336]: Done uploading piece. err: <nil> Oct 7 16:33:56.326228341 (339h2m41.788320824s) [noise=true , address=145.79.227.14:4837 , piece_id=7NT5FVFJTSKN3MD6PM726BN563PGO74PWWYSGDSELJU4LJDAVJDA, seg_pos={0 0}, upload=298336]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: write tcp 188.166.225.170:41920->145.79.227.14:4837: use of closed network connection; write tcp 188.166.225.170:41920->145.79.227.14:4837: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41920->145.79.227.14:4837: use of closed network connection Oct 7 16:33:56.326281603 (339h2m41.788374076s) [noise=true , address=145.79.227.19:4077 , piece_id=BLCMNYESVJJLL2XNB7VU5E5CFVA7IYXAGWQE4YB36VFX2SVRCBGQ, seg_pos={0 0}, upload=298336]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:42372->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:42372->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42372->145.79.227.19:4077: use of closed network connection Oct 7 16:33:56.326440064 (339h2m41.788532537s) [noise=true , address=145.79.227.12:4767 , piece_id=UFKMKZN4V6WWZJ4GRSFMQITUWAMJHEBJM5TZCTWEGDHVE5U3JVMQ, seg_pos={0 0}, upload=298336]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: read tcp 188.166.225.170:48632->145.79.227.12:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:33:56.326519226 (339h2m41.788611709s) [noise=true , address=145.79.227.13:4803 , piece_id=3BPKRBKKWKZWXJD72WW52WQS4PWVFYYR3XHNTROM4GOBX4MQOHPA, seg_pos={0 0}, upload=298336]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:60288->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:60288->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60288->145.79.227.13:4803: use of closed network connection Oct 7 16:33:56.326663580 (339h2m41.788756053s) [noise=true , address=145.79.227.6:4257 , piece_id=NEL5NT3OGI3QFSKWMTXQUADZYGFQ2OEWKPYVCE7QCDGALVZVFVFA, seg_pos={0 0}, upload=298336]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: read tcp 188.166.225.170:58080->145.79.227.6:4257: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:33:56.326707313 (339h2m41.788799806s) [noise=true , address=145.79.227.15:4876 , piece_id=KNCDGWAKAJUDMNF4V2QZ6KOH7PVDKWEZJG6ZISPGH6MDGEY36FMQ, seg_pos={0 0}, upload=298336]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: read tcp 188.166.225.170:56250->145.79.227.15:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:33:56.326733674 (339h2m41.788826157s) [seg_pos={0 0}, upload=298336]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 7 16:33:56.571267312 (339h2m42.033359785s) [upload=298336]: Done uploading segments... Oct 7 16:33:56.571296378 (339h2m42.033388851s) [upload=298336]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 30.246499409s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 10 out of 60 is failed (threshold=3) [.................................................XXXXX.XXXXX] duration: 1m0.253512251s FAIL (2025-10-07 16:33:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== piece... Oct 7 16:32:42.992561460 (339h1m28.454653943s) [noise=true , address=145.79.227.30:4770 , piece_id=K7IFKQKDXZ73KCTYLXCPVQ3WFQN4OCX5HG6CBCC43VTRHD5U3OIQ, seg_pos={0 0}, upload=298324]: Uploading piece... Oct 7 16:32:42.992772943 (339h1m28.454865426s) [noise=true , address=145.79.227.22:4512 , piece_id=UUDLQUIFIYRO7ZL5ILUHPIBPTTJYLEBKCQ24LSMT7ZNFIR3QR3IQ, seg_pos={0 0}, upload=298324]: Uploading piece... Oct 7 16:32:42.993077372 (339h1m28.455169855s) [noise=true , address=77.90.31.10:4526 , piece_id=7TX3ZHI4HHANTYESOLGAXPLOR3U2PYKRDDLAWJQSU3Y72GTCAPTQ, seg_pos={0 0}, upload=298324]: Uploading piece... Oct 7 16:32:42.993457415 (339h1m28.455549889s) [noise=true , address=77.90.31.17:4791 , piece_id=TBLJABBA2ANBT7GP7ZXDJTFQWZJM6MIMPETYLDZJOFAO6TL377VQ, seg_pos={0 0}, upload=298324]: Uploading piece... Oct 7 16:32:42.993504416 (339h1m28.455596899s) [noise=true , address=77.90.31.12:4599 , piece_id=W3CCVJN3GREVLVZF3U36TEUFNKP66DCJFJMLNWRFE4NSOCEI66WA, seg_pos={0 0}, upload=298324]: Uploading piece... Oct 7 16:32:42.993740245 (339h1m28.455832718s) [noise=true , address=145.79.227.32:4835 , piece_id=XX7QXTJLGERFEIWITIEW36RDDOYVVXFYIVOT3UMKUFACTIIFHQDQ, seg_pos={0 0}, upload=298324]: Uploading piece... Oct 7 16:32:42.994042309 (339h1m28.456134782s) [noise=true , address=45.91.116.9:4268 , piece_id=RHEKQOD5Y3UGWB6HRVIKWKBEGM5Q2DTR7XLPYCLFIGK5RUP47TAA, seg_pos={0 0}, upload=298324]: Uploading piece... Oct 7 16:32:42.994202545 (339h1m28.456295038s) [noise=true , address=77.90.31.16:4738 , piece_id=JMJ645Q2CJYIJICXEDUMP2Y7OTYLCGWRIQOBCUHB2IQOLQGSJTSQ, seg_pos={0 0}, upload=298324]: Uploading piece... Oct 7 16:32:42.994312875 (339h1m28.456405358s) [noise=true , address=77.90.31.14:4664 , piece_id=CW4LHRFUK4UBFNL6Y7IY5P6JI6MWG4XIC5FEOHARZTK4SFPZMWDA, seg_pos={0 0}, upload=298324]: Uploading piece... Oct 7 16:32:42.994595683 (339h1m28.456688166s) [noise=true , address=45.91.116.6:4004 , piece_id=4OQKDYXTXJUNOGX6ZNV33UAWFMDFC3XRYGLX4IHN3LKWWUCT6JDQ, seg_pos={0 0}, upload=298324]: Uploading piece... Oct 7 16:32:42.994777269 (339h1m28.456869752s) [noise=true , address=77.90.31.16:4736 , piece_id=HIVUZ4YXSRSSNYWYOFS2CXAONC32EFSCKM6RXBHD62SCWEVZNAXA, seg_pos={0 0}, upload=298324]: Uploading piece... Oct 7 16:32:42.994885084 (339h1m28.456977567s) [noise=true , address=145.79.227.42:4145 , piece_id=V5V6HAHW53BU3EC4ATRDXGCUR6XTKLGKBLIO6UH46CQTTUFGCC6Q, seg_pos={0 0}, upload=298324]: Uploading piece... Oct 7 16:32:42.995645272 (339h1m28.457737765s) [noise=true , address=77.90.31.13:4642 , piece_id=XVDXQQVTEBKCM6RJJWJ2TXYTLPFDDNFY46SKET4OHTTO2L5FRRVQ, seg_pos={0 0}, upload=298324]: Uploading piece... Oct 7 16:32:42.997777342 (339h1m28.459869855s) [noise=true , address=45.91.116.10:4104 , piece_id=C2MDQTO2TPMXYPLXBOAWOASWLSW63KOUEMOVKLBTUFOH6GEKQGNQ, seg_pos={0 0}, upload=298324]: Uploading piece... Oct 7 16:32:42.998922161 (339h1m28.461014644s) [noise=true , address=145.79.227.27:4695 , piece_id=PYD6UP5VDYKQTF5OZKJRYZTQ2H2G6OZS272UNY5WQEWLPTFJ6IGA, seg_pos={0 0}, upload=298324]: Uploading piece... Oct 7 16:32:42.999663484 (339h1m28.461755977s) [noise=true , address=45.91.116.13:4175 , piece_id=M6U636AEV6CAQMURALUVA6SZQUPSZSS7X3SESH2GGQ3CVBBW7TEA, seg_pos={0 0}, upload=298324]: Uploading piece... Oct 7 16:32:44.519934552 (339h1m29.982027035s) [upload=298324]: Next returned nil segment Oct 7 16:32:44.519956623 (339h1m29.982049096s) [upload=298324]: Waiting for error group managing segments... Oct 7 16:32:44.950040246 (339h1m30.412132729s) [noise=true , address=77.90.31.13:4642 , piece_id=XVDXQQVTEBKCM6RJJWJ2TXYTLPFDDNFY46SKET4OHTTO2L5FRRVQ, seg_pos={0 0}, upload=298324]: Done uploading piece. err: <nil> Oct 7 16:32:44.955959337 (339h1m30.41805181s) [noise=true , address=77.90.31.10:4526 , piece_id=7TX3ZHI4HHANTYESOLGAXPLOR3U2PYKRDDLAWJQSU3Y72GTCAPTQ, seg_pos={0 0}, upload=298324]: Done uploading piece. err: <nil> Oct 7 16:32:44.972718009 (339h1m30.434810492s) [noise=true , address=45.91.116.6:4004 , piece_id=4OQKDYXTXJUNOGX6ZNV33UAWFMDFC3XRYGLX4IHN3LKWWUCT6JDQ, seg_pos={0 0}, upload=298324]: Done uploading piece. err: <nil> Oct 7 16:32:44.993892638 (339h1m30.455985121s) [noise=true , address=77.90.31.16:4738 , piece_id=JMJ645Q2CJYIJICXEDUMP2Y7OTYLCGWRIQOBCUHB2IQOLQGSJTSQ, seg_pos={0 0}, upload=298324]: Done uploading piece. err: <nil> Oct 7 16:32:44.998237502 (339h1m30.460329985s) [noise=true , address=77.90.31.21:4891 , piece_id=EI44J5C24XR43WHGBBOUUNTAPSM3KFBW6KRHXG3UPM3MUQVYXZ7Q, seg_pos={0 0}, upload=298324]: Done uploading piece. err: <nil> Oct 7 16:32:45.005931803 (339h1m30.468024286s) [noise=true , address=77.90.31.17:4791 , piece_id=TBLJABBA2ANBT7GP7ZXDJTFQWZJM6MIMPETYLDZJOFAO6TL377VQ, seg_pos={0 0}, upload=298324]: Done uploading piece. err: <nil> Oct 7 16:32:45.022216713 (339h1m30.484309196s) [noise=true , address=77.90.31.16:4736 , piece_id=HIVUZ4YXSRSSNYWYOFS2CXAONC32EFSCKM6RXBHD62SCWEVZNAXA, seg_pos={0 0}, upload=298324]: Done uploading piece. err: <nil> Oct 7 16:32:45.063249157 (339h1m30.52534165s) [noise=true , address=45.91.116.13:4175 , piece_id=M6U636AEV6CAQMURALUVA6SZQUPSZSS7X3SESH2GGQ3CVBBW7TEA, seg_pos={0 0}, upload=298324]: Done uploading piece. err: <nil> Oct 7 16:32:45.079486496 (339h1m30.541578979s) [noise=true , address=45.91.116.10:4104 , piece_id=C2MDQTO2TPMXYPLXBOAWOASWLSW63KOUEMOVKLBTUFOH6GEKQGNQ, seg_pos={0 0}, upload=298324]: Done uploading piece. err: <nil> Oct 7 16:32:45.094989977 (339h1m30.55708246s) [noise=true , address=45.91.116.9:4268 , piece_id=RHEKQOD5Y3UGWB6HRVIKWKBEGM5Q2DTR7XLPYCLFIGK5RUP47TAA, seg_pos={0 0}, upload=298324]: Done uploading piece. err: <nil> Oct 7 16:32:45.103645258 (339h1m30.565737742s) [noise=true , address=77.90.31.14:4664 , piece_id=CW4LHRFUK4UBFNL6Y7IY5P6JI6MWG4XIC5FEOHARZTK4SFPZMWDA, seg_pos={0 0}, upload=298324]: Done uploading piece. err: <nil> Oct 7 16:32:45.181525588 (339h1m30.643618081s) [noise=true , address=77.90.31.12:4599 , piece_id=W3CCVJN3GREVLVZF3U36TEUFNKP66DCJFJMLNWRFE4NSOCEI66WA, seg_pos={0 0}, upload=298324]: Done uploading piece. err: <nil> Oct 7 16:33:41.985650774 (339h2m27.447743257s) [noise=true , address=145.79.227.26:4668 , piece_id=XKRVXR535ETVZ6LZCZOHGQJT6D4TM5PDJXP3OWIUQDCBHWYG2OXQ, seg_pos={0 0}, upload=298324]: Done uploading piece. err: ecclient: upload failed (node:1w4v4QV7PxhXTwuxbvTQST2buoWNySrziRYTo9Mb8dpENd9XCX, address:145.79.227.26:4668): protocol: write tcp 188.166.225.170:39174->145.79.227.26:4668: use of closed network connection; write tcp 188.166.225.170:39174->145.79.227.26:4668: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39174->145.79.227.26:4668: use of closed network connection Oct 7 16:33:41.985872576 (339h2m27.447965069s) [noise=true , address=145.79.227.30:4770 , piece_id=K7IFKQKDXZ73KCTYLXCPVQ3WFQN4OCX5HG6CBCC43VTRHD5U3OIQ, seg_pos={0 0}, upload=298324]: Done uploading piece. err: ecclient: upload failed (node:1Vpr5UhYBKjdwam6GJFcMqrwjdkaCstSTrxgX8AzX5VjhWotK5, address:145.79.227.30:4770): protocol: write tcp 188.166.225.170:50234->145.79.227.30:4770: use of closed network connection; write tcp 188.166.225.170:50234->145.79.227.30:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50234->145.79.227.30:4770: use of closed network connection Oct 7 16:33:41.985893195 (339h2m27.447985678s) [noise=true , address=145.79.227.42:4145 , piece_id=V5V6HAHW53BU3EC4ATRDXGCUR6XTKLGKBLIO6UH46CQTTUFGCC6Q, seg_pos={0 0}, upload=298324]: Done uploading piece. err: ecclient: upload failed (node:1rXBNYi6SgZdwGbiU5ooBE8U7DrEoAGw25ncYsRETgNh4CsiLX, address:145.79.227.42:4145): protocol: read tcp 188.166.225.170:43050->145.79.227.42:4145: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:33:41.985971113 (339h2m27.448063596s) [noise=true , address=145.79.227.32:4835 , piece_id=XX7QXTJLGERFEIWITIEW36RDDOYVVXFYIVOT3UMKUFACTIIFHQDQ, seg_pos={0 0}, upload=298324]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: write tcp 188.166.225.170:48368->145.79.227.32:4835: use of closed network connection; write tcp 188.166.225.170:48368->145.79.227.32:4835: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48368->145.79.227.32:4835: use of closed network connection Oct 7 16:33:41.986110990 (339h2m27.448203473s) [noise=true , address=145.79.227.27:4695 , piece_id=PYD6UP5VDYKQTF5OZKJRYZTQ2H2G6OZS272UNY5WQEWLPTFJ6IGA, seg_pos={0 0}, upload=298324]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: read tcp 188.166.225.170:41122->145.79.227.27:4695: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:33:41.986167408 (339h2m27.448259891s) [noise=true , address=145.79.227.22:4512 , piece_id=UUDLQUIFIYRO7ZL5ILUHPIBPTTJYLEBKCQ24LSMT7ZNFIR3QR3IQ, seg_pos={0 0}, upload=298324]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: write tcp 188.166.225.170:49072->145.79.227.22:4512: use of closed network connection; write tcp 188.166.225.170:49072->145.79.227.22:4512: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49072->145.79.227.22:4512: use of closed network connection Oct 7 16:33:41.986202715 (339h2m27.448295198s) [seg_pos={0 0}, upload=298324]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Oct 7 16:33:42.236800320 (339h2m27.698892793s) [upload=298324]: Done uploading segments... Oct 7 16:33:42.236836278 (339h2m27.698928761s) [upload=298324]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 1m0.253532379s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 17 out of 60 is failed (threshold=3) [..........................................XXXXXXXXXXXXXXXXX.] duration: 6.413157422s FAIL (2025-10-07 16:33:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== d=298319]: Uploading piece... Oct 7 16:32:15.241431802 (339h1m0.703524285s) [noise=true , address=145.79.227.6:4258 , piece_id=6EKXJK6JJGISMFZUMYJHUJEVMPMSUTPA4I7A3J6FG7I6SMEJO5XQ, seg_pos={0 0}, upload=298319]: Uploading piece... Oct 7 16:32:15.241928788 (339h1m0.704021261s) [noise=true , address=145.79.227.14:4837 , piece_id=MECCNUPTQM5AXMR7S4LMQY5XG2QDLMUBX2TZ6ZICNRENEEVOQG4Q, seg_pos={0 0}, upload=298319]: Uploading piece... Oct 7 16:32:15.243398226 (339h1m0.705490709s) [noise=true , address=145.79.227.2:4113 , piece_id=FXJ5BYDBR7ONGDDXSFFLGUUM62TRLNFHAPT4DQCMJXOTT6G25EUQ, seg_pos={0 0}, upload=298319]: Uploading piece... Oct 7 16:32:15.244641353 (339h1m0.706733836s) [noise=true , address=77.90.31.16:4735 , piece_id=KF7AS4GLPJSMPVT5RDXOWHIHCPTNS7DZ4NFYJLZXHBWXSHWVAJ2A, seg_pos={0 0}, upload=298319]: Uploading piece... Oct 7 16:32:15.246095171 (339h1m0.708187654s) [noise=true , address=45.91.116.13:4154 , piece_id=63MSXDPQGJDQI4CQACKEI7ELSTROJJO7C7UKWNXHXA3EZHIPYH4Q, seg_pos={0 0}, upload=298319]: Uploading piece... Oct 7 16:32:15.247508212 (339h1m0.709600685s) [noise=true , address=45.91.116.14:4191 , piece_id=7ENDIK7HKENSR6BDFK6FSA7Y4HAHIR5LHNFE4DKZ3MPYP3WDVWNQ, seg_pos={0 0}, upload=298319]: Uploading piece... Oct 7 16:32:15.248633534 (339h1m0.710726017s) [noise=true , address=145.79.227.18:4005 , piece_id=FC5RT6FUBP5S2XMBM5YFORUYM7KKJGCVBXLJFYZR77LN7WKVD6CA, seg_pos={0 0}, upload=298319]: Uploading piece... Oct 7 16:32:15.250137619 (339h1m0.712230132s) [noise=true , address=45.91.116.5:4298 , piece_id=NPLMUJCBBRM6UJE5HYHAHVH6PIAVW5F76DTLDMMV6C654UWOUVIA, seg_pos={0 0}, upload=298319]: Uploading piece... Oct 7 16:32:15.251269664 (339h1m0.713362147s) [noise=true , address=77.90.31.14:4661 , piece_id=MPLNZ55YX2UGNYQK3DAN3CBTWQDX5TIGQSZ5GSZR6PKWPPCKWWDA, seg_pos={0 0}, upload=298319]: Uploading piece... Oct 7 16:32:16.932398707 (339h1m2.39449119s) [upload=298319]: Next returned nil segment Oct 7 16:32:16.932418565 (339h1m2.394511048s) [upload=298319]: Waiting for error group managing segments... Oct 7 16:32:17.333603177 (339h1m2.79569566s) [noise=true , address=45.91.116.14:4191 , piece_id=7ENDIK7HKENSR6BDFK6FSA7Y4HAHIR5LHNFE4DKZ3MPYP3WDVWNQ, seg_pos={0 0}, upload=298319]: Done uploading piece. err: <nil> Oct 7 16:32:17.368032587 (339h1m2.83012507s) [noise=true , address=77.90.31.16:4735 , piece_id=KF7AS4GLPJSMPVT5RDXOWHIHCPTNS7DZ4NFYJLZXHBWXSHWVAJ2A, seg_pos={0 0}, upload=298319]: Done uploading piece. err: <nil> Oct 7 16:32:17.407536711 (339h1m2.869629194s) [noise=true , address=77.90.31.14:4661 , piece_id=MPLNZ55YX2UGNYQK3DAN3CBTWQDX5TIGQSZ5GSZR6PKWPPCKWWDA, seg_pos={0 0}, upload=298319]: Done uploading piece. err: <nil> Oct 7 16:32:17.422166068 (339h1m2.884258571s) [noise=true , address=45.91.116.13:4154 , piece_id=63MSXDPQGJDQI4CQACKEI7ELSTROJJO7C7UKWNXHXA3EZHIPYH4Q, seg_pos={0 0}, upload=298319]: Done uploading piece. err: <nil> Oct 7 16:32:17.506756615 (339h1m2.968849098s) [noise=true , address=45.91.116.5:4298 , piece_id=NPLMUJCBBRM6UJE5HYHAHVH6PIAVW5F76DTLDMMV6C654UWOUVIA, seg_pos={0 0}, upload=298319]: Done uploading piece. err: <nil> Oct 7 16:32:44.222933374 (339h1m29.685025857s) [noise=true , address=145.79.227.12:4767 , piece_id=UD6BQDH2U7UKJBNJE3U4Y7H45YXJYJSYH2Q5L4DRBSJK7CF6ODZQ, seg_pos={0 0}, upload=298319]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: write tcp 188.166.225.170:38162->145.79.227.12:4767: use of closed network connection; write tcp 188.166.225.170:38162->145.79.227.12:4767: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38162->145.79.227.12:4767: use of closed network connection Oct 7 16:32:44.222999159 (339h1m29.685091632s) [noise=true , address=145.79.227.3:4151 , piece_id=V5TCXSHABEDYGMDE7765J4FCRC43FXQBYROC7YWVOAGKKTPVBX3A, seg_pos={0 0}, upload=298319]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:58494->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:58494->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58494->145.79.227.3:4151: use of closed network connection Oct 7 16:32:44.223013637 (339h1m29.68510611s) [noise=true , address=145.79.227.19:4077 , piece_id=OGFCIC465J44UGDYZ2TLODMXSUMGLMURQPPLAH3IZWBPLOP6D2YQ, seg_pos={0 0}, upload=298319]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:51182->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:51182->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51182->145.79.227.19:4077: use of closed network connection Oct 7 16:32:44.223072309 (339h1m29.685164792s) [noise=true , address=145.79.227.16:4909 , piece_id=R3V3OFZZJ3FSGB44EOKAG5ASDKOCLCZM33CKVSK25E3QZAYJZE7Q, seg_pos={0 0}, upload=298319]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:56566->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:56566->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56566->145.79.227.16:4909: use of closed network connection Oct 7 16:32:44.223095583 (339h1m29.685188076s) [noise=true , address=145.79.227.14:4837 , piece_id=MECCNUPTQM5AXMR7S4LMQY5XG2QDLMUBX2TZ6ZICNRENEEVOQG4Q, seg_pos={0 0}, upload=298319]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: write tcp 188.166.225.170:41068->145.79.227.14:4837: use of closed network connection; write tcp 188.166.225.170:41068->145.79.227.14:4837: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41068->145.79.227.14:4837: use of closed network connection Oct 7 16:32:44.223126713 (339h1m29.685219186s) [noise=true , address=145.79.227.6:4258 , piece_id=6EKXJK6JJGISMFZUMYJHUJEVMPMSUTPA4I7A3J6FG7I6SMEJO5XQ, seg_pos={0 0}, upload=298319]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:50802->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:50802->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50802->145.79.227.6:4258: use of closed network connection Oct 7 16:32:44.223178200 (339h1m29.685270683s) [noise=true , address=145.79.227.2:4113 , piece_id=FXJ5BYDBR7ONGDDXSFFLGUUM62TRLNFHAPT4DQCMJXOTT6G25EUQ, seg_pos={0 0}, upload=298319]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: write tcp 188.166.225.170:55140->145.79.227.2:4113: use of closed network connection; write tcp 188.166.225.170:55140->145.79.227.2:4113: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55140->145.79.227.2:4113: use of closed network connection Oct 7 16:32:44.223227313 (339h1m29.685319786s) [noise=true , address=145.79.227.13:4802 , piece_id=LHQ4775QY6F5CGXIJKZVIGNUQC6HUB5JPTE7FMACWXBHX4BKDZXA, seg_pos={0 0}, upload=298319]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:44660->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:44660->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44660->145.79.227.13:4802: use of closed network connection Oct 7 16:32:44.223278642 (339h1m29.685371125s) [noise=true , address=145.79.227.18:4005 , piece_id=FC5RT6FUBP5S2XMBM5YFORUYM7KKJGCVBXLJFYZR77LN7WKVD6CA, seg_pos={0 0}, upload=298319]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: read tcp 188.166.225.170:42832->145.79.227.18:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:32:44.223297437 (339h1m29.68538992s) [noise=true , address=145.79.227.4:4186 , piece_id=XV6MNUOKKZRXFMKBWJBM3RRCB7LC4NWEKEUA3MKVTBJOXEFJCARA, seg_pos={0 0}, upload=298319]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: read tcp 188.166.225.170:51984->145.79.227.4:4186: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:32:44.223365336 (339h1m29.685457819s) [noise=true , address=145.79.227.6:4259 , piece_id=4QG6GV5QYLCDMXUE2V24N4YQOXY56FPT3WNGI6PCNCQJRUYPLTTQ, seg_pos={0 0}, upload=298319]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:35468->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Oct 7 16:32:44.223384343 (339h1m29.685476816s) [seg_pos={0 0}, upload=298319]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 7 16:32:44.489737751 (339h1m29.951830234s) [upload=298319]: Done uploading segments... Oct 7 16:32:44.489777086 (339h1m29.951869569s) [upload=298319]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 6.413188552s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 17 out of 60 is failed (threshold=3) [...........................................XXXXXXXXXXXXXXXXX] duration: 30.268111335s FAIL (2025-10-07 16:32:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== d=298319]: Uploading piece... Oct 7 16:32:15.241431802 (339h1m0.703524285s) [noise=true , address=145.79.227.6:4258 , piece_id=6EKXJK6JJGISMFZUMYJHUJEVMPMSUTPA4I7A3J6FG7I6SMEJO5XQ, seg_pos={0 0}, upload=298319]: Uploading piece... Oct 7 16:32:15.241928788 (339h1m0.704021261s) [noise=true , address=145.79.227.14:4837 , piece_id=MECCNUPTQM5AXMR7S4LMQY5XG2QDLMUBX2TZ6ZICNRENEEVOQG4Q, seg_pos={0 0}, upload=298319]: Uploading piece... Oct 7 16:32:15.243398226 (339h1m0.705490709s) [noise=true , address=145.79.227.2:4113 , piece_id=FXJ5BYDBR7ONGDDXSFFLGUUM62TRLNFHAPT4DQCMJXOTT6G25EUQ, seg_pos={0 0}, upload=298319]: Uploading piece... Oct 7 16:32:15.244641353 (339h1m0.706733836s) [noise=true , address=77.90.31.16:4735 , piece_id=KF7AS4GLPJSMPVT5RDXOWHIHCPTNS7DZ4NFYJLZXHBWXSHWVAJ2A, seg_pos={0 0}, upload=298319]: Uploading piece... Oct 7 16:32:15.246095171 (339h1m0.708187654s) [noise=true , address=45.91.116.13:4154 , piece_id=63MSXDPQGJDQI4CQACKEI7ELSTROJJO7C7UKWNXHXA3EZHIPYH4Q, seg_pos={0 0}, upload=298319]: Uploading piece... Oct 7 16:32:15.247508212 (339h1m0.709600685s) [noise=true , address=45.91.116.14:4191 , piece_id=7ENDIK7HKENSR6BDFK6FSA7Y4HAHIR5LHNFE4DKZ3MPYP3WDVWNQ, seg_pos={0 0}, upload=298319]: Uploading piece... Oct 7 16:32:15.248633534 (339h1m0.710726017s) [noise=true , address=145.79.227.18:4005 , piece_id=FC5RT6FUBP5S2XMBM5YFORUYM7KKJGCVBXLJFYZR77LN7WKVD6CA, seg_pos={0 0}, upload=298319]: Uploading piece... Oct 7 16:32:15.250137619 (339h1m0.712230132s) [noise=true , address=45.91.116.5:4298 , piece_id=NPLMUJCBBRM6UJE5HYHAHVH6PIAVW5F76DTLDMMV6C654UWOUVIA, seg_pos={0 0}, upload=298319]: Uploading piece... Oct 7 16:32:15.251269664 (339h1m0.713362147s) [noise=true , address=77.90.31.14:4661 , piece_id=MPLNZ55YX2UGNYQK3DAN3CBTWQDX5TIGQSZ5GSZR6PKWPPCKWWDA, seg_pos={0 0}, upload=298319]: Uploading piece... Oct 7 16:32:16.932398707 (339h1m2.39449119s) [upload=298319]: Next returned nil segment Oct 7 16:32:16.932418565 (339h1m2.394511048s) [upload=298319]: Waiting for error group managing segments... Oct 7 16:32:17.333603177 (339h1m2.79569566s) [noise=true , address=45.91.116.14:4191 , piece_id=7ENDIK7HKENSR6BDFK6FSA7Y4HAHIR5LHNFE4DKZ3MPYP3WDVWNQ, seg_pos={0 0}, upload=298319]: Done uploading piece. err: <nil> Oct 7 16:32:17.368032587 (339h1m2.83012507s) [noise=true , address=77.90.31.16:4735 , piece_id=KF7AS4GLPJSMPVT5RDXOWHIHCPTNS7DZ4NFYJLZXHBWXSHWVAJ2A, seg_pos={0 0}, upload=298319]: Done uploading piece. err: <nil> Oct 7 16:32:17.407536711 (339h1m2.869629194s) [noise=true , address=77.90.31.14:4661 , piece_id=MPLNZ55YX2UGNYQK3DAN3CBTWQDX5TIGQSZ5GSZR6PKWPPCKWWDA, seg_pos={0 0}, upload=298319]: Done uploading piece. err: <nil> Oct 7 16:32:17.422166068 (339h1m2.884258571s) [noise=true , address=45.91.116.13:4154 , piece_id=63MSXDPQGJDQI4CQACKEI7ELSTROJJO7C7UKWNXHXA3EZHIPYH4Q, seg_pos={0 0}, upload=298319]: Done uploading piece. err: <nil> Oct 7 16:32:17.506756615 (339h1m2.968849098s) [noise=true , address=45.91.116.5:4298 , piece_id=NPLMUJCBBRM6UJE5HYHAHVH6PIAVW5F76DTLDMMV6C654UWOUVIA, seg_pos={0 0}, upload=298319]: Done uploading piece. err: <nil> Oct 7 16:32:44.222933374 (339h1m29.685025857s) [noise=true , address=145.79.227.12:4767 , piece_id=UD6BQDH2U7UKJBNJE3U4Y7H45YXJYJSYH2Q5L4DRBSJK7CF6ODZQ, seg_pos={0 0}, upload=298319]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: write tcp 188.166.225.170:38162->145.79.227.12:4767: use of closed network connection; write tcp 188.166.225.170:38162->145.79.227.12:4767: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38162->145.79.227.12:4767: use of closed network connection Oct 7 16:32:44.222999159 (339h1m29.685091632s) [noise=true , address=145.79.227.3:4151 , piece_id=V5TCXSHABEDYGMDE7765J4FCRC43FXQBYROC7YWVOAGKKTPVBX3A, seg_pos={0 0}, upload=298319]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:58494->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:58494->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58494->145.79.227.3:4151: use of closed network connection Oct 7 16:32:44.223013637 (339h1m29.68510611s) [noise=true , address=145.79.227.19:4077 , piece_id=OGFCIC465J44UGDYZ2TLODMXSUMGLMURQPPLAH3IZWBPLOP6D2YQ, seg_pos={0 0}, upload=298319]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:51182->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:51182->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51182->145.79.227.19:4077: use of closed network connection Oct 7 16:32:44.223072309 (339h1m29.685164792s) [noise=true , address=145.79.227.16:4909 , piece_id=R3V3OFZZJ3FSGB44EOKAG5ASDKOCLCZM33CKVSK25E3QZAYJZE7Q, seg_pos={0 0}, upload=298319]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:56566->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:56566->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56566->145.79.227.16:4909: use of closed network connection Oct 7 16:32:44.223095583 (339h1m29.685188076s) [noise=true , address=145.79.227.14:4837 , piece_id=MECCNUPTQM5AXMR7S4LMQY5XG2QDLMUBX2TZ6ZICNRENEEVOQG4Q, seg_pos={0 0}, upload=298319]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: write tcp 188.166.225.170:41068->145.79.227.14:4837: use of closed network connection; write tcp 188.166.225.170:41068->145.79.227.14:4837: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41068->145.79.227.14:4837: use of closed network connection Oct 7 16:32:44.223126713 (339h1m29.685219186s) [noise=true , address=145.79.227.6:4258 , piece_id=6EKXJK6JJGISMFZUMYJHUJEVMPMSUTPA4I7A3J6FG7I6SMEJO5XQ, seg_pos={0 0}, upload=298319]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:50802->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:50802->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50802->145.79.227.6:4258: use of closed network connection Oct 7 16:32:44.223178200 (339h1m29.685270683s) [noise=true , address=145.79.227.2:4113 , piece_id=FXJ5BYDBR7ONGDDXSFFLGUUM62TRLNFHAPT4DQCMJXOTT6G25EUQ, seg_pos={0 0}, upload=298319]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: write tcp 188.166.225.170:55140->145.79.227.2:4113: use of closed network connection; write tcp 188.166.225.170:55140->145.79.227.2:4113: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55140->145.79.227.2:4113: use of closed network connection Oct 7 16:32:44.223227313 (339h1m29.685319786s) [noise=true , address=145.79.227.13:4802 , piece_id=LHQ4775QY6F5CGXIJKZVIGNUQC6HUB5JPTE7FMACWXBHX4BKDZXA, seg_pos={0 0}, upload=298319]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:44660->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:44660->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44660->145.79.227.13:4802: use of closed network connection Oct 7 16:32:44.223278642 (339h1m29.685371125s) [noise=true , address=145.79.227.18:4005 , piece_id=FC5RT6FUBP5S2XMBM5YFORUYM7KKJGCVBXLJFYZR77LN7WKVD6CA, seg_pos={0 0}, upload=298319]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: read tcp 188.166.225.170:42832->145.79.227.18:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:32:44.223297437 (339h1m29.68538992s) [noise=true , address=145.79.227.4:4186 , piece_id=XV6MNUOKKZRXFMKBWJBM3RRCB7LC4NWEKEUA3MKVTBJOXEFJCARA, seg_pos={0 0}, upload=298319]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: read tcp 188.166.225.170:51984->145.79.227.4:4186: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:32:44.223365336 (339h1m29.685457819s) [noise=true , address=145.79.227.6:4259 , piece_id=4QG6GV5QYLCDMXUE2V24N4YQOXY56FPT3WNGI6PCNCQJRUYPLTTQ, seg_pos={0 0}, upload=298319]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:35468->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Oct 7 16:32:44.223384343 (339h1m29.685476816s) [seg_pos={0 0}, upload=298319]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 7 16:32:44.489737751 (339h1m29.951830234s) [upload=298319]: Done uploading segments... Oct 7 16:32:44.489777086 (339h1m29.951869569s) [upload=298319]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 30.268128328s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 9 out of 60 is failed (threshold=3) [..................................................XXXXX.XXXX] duration: 1m0.268550926s FAIL (2025-10-07 16:32:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== _id=TPB3C6EQMS6ZZAT4P3U6BJDGKJSMITSE4YTDLQ4PY4CABXK57M5Q, seg_pos={0 0}, upload=298310]: Uploading piece... Oct 7 16:31:42.507705626 (339h0m27.9697981s) [noise=true , address=45.91.116.4:4942 , piece_id=AAYGCLYYEZQZGLHIIWNOYIZYQF7DKT5AOQWJCFBDIGZGVWHNZVRA, seg_pos={0 0}, upload=298310]: Uploading piece... Oct 7 16:31:42.508057486 (339h0m27.970149959s) [noise=true , address=77.90.31.16:4768 , piece_id=6JO3JAS6Q4XP3AXNBG4SWQIBV5F6SAVX7UPGNWNVOWTGLROV56AA, seg_pos={0 0}, upload=298310]: Uploading piece... Oct 7 16:31:42.508512974 (339h0m27.970605447s) [noise=true , address=77.90.31.13:4651 , piece_id=HDJPED7I4T6W6K3QATLO5C3A52PZ3YDZC6FMJ5XBK6ZRD5MKOERA, seg_pos={0 0}, upload=298310]: Uploading piece... Oct 7 16:31:42.508785873 (339h0m27.970878346s) [noise=true , address=45.91.116.9:4270 , piece_id=O5OKDSK532VCL5AXONRKNJCKOVDVEAUMC3CRHVSCZPQF4W4IKQBA, seg_pos={0 0}, upload=298310]: Uploading piece... Oct 7 16:31:42.509142783 (339h0m27.971235266s) [noise=true , address=45.91.116.6:4981 , piece_id=WVWZI7TXQXU6GO2T4GY7ITJL4E3GLJ75GK523IW4R6A5G4JJZFCQ, seg_pos={0 0}, upload=298310]: Uploading piece... Oct 7 16:31:42.509733007 (339h0m27.97182549s) [noise=true , address=45.91.116.4:4948 , piece_id=Q2XDX77JX2GJQXJSYAJ4IZ4RY7QXIDFL7MWDADBEP7AK2W37VU7Q, seg_pos={0 0}, upload=298310]: Uploading piece... Oct 7 16:31:42.510362245 (339h0m27.972454728s) [noise=true , address=145.79.227.28:4739 , piece_id=YV3PYPWRBKS5MDTK7XACEL4FZDV6QCW47Q5E3OTFDKB4AP5WUNMA, seg_pos={0 0}, upload=298310]: Uploading piece... Oct 7 16:31:42.510734815 (339h0m27.972827298s) [noise=true , address=145.79.227.25:4624 , piece_id=ELIW3XAU7QUQ3PMOVSXON4HP5P767QEVXX3LN76Z77ZQXYOZ63SA, seg_pos={0 0}, upload=298310]: Uploading piece... Oct 7 16:31:42.511991077 (339h0m27.97408356s) [noise=true , address=145.79.227.24:4615 , piece_id=QPFPDEBYUO3C5OJKGDIGAYJ574HM3B57CWTF5KK2BKNYVLY7N3FQ, seg_pos={0 0}, upload=298310]: Uploading piece... Oct 7 16:31:42.513591133 (339h0m27.975683616s) [noise=true , address=77.90.31.12:4593 , piece_id=TQ4C4BPQ5XU3H2TJ63A74GTD24E2OWIMLIHPTQGGQG2NIOWX2AVQ, seg_pos={0 0}, upload=298310]: Uploading piece... Oct 7 16:31:42.514514251 (339h0m27.976606734s) [noise=true , address=145.79.227.38:4986 , piece_id=QQDPWRA6YYKDPTMANHTQRS3FA6NGKEEXCLEWH6ZTN4XXJISMQVFA, seg_pos={0 0}, upload=298310]: Uploading piece... Oct 7 16:31:42.514853547 (339h0m27.97694603s) [noise=true , address=145.79.227.33:4884 , piece_id=ZJ3BRYRXFYY3YMCMHVDPGMJ7SWKKURQSVAUQZEUKITPCENNHYLSQ, seg_pos={0 0}, upload=298310]: Uploading piece... Oct 7 16:31:42.516050146 (339h0m27.978142629s) [noise=true , address=45.91.116.7:4040 , piece_id=4PIA47CNKISJGAIOP7P6FBD7QHO5XDZGUSHRYT4MJ4QSZ7MHS3RA, seg_pos={0 0}, upload=298310]: Uploading piece... Oct 7 16:31:44.101786214 (339h0m29.563878687s) [upload=298310]: Next returned nil segment Oct 7 16:31:44.101834205 (339h0m29.563926688s) [upload=298310]: Waiting for error group managing segments... Oct 7 16:31:44.507140837 (339h0m29.96923332s) [noise=true , address=45.91.116.7:4040 , piece_id=4PIA47CNKISJGAIOP7P6FBD7QHO5XDZGUSHRYT4MJ4QSZ7MHS3RA, seg_pos={0 0}, upload=298310]: Done uploading piece. err: <nil> Oct 7 16:31:44.548145036 (339h0m30.010237519s) [noise=true , address=45.91.116.9:4270 , piece_id=O5OKDSK532VCL5AXONRKNJCKOVDVEAUMC3CRHVSCZPQF4W4IKQBA, seg_pos={0 0}, upload=298310]: Done uploading piece. err: <nil> Oct 7 16:31:44.548982390 (339h0m30.011074864s) [noise=true , address=77.90.31.12:4593 , piece_id=TQ4C4BPQ5XU3H2TJ63A74GTD24E2OWIMLIHPTQGGQG2NIOWX2AVQ, seg_pos={0 0}, upload=298310]: Done uploading piece. err: <nil> Oct 7 16:31:44.552465894 (339h0m30.014558367s) [noise=true , address=45.91.116.4:4948 , piece_id=Q2XDX77JX2GJQXJSYAJ4IZ4RY7QXIDFL7MWDADBEP7AK2W37VU7Q, seg_pos={0 0}, upload=298310]: Done uploading piece. err: <nil> Oct 7 16:31:44.552882397 (339h0m30.01497488s) [noise=true , address=77.90.31.19:4859 , piece_id=JMURPEWP3Q27R4ZONUI5U4EZ5X3IYQSVHO4OCRLSMIVBRT5HYFHQ, seg_pos={0 0}, upload=298310]: Done uploading piece. err: <nil> Oct 7 16:31:44.559016367 (339h0m30.02110885s) [noise=true , address=77.90.31.13:4651 , piece_id=HDJPED7I4T6W6K3QATLO5C3A52PZ3YDZC6FMJ5XBK6ZRD5MKOERA, seg_pos={0 0}, upload=298310]: Done uploading piece. err: <nil> Oct 7 16:31:44.561870121 (339h0m30.023962604s) [noise=true , address=45.91.116.6:4981 , piece_id=WVWZI7TXQXU6GO2T4GY7ITJL4E3GLJ75GK523IW4R6A5G4JJZFCQ, seg_pos={0 0}, upload=298310]: Done uploading piece. err: <nil> Oct 7 16:31:44.575605536 (339h0m30.037698019s) [noise=true , address=45.91.116.4:4942 , piece_id=AAYGCLYYEZQZGLHIIWNOYIZYQF7DKT5AOQWJCFBDIGZGVWHNZVRA, seg_pos={0 0}, upload=298310]: Done uploading piece. err: <nil> Oct 7 16:31:44.641297476 (339h0m30.103389959s) [noise=true , address=77.90.31.18:4835 , piece_id=TPB3C6EQMS6ZZAT4P3U6BJDGKJSMITSE4YTDLQ4PY4CABXK57M5Q, seg_pos={0 0}, upload=298310]: Done uploading piece. err: <nil> Oct 7 16:31:46.229038270 (339h0m31.691130743s) [noise=true , address=77.90.31.16:4768 , piece_id=6JO3JAS6Q4XP3AXNBG4SWQIBV5F6SAVX7UPGNWNVOWTGLROV56AA, seg_pos={0 0}, upload=298310]: Done uploading piece. err: <nil> Oct 7 16:32:41.491615832 (339h1m26.953708315s) [noise=true , address=145.79.227.38:4986 , piece_id=QQDPWRA6YYKDPTMANHTQRS3FA6NGKEEXCLEWH6ZTN4XXJISMQVFA, seg_pos={0 0}, upload=298310]: Done uploading piece. err: ecclient: upload failed (node:1xiyNnuK7RcA3pYJRz2QStzUVfaU6gVUovxX2gV86xAQ2K9np4, address:145.79.227.38:4986): protocol: write tcp 188.166.225.170:43818->145.79.227.38:4986: use of closed network connection; write tcp 188.166.225.170:43818->145.79.227.38:4986: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43818->145.79.227.38:4986: use of closed network connection Oct 7 16:32:41.491681477 (339h1m26.95377396s) [noise=true , address=145.79.227.25:4624 , piece_id=ELIW3XAU7QUQ3PMOVSXON4HP5P767QEVXX3LN76Z77ZQXYOZ63SA, seg_pos={0 0}, upload=298310]: Done uploading piece. err: ecclient: upload failed (node:1GG1c98sVuVmeJgmwXuVqxm7hKZ7Wv3LgwQGzgzGtYETe4RbF1, address:145.79.227.25:4624): protocol: read tcp 188.166.225.170:48986->145.79.227.25:4624: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:32:41.491754676 (339h1m26.953847159s) [noise=true , address=145.79.227.33:4884 , piece_id=ZJ3BRYRXFYY3YMCMHVDPGMJ7SWKKURQSVAUQZEUKITPCENNHYLSQ, seg_pos={0 0}, upload=298310]: Done uploading piece. err: ecclient: upload failed (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG, address:145.79.227.33:4884): protocol: read tcp 188.166.225.170:43798->145.79.227.33:4884: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:32:41.491767941 (339h1m26.953860424s) [noise=true , address=145.79.227.24:4615 , piece_id=QPFPDEBYUO3C5OJKGDIGAYJ574HM3B57CWTF5KK2BKNYVLY7N3FQ, seg_pos={0 0}, upload=298310]: Done uploading piece. err: ecclient: upload failed (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc, address:145.79.227.24:4615): protocol: write tcp 188.166.225.170:43588->145.79.227.24:4615: use of closed network connection; write tcp 188.166.225.170:43588->145.79.227.24:4615: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43588->145.79.227.24:4615: use of closed network connection Oct 7 16:32:41.491827114 (339h1m26.953919587s) [noise=true , address=145.79.227.30:4766 , piece_id=FPPOAVIT6B26H676HZZ22J6QUGYEFLKMQJL5EM7OXGYER2P5EOTA, seg_pos={0 0}, upload=298310]: Done uploading piece. err: ecclient: upload failed (node:1k6zdamuKPkBdzyNZNWx4FCmaTkv33PchcwvTRR8bgcETBs4K7, address:145.79.227.30:4766): protocol: write tcp 188.166.225.170:43506->145.79.227.30:4766: use of closed network connection; write tcp 188.166.225.170:43506->145.79.227.30:4766: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43506->145.79.227.30:4766: use of closed network connection Oct 7 16:32:41.491854727 (339h1m26.95394721s) [noise=true , address=145.79.227.28:4739 , piece_id=YV3PYPWRBKS5MDTK7XACEL4FZDV6QCW47Q5E3OTFDKB4AP5WUNMA, seg_pos={0 0}, upload=298310]: Done uploading piece. err: ecclient: upload failed (node:12A4nWQsS43tSv3atCnj6CB2ZGKFxQUHJp8a7ftP9y1XumeFk33, address:145.79.227.28:4739): protocol: write tcp 188.166.225.170:33474->145.79.227.28:4739: use of closed network connection; write tcp 188.166.225.170:33474->145.79.227.28:4739: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33474->145.79.227.28:4739: use of closed network connection Oct 7 16:32:41.491877981 (339h1m26.953970454s) [noise=true , address=145.79.227.16:4925 , piece_id=22GB7S3DEGQTWAP3P4WPZ2R26HTPLCHNA63QV324AERRK2NLA6OA, seg_pos={0 0}, upload=298310]: Done uploading piece. err: ecclient: upload failed (node:1RermE4TG8CP8Z7yeAMXDbLaztghzKSpCJQFjDvLCCsy4y3rdn, address:145.79.227.16:4925): protocol: read tcp 188.166.225.170:37340->145.79.227.16:4925: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:32:41.491902047 (339h1m26.95399453s) [noise=true , address=145.79.227.44:4204 , piece_id=UELNN2ME3QZAFR5JAEIUW57JINFC7BSAQVGZCRMQJNDVUK6Y6LKQ, seg_pos={0 0}, upload=298310]: Done uploading piece. err: ecclient: upload failed (node:1rBZH6aLHsnWh22uNzaMiMwmLJCDMn4bYbNC5jRG7KCEuRfqpH, address:145.79.227.44:4204): protocol: read tcp 188.166.225.170:45398->145.79.227.44:4204: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:32:41.491933376 (339h1m26.95402586s) [seg_pos={0 0}, upload=298310]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:32:41.758501021 (339h1m27.220593514s) [upload=298310]: Done uploading segments... Oct 7 16:32:41.758540456 (339h1m27.220632939s) [upload=298310]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 1m0.268568952s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 16 out of 60 is failed (threshold=3) [............................................XXXXXXXXXXXXXXXX] duration: 30.259416561s FAIL (2025-10-07 16:32:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Oct 7 16:31:44.461731458 (339h0m29.923823941s) [upload=298311]: Starting upload Oct 7 16:31:44.461942239 (339h0m29.924034722s) [upload=298311]: Done starting upload Oct 7 16:31:44.462078198 (339h0m29.924170671s) [upload=298311]: Uploading segments... Oct 7 16:31:44.462235308 (339h0m29.924327791s) [upload=298311]: Got next segment. Inline: false Oct 7 16:31:44.462286806 (339h0m29.924379299s) [upload=298311]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 16:31:44.462293078 (339h0m29.924385561s) [upload=298311]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 16:31:44.720732185 (339h0m30.182824678s) [seg_pos={0 0}, upload=298311]: Begin upload segment... Oct 7 16:31:44.720807658 (339h0m30.182900152s) [seg_pos={0 0}, upload=298311]: Done begin upload segment. Oct 7 16:31:44.720839970 (339h0m30.182932453s) [noise=true , address=45.91.116.13:4153 , piece_id=GZGNVSCJW4DPTTPLN4ODPZRL4FII5KJ4LPXNPR5HTOYWVZYEJCJA, seg_pos={0 0}, upload=298311]: Uploading piece... Oct 7 16:31:44.720882031 (339h0m30.182974524s) [noise=true , address=77.90.31.10:4517 , piece_id=YT5DEXYCYJ7R2XRQQTX6V6R4DYKQP7DTJODJCTISGDUIPPHODGFQ, seg_pos={0 0}, upload=298311]: Uploading piece... Oct 7 16:31:44.721626618 (339h0m30.183719101s) [noise=true , address=77.90.31.17:4770 , piece_id=SGDG6QCUOBCXPTEYSX6JMXDMLQXQNPPN2A2GP3J3HNIUCQAMW5DQ, seg_pos={0 0}, upload=298311]: Uploading piece... Oct 7 16:31:44.722100221 (339h0m30.184192704s) [noise=true , address=145.79.227.6:4258 , piece_id=AXQK25FV3XGUWPR63OIF4FRYEYVYAW3GSNAF3J4RZ3A76PN7DCQQ, seg_pos={0 0}, upload=298311]: Uploading piece... Oct 7 16:31:44.722561188 (339h0m30.184653671s) [noise=true , address=145.79.227.19:4077 , piece_id=U3FJJISJELOOM5Z6UT52RHX7QMRTXQKBHA554O7MISMSFQ6BNKQQ, seg_pos={0 0}, upload=298311]: Uploading piece... Oct 7 16:31:44.722916394 (339h0m30.185008887s) [noise=true , address=77.90.31.18:4806 , piece_id=OVTKB6RUH4NPRN54UM23EI6SJNGWFQ3EGBCNBKNFAABAZBOIGDRQ, seg_pos={0 0}, upload=298311]: Uploading piece... Oct 7 16:31:44.723436685 (339h0m30.185529168s) [noise=true , address=77.90.31.17:4771 , piece_id=DVKJ5B5R653JRLNGCKUUKU6UZAJKPTQSTBRXXGTR3BE2QQUUFIBQ, seg_pos={0 0}, upload=298311]: Uploading piece... Oct 7 16:31:44.723873928 (339h0m30.185966411s) [noise=true , address=45.91.116.9:4262 , piece_id=3G2NSCQIFOETPTXA3WWTUYAE2JQSG4USIOM5EAUUQRKHD5VLHEAQ, seg_pos={0 0}, upload=298311]: Uploading piece... Oct 7 16:31:44.724320298 (339h0m30.186412781s) [noise=true , address=145.79.227.12:4767 , piece_id=VNSIVTJJHHSMYPHI7HAYHAKSAKAEJRXH2DTJYYTHFBOLUBD33JKA, seg_pos={0 0}, upload=298311]: Uploading piece... Oct 7 16:31:44.724773491 (339h0m30.186865974s) [noise=true , address=77.90.31.21:4878 , piece_id=FAJ3CW5RAJQJWC7EFVPT2WQ66D6KOEQ44RNB2LMEPA3K3BXMM47A, seg_pos={0 0}, upload=298311]: Uploading piece... Oct 7 16:31:44.725285657 (339h0m30.18737814s) [noise=true , address=77.90.31.12:4589 , piece_id=QFAU7ZID3OWUU7R3ZE46MPWFS7O6SYVJR6NLCBGCTMZIZMZE3DEA, seg_pos={0 0}, upload=298311]: Uploading piece... Oct 7 16:31:44.725737968 (339h0m30.187830471s) [noise=true , address=77.90.31.11:4554 , piece_id=EDWKCPYFVPUDJXYRECIPMY5SYNB2NEW6EUIBYRXQME6OZLRWSNJA, seg_pos={0 0}, upload=298311]: Uploading piece... Oct 7 16:31:44.726134933 (339h0m30.188227407s) [noise=true , address=145.79.227.3:4150 , piece_id=S4HIIZUMA4OTU5FKFKSWRBZSPQVRU44JFLQT5LKBUBOWNJNUS6XA, seg_pos={0 0}, upload=298311]: Uploading piece... Oct 7 16:31:44.726661125 (339h0m30.188753598s) [noise=true , address=45.91.116.8:4047 , piece_id=FAOYZZSLKENG64QAIGP26QOYS4L7BDIMPB6WUAHBZ2KHIP6XMPYQ, seg_pos={0 0}, upload=298311]: Uploading piece... Oct 7 16:31:44.727065606 (339h0m30.189158089s) [noise=true , address=45.91.116.5:4297 , piece_id=AE5ZT3QV4RL5T453UJJUAJQOYAN5NCWMSU7PHHUNF3UQ3W6YZLNQ, seg_pos={0 0}, upload=298311]: Uploading piece... Oct 7 16:31:44.727476008 (339h0m30.189568481s) [noise=true , address=77.90.31.19:4843 , piece_id=LKT5HR3AHSUVTMCY53TWOIIMV4CK7T5L7QX56C3BWTQEDPJ4JYWQ, seg_pos={0 0}, upload=298311]: Uploading piece... Oct 7 16:31:46.544748433 (339h0m32.006840916s) [upload=298311]: Next returned nil segment Oct 7 16:31:46.544772288 (339h0m32.006864771s) [upload=298311]: Waiting for error group managing segments... Oct 7 16:31:46.842715640 (339h0m32.304808123s) [noise=true , address=77.90.31.17:4770 , piece_id=SGDG6QCUOBCXPTEYSX6JMXDMLQXQNPPN2A2GP3J3HNIUCQAMW5DQ, seg_pos={0 0}, upload=298311]: Done uploading piece. err: <nil> Oct 7 16:31:46.861638112 (339h0m32.323730595s) [noise=true , address=45.91.116.13:4153 , piece_id=GZGNVSCJW4DPTTPLN4ODPZRL4FII5KJ4LPXNPR5HTOYWVZYEJCJA, seg_pos={0 0}, upload=298311]: Done uploading piece. err: <nil> Oct 7 16:31:46.872175678 (339h0m32.334268161s) [noise=true , address=77.90.31.10:4517 , piece_id=YT5DEXYCYJ7R2XRQQTX6V6R4DYKQP7DTJODJCTISGDUIPPHODGFQ, seg_pos={0 0}, upload=298311]: Done uploading piece. err: <nil> Oct 7 16:31:46.879627587 (339h0m32.34172007s) [noise=true , address=77.90.31.19:4843 , piece_id=LKT5HR3AHSUVTMCY53TWOIIMV4CK7T5L7QX56C3BWTQEDPJ4JYWQ, seg_pos={0 0}, upload=298311]: Done uploading piece. err: <nil> Oct 7 16:31:46.901635665 (339h0m32.363728148s) [noise=true , address=45.91.116.5:4297 , piece_id=AE5ZT3QV4RL5T453UJJUAJQOYAN5NCWMSU7PHHUNF3UQ3W6YZLNQ, seg_pos={0 0}, upload=298311]: Done uploading piece. err: <nil> Oct 7 16:31:46.903242304 (339h0m32.365334787s) [noise=true , address=77.90.31.17:4771 , piece_id=DVKJ5B5R653JRLNGCKUUKU6UZAJKPTQSTBRXXGTR3BE2QQUUFIBQ, seg_pos={0 0}, upload=298311]: Done uploading piece. err: <nil> Oct 7 16:31:46.904302192 (339h0m32.366394675s) [noise=true , address=77.90.31.11:4554 , piece_id=EDWKCPYFVPUDJXYRECIPMY5SYNB2NEW6EUIBYRXQME6OZLRWSNJA, seg_pos={0 0}, upload=298311]: Done uploading piece. err: <nil> Oct 7 16:31:46.914795243 (339h0m32.376887726s) [noise=true , address=77.90.31.18:4806 , piece_id=OVTKB6RUH4NPRN54UM23EI6SJNGWFQ3EGBCNBKNFAABAZBOIGDRQ, seg_pos={0 0}, upload=298311]: Done uploading piece. err: <nil> Oct 7 16:31:46.963161952 (339h0m32.425254436s) [noise=true , address=45.91.116.8:4047 , piece_id=FAOYZZSLKENG64QAIGP26QOYS4L7BDIMPB6WUAHBZ2KHIP6XMPYQ, seg_pos={0 0}, upload=298311]: Done uploading piece. err: <nil> Oct 7 16:31:46.988725150 (339h0m32.450817633s) [noise=true , address=77.90.31.21:4878 , piece_id=FAJ3CW5RAJQJWC7EFVPT2WQ66D6KOEQ44RNB2LMEPA3K3BXMM47A, seg_pos={0 0}, upload=298311]: Done uploading piece. err: <nil> Oct 7 16:31:46.993918179 (339h0m32.456010662s) [noise=true , address=45.91.116.9:4262 , piece_id=3G2NSCQIFOETPTXA3WWTUYAE2JQSG4USIOM5EAUUQRKHD5VLHEAQ, seg_pos={0 0}, upload=298311]: Done uploading piece. err: <nil> Oct 7 16:31:47.049083223 (339h0m32.511175706s) [noise=true , address=77.90.31.12:4589 , piece_id=QFAU7ZID3OWUU7R3ZE46MPWFS7O6SYVJR6NLCBGCTMZIZMZE3DEA, seg_pos={0 0}, upload=298311]: Done uploading piece. err: <nil> Oct 7 16:32:13.748892329 (339h0m59.210984812s) [noise=true , address=145.79.227.6:4258 , piece_id=AXQK25FV3XGUWPR63OIF4FRYEYVYAW3GSNAF3J4RZ3A76PN7DCQQ, seg_pos={0 0}, upload=298311]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:41512->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:41512->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41512->145.79.227.6:4258: use of closed network connection Oct 7 16:32:13.748990295 (339h0m59.211082778s) [noise=true , address=145.79.227.3:4150 , piece_id=S4HIIZUMA4OTU5FKFKSWRBZSPQVRU44JFLQT5LKBUBOWNJNUS6XA, seg_pos={0 0}, upload=298311]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: read tcp 188.166.225.170:46470->145.79.227.3:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:32:13.749233708 (339h0m59.211326201s) [noise=true , address=145.79.227.12:4767 , piece_id=VNSIVTJJHHSMYPHI7HAYHAKSAKAEJRXH2DTJYYTHFBOLUBD33JKA, seg_pos={0 0}, upload=298311]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: read tcp 188.166.225.170:48098->145.79.227.12:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:32:13.749301126 (339h0m59.21139361s) [noise=true , address=145.79.227.19:4077 , piece_id=U3FJJISJELOOM5Z6UT52RHX7QMRTXQKBHA554O7MISMSFQ6BNKQQ, seg_pos={0 0}, upload=298311]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:56468->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:56468->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56468->145.79.227.19:4077: use of closed network connection Oct 7 16:32:13.749357985 (339h0m59.211450468s) [seg_pos={0 0}, upload=298311]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Oct 7 16:32:14.006122244 (339h0m59.468214737s) [upload=298311]: Done uploading segments... Oct 7 16:32:14.006173401 (339h0m59.468265884s) [upload=298311]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.259437402s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 15 out of 60 is failed (threshold=3) [.............................................XXXXXXXXXXXXXXX] duration: 30.273905169s FAIL (2025-10-07 16:31:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Oct 7 16:31:14.063124633 (338h59m59.525217116s) [upload=298302]: Starting upload Oct 7 16:31:14.063251965 (338h59m59.525344438s) [upload=298302]: Done starting upload Oct 7 16:31:14.063433381 (338h59m59.525525864s) [upload=298302]: Uploading segments... Oct 7 16:31:14.063591272 (338h59m59.525683755s) [upload=298302]: Got next segment. Inline: false Oct 7 16:31:14.063667186 (338h59m59.525759669s) [upload=298302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 16:31:14.063675842 (338h59m59.525768315s) [upload=298302]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 16:31:14.342826519 (338h59m59.804919022s) [seg_pos={0 0}, upload=298302]: Begin upload segment... Oct 7 16:31:14.342887726 (338h59m59.804980209s) [seg_pos={0 0}, upload=298302]: Done begin upload segment. Oct 7 16:31:14.342919988 (338h59m59.805012471s) [noise=true , address=45.91.116.9:4263 , piece_id=KSZQBFDHNV5CSQPNLQVFHIWJ2FDH5YMDRXAALYUZV7BUKI7LB55Q, seg_pos={0 0}, upload=298302]: Uploading piece... Oct 7 16:31:14.343907758 (338h59m59.806000241s) [noise=true , address=45.91.116.12:4226 , piece_id=RRQMXC5F42SRKHCS5HS7OQHICTYQ4OVP4GAO4ZWLVCOBFO7EYLTA, seg_pos={0 0}, upload=298302]: Uploading piece... Oct 7 16:31:14.344579166 (338h59m59.806671649s) [noise=true , address=145.79.227.19:4079 , piece_id=JZIWCCEU2AMHYAP6EYSI3QMY3SUAUUWNIWCFDRYX7AG7Q4GHRAKA, seg_pos={0 0}, upload=298302]: Uploading piece... Oct 7 16:31:14.344963939 (338h59m59.807056412s) [noise=true , address=45.91.116.7:4010 , piece_id=5C56UKYTQCAH6MWY7U6PPGVXCAVSWJ7I3MMILLEB7YITXGNCBAVQ, seg_pos={0 0}, upload=298302]: Uploading piece... Oct 7 16:31:14.345443593 (338h59m59.807536076s) [noise=true , address=45.91.116.7:4011 , piece_id=4PHRXCEP7OMSELOSDNGCM5YEJ7D7JMCL72VJGWRVDF6GGEEKCAKQ, seg_pos={0 0}, upload=298302]: Uploading piece... Oct 7 16:31:14.345864073 (338h59m59.807956556s) [noise=true , address=45.91.116.11:4117 , piece_id=OBQUFJRMOYCRWIE46C7WMTSY7BOZXKFLWTGG5GM4ZY5ZQNQQY5TA, seg_pos={0 0}, upload=298302]: Uploading piece... Oct 7 16:31:14.346255238 (338h59m59.808347721s) [noise=true , address=77.90.31.13:4626 , piece_id=M3MQEYDEAK4JSYM4VMTBT5BBA5M2VJNSIZDTICJZS27OV4CBZAPA, seg_pos={0 0}, upload=298302]: Uploading piece... Oct 7 16:31:14.346626645 (338h59m59.808719128s) [noise=true , address=45.91.116.11:4119 , piece_id=4ZHYJRDHM6VQ6LAJVEBKEA3YE2UVLYKK2Z5UATMVWJMYTWAU4U4A, seg_pos={0 0}, upload=298302]: Uploading piece... Oct 7 16:31:14.346995929 (338h59m59.809088412s) [noise=true , address=145.79.227.11:4731 , piece_id=ZGPM223YNA4PVTVMFQGZIM5CB3XIVXO27EN3S6K2MPPBRJLXEP3Q, seg_pos={0 0}, upload=298302]: Uploading piece... Oct 7 16:31:14.347380441 (338h59m59.809472924s) [noise=true , address=45.91.116.14:4191 , piece_id=RSQIBSAANNDZQLJRZGVONEPOL337BQL3PYVB22VK5UFVMB7QX3HA, seg_pos={0 0}, upload=298302]: Uploading piece... Oct 7 16:31:14.347744794 (338h59m59.809837267s) [noise=true , address=77.90.31.11:4555 , piece_id=W2GQRD3KAT5GM2WUCP3IORWQ2VPGOGM5IDU34YKOUVXI5VANQHPQ, seg_pos={0 0}, upload=298302]: Uploading piece... Oct 7 16:31:14.356348769 (338h59m59.818441242s) [noise=true , address=77.90.31.14:4663 , piece_id=HEVE5ESZKYCXAC7SNJHVU7WIRZQPS63FVNDR56HT4T46QDGMAISA, seg_pos={0 0}, upload=298302]: Uploading piece... Oct 7 16:31:14.358378483 (338h59m59.820470966s) [noise=true , address=77.90.31.19:4842 , piece_id=O2IUU2474ZTGRI6XERG6ELN5CGHJFYTJWSJDZ62N6IR5I6QWKDSA, seg_pos={0 0}, upload=298302]: Uploading piece... Oct 7 16:31:14.361150953 (338h59m59.823243436s) [noise=true , address=145.79.227.3:4150 , piece_id=N3T4YB64QI2B4FM6EA3AQEG4KE5J2CJNV5USNSCO3A6EPUKV2VQA, seg_pos={0 0}, upload=298302]: Uploading piece... Oct 7 16:31:14.372245970 (338h59m59.834338453s) [noise=true , address=77.90.31.21:4879 , piece_id=F27IHSIEJC6Q3Y2NX4RHMH4FXIRZ5URB4JKQNZQBDGRDNI3GVTVQ, seg_pos={0 0}, upload=298302]: Uploading piece... Oct 7 16:31:14.374084921 (338h59m59.836177394s) [noise=true , address=145.79.227.5:4221 , piece_id=VBH4PSHRITVEKJENOTTEBEUP446EQFQCMBXZHAFG44LGPL77IYKA, seg_pos={0 0}, upload=298302]: Uploading piece... Oct 7 16:31:16.069176942 (339h0m1.531269435s) [upload=298302]: Next returned nil segment Oct 7 16:31:16.069202671 (339h0m1.531295174s) [upload=298302]: Waiting for error group managing segments... Oct 7 16:31:16.466021180 (339h0m1.928113653s) [noise=true , address=45.91.116.12:4226 , piece_id=RRQMXC5F42SRKHCS5HS7OQHICTYQ4OVP4GAO4ZWLVCOBFO7EYLTA, seg_pos={0 0}, upload=298302]: Done uploading piece. err: <nil> Oct 7 16:31:16.495198719 (339h0m1.957291202s) [noise=true , address=45.91.116.7:4010 , piece_id=5C56UKYTQCAH6MWY7U6PPGVXCAVSWJ7I3MMILLEB7YITXGNCBAVQ, seg_pos={0 0}, upload=298302]: Done uploading piece. err: <nil> Oct 7 16:31:16.498551454 (339h0m1.960643947s) [noise=true , address=77.90.31.11:4555 , piece_id=W2GQRD3KAT5GM2WUCP3IORWQ2VPGOGM5IDU34YKOUVXI5VANQHPQ, seg_pos={0 0}, upload=298302]: Done uploading piece. err: <nil> Oct 7 16:31:16.502986088 (339h0m1.965078571s) [noise=true , address=45.91.116.14:4191 , piece_id=RSQIBSAANNDZQLJRZGVONEPOL337BQL3PYVB22VK5UFVMB7QX3HA, seg_pos={0 0}, upload=298302]: Done uploading piece. err: <nil> Oct 7 16:31:16.512278953 (339h0m1.974371436s) [noise=true , address=77.90.31.14:4663 , piece_id=HEVE5ESZKYCXAC7SNJHVU7WIRZQPS63FVNDR56HT4T46QDGMAISA, seg_pos={0 0}, upload=298302]: Done uploading piece. err: <nil> Oct 7 16:31:16.547667881 (339h0m2.009760364s) [noise=true , address=45.91.116.9:4263 , piece_id=KSZQBFDHNV5CSQPNLQVFHIWJ2FDH5YMDRXAALYUZV7BUKI7LB55Q, seg_pos={0 0}, upload=298302]: Done uploading piece. err: <nil> Oct 7 16:31:16.548235872 (339h0m2.010328355s) [noise=true , address=45.91.116.11:4119 , piece_id=4ZHYJRDHM6VQ6LAJVEBKEA3YE2UVLYKK2Z5UATMVWJMYTWAU4U4A, seg_pos={0 0}, upload=298302]: Done uploading piece. err: <nil> Oct 7 16:31:16.550079342 (339h0m2.012171826s) [noise=true , address=45.91.116.11:4117 , piece_id=OBQUFJRMOYCRWIE46C7WMTSY7BOZXKFLWTGG5GM4ZY5ZQNQQY5TA, seg_pos={0 0}, upload=298302]: Done uploading piece. err: <nil> Oct 7 16:31:16.554227011 (339h0m2.016319494s) [noise=true , address=77.90.31.21:4879 , piece_id=F27IHSIEJC6Q3Y2NX4RHMH4FXIRZ5URB4JKQNZQBDGRDNI3GVTVQ, seg_pos={0 0}, upload=298302]: Done uploading piece. err: <nil> Oct 7 16:31:16.574241783 (339h0m2.036334266s) [noise=true , address=45.91.116.7:4011 , piece_id=4PHRXCEP7OMSELOSDNGCM5YEJ7D7JMCL72VJGWRVDF6GGEEKCAKQ, seg_pos={0 0}, upload=298302]: Done uploading piece. err: <nil> Oct 7 16:31:16.600583432 (339h0m2.062675915s) [noise=true , address=77.90.31.19:4842 , piece_id=O2IUU2474ZTGRI6XERG6ELN5CGHJFYTJWSJDZ62N6IR5I6QWKDSA, seg_pos={0 0}, upload=298302]: Done uploading piece. err: <nil> Oct 7 16:31:18.996443129 (339h0m4.458535612s) [noise=true , address=77.90.31.13:4626 , piece_id=M3MQEYDEAK4JSYM4VMTBT5BBA5M2VJNSIZDTICJZS27OV4CBZAPA, seg_pos={0 0}, upload=298302]: Done uploading piece. err: <nil> Oct 7 16:31:43.261933833 (339h0m28.724026316s) [noise=true , address=145.79.227.19:4079 , piece_id=JZIWCCEU2AMHYAP6EYSI3QMY3SUAUUWNIWCFDRYX7AG7Q4GHRAKA, seg_pos={0 0}, upload=298302]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:34298->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:34298->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34298->145.79.227.19:4079: use of closed network connection Oct 7 16:31:43.262017593 (339h0m28.724110086s) [noise=true , address=145.79.227.11:4731 , piece_id=ZGPM223YNA4PVTVMFQGZIM5CB3XIVXO27EN3S6K2MPPBRJLXEP3Q, seg_pos={0 0}, upload=298302]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:145.79.227.11:4731): protocol: write tcp 188.166.225.170:45640->145.79.227.11:4731: use of closed network connection; write tcp 188.166.225.170:45640->145.79.227.11:4731: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45640->145.79.227.11:4731: use of closed network connection Oct 7 16:31:43.262030096 (339h0m28.724122569s) [noise=true , address=145.79.227.3:4150 , piece_id=N3T4YB64QI2B4FM6EA3AQEG4KE5J2CJNV5USNSCO3A6EPUKV2VQA, seg_pos={0 0}, upload=298302]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:40012->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:40012->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40012->145.79.227.3:4150: use of closed network connection Oct 7 16:31:43.262164432 (339h0m28.724256915s) [noise=true , address=145.79.227.5:4221 , piece_id=VBH4PSHRITVEKJENOTTEBEUP446EQFQCMBXZHAFG44LGPL77IYKA, seg_pos={0 0}, upload=298302]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:41794->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:41794->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41794->145.79.227.5:4221: use of closed network connection Oct 7 16:31:43.262197275 (339h0m28.724289758s) [seg_pos={0 0}, upload=298302]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Oct 7 16:31:43.534145326 (339h0m28.996237809s) [upload=298302]: Done uploading segments... Oct 7 16:31:43.534176525 (339h0m28.996269008s) [upload=298302]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.273939333s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [...................................................XXXXX.XXX] duration: 1m0.260208365s FAIL (2025-10-07 16:31:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== , upload=298297]: Uploading piece... Oct 7 16:30:42.081642811 (338h59m27.543735294s) [noise=true , address=77.90.31.13:4625 , piece_id=EIQKVLU6KVJRQHC5JLZ6446A3SUDPSDW2BGWFAELZQD3CXRJSHDQ, seg_pos={0 0}, upload=298297]: Uploading piece... Oct 7 16:30:42.081717012 (338h59m27.543809495s) [noise=true , address=77.90.31.14:4665 , piece_id=Z27ZEA2IWNEYNRUCSSKHUHDRM3BRXIV4CPQKK3K6N33DQ65OPDAQ, seg_pos={0 0}, upload=298297]: Uploading piece... Oct 7 16:30:42.082149276 (338h59m27.544241759s) [noise=true , address=45.91.116.12:4231 , piece_id=EZL4QA2Z44JCEM5PGWGZE6NN2WZMKLXNYPDN7CR27N57WUQJHKIQ, seg_pos={0 0}, upload=298297]: Uploading piece... Oct 7 16:30:42.082586008 (338h59m27.544678501s) [noise=true , address=77.90.31.10:4528 , piece_id=MUJ7T35MSTXWD3IHHFO5HSTBNUTI5GXXNSV3FFEQDPDWYSLAFBOQ, seg_pos={0 0}, upload=298297]: Uploading piece... Oct 7 16:30:42.082982412 (338h59m27.545074885s) [noise=true , address=77.90.31.21:4880 , piece_id=ZUNFA3SRDLB7UKO6WSIP4GLSX6S2G2XDM4BARWP2E73V6NE2LC3A, seg_pos={0 0}, upload=298297]: Uploading piece... Oct 7 16:30:42.083269549 (338h59m27.545362032s) [noise=true , address=77.90.31.16:4754 , piece_id=5AKXPRJOQPRQGETDYTDZROOXHOWXILT3LV5J6B2A6KNUBNHOIUWA, seg_pos={0 0}, upload=298297]: Uploading piece... Oct 7 16:30:42.083551516 (338h59m27.545643999s) [noise=true , address=145.79.227.29:4947 , piece_id=K2ESOZ35IEQHRKRACDIMTWX4RI2HZNABBZS3FWSKV2HUJKHKPRLA, seg_pos={0 0}, upload=298297]: Uploading piece... Oct 7 16:30:42.083818093 (338h59m27.545910567s) [noise=true , address=145.79.227.20:4469 , piece_id=EYYXSBD2P66IPWNXF6L3ZCXEXHMZAVB42LSIZX5QPUNWG4HWQGNQ, seg_pos={0 0}, upload=298297]: Uploading piece... Oct 7 16:30:42.084084701 (338h59m27.546177175s) [noise=true , address=145.79.227.30:4763 , piece_id=Q22PU6JFI67STYLIX2UNE2NJVGZOTJCR2AUFKZ2GXEK7LIZFB3CQ, seg_pos={0 0}, upload=298297]: Uploading piece... Oct 7 16:30:42.084415150 (338h59m27.546507623s) [noise=true , address=64.49.13.154:4929 , piece_id=5F5KUTGQVDE5XOGN65T2E75RTH6ZRGS2OEFXYXXQ5CHHM22KGSBQ, seg_pos={0 0}, upload=298297]: Uploading piece... Oct 7 16:30:42.084740180 (338h59m27.546832653s) [noise=true , address=45.91.116.9:4277 , piece_id=A4WJCKVTP5XQAMQNE6OA4T56FDIGTXKFIYYD3CHHBQMP5FQ3XBJA, seg_pos={0 0}, upload=298297]: Uploading piece... Oct 7 16:30:42.085150240 (338h59m27.547242723s) [noise=true , address=45.91.116.13:4172 , piece_id=FLAYS35IEF4DRP4V3OTHFNJB4IAFMGYH2UUXOSJU5RJIKMEFJ5DA, seg_pos={0 0}, upload=298297]: Uploading piece... Oct 7 16:30:42.085581882 (338h59m27.547674355s) [noise=true , address=145.79.227.33:4880 , piece_id=TTZEE5LCT3IE5OKWLFR2VIV6TKLMPBCUWJS5HPJO2ZAQ2RRWV2SA, seg_pos={0 0}, upload=298297]: Uploading piece... Oct 7 16:30:42.085976584 (338h59m27.548069067s) [noise=true , address=45.91.116.14:4201 , piece_id=G45ZH5EUZXCDQZZTA5ILDIIO7W526Q3XNQ2QQMNNQUTWWBP4VC2Q, seg_pos={0 0}, upload=298297]: Uploading piece... Oct 7 16:30:42.086168500 (338h59m27.548260983s) [noise=true , address=45.91.116.8:4049 , piece_id=XPBARJR7YLYL5IAC6K7AFWFLYTX23KE7DCX7NLUCEZ654RHNR6RQ, seg_pos={0 0}, upload=298297]: Uploading piece... Oct 7 16:30:42.086558472 (338h59m27.548650955s) [noise=true , address=45.91.116.10:4087 , piece_id=EW46P3YI5NK45AJSUAM3OUXKPVBZ4CAVCVD5NFYECOYYDOJ2BW4A, seg_pos={0 0}, upload=298297]: Uploading piece... Oct 7 16:30:42.087873967 (338h59m27.54996645s) [noise=true , address=77.90.31.13:4641 , piece_id=RWWGRGKCVE7M4TACU7L4BCOQJ5NUTDZEJNHXGUPM2BASY4TOJLAQ, seg_pos={0 0}, upload=298297]: Uploading piece... Oct 7 16:30:43.613484532 (338h59m29.075577015s) [upload=298297]: Next returned nil segment Oct 7 16:30:43.613506965 (338h59m29.075599448s) [upload=298297]: Waiting for error group managing segments... Oct 7 16:30:44.060063263 (338h59m29.522155746s) [noise=true , address=45.91.116.13:4172 , piece_id=FLAYS35IEF4DRP4V3OTHFNJB4IAFMGYH2UUXOSJU5RJIKMEFJ5DA, seg_pos={0 0}, upload=298297]: Done uploading piece. err: <nil> Oct 7 16:30:44.069043995 (338h59m29.531136478s) [noise=true , address=45.91.116.9:4277 , piece_id=A4WJCKVTP5XQAMQNE6OA4T56FDIGTXKFIYYD3CHHBQMP5FQ3XBJA, seg_pos={0 0}, upload=298297]: Done uploading piece. err: <nil> Oct 7 16:30:44.077650493 (338h59m29.539742976s) [noise=true , address=77.90.31.10:4528 , piece_id=MUJ7T35MSTXWD3IHHFO5HSTBNUTI5GXXNSV3FFEQDPDWYSLAFBOQ, seg_pos={0 0}, upload=298297]: Done uploading piece. err: <nil> Oct 7 16:30:44.093010672 (338h59m29.555103145s) [noise=true , address=77.90.31.21:4880 , piece_id=ZUNFA3SRDLB7UKO6WSIP4GLSX6S2G2XDM4BARWP2E73V6NE2LC3A, seg_pos={0 0}, upload=298297]: Done uploading piece. err: <nil> Oct 7 16:30:44.107212335 (338h59m29.569304808s) [noise=true , address=77.90.31.13:4641 , piece_id=RWWGRGKCVE7M4TACU7L4BCOQJ5NUTDZEJNHXGUPM2BASY4TOJLAQ, seg_pos={0 0}, upload=298297]: Done uploading piece. err: <nil> Oct 7 16:30:44.112196165 (338h59m29.574288638s) [noise=true , address=77.90.31.14:4665 , piece_id=Z27ZEA2IWNEYNRUCSSKHUHDRM3BRXIV4CPQKK3K6N33DQ65OPDAQ, seg_pos={0 0}, upload=298297]: Done uploading piece. err: <nil> Oct 7 16:30:44.123835438 (338h59m29.585927922s) [noise=true , address=77.90.31.16:4754 , piece_id=5AKXPRJOQPRQGETDYTDZROOXHOWXILT3LV5J6B2A6KNUBNHOIUWA, seg_pos={0 0}, upload=298297]: Done uploading piece. err: <nil> Oct 7 16:30:44.155785908 (338h59m29.617878391s) [noise=true , address=45.91.116.7:4041 , piece_id=JTBHHZPMI2RVVCDXQPQFWBGGI2C5IZHULGV3WYVHS5WD4R6FPPYA, seg_pos={0 0}, upload=298297]: Done uploading piece. err: <nil> Oct 7 16:30:44.163416970 (338h59m29.625509453s) [noise=true , address=45.91.116.10:4087 , piece_id=EW46P3YI5NK45AJSUAM3OUXKPVBZ4CAVCVD5NFYECOYYDOJ2BW4A, seg_pos={0 0}, upload=298297]: Done uploading piece. err: <nil> Oct 7 16:30:44.177688194 (338h59m29.639780677s) [noise=true , address=45.91.116.14:4201 , piece_id=G45ZH5EUZXCDQZZTA5ILDIIO7W526Q3XNQ2QQMNNQUTWWBP4VC2Q, seg_pos={0 0}, upload=298297]: Done uploading piece. err: <nil> Oct 7 16:30:44.180511841 (338h59m29.642604324s) [noise=true , address=77.90.31.13:4625 , piece_id=EIQKVLU6KVJRQHC5JLZ6446A3SUDPSDW2BGWFAELZQD3CXRJSHDQ, seg_pos={0 0}, upload=298297]: Done uploading piece. err: <nil> Oct 7 16:30:44.201463407 (338h59m29.66355589s) [noise=true , address=45.91.116.12:4231 , piece_id=EZL4QA2Z44JCEM5PGWGZE6NN2WZMKLXNYPDN7CR27N57WUQJHKIQ, seg_pos={0 0}, upload=298297]: Done uploading piece. err: <nil> Oct 7 16:30:44.222179034 (338h59m29.684271507s) [noise=true , address=45.91.116.8:4049 , piece_id=XPBARJR7YLYL5IAC6K7AFWFLYTX23KE7DCX7NLUCEZ654RHNR6RQ, seg_pos={0 0}, upload=298297]: Done uploading piece. err: <nil> Oct 7 16:31:41.019620035 (339h0m26.481712528s) [noise=true , address=145.79.227.20:4469 , piece_id=EYYXSBD2P66IPWNXF6L3ZCXEXHMZAVB42LSIZX5QPUNWG4HWQGNQ, seg_pos={0 0}, upload=298297]: Done uploading piece. err: ecclient: upload failed (node:1A6EEfrxXWy6k1Ki5UrjR5tKgRYsVXsSG9za2bQvKuejRpawHT, address:145.79.227.20:4469): protocol: write tcp 188.166.225.170:50970->145.79.227.20:4469: use of closed network connection; write tcp 188.166.225.170:50970->145.79.227.20:4469: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50970->145.79.227.20:4469: use of closed network connection Oct 7 16:31:41.019909656 (339h0m26.482002159s) [noise=true , address=145.79.227.29:4947 , piece_id=K2ESOZ35IEQHRKRACDIMTWX4RI2HZNABBZS3FWSKV2HUJKHKPRLA, seg_pos={0 0}, upload=298297]: Done uploading piece. err: ecclient: upload failed (node:1vVHmSRAfugvyvTkEZHitE4uFMGXxgrbnWfJuGD9MzS9avAYsU, address:145.79.227.29:4947): protocol: write tcp 188.166.225.170:38310->145.79.227.29:4947: use of closed network connection; write tcp 188.166.225.170:38310->145.79.227.29:4947: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38310->145.79.227.29:4947: use of closed network connection Oct 7 16:31:41.019977535 (339h0m26.482070018s) [noise=true , address=145.79.227.30:4763 , piece_id=Q22PU6JFI67STYLIX2UNE2NJVGZOTJCR2AUFKZ2GXEK7LIZFB3CQ, seg_pos={0 0}, upload=298297]: Done uploading piece. err: ecclient: upload failed (node:12Xy6Y953cfdoyywnf98XTrbd9WuDZNEV8SRhkBKbZRHrU2ymPg, address:145.79.227.30:4763): protocol: write tcp 188.166.225.170:34240->145.79.227.30:4763: use of closed network connection; write tcp 188.166.225.170:34240->145.79.227.30:4763: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34240->145.79.227.30:4763: use of closed network connection Oct 7 16:31:41.020247219 (339h0m26.482339702s) [noise=true , address=64.49.13.154:4929 , piece_id=5F5KUTGQVDE5XOGN65T2E75RTH6ZRGS2OEFXYXXQ5CHHM22KGSBQ, seg_pos={0 0}, upload=298297]: Done uploading piece. err: ecclient: upload failed (node:1tY9qdfxejitZBjGRg6r4geETX9wwdUbMCvG2zXQDWnGf9Z5gd, address:64.49.13.154:4929): protocol: read tcp 188.166.225.170:57150->64.49.13.154:4929: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:31:41.020327752 (339h0m26.482420225s) [noise=true , address=145.79.227.33:4880 , piece_id=TTZEE5LCT3IE5OKWLFR2VIV6TKLMPBCUWJS5HPJO2ZAQ2RRWV2SA, seg_pos={0 0}, upload=298297]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: write tcp 188.166.225.170:57434->145.79.227.33:4880: use of closed network connection; write tcp 188.166.225.170:57434->145.79.227.33:4880: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57434->145.79.227.33:4880: use of closed network connection Oct 7 16:31:41.020415289 (339h0m26.482507772s) [seg_pos={0 0}, upload=298297]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Oct 7 16:31:41.277643601 (339h0m26.739736074s) [upload=298297]: Done uploading segments... Oct 7 16:31:41.277672376 (339h0m26.739764849s) [upload=298297]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.260224547s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 7 out of 60 is failed (threshold=3) [....................................................XXXXX.XX] duration: 1m0.259367715s FAIL (2025-10-07 16:30:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== piece... Oct 7 16:29:41.585007664 (338h58m27.047100147s) [noise=true , address=193.149.164.143:4702 , piece_id=7UP4GQKXOF4ZZ67ANUFB7QJAEGKJLSDMJKW7YIH4BBM6KHDW77SA, seg_pos={0 0}, upload=298284]: Uploading piece... Oct 7 16:29:41.585555075 (338h58m27.047647558s) [noise=true , address=145.79.227.27:4708 , piece_id=5P732HWHIT5U2N7MXDXYM6ZOUP4KBC7BZHQXRX5W27EPLWCOZCUA, seg_pos={0 0}, upload=298284]: Uploading piece... Oct 7 16:29:41.585589741 (338h58m27.047682224s) [noise=true , address=145.79.227.41:4087 , piece_id=KT6EDDBTC2B3SQHOGGEURYXWZH65EKKNADUPQGTVCNADNPN6RZVQ, seg_pos={0 0}, upload=298284]: Uploading piece... Oct 7 16:29:41.586011886 (338h58m27.048104379s) [noise=true , address=45.91.116.8:4072 , piece_id=ME5QPEPDAFLJL5DHVIFRNMCBOA36TFQ77H6SQNGYXKZFGEEL3NWA, seg_pos={0 0}, upload=298284]: Uploading piece... Oct 7 16:29:41.586264176 (338h58m27.048356649s) [noise=true , address=45.91.116.6:4004 , piece_id=TVZNHYAZ3Z5G5SJEW4WAKFLOBGJ77XCZDRCCZUOSGHROIZPW36RQ, seg_pos={0 0}, upload=298284]: Uploading piece... Oct 7 16:29:41.586464738 (338h58m27.048557221s) [noise=true , address=45.91.116.14:4222 , piece_id=VX6BU73YWKSDLOY3KWM72UUWRWVS34GZB2PAZQ5PQ36FJ4XD47NA, seg_pos={0 0}, upload=298284]: Uploading piece... Oct 7 16:29:41.586607781 (338h58m27.048700254s) [noise=true , address=145.79.227.26:4654 , piece_id=EJCT42ZEPYLWLJA5Q2LRZAZUFZZZBKVMKMU6LJCOCHBVLWWQ2ZQQ, seg_pos={0 0}, upload=298284]: Uploading piece... Oct 7 16:29:41.586891330 (338h58m27.048983813s) [noise=true , address=145.79.227.52:4446 , piece_id=NCKKSC6H4IQNFEY26RCWCRHQGOHJPXIE3OVNPGZLRT4NCEYLMOIA, seg_pos={0 0}, upload=298284]: Uploading piece... Oct 7 16:29:41.586961063 (338h58m27.049053536s) [noise=true , address=45.91.116.13:4186 , piece_id=QGYSWCPC7TW42Z3RUUEBFIWL6GTXPLQNSIU2WEJHCS6WVB3KGVIA, seg_pos={0 0}, upload=298284]: Uploading piece... Oct 7 16:29:41.587299557 (338h58m27.04939207s) [noise=true , address=45.91.116.9:4264 , piece_id=OHR2456ZQVGVYDROPQ4WLY7XBLMW23ZN35MBVYD7EXN2YUF2UASQ, seg_pos={0 0}, upload=298284]: Uploading piece... Oct 7 16:29:41.587356516 (338h58m27.049448999s) [noise=true , address=145.79.227.38:4996 , piece_id=LHZITYVBNBBBY5QHMJWK35Y2L2VJXXXB55ABA2ESS7RPKBSIPUEA, seg_pos={0 0}, upload=298284]: Uploading piece... Oct 7 16:29:41.587770935 (338h58m27.049863418s) [noise=true , address=64.49.13.138:4491 , piece_id=57QXO35NEZ24ML4NJJ3ZMGLCKRTS3JXTCESBWZ5EFJ26DVTTVXSQ, seg_pos={0 0}, upload=298284]: Uploading piece... Oct 7 16:29:41.587908347 (338h58m27.05000083s) [noise=true , address=77.90.31.11:4562 , piece_id=XPFZOF4OZ6TXNL3CZBWPRRHEWHQE63H22UN6BX3EOWOVNRPOXU4A, seg_pos={0 0}, upload=298284]: Uploading piece... Oct 7 16:29:41.588363042 (338h58m27.050455516s) [noise=true , address=45.91.116.4:4947 , piece_id=QYLTTSGNM4DP7TFUSQV3Z22XJ2PXHXB4WM4S5APMUYVI727LDXXA, seg_pos={0 0}, upload=298284]: Uploading piece... Oct 7 16:29:41.588952655 (338h58m27.051045138s) [noise=true , address=145.79.227.31:4797 , piece_id=ZGPFJVQZNSOV5RL2T66I5A3ZOZXPOZEO2A5XPRADL2UBGR32YYTA, seg_pos={0 0}, upload=298284]: Uploading piece... Oct 7 16:29:42.956842410 (338h58m28.418934883s) [upload=298284]: Next returned nil segment Oct 7 16:29:42.956867378 (338h58m28.418959861s) [upload=298284]: Waiting for error group managing segments... Oct 7 16:29:43.424117002 (338h58m28.886209485s) [noise=true , address=193.149.164.143:4702 , piece_id=7UP4GQKXOF4ZZ67ANUFB7QJAEGKJLSDMJKW7YIH4BBM6KHDW77SA, seg_pos={0 0}, upload=298284]: Done uploading piece. err: <nil> Oct 7 16:29:43.584880054 (338h58m29.046972537s) [noise=true , address=77.90.31.11:4562 , piece_id=XPFZOF4OZ6TXNL3CZBWPRRHEWHQE63H22UN6BX3EOWOVNRPOXU4A, seg_pos={0 0}, upload=298284]: Done uploading piece. err: <nil> Oct 7 16:29:43.590178925 (338h58m29.052271408s) [noise=true , address=45.91.116.7:4031 , piece_id=A7SZEJZJDP4GLJRPO6IHLW4U6GBL5MP2DSHCXUZHDZBOPA7KYKMQ, seg_pos={0 0}, upload=298284]: Done uploading piece. err: <nil> Oct 7 16:29:43.633076189 (338h58m29.095168662s) [noise=true , address=45.91.116.6:4004 , piece_id=TVZNHYAZ3Z5G5SJEW4WAKFLOBGJ77XCZDRCCZUOSGHROIZPW36RQ, seg_pos={0 0}, upload=298284]: Done uploading piece. err: <nil> Oct 7 16:29:43.699667131 (338h58m29.161759604s) [noise=true , address=45.91.116.14:4222 , piece_id=VX6BU73YWKSDLOY3KWM72UUWRWVS34GZB2PAZQ5PQ36FJ4XD47NA, seg_pos={0 0}, upload=298284]: Done uploading piece. err: <nil> Oct 7 16:29:43.719702051 (338h58m29.181794534s) [noise=true , address=45.91.116.13:4186 , piece_id=QGYSWCPC7TW42Z3RUUEBFIWL6GTXPLQNSIU2WEJHCS6WVB3KGVIA, seg_pos={0 0}, upload=298284]: Done uploading piece. err: <nil> Oct 7 16:29:43.722584029 (338h58m29.184676522s) [noise=true , address=77.90.31.19:4857 , piece_id=6FNDRCHDNXVV72CMIVHVCHBZGKC4CSCKNSMHS64DIEFWIQQLCJZA, seg_pos={0 0}, upload=298284]: Done uploading piece. err: <nil> Oct 7 16:29:43.745560430 (338h58m29.207652913s) [noise=true , address=45.91.116.9:4264 , piece_id=OHR2456ZQVGVYDROPQ4WLY7XBLMW23ZN35MBVYD7EXN2YUF2UASQ, seg_pos={0 0}, upload=298284]: Done uploading piece. err: <nil> Oct 7 16:29:43.765040755 (338h58m29.227133238s) [noise=true , address=45.91.116.8:4072 , piece_id=ME5QPEPDAFLJL5DHVIFRNMCBOA36TFQ77H6SQNGYXKZFGEEL3NWA, seg_pos={0 0}, upload=298284]: Done uploading piece. err: <nil> Oct 7 16:29:43.958951739 (338h58m29.421044222s) [noise=true , address=45.91.116.4:4947 , piece_id=QYLTTSGNM4DP7TFUSQV3Z22XJ2PXHXB4WM4S5APMUYVI727LDXXA, seg_pos={0 0}, upload=298284]: Done uploading piece. err: <nil> Oct 7 16:29:44.237613334 (338h58m29.699705807s) [noise=true , address=64.49.13.138:4491 , piece_id=57QXO35NEZ24ML4NJJ3ZMGLCKRTS3JXTCESBWZ5EFJ26DVTTVXSQ, seg_pos={0 0}, upload=298284]: Done uploading piece. err: <nil> Oct 7 16:30:40.550925290 (338h59m26.013017783s) [noise=true , address=145.79.227.24:4594 , piece_id=6UFQZQ6XEGC4TQHIYV2U4YSQ74REOIDKAPDZGN32SN4ZB7NYRTZA, seg_pos={0 0}, upload=298284]: Done uploading piece. err: ecclient: upload failed (node:12D9nh4XFmsjjFcZEMjaL4uw4Whsa8nfMrAsYPu6NVpsxgb3jvf, address:145.79.227.24:4594): protocol: write tcp 188.166.225.170:50538->145.79.227.24:4594: use of closed network connection; write tcp 188.166.225.170:50538->145.79.227.24:4594: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50538->145.79.227.24:4594: use of closed network connection Oct 7 16:30:40.551151050 (338h59m26.013243554s) [noise=true , address=145.79.227.26:4654 , piece_id=EJCT42ZEPYLWLJA5Q2LRZAZUFZZZBKVMKMU6LJCOCHBVLWWQ2ZQQ, seg_pos={0 0}, upload=298284]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 188.166.225.170:60774->145.79.227.26:4654: use of closed network connection; write tcp 188.166.225.170:60774->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60774->145.79.227.26:4654: use of closed network connection Oct 7 16:30:40.551216996 (338h59m26.013309489s) [noise=true , address=145.79.227.52:4446 , piece_id=NCKKSC6H4IQNFEY26RCWCRHQGOHJPXIE3OVNPGZLRT4NCEYLMOIA, seg_pos={0 0}, upload=298284]: Done uploading piece. err: ecclient: upload failed (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7, address:145.79.227.52:4446): protocol: write tcp 188.166.225.170:48118->145.79.227.52:4446: use of closed network connection; write tcp 188.166.225.170:48118->145.79.227.52:4446: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48118->145.79.227.52:4446: use of closed network connection Oct 7 16:30:40.551319271 (338h59m26.013411754s) [noise=true , address=145.79.227.38:4996 , piece_id=LHZITYVBNBBBY5QHMJWK35Y2L2VJXXXB55ABA2ESS7RPKBSIPUEA, seg_pos={0 0}, upload=298284]: Done uploading piece. err: ecclient: upload failed (node:1qomJ2ceswE6SKfoPAxWpiCkcW88EpfFbPnJXs7ETb5CZvSpqS, address:145.79.227.38:4996): protocol: write tcp 188.166.225.170:44872->145.79.227.38:4996: use of closed network connection; write tcp 188.166.225.170:44872->145.79.227.38:4996: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44872->145.79.227.38:4996: use of closed network connection Oct 7 16:30:40.551428589 (338h59m26.013521112s) [noise=true , address=145.79.227.27:4708 , piece_id=5P732HWHIT5U2N7MXDXYM6ZOUP4KBC7BZHQXRX5W27EPLWCOZCUA, seg_pos={0 0}, upload=298284]: Done uploading piece. err: ecclient: upload failed (node:1BdJtXzvjMoNoQUjtHETyADPcZBTzcFzH8YDd651t7eTiFb1wf, address:145.79.227.27:4708): protocol: read tcp 188.166.225.170:45924->145.79.227.27:4708: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:30:40.551495016 (338h59m26.013587499s) [noise=true , address=145.79.227.41:4087 , piece_id=KT6EDDBTC2B3SQHOGGEURYXWZH65EKKNADUPQGTVCNADNPN6RZVQ, seg_pos={0 0}, upload=298284]: Done uploading piece. err: ecclient: upload failed (node:1BfeGD2MGRPqsBRGLioTiTAcPykpSTUUx2CBVSPQcz4LQqFdWR, address:145.79.227.41:4087): protocol: read tcp 188.166.225.170:36194->145.79.227.41:4087: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:30:40.551694134 (338h59m26.013786617s) [noise=true , address=145.79.227.31:4797 , piece_id=ZGPFJVQZNSOV5RL2T66I5A3ZOZXPOZEO2A5XPRADL2UBGR32YYTA, seg_pos={0 0}, upload=298284]: Done uploading piece. err: ecclient: upload failed (node:1VwwhXQqXCHcgP37bcQAUA6urv5YGVt7NCpRNrqMKSSE5AScK9, address:145.79.227.31:4797): protocol: context deadline exceeded; context deadline exceeded Oct 7 16:30:40.551726886 (338h59m26.013819369s) [seg_pos={0 0}, upload=298284]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Oct 7 16:30:40.807786835 (338h59m26.269879328s) [upload=298284]: Done uploading segments... Oct 7 16:30:40.807822813 (338h59m26.269915307s) [upload=298284]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 1m0.25938568s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [..............................................XXXXXXXXXXXXXX] duration: 30.277603072s FAIL (2025-10-07 16:30:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== 9.996650243 (338h58m55.458742716s) [upload=298290]: Done starting upload Oct 7 16:30:09.996737830 (338h58m55.458830333s) [upload=298290]: Uploading segments... Oct 7 16:30:09.996907352 (338h58m55.458999846s) [upload=298290]: Got next segment. Inline: false Oct 7 16:30:09.996967227 (338h58m55.45905971s) [upload=298290]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 16:30:09.996974240 (338h58m55.459066723s) [upload=298290]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 16:30:10.266957099 (338h58m55.729049582s) [seg_pos={0 0}, upload=298290]: Begin upload segment... Oct 7 16:30:10.267047771 (338h58m55.729140254s) [seg_pos={0 0}, upload=298290]: Done begin upload segment. Oct 7 16:30:10.267066868 (338h58m55.729159351s) [noise=true , address=145.79.227.19:4078 , piece_id=6QVTUQ527DOAHR5SKGWTYA3I5BZLUN67KVLU6KVD2YA6VTT3WWRA, seg_pos={0 0}, upload=298290]: Uploading piece... Oct 7 16:30:10.267089662 (338h58m55.729182155s) [noise=true , address=145.79.227.11:4732 , piece_id=XYHUO7FSHTYLNXLGYTCIWYGOV7DZOQZIA7US3HMETHMKY2AXKHRQ, seg_pos={0 0}, upload=298290]: Uploading piece... Oct 7 16:30:10.267163272 (338h58m55.729255745s) [noise=true , address=45.91.116.6:4975 , piece_id=D3RAVBUMKRP6F5IZE7HSKOLHSW3Y4QC5JRXSVPNGPKA65Z253R3A, seg_pos={0 0}, upload=298290]: Uploading piece... Oct 7 16:30:10.268240814 (338h58m55.730333307s) [noise=true , address=77.90.31.19:4841 , piece_id=WER3P4PTV2LJ66GG6ICPDHHZFUUAYDTAEGNDZLS2QOHMVW4JR3JQ, seg_pos={0 0}, upload=298290]: Uploading piece... Oct 7 16:30:10.268817411 (338h58m55.730909894s) [noise=true , address=77.90.31.14:4662 , piece_id=5XI2PGETTMJE7X4B3DS6KJBEBHYIAN6XUOJGT3ORW2SDMB2O4BEA, seg_pos={0 0}, upload=298290]: Uploading piece... Oct 7 16:30:10.269499250 (338h58m55.731591733s) [noise=true , address=145.79.227.6:4259 , piece_id=D5RAINWGT5SZRB3ZV7N4K7RK7RTD3I3RHAQNPC2JN3EM6GZIOKPA, seg_pos={0 0}, upload=298290]: Uploading piece... Oct 7 16:30:10.270051562 (338h58m55.732144045s) [noise=true , address=45.91.116.7:4011 , piece_id=ASZZFGP47SLV4LQ2WSNKBBH2EBUQVY542GBVS42APOWH3RTU4YEQ, seg_pos={0 0}, upload=298290]: Uploading piece... Oct 7 16:30:10.270502280 (338h58m55.732594773s) [noise=true , address=45.91.116.7:4009 , piece_id=6DGIAYAXPPZIP4PKKIUG7ZO2LUCTESF7ZP2SHNYCOCOUGUSHYWKQ, seg_pos={0 0}, upload=298290]: Uploading piece... Oct 7 16:30:10.271026769 (338h58m55.733119252s) [noise=true , address=45.91.116.4:4940 , piece_id=QKTHYJNB623XVZFERAXV4SZOU7JY624VG5ILDVCLX6ARAOMNJUSA, seg_pos={0 0}, upload=298290]: Uploading piece... Oct 7 16:30:10.271583358 (338h58m55.733675832s) [noise=true , address=45.91.116.5:4299 , piece_id=6MLTHVCTMM5POZSFPO4KDP7E6OAW37F5GQ7HFORH7KTWTA5R2HNA, seg_pos={0 0}, upload=298290]: Uploading piece... Oct 7 16:30:10.272029377 (338h58m55.73412186s) [noise=true , address=145.79.227.4:4187 , piece_id=NM63Q4IQ7QNXASTL6KNQ3UE7F6HANWVMINIIBAXYOOHEXCP7OXIA, seg_pos={0 0}, upload=298290]: Uploading piece... Oct 7 16:30:10.275508904 (338h58m55.737601387s) [noise=true , address=145.79.227.12:4767 , piece_id=FLV7ZVFFJPLYDHQ6UBJI3JC6JLBTTAM26UE5CXFGBFYR5E7E55NQ, seg_pos={0 0}, upload=298290]: Uploading piece... Oct 7 16:30:10.278425137 (338h58m55.74051762s) [noise=true , address=77.90.31.16:4733 , piece_id=BUT5BYBTWYD2EDYAGHD65H3AA4VE5HY5SCHFWCFYWUFSBCSLTX4Q, seg_pos={0 0}, upload=298290]: Uploading piece... Oct 7 16:30:10.281152820 (338h58m55.743245304s) [noise=true , address=145.79.227.5:4221 , piece_id=GSQSPSHBXX46ZWCFG2YMACWOJRY24DUQWIUDPBWZHAAKNJB4P4YQ, seg_pos={0 0}, upload=298290]: Uploading piece... Oct 7 16:30:10.283213755 (338h58m55.745306238s) [noise=true , address=45.91.116.5:4297 , piece_id=R7P5BJ6FHHAPDWC2RGAUY2ONIAPUKO4SUS44R7BHH2ZEYDOA2ZBA, seg_pos={0 0}, upload=298290]: Uploading piece... Oct 7 16:30:10.285193094 (338h58m55.747286208s) [noise=true , address=77.90.31.17:4770 , piece_id=CD5OBITLXLQOLJXFV6YBNHCHU4RMP4SOONJWZUF32YTGUKO4YBOQ, seg_pos={0 0}, upload=298290]: Uploading piece... Oct 7 16:30:12.071490287 (338h58m57.53358277s) [upload=298290]: Next returned nil segment Oct 7 16:30:12.071515516 (338h58m57.533607999s) [upload=298290]: Waiting for error group managing segments... Oct 7 16:30:12.380987139 (338h58m57.843079622s) [noise=true , address=45.91.116.6:4975 , piece_id=D3RAVBUMKRP6F5IZE7HSKOLHSW3Y4QC5JRXSVPNGPKA65Z253R3A, seg_pos={0 0}, upload=298290]: Done uploading piece. err: <nil> Oct 7 16:30:12.389052717 (338h58m57.8511452s) [noise=true , address=45.91.116.7:4011 , piece_id=ASZZFGP47SLV4LQ2WSNKBBH2EBUQVY542GBVS42APOWH3RTU4YEQ, seg_pos={0 0}, upload=298290]: Done uploading piece. err: <nil> Oct 7 16:30:12.408468589 (338h58m57.870561072s) [noise=true , address=45.91.116.7:4009 , piece_id=6DGIAYAXPPZIP4PKKIUG7ZO2LUCTESF7ZP2SHNYCOCOUGUSHYWKQ, seg_pos={0 0}, upload=298290]: Done uploading piece. err: <nil> Oct 7 16:30:12.425483629 (338h58m57.887576112s) [noise=true , address=45.91.116.5:4299 , piece_id=6MLTHVCTMM5POZSFPO4KDP7E6OAW37F5GQ7HFORH7KTWTA5R2HNA, seg_pos={0 0}, upload=298290]: Done uploading piece. err: <nil> Oct 7 16:30:12.428340088 (338h58m57.890432571s) [noise=true , address=45.91.116.5:4297 , piece_id=R7P5BJ6FHHAPDWC2RGAUY2ONIAPUKO4SUS44R7BHH2ZEYDOA2ZBA, seg_pos={0 0}, upload=298290]: Done uploading piece. err: <nil> Oct 7 16:30:12.487570604 (338h58m57.949663078s) [noise=true , address=77.90.31.19:4841 , piece_id=WER3P4PTV2LJ66GG6ICPDHHZFUUAYDTAEGNDZLS2QOHMVW4JR3JQ, seg_pos={0 0}, upload=298290]: Done uploading piece. err: <nil> Oct 7 16:30:12.551903717 (338h58m58.0139962s) [noise=true , address=45.91.116.4:4940 , piece_id=QKTHYJNB623XVZFERAXV4SZOU7JY624VG5ILDVCLX6ARAOMNJUSA, seg_pos={0 0}, upload=298290]: Done uploading piece. err: <nil> Oct 7 16:30:12.568311310 (338h58m58.030403803s) [noise=true , address=77.90.31.14:4662 , piece_id=5XI2PGETTMJE7X4B3DS6KJBEBHYIAN6XUOJGT3ORW2SDMB2O4BEA, seg_pos={0 0}, upload=298290]: Done uploading piece. err: <nil> Oct 7 16:30:12.600390215 (338h58m58.062482698s) [noise=true , address=77.90.31.17:4770 , piece_id=CD5OBITLXLQOLJXFV6YBNHCHU4RMP4SOONJWZUF32YTGUKO4YBOQ, seg_pos={0 0}, upload=298290]: Done uploading piece. err: <nil> Oct 7 16:30:12.650357643 (338h58m58.112450136s) [noise=true , address=77.90.31.16:4733 , piece_id=BUT5BYBTWYD2EDYAGHD65H3AA4VE5HY5SCHFWCFYWUFSBCSLTX4Q, seg_pos={0 0}, upload=298290]: Done uploading piece. err: <nil> Oct 7 16:30:39.251552836 (338h59m24.713645319s) [noise=true , address=145.79.227.5:4221 , piece_id=GSQSPSHBXX46ZWCFG2YMACWOJRY24DUQWIUDPBWZHAAKNJB4P4YQ, seg_pos={0 0}, upload=298290]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:60920->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:60920->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60920->145.79.227.5:4221: use of closed network connection Oct 7 16:30:39.251708844 (338h59m24.713801327s) [noise=true , address=145.79.227.12:4767 , piece_id=FLV7ZVFFJPLYDHQ6UBJI3JC6JLBTTAM26UE5CXFGBFYR5E7E55NQ, seg_pos={0 0}, upload=298290]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: write tcp 188.166.225.170:45886->145.79.227.12:4767: use of closed network connection; write tcp 188.166.225.170:45886->145.79.227.12:4767: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45886->145.79.227.12:4767: use of closed network connection Oct 7 16:30:39.252029595 (338h59m24.714122098s) [noise=true , address=145.79.227.6:4259 , piece_id=D5RAINWGT5SZRB3ZV7N4K7RK7RTD3I3RHAQNPC2JN3EM6GZIOKPA, seg_pos={0 0}, upload=298290]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:38558->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:30:39.252156707 (338h59m24.71424919s) [noise=true , address=145.79.227.4:4187 , piece_id=NM63Q4IQ7QNXASTL6KNQ3UE7F6HANWVMINIIBAXYOOHEXCP7OXIA, seg_pos={0 0}, upload=298290]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:45826->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:30:39.252242229 (338h59m24.714334712s) [noise=true , address=145.79.227.11:4732 , piece_id=XYHUO7FSHTYLNXLGYTCIWYGOV7DZOQZIA7US3HMETHMKY2AXKHRQ, seg_pos={0 0}, upload=298290]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 188.166.225.170:51940->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:30:39.252353371 (338h59m24.714445844s) [noise=true , address=145.79.227.19:4078 , piece_id=6QVTUQ527DOAHR5SKGWTYA3I5BZLUN67KVLU6KVD2YA6VTT3WWRA, seg_pos={0 0}, upload=298290]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: read tcp 188.166.225.170:58144->145.79.227.19:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:30:39.252375894 (338h59m24.714468377s) [seg_pos={0 0}, upload=298290]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 7 16:30:39.527658374 (338h59m24.989750847s) [upload=298290]: Done uploading segments... Oct 7 16:30:39.527687840 (338h59m24.989780313s) [upload=298290]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 30.277659189s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [...............................................XXXXXXXXXXXXX] duration: 30.263406085s FAIL (2025-10-07 16:29:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 7 16:29:10.952429554 (338h57m56.414522037s) [upload=298278]: Got next segment. Inline: false Oct 7 16:29:10.952486692 (338h57m56.414579175s) [upload=298278]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 16:29:10.952493806 (338h57m56.414586289s) [upload=298278]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 16:29:11.216411125 (338h57m56.678503618s) [seg_pos={0 0}, upload=298278]: Begin upload segment... Oct 7 16:29:11.216495695 (338h57m56.678588179s) [seg_pos={0 0}, upload=298278]: Done begin upload segment. Oct 7 16:29:11.216533688 (338h57m56.678626161s) [noise=true , address=77.90.31.11:4555 , piece_id=JHSWTWW25W2FEFI4DFVMCWGT3UUIKGFUCOADO3PAC6M337CPHDFQ, seg_pos={0 0}, upload=298278]: Uploading piece... Oct 7 16:29:11.216643236 (338h57m56.678735719s) [noise=true , address=77.90.31.15:4698 , piece_id=DWQY3M522YMHZL3BLDXJ5NEN24VLTDEADHI2ZQD4VR7RR4YSVHNQ, seg_pos={0 0}, upload=298278]: Uploading piece... Oct 7 16:29:11.217481051 (338h57m56.679573545s) [noise=true , address=145.79.227.13:4804 , piece_id=X4LZ25IBAWKHHDCNM37PVG7HVE5RCGHR5KEYYT4LJH5VIUZM3DPA, seg_pos={0 0}, upload=298278]: Uploading piece... Oct 7 16:29:11.217642870 (338h57m56.679735363s) [noise=true , address=145.79.227.14:4837 , piece_id=72R4QNGWLRIGBHHMKUMEYL7TEYRDD5KXHJQA3JAIE4XDPHUE5I7A, seg_pos={0 0}, upload=298278]: Uploading piece... Oct 7 16:29:11.218091144 (338h57m56.680183627s) [noise=true , address=45.91.116.14:4191 , piece_id=6JR6QSZCHLZTTU4LLJATG56CL4C2R545REEUXPLKUYQQ77DPOCDA, seg_pos={0 0}, upload=298278]: Uploading piece... Oct 7 16:29:11.218432063 (338h57m56.680524546s) [noise=true , address=145.79.227.7:4295 , piece_id=GEKBPSFLKGUMDFUEXZYKNC3265RXXDYDQLMTUKELX4XB33XEFWLA, seg_pos={0 0}, upload=298278]: Uploading piece... Oct 7 16:29:11.218769917 (338h57m56.6808624s) [noise=true , address=45.91.116.6:4973 , piece_id=6JRFWYBZ7GFNADMDNKZZPH4GADB647BJMKBYLYXI7U5N5IQQFM3Q, seg_pos={0 0}, upload=298278]: Uploading piece... Oct 7 16:29:11.219050260 (338h57m56.681142744s) [noise=true , address=77.90.31.18:4807 , piece_id=PH726NTQ5OOB75PW3T2RCZ6EV4Q25K44WTFY75BD4JBM7UI7TB5A, seg_pos={0 0}, upload=298278]: Uploading piece... Oct 7 16:29:11.219428150 (338h57m56.681520633s) [noise=true , address=145.79.227.15:4874 , piece_id=2PDGGMVYPN5RQRBULRDQORIYIU3HKJYOJ7YEKGR3J4E6Q2AZK52Q, seg_pos={0 0}, upload=298278]: Uploading piece... Oct 7 16:29:11.219827270 (338h57m56.681919743s) [noise=true , address=45.91.116.13:4154 , piece_id=VEGZVON4OJBR7GQPAA3LIRBOL6Y5ZEBU2S624MVIHVILOYQVRPIQ, seg_pos={0 0}, upload=298278]: Uploading piece... Oct 7 16:29:11.222546998 (338h57m56.684639481s) [noise=true , address=45.91.116.8:4048 , piece_id=UVHCYCPQQQYPYZDAS6F524KPM44JHMXPFEJ4L4TVKDWGWDZHYMJQ, seg_pos={0 0}, upload=298278]: Uploading piece... Oct 7 16:29:11.223327295 (338h57m56.685419778s) [noise=true , address=77.90.31.21:4877 , piece_id=GCGEJLFW6GAHCMFL5EAUYYALQUR2VLNYIFKK2IMTN6CPNT6IVC3Q, seg_pos={0 0}, upload=298278]: Uploading piece... Oct 7 16:29:11.226041643 (338h57m56.688134126s) [noise=true , address=45.91.116.6:4975 , piece_id=YTUB3AIO4UKQO4DLXEIJWMRMEBDCSE56IV5JXWRFSNAQR4GTEA7A, seg_pos={0 0}, upload=298278]: Uploading piece... Oct 7 16:29:11.230260968 (338h57m56.692353451s) [noise=true , address=45.91.116.7:4011 , piece_id=YX2BFKQUSSQWK6ZKVTBVCAV52GSWIVNCF2HCP33O6FQWRBJXUFSQ, seg_pos={0 0}, upload=298278]: Uploading piece... Oct 7 16:29:11.233140731 (338h57m56.695233214s) [noise=true , address=145.79.227.6:4257 , piece_id=24NL4QWNFCI3A5C7T2VKKHSJVX6U4MIDPYCTJTUZC4I4ODK7GO3A, seg_pos={0 0}, upload=298278]: Uploading piece... Oct 7 16:29:11.236772166 (338h57m56.698864649s) [noise=true , address=45.91.116.11:4119 , piece_id=KOZD4BXT7EGFSWVE5MW63RJAZT5GP6F2T662CXMC7T5GVRR6755A, seg_pos={0 0}, upload=298278]: Uploading piece... Oct 7 16:29:12.995668883 (338h57m58.457761367s) [upload=298278]: Next returned nil segment Oct 7 16:29:12.995693931 (338h57m58.457786414s) [upload=298278]: Waiting for error group managing segments... Oct 7 16:29:13.279394600 (338h57m58.741487083s) [noise=true , address=45.91.116.13:4154 , piece_id=VEGZVON4OJBR7GQPAA3LIRBOL6Y5ZEBU2S624MVIHVILOYQVRPIQ, seg_pos={0 0}, upload=298278]: Done uploading piece. err: <nil> Oct 7 16:29:13.318717838 (338h57m58.780810331s) [noise=true , address=45.91.116.7:4011 , piece_id=YX2BFKQUSSQWK6ZKVTBVCAV52GSWIVNCF2HCP33O6FQWRBJXUFSQ, seg_pos={0 0}, upload=298278]: Done uploading piece. err: <nil> Oct 7 16:29:13.366180407 (338h57m58.82827289s) [noise=true , address=77.90.31.18:4807 , piece_id=PH726NTQ5OOB75PW3T2RCZ6EV4Q25K44WTFY75BD4JBM7UI7TB5A, seg_pos={0 0}, upload=298278]: Done uploading piece. err: <nil> Oct 7 16:29:13.366302198 (338h57m58.828394681s) [noise=true , address=77.90.31.21:4877 , piece_id=GCGEJLFW6GAHCMFL5EAUYYALQUR2VLNYIFKK2IMTN6CPNT6IVC3Q, seg_pos={0 0}, upload=298278]: Done uploading piece. err: <nil> Oct 7 16:29:13.371987093 (338h57m58.834079576s) [noise=true , address=45.91.116.6:4973 , piece_id=6JRFWYBZ7GFNADMDNKZZPH4GADB647BJMKBYLYXI7U5N5IQQFM3Q, seg_pos={0 0}, upload=298278]: Done uploading piece. err: <nil> Oct 7 16:29:13.378328288 (338h57m58.840420771s) [noise=true , address=77.90.31.15:4698 , piece_id=DWQY3M522YMHZL3BLDXJ5NEN24VLTDEADHI2ZQD4VR7RR4YSVHNQ, seg_pos={0 0}, upload=298278]: Done uploading piece. err: <nil> Oct 7 16:29:13.394721393 (338h57m58.856813877s) [noise=true , address=45.91.116.8:4048 , piece_id=UVHCYCPQQQYPYZDAS6F524KPM44JHMXPFEJ4L4TVKDWGWDZHYMJQ, seg_pos={0 0}, upload=298278]: Done uploading piece. err: <nil> Oct 7 16:29:13.409401708 (338h57m58.871494191s) [noise=true , address=45.91.116.6:4975 , piece_id=YTUB3AIO4UKQO4DLXEIJWMRMEBDCSE56IV5JXWRFSNAQR4GTEA7A, seg_pos={0 0}, upload=298278]: Done uploading piece. err: <nil> Oct 7 16:29:13.442114098 (338h57m58.904206571s) [noise=true , address=45.91.116.14:4191 , piece_id=6JR6QSZCHLZTTU4LLJATG56CL4C2R545REEUXPLKUYQQ77DPOCDA, seg_pos={0 0}, upload=298278]: Done uploading piece. err: <nil> Oct 7 16:29:13.451975236 (338h57m58.914067709s) [noise=true , address=45.91.116.11:4119 , piece_id=KOZD4BXT7EGFSWVE5MW63RJAZT5GP6F2T662CXMC7T5GVRR6755A, seg_pos={0 0}, upload=298278]: Done uploading piece. err: <nil> Oct 7 16:29:13.514663557 (338h57m58.97675604s) [noise=true , address=77.90.31.11:4555 , piece_id=JHSWTWW25W2FEFI4DFVMCWGT3UUIKGFUCOADO3PAC6M337CPHDFQ, seg_pos={0 0}, upload=298278]: Done uploading piece. err: <nil> Oct 7 16:29:40.210487373 (338h58m25.672579856s) [noise=true , address=145.79.227.13:4804 , piece_id=X4LZ25IBAWKHHDCNM37PVG7HVE5RCGHR5KEYYT4LJH5VIUZM3DPA, seg_pos={0 0}, upload=298278]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: write tcp 188.166.225.170:44754->145.79.227.13:4804: use of closed network connection; write tcp 188.166.225.170:44754->145.79.227.13:4804: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44754->145.79.227.13:4804: use of closed network connection Oct 7 16:29:40.210619254 (338h58m25.672711737s) [noise=true , address=145.79.227.7:4295 , piece_id=GEKBPSFLKGUMDFUEXZYKNC3265RXXDYDQLMTUKELX4XB33XEFWLA, seg_pos={0 0}, upload=298278]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:54640->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:54640->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54640->145.79.227.7:4295: use of closed network connection Oct 7 16:29:40.210862126 (338h58m25.672954609s) [noise=true , address=145.79.227.6:4257 , piece_id=24NL4QWNFCI3A5C7T2VKKHSJVX6U4MIDPYCTJTUZC4I4ODK7GO3A, seg_pos={0 0}, upload=298278]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:51638->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:51638->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51638->145.79.227.6:4257: use of closed network connection Oct 7 16:29:40.210893145 (338h58m25.672985618s) [noise=true , address=145.79.227.14:4837 , piece_id=72R4QNGWLRIGBHHMKUMEYL7TEYRDD5KXHJQA3JAIE4XDPHUE5I7A, seg_pos={0 0}, upload=298278]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: write tcp 188.166.225.170:46642->145.79.227.14:4837: use of closed network connection; write tcp 188.166.225.170:46642->145.79.227.14:4837: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46642->145.79.227.14:4837: use of closed network connection Oct 7 16:29:40.210949263 (338h58m25.673041736s) [noise=true , address=145.79.227.15:4874 , piece_id=2PDGGMVYPN5RQRBULRDQORIYIU3HKJYOJ7YEKGR3J4E6Q2AZK52Q, seg_pos={0 0}, upload=298278]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:145.79.227.15:4874): protocol: write tcp 188.166.225.170:33968->145.79.227.15:4874: use of closed network connection; write tcp 188.166.225.170:33968->145.79.227.15:4874: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33968->145.79.227.15:4874: use of closed network connection Oct 7 16:29:40.210976986 (338h58m25.673069459s) [seg_pos={0 0}, upload=298278]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 16:29:40.472294193 (338h58m25.934386676s) [upload=298278]: Done uploading segments... Oct 7 16:29:40.472324731 (338h58m25.934417214s) [upload=298278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 30.263434509s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 6 out of 60 is failed (threshold=3) [.....................................................XXXXX.X] duration: 1m0.272116575s FAIL (2025-10-07 16:29:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== oise=true , address=77.90.31.10:4538 , piece_id=DRA5B47FDASBUUAXXZ7JDRLSZQBHRMHVILLV55KK7KNKIUTLCWJA, seg_pos={0 0}, upload=298268]: Uploading piece... Oct 7 16:28:41.044463751 (338h57m26.506556234s) [noise=true , address=77.90.31.17:4799 , piece_id=SHBGV7LURTSXRPCHNVKUBLFJ3YIXWBOCN76M46JNJ3Z5ON5RUDMA, seg_pos={0 0}, upload=298268]: Uploading piece... Oct 7 16:28:41.045047883 (338h57m26.507140367s) [noise=true , address=45.91.116.10:4104 , piece_id=HXGHCQCGAPG4DKVNRW5H5ILTQW3FT44QUELPQP7WTIAOOF6ZTU7A, seg_pos={0 0}, upload=298268]: Uploading piece... Oct 7 16:28:41.045663145 (338h57m26.507755628s) [noise=true , address=45.91.116.12:4257 , piece_id=U2F7P3FEXQL6VTCQ6NU42Z5LICFXSCU53DMLW4VXX4MGISW3K47Q, seg_pos={0 0}, upload=298268]: Uploading piece... Oct 7 16:28:41.046174709 (338h57m26.508267192s) [noise=true , address=45.91.116.7:4040 , piece_id=D7NVTCGBESFKVKK5ZVP2DVQQ764U7AMGU7UVBNT6CQOLT5JSY32A, seg_pos={0 0}, upload=298268]: Uploading piece... Oct 7 16:28:41.046698897 (338h57m26.508791381s) [noise=true , address=145.79.227.20:4438 , piece_id=UCKL7JDHQI2XN6U7ZMPBEQAWGJJ5H7KQCMA2PJKG2JRVCXTEWYYQ, seg_pos={0 0}, upload=298268]: Uploading piece... Oct 7 16:28:41.048229271 (338h57m26.510321744s) [noise=true , address=145.79.227.33:4903 , piece_id=RUJTAYUQYPQR5CB67WSGWPIB5JPTKVTUGYO6BPXLUHD2KGF3THZA, seg_pos={0 0}, upload=298268]: Uploading piece... Oct 7 16:28:41.048537859 (338h57m26.510630362s) [noise=true , address=145.79.227.52:4452 , piece_id=N3BYITEA2CC3NAF6VTTVDR3H7XPFE6WGCUVAAXKB33V4S56B3EWA, seg_pos={0 0}, upload=298268]: Uploading piece... Oct 7 16:28:41.049976859 (338h57m26.512069333s) [noise=true , address=77.90.31.19:4866 , piece_id=GADWEU2UJDYIDSY7YWMLEPTSG6CN3BUFEAL5VXKJFSQ6XN7ZVTEQ, seg_pos={0 0}, upload=298268]: Uploading piece... Oct 7 16:28:41.050555781 (338h57m26.512648264s) [noise=true , address=45.91.116.5:4323 , piece_id=XS74SFN5UXXELUKE7A2OYZUZQL7JTCEASSW67M6SIVYXERDNLFPQ, seg_pos={0 0}, upload=298268]: Uploading piece... Oct 7 16:28:41.051651638 (338h57m26.513744112s) [noise=true , address=77.90.31.13:4644 , piece_id=45FHSDD2YP7U22RL5FNGHJBQPLTYKLKC5YWBOT5SEW2DI7BQSAAA, seg_pos={0 0}, upload=298268]: Uploading piece... Oct 7 16:28:41.052544017 (338h57m26.5146365s) [noise=true , address=45.91.116.9:4265 , piece_id=H3EZ4AUBC4BFYZJFRF6G3TPVLILMBHGTCEFPAKWWUWSFIOWKT6AQ, seg_pos={0 0}, upload=298268]: Uploading piece... Oct 7 16:28:41.053348299 (338h57m26.515440783s) [noise=true , address=145.79.227.21:4482 , piece_id=7DRDN3G3677Y22KX6MIDJ5TDUSHQTMD5VVBBBZTU53DJGK74LS2A, seg_pos={0 0}, upload=298268]: Uploading piece... Oct 7 16:28:41.054866981 (338h57m26.516959454s) [noise=true , address=77.90.31.14:4684 , piece_id=KKS65ZYYPCFWPRLBR6PJGQ4ZLVCINFIWIYAGNUKSYQP677ES25CQ, seg_pos={0 0}, upload=298268]: Uploading piece... Oct 7 16:28:41.056275904 (338h57m26.518368387s) [noise=true , address=77.90.31.12:4612 , piece_id=5HBF6ZP2KELYU45ERJZEABFQ6QYM6T2CHVVLRDGEWYQKSG3MT2UQ, seg_pos={0 0}, upload=298268]: Uploading piece... Oct 7 16:28:41.058012190 (338h57m26.520104663s) [noise=true , address=145.79.227.32:4835 , piece_id=CVXCN2EC73H7VDBOK7I27K33W54L57RD34NLHHVSVIW3XXRQ6ZCQ, seg_pos={0 0}, upload=298268]: Uploading piece... Oct 7 16:28:42.594546557 (338h57m28.05663907s) [upload=298268]: Next returned nil segment Oct 7 16:28:42.594570472 (338h57m28.056662945s) [upload=298268]: Waiting for error group managing segments... Oct 7 16:28:42.986728025 (338h57m28.448820498s) [noise=true , address=77.90.31.13:4644 , piece_id=45FHSDD2YP7U22RL5FNGHJBQPLTYKLKC5YWBOT5SEW2DI7BQSAAA, seg_pos={0 0}, upload=298268]: Done uploading piece. err: <nil> Oct 7 16:28:43.013719583 (338h57m28.475812056s) [noise=true , address=45.91.116.9:4265 , piece_id=H3EZ4AUBC4BFYZJFRF6G3TPVLILMBHGTCEFPAKWWUWSFIOWKT6AQ, seg_pos={0 0}, upload=298268]: Done uploading piece. err: <nil> Oct 7 16:28:43.019274190 (338h57m28.481366673s) [noise=true , address=77.90.31.16:4739 , piece_id=Q7LXVTQEXNYQTO72P5NBRTA2AR7EQ3GBZ45XSLXU7VZBI3ZKHS6Q, seg_pos={0 0}, upload=298268]: Done uploading piece. err: <nil> Oct 7 16:28:43.045208253 (338h57m28.507300726s) [noise=true , address=45.91.116.10:4104 , piece_id=HXGHCQCGAPG4DKVNRW5H5ILTQW3FT44QUELPQP7WTIAOOF6ZTU7A, seg_pos={0 0}, upload=298268]: Done uploading piece. err: <nil> Oct 7 16:28:43.083956718 (338h57m28.546049191s) [noise=true , address=45.91.116.12:4257 , piece_id=U2F7P3FEXQL6VTCQ6NU42Z5LICFXSCU53DMLW4VXX4MGISW3K47Q, seg_pos={0 0}, upload=298268]: Done uploading piece. err: <nil> Oct 7 16:28:43.105210218 (338h57m28.567302701s) [noise=true , address=77.90.31.10:4538 , piece_id=DRA5B47FDASBUUAXXZ7JDRLSZQBHRMHVILLV55KK7KNKIUTLCWJA, seg_pos={0 0}, upload=298268]: Done uploading piece. err: <nil> Oct 7 16:28:43.134361849 (338h57m28.596454332s) [noise=true , address=45.91.116.5:4323 , piece_id=XS74SFN5UXXELUKE7A2OYZUZQL7JTCEASSW67M6SIVYXERDNLFPQ, seg_pos={0 0}, upload=298268]: Done uploading piece. err: <nil> Oct 7 16:28:43.135064526 (338h57m28.597157s) [noise=true , address=45.91.116.7:4040 , piece_id=D7NVTCGBESFKVKK5ZVP2DVQQ764U7AMGU7UVBNT6CQOLT5JSY32A, seg_pos={0 0}, upload=298268]: Done uploading piece. err: <nil> Oct 7 16:28:43.136697035 (338h57m28.598789508s) [noise=true , address=77.90.31.12:4612 , piece_id=5HBF6ZP2KELYU45ERJZEABFQ6QYM6T2CHVVLRDGEWYQKSG3MT2UQ, seg_pos={0 0}, upload=298268]: Done uploading piece. err: <nil> Oct 7 16:28:43.194878655 (338h57m28.656971128s) [noise=true , address=77.90.31.19:4866 , piece_id=GADWEU2UJDYIDSY7YWMLEPTSG6CN3BUFEAL5VXKJFSQ6XN7ZVTEQ, seg_pos={0 0}, upload=298268]: Done uploading piece. err: <nil> Oct 7 16:28:43.206318829 (338h57m28.668411302s) [noise=true , address=77.90.31.14:4684 , piece_id=KKS65ZYYPCFWPRLBR6PJGQ4ZLVCINFIWIYAGNUKSYQP677ES25CQ, seg_pos={0 0}, upload=298268]: Done uploading piece. err: <nil> Oct 7 16:28:43.281985543 (338h57m28.744078016s) [noise=true , address=77.90.31.17:4799 , piece_id=SHBGV7LURTSXRPCHNVKUBLFJ3YIXWBOCN76M46JNJ3Z5ON5RUDMA, seg_pos={0 0}, upload=298268]: Done uploading piece. err: <nil> Oct 7 16:29:40.065016739 (338h58m25.527109222s) [noise=true , address=145.79.227.30:4771 , piece_id=INMYDY34ITJN7MA6IKYVZNXQVCMVPJINXUL5EDVY3Y52NOZTKLLQ, seg_pos={0 0}, upload=298268]: Done uploading piece. err: ecclient: upload failed (node:1PggYtrfQ5ozsJL1HeAVJWc4jLvf5jiHspX3CgFY89swMimWto, address:145.79.227.30:4771): protocol: write tcp 188.166.225.170:48086->145.79.227.30:4771: use of closed network connection; write tcp 188.166.225.170:48086->145.79.227.30:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48086->145.79.227.30:4771: use of closed network connection Oct 7 16:29:40.065310358 (338h58m25.527402831s) [noise=true , address=145.79.227.21:4482 , piece_id=7DRDN3G3677Y22KX6MIDJ5TDUSHQTMD5VVBBBZTU53DJGK74LS2A, seg_pos={0 0}, upload=298268]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: write tcp 188.166.225.170:58682->145.79.227.21:4482: use of closed network connection; write tcp 188.166.225.170:58682->145.79.227.21:4482: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58682->145.79.227.21:4482: use of closed network connection Oct 7 16:29:40.065373668 (338h58m25.527466141s) [noise=true , address=145.79.227.33:4903 , piece_id=RUJTAYUQYPQR5CB67WSGWPIB5JPTKVTUGYO6BPXLUHD2KGF3THZA, seg_pos={0 0}, upload=298268]: Done uploading piece. err: ecclient: upload failed (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq, address:145.79.227.33:4903): protocol: write tcp 188.166.225.170:54896->145.79.227.33:4903: use of closed network connection; write tcp 188.166.225.170:54896->145.79.227.33:4903: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54896->145.79.227.33:4903: use of closed network connection Oct 7 16:29:40.065470804 (338h58m25.527563287s) [noise=true , address=145.79.227.52:4452 , piece_id=N3BYITEA2CC3NAF6VTTVDR3H7XPFE6WGCUVAAXKB33V4S56B3EWA, seg_pos={0 0}, upload=298268]: Done uploading piece. err: ecclient: upload failed (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5, address:145.79.227.52:4452): protocol: write tcp 188.166.225.170:52480->145.79.227.52:4452: use of closed network connection; write tcp 188.166.225.170:52480->145.79.227.52:4452: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52480->145.79.227.52:4452: use of closed network connection Oct 7 16:29:40.065680563 (338h58m25.527773046s) [noise=true , address=145.79.227.20:4438 , piece_id=UCKL7JDHQI2XN6U7ZMPBEQAWGJJ5H7KQCMA2PJKG2JRVCXTEWYYQ, seg_pos={0 0}, upload=298268]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: read tcp 188.166.225.170:46852->145.79.227.20:4438: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:29:40.065781355 (338h58m25.527873838s) [noise=true , address=145.79.227.32:4835 , piece_id=CVXCN2EC73H7VDBOK7I27K33W54L57RD34NLHHVSVIW3XXRQ6ZCQ, seg_pos={0 0}, upload=298268]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: write tcp 188.166.225.170:34428->145.79.227.32:4835: use of closed network connection; write tcp 188.166.225.170:34428->145.79.227.32:4835: use of closed network connection Oct 7 16:29:40.065843673 (338h58m25.527936146s) [seg_pos={0 0}, upload=298268]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Oct 7 16:29:40.334751355 (338h58m25.796843838s) [upload=298268]: Done uploading segments... Oct 7 16:29:40.334782043 (338h58m25.796874516s) [upload=298268]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 1m0.272155049s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [................................................XXXXXXXXXXXX] duration: 30.253177491s FAIL (2025-10-07 16:28:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Inline: false Oct 7 16:28:15.738724874 (338h57m1.200817348s) [upload=298262]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 16:28:15.738735274 (338h57m1.200827757s) [upload=298262]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 16:28:15.996132739 (338h57m1.458225222s) [seg_pos={0 0}, upload=298262]: Begin upload segment... Oct 7 16:28:15.996209486 (338h57m1.458301959s) [seg_pos={0 0}, upload=298262]: Done begin upload segment. Oct 7 16:28:15.996245935 (338h57m1.458338418s) [noise=true , address=145.79.227.4:4185 , piece_id=PSRAFS5S4N326RLBELVUXY7LTVQB3SR4IJ26WDOUO7OZJQGE6PFQ, seg_pos={0 0}, upload=298262]: Uploading piece... Oct 7 16:28:15.996339743 (338h57m1.458432226s) [noise=true , address=45.91.116.7:4010 , piece_id=5ESHTKFMCLOUWCX7ZKEVVCUJ4TZZWAKLDILEFMYRUCTNHOSQ2OGQ, seg_pos={0 0}, upload=298262]: Uploading piece... Oct 7 16:28:15.998126616 (338h57m1.460219099s) [noise=true , address=145.79.227.7:4295 , piece_id=7RZ5HWBVLOBPE4AXQFQF7HGAXDREKVGDGJM26FSRETJGHVEI5OKQ, seg_pos={0 0}, upload=298262]: Uploading piece... Oct 7 16:28:15.999148211 (338h57m1.461240694s) [noise=true , address=45.91.116.10:4083 , piece_id=F6VW6ERDLAAKZ3PQUSEOVLCCM5XLQNP23VPL5QD7K64AFYHZJD5A, seg_pos={0 0}, upload=298262]: Uploading piece... Oct 7 16:28:15.999351699 (338h57m1.461444182s) [noise=true , address=77.90.31.14:4661 , piece_id=5HQOSGKMH6WZWIBQBTXJ6PTPUTIQM2YUVLWMSR5OPDVL7WXRL33A, seg_pos={0 0}, upload=298262]: Uploading piece... Oct 7 16:28:16.000682924 (338h57m1.462775417s) [noise=true , address=145.79.227.11:4729 , piece_id=4BWIHTCIW76RDGLDRSCYQDG6HELQQIYWQKWQ3ISCDNNCPG2EX7QQ, seg_pos={0 0}, upload=298262]: Uploading piece... Oct 7 16:28:16.000856184 (338h57m1.462948697s) [noise=true , address=45.91.116.12:4226 , piece_id=YNDYZMETBMXGWFUB4HGJ2V6BVNRYDPDUXZWZFGPVAVUDVMVAUULQ, seg_pos={0 0}, upload=298262]: Uploading piece... Oct 7 16:28:16.001642631 (338h57m1.463735135s) [noise=true , address=145.79.227.13:4804 , piece_id=4S52VQ4TS2KCI6XPVPRZ7ZEBHBTPJJGRDWH5FQRNCPA3XKTRP4GA, seg_pos={0 0}, upload=298262]: Uploading piece... Oct 7 16:28:16.002712027 (338h57m1.46480451s) [noise=true , address=145.79.227.12:4767 , piece_id=FWXKONTASSVTDVFKFG73SFGOMVTAU7UPXAOUBVDTWSL42QGHPTDA, seg_pos={0 0}, upload=298262]: Uploading piece... Oct 7 16:28:16.002954739 (338h57m1.465047222s) [noise=true , address=45.91.116.8:4048 , piece_id=POUX7SOK2LG744NGMEFGLB3INR52P25JQN7NXJEV7RKTXATKGAOQ, seg_pos={0 0}, upload=298262]: Uploading piece... Oct 7 16:28:16.003672757 (338h57m1.46576525s) [noise=true , address=145.79.227.5:4222 , piece_id=A6GVWBGBF2F44IARREG54MBZUUDKN5F5IWIEOZYUS6OQUAMX3L7Q, seg_pos={0 0}, upload=298262]: Uploading piece... Oct 7 16:28:16.005161131 (338h57m1.467253614s) [noise=true , address=77.90.31.16:4735 , piece_id=ASD6EM7RASS3NVCRIHR4OBZXI5RUDCWN7MDME4I4K3CHATBLYNBA, seg_pos={0 0}, upload=298262]: Uploading piece... Oct 7 16:28:16.005961465 (338h57m1.468053948s) [noise=true , address=45.91.116.7:4011 , piece_id=ONMDUPBITVYZHT6D7WASNJU2XT3IJFNGBZBZFGMS5TWULUD3HHWA, seg_pos={0 0}, upload=298262]: Uploading piece... Oct 7 16:28:16.006676917 (338h57m1.4687694s) [noise=true , address=45.91.116.4:4938 , piece_id=7IPEUWWCSRSOCN5ANL3VZHJRQPDZS74WBIWM3VS35ZNXIYU5FT3Q, seg_pos={0 0}, upload=298262]: Uploading piece... Oct 7 16:28:16.009954738 (338h57m1.472047272s) [noise=true , address=77.90.31.14:4662 , piece_id=MHPJCR6AUUA5P32AXYT56PS6MFGBIKRDYMKCEFRGIFTJGKRFSQ5Q, seg_pos={0 0}, upload=298262]: Uploading piece... Oct 7 16:28:16.022706631 (338h57m1.484799124s) [noise=true , address=45.91.116.11:4117 , piece_id=IY4RSJYOR2XBTJEEVJUQY427GLNJXGCQCWHDQNAF7ZY5CIAAZ6BQ, seg_pos={0 0}, upload=298262]: Uploading piece... Oct 7 16:28:17.688012551 (338h57m3.150105034s) [upload=298262]: Next returned nil segment Oct 7 16:28:17.688033080 (338h57m3.150125564s) [upload=298262]: Waiting for error group managing segments... Oct 7 16:28:18.100981262 (338h57m3.563073755s) [noise=true , address=45.91.116.10:4083 , piece_id=F6VW6ERDLAAKZ3PQUSEOVLCCM5XLQNP23VPL5QD7K64AFYHZJD5A, seg_pos={0 0}, upload=298262]: Done uploading piece. err: <nil> Oct 7 16:28:18.117652367 (338h57m3.57974484s) [noise=true , address=77.90.31.14:4662 , piece_id=MHPJCR6AUUA5P32AXYT56PS6MFGBIKRDYMKCEFRGIFTJGKRFSQ5Q, seg_pos={0 0}, upload=298262]: Done uploading piece. err: <nil> Oct 7 16:28:18.135971160 (338h57m3.598063633s) [noise=true , address=45.91.116.7:4010 , piece_id=5ESHTKFMCLOUWCX7ZKEVVCUJ4TZZWAKLDILEFMYRUCTNHOSQ2OGQ, seg_pos={0 0}, upload=298262]: Done uploading piece. err: <nil> Oct 7 16:28:18.155825407 (338h57m3.61791789s) [noise=true , address=77.90.31.14:4661 , piece_id=5HQOSGKMH6WZWIBQBTXJ6PTPUTIQM2YUVLWMSR5OPDVL7WXRL33A, seg_pos={0 0}, upload=298262]: Done uploading piece. err: <nil> Oct 7 16:28:18.166187758 (338h57m3.628280231s) [noise=true , address=77.90.31.16:4735 , piece_id=ASD6EM7RASS3NVCRIHR4OBZXI5RUDCWN7MDME4I4K3CHATBLYNBA, seg_pos={0 0}, upload=298262]: Done uploading piece. err: <nil> Oct 7 16:28:18.167402000 (338h57m3.629494473s) [noise=true , address=45.91.116.12:4226 , piece_id=YNDYZMETBMXGWFUB4HGJ2V6BVNRYDPDUXZWZFGPVAVUDVMVAUULQ, seg_pos={0 0}, upload=298262]: Done uploading piece. err: <nil> Oct 7 16:28:18.186235343 (338h57m3.648327826s) [noise=true , address=45.91.116.8:4048 , piece_id=POUX7SOK2LG744NGMEFGLB3INR52P25JQN7NXJEV7RKTXATKGAOQ, seg_pos={0 0}, upload=298262]: Done uploading piece. err: <nil> Oct 7 16:28:18.186301339 (338h57m3.648393812s) [noise=true , address=45.91.116.7:4011 , piece_id=ONMDUPBITVYZHT6D7WASNJU2XT3IJFNGBZBZFGMS5TWULUD3HHWA, seg_pos={0 0}, upload=298262]: Done uploading piece. err: <nil> Oct 7 16:28:18.314172940 (338h57m3.776265423s) [noise=true , address=45.91.116.4:4938 , piece_id=7IPEUWWCSRSOCN5ANL3VZHJRQPDZS74WBIWM3VS35ZNXIYU5FT3Q, seg_pos={0 0}, upload=298262]: Done uploading piece. err: <nil> Oct 7 16:28:19.701630947 (338h57m5.16372343s) [noise=true , address=45.91.116.11:4117 , piece_id=IY4RSJYOR2XBTJEEVJUQY427GLNJXGCQCWHDQNAF7ZY5CIAAZ6BQ, seg_pos={0 0}, upload=298262]: Done uploading piece. err: <nil> Oct 7 16:28:45.022654870 (338h57m30.484747353s) [noise=true , address=145.79.227.4:4185 , piece_id=PSRAFS5S4N326RLBELVUXY7LTVQB3SR4IJ26WDOUO7OZJQGE6PFQ, seg_pos={0 0}, upload=298262]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:51944->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:51944->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51944->145.79.227.4:4185: use of closed network connection Oct 7 16:28:45.022769659 (338h57m30.484862132s) [noise=true , address=145.79.227.11:4729 , piece_id=4BWIHTCIW76RDGLDRSCYQDG6HELQQIYWQKWQ3ISCDNNCPG2EX7QQ, seg_pos={0 0}, upload=298262]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:38570->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:38570->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38570->145.79.227.11:4729: use of closed network connection Oct 7 16:28:45.022846185 (338h57m30.484938658s) [noise=true , address=145.79.227.13:4804 , piece_id=4S52VQ4TS2KCI6XPVPRZ7ZEBHBTPJJGRDWH5FQRNCPA3XKTRP4GA, seg_pos={0 0}, upload=298262]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: write tcp 188.166.225.170:58702->145.79.227.13:4804: use of closed network connection; write tcp 188.166.225.170:58702->145.79.227.13:4804: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58702->145.79.227.13:4804: use of closed network connection Oct 7 16:28:45.022911690 (338h57m30.485004173s) [noise=true , address=145.79.227.5:4222 , piece_id=A6GVWBGBF2F44IARREG54MBZUUDKN5F5IWIEOZYUS6OQUAMX3L7Q, seg_pos={0 0}, upload=298262]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:57352->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:57352->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57352->145.79.227.5:4222: use of closed network connection Oct 7 16:28:45.023070000 (338h57m30.485162484s) [noise=true , address=145.79.227.12:4767 , piece_id=FWXKONTASSVTDVFKFG73SFGOMVTAU7UPXAOUBVDTWSL42QGHPTDA, seg_pos={0 0}, upload=298262]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: read tcp 188.166.225.170:42742->145.79.227.12:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:28:45.023129694 (338h57m30.485222167s) [noise=true , address=145.79.227.7:4295 , piece_id=7RZ5HWBVLOBPE4AXQFQF7HGAXDREKVGDGJM26FSRETJGHVEI5OKQ, seg_pos={0 0}, upload=298262]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: read tcp 188.166.225.170:52988->145.79.227.7:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:28:45.023172896 (338h57m30.48526537s) [seg_pos={0 0}, upload=298262]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 7 16:28:45.274442001 (338h57m30.736534945s) [upload=298262]: Done uploading segments... Oct 7 16:28:45.274481927 (338h57m30.7365744s) [upload=298262]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 30.253207597s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.................................................XXXXXXXXXXX] duration: 30.258767873s FAIL (2025-10-07 16:27:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== BQ, seg_pos={0 0}, upload=298250]: Uploading piece... Oct 7 16:27:24.966308330 (338h56m10.428400813s) [noise=true , address=77.90.31.10:4520 , piece_id=M65LHVH2WGDWTL7GPHAIPDVOK5CPMHIQAIVWLZYJBJGKBPXV7H2A, seg_pos={0 0}, upload=298250]: Uploading piece... Oct 7 16:27:24.966613200 (338h56m10.428705673s) [noise=true , address=145.79.227.2:4114 , piece_id=GLXQQ3KZXYVK52Y7RDSKH5OB2BRJ3KEIB7YAL4LEOFALG2AGR27A, seg_pos={0 0}, upload=298250]: Uploading piece... Oct 7 16:27:24.966873976 (338h56m10.428966449s) [noise=true , address=145.79.227.11:4729 , piece_id=GD5CG3EU2NFTO3CBSOSSBHTZS6NV5LA54P6RXGOBCASQS2RJZ5TA, seg_pos={0 0}, upload=298250]: Uploading piece... Oct 7 16:27:24.967122970 (338h56m10.429215443s) [noise=true , address=145.79.227.6:4259 , piece_id=FJLNLRKFRK6Z3SGQ4ZAEBPVGSEFHJ4IB2HDEMK3SEQCKLYHDCDSQ, seg_pos={0 0}, upload=298250]: Uploading piece... Oct 7 16:27:24.967394558 (338h56m10.429487031s) [noise=true , address=145.79.227.19:4077 , piece_id=NRF2LMABJOHZPVVXVILPPTVHTR35EFYPNYJ6UPXFFTXRQGGMJANA, seg_pos={0 0}, upload=298250]: Uploading piece... Oct 7 16:27:24.967659432 (338h56m10.429751906s) [noise=true , address=145.79.227.6:4258 , piece_id=WJPL2SC7JMYHAGZ3PL2XT2UPZHMAR2IRYQKY3J5BDR6LCK5HIYYQ, seg_pos={0 0}, upload=298250]: Uploading piece... Oct 7 16:27:24.967896233 (338h56m10.429988706s) [noise=true , address=45.91.116.4:4937 , piece_id=Z4I7YB6X36CDAGRMK4M4CQ7DTB26MKTHVEWPRRCAI5CGYX5DWX5A, seg_pos={0 0}, upload=298250]: Uploading piece... Oct 7 16:27:24.968191626 (338h56m10.430284109s) [noise=true , address=145.79.227.5:4222 , piece_id=DA6UIYMXUJ5DBQKOHD7WLLZNZMMKJIAIZYE4AFNE63GUC7Z4DFAQ, seg_pos={0 0}, upload=298250]: Uploading piece... Oct 7 16:27:24.968442443 (338h56m10.430534916s) [noise=true , address=77.90.31.14:4663 , piece_id=FC3SRSQ2LWDNS6LPU76U4CSWVDJ2H37FZIIKPA3SF7XJNUI2Y7WA, seg_pos={0 0}, upload=298250]: Uploading piece... Oct 7 16:27:24.968690866 (338h56m10.430783339s) [noise=true , address=145.79.227.11:4730 , piece_id=BYNCEYKFMHUCZIIU3NFUU7TZWSF5IOK2YA6J6EHQHQZKSPMFAP5A, seg_pos={0 0}, upload=298250]: Uploading piece... Oct 7 16:27:24.968932807 (338h56m10.43102529s) [noise=true , address=145.79.227.18:4006 , piece_id=ZLBXNFJNNVGBXD33AD34Y6DUV4XC2TNP4672YSMVCC4CH3Y2ZR3Q, seg_pos={0 0}, upload=298250]: Uploading piece... Oct 7 16:27:24.969247766 (338h56m10.431340249s) [noise=true , address=77.90.31.18:4806 , piece_id=3RHGJ4V6RBQNBD7LY5NMHGPLMOLDOUFGK5LT4Z5VSCWWCVRXLH2A, seg_pos={0 0}, upload=298250]: Uploading piece... Oct 7 16:27:24.969552196 (338h56m10.431644669s) [noise=true , address=45.91.116.6:4975 , piece_id=R6SNX7KC7BNBXP6UPVGI2BK22T5SOWEAIEKK5B3PTMV4MQHMMZPA, seg_pos={0 0}, upload=298250]: Uploading piece... Oct 7 16:27:24.969881513 (338h56m10.431973986s) [noise=true , address=77.90.31.19:4842 , piece_id=SH5L46YXMC4B6RZY62Z4GCAQC4LZCHTW6LVX76YIEKW3O6NI3EKQ, seg_pos={0 0}, upload=298250]: Uploading piece... Oct 7 16:27:24.970191323 (338h56m10.432283796s) [noise=true , address=45.91.116.14:4190 , piece_id=SNVORMGXWTIVOTGPFNZ6LMFRZDTRFV2KGLLABUOGNFOPVWTMMEZA, seg_pos={0 0}, upload=298250]: Uploading piece... Oct 7 16:27:26.747052579 (338h56m12.209145052s) [upload=298250]: Next returned nil segment Oct 7 16:27:26.747085011 (338h56m12.209177484s) [upload=298250]: Waiting for error group managing segments... Oct 7 16:27:27.081280233 (338h56m12.543372706s) [noise=true , address=45.91.116.6:4975 , piece_id=R6SNX7KC7BNBXP6UPVGI2BK22T5SOWEAIEKK5B3PTMV4MQHMMZPA, seg_pos={0 0}, upload=298250]: Done uploading piece. err: <nil> Oct 7 16:27:27.090100809 (338h56m12.552193292s) [noise=true , address=45.91.116.14:4190 , piece_id=SNVORMGXWTIVOTGPFNZ6LMFRZDTRFV2KGLLABUOGNFOPVWTMMEZA, seg_pos={0 0}, upload=298250]: Done uploading piece. err: <nil> Oct 7 16:27:27.093469613 (338h56m12.555562096s) [noise=true , address=45.91.116.4:4937 , piece_id=Z4I7YB6X36CDAGRMK4M4CQ7DTB26MKTHVEWPRRCAI5CGYX5DWX5A, seg_pos={0 0}, upload=298250]: Done uploading piece. err: <nil> Oct 7 16:27:27.134757383 (338h56m12.596849866s) [noise=true , address=77.90.31.14:4663 , piece_id=FC3SRSQ2LWDNS6LPU76U4CSWVDJ2H37FZIIKPA3SF7XJNUI2Y7WA, seg_pos={0 0}, upload=298250]: Done uploading piece. err: <nil> Oct 7 16:27:27.225017466 (338h56m12.687109939s) [noise=true , address=77.90.31.18:4806 , piece_id=3RHGJ4V6RBQNBD7LY5NMHGPLMOLDOUFGK5LT4Z5VSCWWCVRXLH2A, seg_pos={0 0}, upload=298250]: Done uploading piece. err: <nil> Oct 7 16:27:27.243608036 (338h56m12.705700519s) [noise=true , address=77.90.31.10:4520 , piece_id=M65LHVH2WGDWTL7GPHAIPDVOK5CPMHIQAIVWLZYJBJGKBPXV7H2A, seg_pos={0 0}, upload=298250]: Done uploading piece. err: <nil> Oct 7 16:27:27.384824129 (338h56m12.846916612s) [noise=true , address=77.90.31.19:4842 , piece_id=SH5L46YXMC4B6RZY62Z4GCAQC4LZCHTW6LVX76YIEKW3O6NI3EKQ, seg_pos={0 0}, upload=298250]: Done uploading piece. err: <nil> Oct 7 16:27:53.940738005 (338h56m39.402830488s) [noise=true , address=145.79.227.5:4223 , piece_id=OQW5PNLHHPPGQNU5LUUZM4XQXEDALCBGH3DUW7ETVN7GRSENX2BQ, seg_pos={0 0}, upload=298250]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:41952->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:41952->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41952->145.79.227.5:4223: use of closed network connection Oct 7 16:27:53.940858414 (338h56m39.402950897s) [noise=true , address=145.79.227.2:4114 , piece_id=GLXQQ3KZXYVK52Y7RDSKH5OB2BRJ3KEIB7YAL4LEOFALG2AGR27A, seg_pos={0 0}, upload=298250]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:27:53.940914641 (338h56m39.403007114s) [noise=true , address=145.79.227.11:4729 , piece_id=GD5CG3EU2NFTO3CBSOSSBHTZS6NV5LA54P6RXGOBCASQS2RJZ5TA, seg_pos={0 0}, upload=298250]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:42268->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:42268->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42268->145.79.227.11:4729: use of closed network connection Oct 7 16:27:53.940994753 (338h56m39.403087236s) [noise=true , address=145.79.227.11:4730 , piece_id=BYNCEYKFMHUCZIIU3NFUU7TZWSF5IOK2YA6J6EHQHQZKSPMFAP5A, seg_pos={0 0}, upload=298250]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:40242->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:40242->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40242->145.79.227.11:4730: use of closed network connection Oct 7 16:27:53.941288563 (338h56m39.403381036s) [noise=true , address=145.79.227.5:4222 , piece_id=DA6UIYMXUJ5DBQKOHD7WLLZNZMMKJIAIZYE4AFNE63GUC7Z4DFAQ, seg_pos={0 0}, upload=298250]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:47374->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:27:53.941309703 (338h56m39.403402186s) [noise=true , address=145.79.227.19:4077 , piece_id=NRF2LMABJOHZPVVXVILPPTVHTR35EFYPNYJ6UPXFFTXRQGGMJANA, seg_pos={0 0}, upload=298250]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: read tcp 188.166.225.170:45314->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:27:53.941442967 (338h56m39.40353544s) [noise=true , address=145.79.227.6:4258 , piece_id=WJPL2SC7JMYHAGZ3PL2XT2UPZHMAR2IRYQKY3J5BDR6LCK5HIYYQ, seg_pos={0 0}, upload=298250]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:50066->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:27:53.941503072 (338h56m39.403595545s) [noise=true , address=145.79.227.6:4259 , piece_id=FJLNLRKFRK6Z3SGQ4ZAEBPVGSEFHJ4IB2HDEMK3SEQCKLYHDCDSQ, seg_pos={0 0}, upload=298250]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:34640->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:27:53.941596750 (338h56m39.403689223s) [noise=true , address=145.79.227.18:4006 , piece_id=ZLBXNFJNNVGBXD33AD34Y6DUV4XC2TNP4672YSMVCC4CH3Y2ZR3Q, seg_pos={0 0}, upload=298250]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:53480->145.79.227.18:4006: use of closed network connection; context deadline exceeded Oct 7 16:27:53.941655982 (338h56m39.403748466s) [seg_pos={0 0}, upload=298250]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Oct 7 16:27:54.197056064 (338h56m39.659148547s) [upload=298250]: Done uploading segments... Oct 7 16:27:54.197169009 (338h56m39.659261482s) [upload=298250]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 30.258818831s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 5 out of 60 is failed (threshold=3) [......................................................XXXXX.] duration: 6.256413614s FAIL (2025-10-07 16:27:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== 46803924 (338h55m13.708896398s) [noise=true , address=77.90.31.10:4544 , piece_id=AD2YMP3R2Z33U5W6PFZXKJL6O5DO4N7PRD2SSFX2ODRSKCLIO2OA, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.247540156 (338h55m13.709632629s) [noise=true , address=145.79.227.25:4642 , piece_id=2V7SN53OE7KWRTOF4NARPQFVU3PLPCXELRMOVA5ACBR76Q4DWWIQ, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.247862480 (338h55m13.709954963s) [noise=true , address=145.79.227.31:4809 , piece_id=TYWMH4X57TPHAJ7K5AJTZX6WUXKMP7R3ZOYZGAPMOYMUOQHUXNZQ, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.250183079 (338h55m13.712275552s) [noise=true , address=77.90.31.13:4645 , piece_id=ZJWL75YKIUV2MITCFVU6VDYZHZUFQW6IXCEA5NIV3CV2K6QKCLXA, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.250544186 (338h55m13.712636659s) [noise=true , address=77.90.31.11:4585 , piece_id=VBBCQII7N5ENCJ27YSWP6PVJM5WSUWZAPI4KONW2IBTU44HOBP2Q, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.252715231 (338h55m13.714807714s) [noise=true , address=145.79.227.33:4897 , piece_id=ORVS7BM6BYKYZKMFMR2WHQ52MNJEIXV4ZXPUEPZM4NJL2MRCMFMQ, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.254246957 (338h55m13.716339441s) [noise=true , address=77.90.31.19:4844 , piece_id=OFJU26QEZJVBWYYWJ4M7MI3YEPMK26GQHFLKLMSTRANYQ7VZKWRQ, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.256869090 (338h55m13.718961573s) [noise=true , address=45.91.116.11:4144 , piece_id=XT4K7JUSSV4RQZXS2XCXIUSBU663NQW4JCI5XOEXT5GI2LP5PHWQ, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.258630414 (338h55m13.720722887s) [noise=true , address=45.91.116.14:4207 , piece_id=ARIDTJA4OMDKQBBRLOWTSZ5BPW446RT2LTGYRTNWUV74DOSUS4MQ, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.261535265 (338h55m13.723627738s) [noise=true , address=145.79.227.5:4237 , piece_id=EONN4DU3F7SXOGKFKNAF5S6PAZLGK36NKRP6VCQMOTPO6QWW6LWQ, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.262971410 (338h55m13.725063883s) [noise=true , address=145.79.227.36:4518 , piece_id=CRKU4FYXXHNP3LOO47D3CJG3KP7G7C4QRHSMMA2UUV3MNOPK4APQ, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.262998762 (338h55m13.725091245s) [noise=true , address=45.91.116.13:4160 , piece_id=TFBSSIJRMRAONK6PASKBDIDSYLX32YD36P4C7CQ6AFZA2NWW6RCA, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.264401423 (338h55m13.726493946s) [noise=true , address=145.79.227.45:4229 , piece_id=6SAMZBCKFSIAOZZIW5GRBUSTXBGSTC6KK3JMA5P6B5CRP52HMBXQ, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.266330056 (338h55m13.728422539s) [noise=true , address=64.49.13.139:4479 , piece_id=JEJONPB3JZPDGYRPNDMHS5AIKWC2JULAF4UJPERCBSGFSVKXT6LQ, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:29.722178542 (338h55m15.184271025s) [upload=298237]: Next returned nil segment Oct 7 16:26:29.722198890 (338h55m15.184291373s) [upload=298237]: Waiting for error group managing segments... Oct 7 16:26:30.249871549 (338h55m15.711964032s) [noise=true , address=77.90.31.12:4609 , piece_id=K62EAYIZVSLGCMPH4CLA5R4SZ2Y7NN4AAKRDMH3YAMTYKBKDHFYA, seg_pos={0 0}, upload=298237]: Done uploading piece. err: <nil> Oct 7 16:26:30.256127823 (338h55m15.718220326s) [noise=true , address=77.90.31.11:4585 , piece_id=VBBCQII7N5ENCJ27YSWP6PVJM5WSUWZAPI4KONW2IBTU44HOBP2Q, seg_pos={0 0}, upload=298237]: Done uploading piece. err: <nil> Oct 7 16:26:30.256981559 (338h55m15.719074042s) [noise=true , address=45.91.116.7:4033 , piece_id=GQWBZWSQ32ZGTYPBYNDOQXUMQOMU6HXHWAUUOABPU25XI34BVQAQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: <nil> Oct 7 16:26:30.275088958 (338h55m15.737181441s) [noise=true , address=45.91.116.14:4207 , piece_id=ARIDTJA4OMDKQBBRLOWTSZ5BPW446RT2LTGYRTNWUV74DOSUS4MQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: <nil> Oct 7 16:26:30.278243816 (338h55m15.740336299s) [noise=true , address=45.91.116.11:4144 , piece_id=XT4K7JUSSV4RQZXS2XCXIUSBU663NQW4JCI5XOEXT5GI2LP5PHWQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: <nil> Oct 7 16:26:30.284298626 (338h55m15.746391099s) [noise=true , address=77.90.31.16:4759 , piece_id=755HK5G65AG3PUOSTMUUXRPWO7KSE45XNC6GTT6GALEZDWDXJMNQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: <nil> Oct 7 16:26:30.286195778 (338h55m15.748288261s) [noise=true , address=77.90.31.18:4826 , piece_id=CDKAIVBKUO5ZJRFHIOEEK6WZHWBROHTV7RWUZPGGGO7SK7ZGUANA, seg_pos={0 0}, upload=298237]: Done uploading piece. err: <nil> Oct 7 16:26:30.328511686 (338h55m15.790604159s) [noise=true , address=77.90.31.13:4645 , piece_id=ZJWL75YKIUV2MITCFVU6VDYZHZUFQW6IXCEA5NIV3CV2K6QKCLXA, seg_pos={0 0}, upload=298237]: Done uploading piece. err: <nil> Oct 7 16:26:30.349247000 (338h55m15.811339483s) [noise=true , address=77.90.31.10:4544 , piece_id=AD2YMP3R2Z33U5W6PFZXKJL6O5DO4N7PRD2SSFX2ODRSKCLIO2OA, seg_pos={0 0}, upload=298237]: Done uploading piece. err: <nil> Oct 7 16:26:30.355893426 (338h55m15.817985909s) [noise=true , address=77.90.31.19:4844 , piece_id=OFJU26QEZJVBWYYWJ4M7MI3YEPMK26GQHFLKLMSTRANYQ7VZKWRQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: <nil> Oct 7 16:26:30.473526252 (338h55m15.935618735s) [noise=true , address=45.91.116.13:4160 , piece_id=TFBSSIJRMRAONK6PASKBDIDSYLX32YD36P4C7CQ6AFZA2NWW6RCA, seg_pos={0 0}, upload=298237]: Done uploading piece. err: <nil> Oct 7 16:27:27.264884661 (338h56m12.726977144s) [noise=true , address=145.79.227.33:4897 , piece_id=ORVS7BM6BYKYZKMFMR2WHQ52MNJEIXV4ZXPUEPZM4NJL2MRCMFMQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: ecclient: upload failed (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU, address:145.79.227.33:4897): protocol: write tcp 188.166.225.170:47892->145.79.227.33:4897: use of closed network connection; write tcp 188.166.225.170:47892->145.79.227.33:4897: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47892->145.79.227.33:4897: use of closed network connection Oct 7 16:27:27.265003176 (338h56m12.727095649s) [noise=true , address=145.79.227.45:4229 , piece_id=6SAMZBCKFSIAOZZIW5GRBUSTXBGSTC6KK3JMA5P6B5CRP52HMBXQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: ecclient: upload failed (node:12wWYnhWHSqqAFgje4p9Cr7WYaJ6dJWsCqvrx8ZqVFoakjuFeka, address:145.79.227.45:4229): protocol: write tcp 188.166.225.170:54312->145.79.227.45:4229: use of closed network connection; write tcp 188.166.225.170:54312->145.79.227.45:4229: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54312->145.79.227.45:4229: use of closed network connection Oct 7 16:27:27.265219659 (338h56m12.727312142s) [noise=true , address=145.79.227.36:4518 , piece_id=CRKU4FYXXHNP3LOO47D3CJG3KP7G7C4QRHSMMA2UUV3MNOPK4APQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: ecclient: upload failed (node:17TZ9JLdCivFF46guhSTW6hcoUmTz5uo5wvLkDqC4BGmpm9eLb, address:145.79.227.36:4518): protocol: read tcp 188.166.225.170:50754->145.79.227.36:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:27:27.265358393 (338h56m12.727450876s) [noise=true , address=145.79.227.5:4237 , piece_id=EONN4DU3F7SXOGKFKNAF5S6PAZLGK36NKRP6VCQMOTPO6QWW6LWQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: ecclient: upload failed (node:1o2jLTwKNSjxjFEmckxkG1c5EuySK3o3sawGEikd2Ttz4CWfLa, address:145.79.227.5:4237): protocol: write tcp 188.166.225.170:53312->145.79.227.5:4237: use of closed network connection; write tcp 188.166.225.170:53312->145.79.227.5:4237: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53312->145.79.227.5:4237: use of closed network connection Oct 7 16:27:27.265438375 (338h56m12.727530848s) [noise=true , address=145.79.227.25:4642 , piece_id=2V7SN53OE7KWRTOF4NARPQFVU3PLPCXELRMOVA5ACBR76Q4DWWIQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: ecclient: upload failed (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L, address:145.79.227.25:4642): protocol: write tcp 188.166.225.170:55514->145.79.227.25:4642: use of closed network connection; write tcp 188.166.225.170:55514->145.79.227.25:4642: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55514->145.79.227.25:4642: use of closed network connection Oct 7 16:27:27.265517145 (338h56m12.727609618s) [noise=true , address=145.79.227.31:4809 , piece_id=TYWMH4X57TPHAJ7K5AJTZX6WUXKMP7R3ZOYZGAPMOYMUOQHUXNZQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: ecclient: upload failed (node:1VZgucaa2gRuFhNxARMb7BDS6EGZXKChGPppbFksbPc5we7fTQ, address:145.79.227.31:4809): protocol: write tcp 188.166.225.170:52532->145.79.227.31:4809: use of closed network connection; write tcp 188.166.225.170:52532->145.79.227.31:4809: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52532->145.79.227.31:4809: use of closed network connection Oct 7 16:27:27.265728457 (338h56m12.72782093s) [noise=true , address=64.49.13.139:4479 , piece_id=JEJONPB3JZPDGYRPNDMHS5AIKWC2JULAF4UJPERCBSGFSVKXT6LQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: ecclient: upload failed (node:12fa8o8SX7mogECREbm3fLwNDTNT4qVGSa8NUwaG1GkNe96FFqw, address:64.49.13.139:4479): protocol: read tcp 188.166.225.170:57546->64.49.13.139:4479: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:27:27.265756060 (338h56m12.727848533s) [seg_pos={0 0}, upload=298237]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Oct 7 16:27:27.512032067 (338h56m12.97412456s) [upload=298237]: Done uploading segments... Oct 7 16:27:27.512067284 (338h56m12.974159767s) [upload=298237]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 6.25646936s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......................................................XXXXX] duration: 1m0.249838379s FAIL (2025-10-07 16:27:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== 46803924 (338h55m13.708896398s) [noise=true , address=77.90.31.10:4544 , piece_id=AD2YMP3R2Z33U5W6PFZXKJL6O5DO4N7PRD2SSFX2ODRSKCLIO2OA, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.247540156 (338h55m13.709632629s) [noise=true , address=145.79.227.25:4642 , piece_id=2V7SN53OE7KWRTOF4NARPQFVU3PLPCXELRMOVA5ACBR76Q4DWWIQ, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.247862480 (338h55m13.709954963s) [noise=true , address=145.79.227.31:4809 , piece_id=TYWMH4X57TPHAJ7K5AJTZX6WUXKMP7R3ZOYZGAPMOYMUOQHUXNZQ, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.250183079 (338h55m13.712275552s) [noise=true , address=77.90.31.13:4645 , piece_id=ZJWL75YKIUV2MITCFVU6VDYZHZUFQW6IXCEA5NIV3CV2K6QKCLXA, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.250544186 (338h55m13.712636659s) [noise=true , address=77.90.31.11:4585 , piece_id=VBBCQII7N5ENCJ27YSWP6PVJM5WSUWZAPI4KONW2IBTU44HOBP2Q, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.252715231 (338h55m13.714807714s) [noise=true , address=145.79.227.33:4897 , piece_id=ORVS7BM6BYKYZKMFMR2WHQ52MNJEIXV4ZXPUEPZM4NJL2MRCMFMQ, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.254246957 (338h55m13.716339441s) [noise=true , address=77.90.31.19:4844 , piece_id=OFJU26QEZJVBWYYWJ4M7MI3YEPMK26GQHFLKLMSTRANYQ7VZKWRQ, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.256869090 (338h55m13.718961573s) [noise=true , address=45.91.116.11:4144 , piece_id=XT4K7JUSSV4RQZXS2XCXIUSBU663NQW4JCI5XOEXT5GI2LP5PHWQ, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.258630414 (338h55m13.720722887s) [noise=true , address=45.91.116.14:4207 , piece_id=ARIDTJA4OMDKQBBRLOWTSZ5BPW446RT2LTGYRTNWUV74DOSUS4MQ, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.261535265 (338h55m13.723627738s) [noise=true , address=145.79.227.5:4237 , piece_id=EONN4DU3F7SXOGKFKNAF5S6PAZLGK36NKRP6VCQMOTPO6QWW6LWQ, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.262971410 (338h55m13.725063883s) [noise=true , address=145.79.227.36:4518 , piece_id=CRKU4FYXXHNP3LOO47D3CJG3KP7G7C4QRHSMMA2UUV3MNOPK4APQ, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.262998762 (338h55m13.725091245s) [noise=true , address=45.91.116.13:4160 , piece_id=TFBSSIJRMRAONK6PASKBDIDSYLX32YD36P4C7CQ6AFZA2NWW6RCA, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.264401423 (338h55m13.726493946s) [noise=true , address=145.79.227.45:4229 , piece_id=6SAMZBCKFSIAOZZIW5GRBUSTXBGSTC6KK3JMA5P6B5CRP52HMBXQ, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:28.266330056 (338h55m13.728422539s) [noise=true , address=64.49.13.139:4479 , piece_id=JEJONPB3JZPDGYRPNDMHS5AIKWC2JULAF4UJPERCBSGFSVKXT6LQ, seg_pos={0 0}, upload=298237]: Uploading piece... Oct 7 16:26:29.722178542 (338h55m15.184271025s) [upload=298237]: Next returned nil segment Oct 7 16:26:29.722198890 (338h55m15.184291373s) [upload=298237]: Waiting for error group managing segments... Oct 7 16:26:30.249871549 (338h55m15.711964032s) [noise=true , address=77.90.31.12:4609 , piece_id=K62EAYIZVSLGCMPH4CLA5R4SZ2Y7NN4AAKRDMH3YAMTYKBKDHFYA, seg_pos={0 0}, upload=298237]: Done uploading piece. err: <nil> Oct 7 16:26:30.256127823 (338h55m15.718220326s) [noise=true , address=77.90.31.11:4585 , piece_id=VBBCQII7N5ENCJ27YSWP6PVJM5WSUWZAPI4KONW2IBTU44HOBP2Q, seg_pos={0 0}, upload=298237]: Done uploading piece. err: <nil> Oct 7 16:26:30.256981559 (338h55m15.719074042s) [noise=true , address=45.91.116.7:4033 , piece_id=GQWBZWSQ32ZGTYPBYNDOQXUMQOMU6HXHWAUUOABPU25XI34BVQAQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: <nil> Oct 7 16:26:30.275088958 (338h55m15.737181441s) [noise=true , address=45.91.116.14:4207 , piece_id=ARIDTJA4OMDKQBBRLOWTSZ5BPW446RT2LTGYRTNWUV74DOSUS4MQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: <nil> Oct 7 16:26:30.278243816 (338h55m15.740336299s) [noise=true , address=45.91.116.11:4144 , piece_id=XT4K7JUSSV4RQZXS2XCXIUSBU663NQW4JCI5XOEXT5GI2LP5PHWQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: <nil> Oct 7 16:26:30.284298626 (338h55m15.746391099s) [noise=true , address=77.90.31.16:4759 , piece_id=755HK5G65AG3PUOSTMUUXRPWO7KSE45XNC6GTT6GALEZDWDXJMNQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: <nil> Oct 7 16:26:30.286195778 (338h55m15.748288261s) [noise=true , address=77.90.31.18:4826 , piece_id=CDKAIVBKUO5ZJRFHIOEEK6WZHWBROHTV7RWUZPGGGO7SK7ZGUANA, seg_pos={0 0}, upload=298237]: Done uploading piece. err: <nil> Oct 7 16:26:30.328511686 (338h55m15.790604159s) [noise=true , address=77.90.31.13:4645 , piece_id=ZJWL75YKIUV2MITCFVU6VDYZHZUFQW6IXCEA5NIV3CV2K6QKCLXA, seg_pos={0 0}, upload=298237]: Done uploading piece. err: <nil> Oct 7 16:26:30.349247000 (338h55m15.811339483s) [noise=true , address=77.90.31.10:4544 , piece_id=AD2YMP3R2Z33U5W6PFZXKJL6O5DO4N7PRD2SSFX2ODRSKCLIO2OA, seg_pos={0 0}, upload=298237]: Done uploading piece. err: <nil> Oct 7 16:26:30.355893426 (338h55m15.817985909s) [noise=true , address=77.90.31.19:4844 , piece_id=OFJU26QEZJVBWYYWJ4M7MI3YEPMK26GQHFLKLMSTRANYQ7VZKWRQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: <nil> Oct 7 16:26:30.473526252 (338h55m15.935618735s) [noise=true , address=45.91.116.13:4160 , piece_id=TFBSSIJRMRAONK6PASKBDIDSYLX32YD36P4C7CQ6AFZA2NWW6RCA, seg_pos={0 0}, upload=298237]: Done uploading piece. err: <nil> Oct 7 16:27:27.264884661 (338h56m12.726977144s) [noise=true , address=145.79.227.33:4897 , piece_id=ORVS7BM6BYKYZKMFMR2WHQ52MNJEIXV4ZXPUEPZM4NJL2MRCMFMQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: ecclient: upload failed (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU, address:145.79.227.33:4897): protocol: write tcp 188.166.225.170:47892->145.79.227.33:4897: use of closed network connection; write tcp 188.166.225.170:47892->145.79.227.33:4897: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47892->145.79.227.33:4897: use of closed network connection Oct 7 16:27:27.265003176 (338h56m12.727095649s) [noise=true , address=145.79.227.45:4229 , piece_id=6SAMZBCKFSIAOZZIW5GRBUSTXBGSTC6KK3JMA5P6B5CRP52HMBXQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: ecclient: upload failed (node:12wWYnhWHSqqAFgje4p9Cr7WYaJ6dJWsCqvrx8ZqVFoakjuFeka, address:145.79.227.45:4229): protocol: write tcp 188.166.225.170:54312->145.79.227.45:4229: use of closed network connection; write tcp 188.166.225.170:54312->145.79.227.45:4229: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54312->145.79.227.45:4229: use of closed network connection Oct 7 16:27:27.265219659 (338h56m12.727312142s) [noise=true , address=145.79.227.36:4518 , piece_id=CRKU4FYXXHNP3LOO47D3CJG3KP7G7C4QRHSMMA2UUV3MNOPK4APQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: ecclient: upload failed (node:17TZ9JLdCivFF46guhSTW6hcoUmTz5uo5wvLkDqC4BGmpm9eLb, address:145.79.227.36:4518): protocol: read tcp 188.166.225.170:50754->145.79.227.36:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:27:27.265358393 (338h56m12.727450876s) [noise=true , address=145.79.227.5:4237 , piece_id=EONN4DU3F7SXOGKFKNAF5S6PAZLGK36NKRP6VCQMOTPO6QWW6LWQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: ecclient: upload failed (node:1o2jLTwKNSjxjFEmckxkG1c5EuySK3o3sawGEikd2Ttz4CWfLa, address:145.79.227.5:4237): protocol: write tcp 188.166.225.170:53312->145.79.227.5:4237: use of closed network connection; write tcp 188.166.225.170:53312->145.79.227.5:4237: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53312->145.79.227.5:4237: use of closed network connection Oct 7 16:27:27.265438375 (338h56m12.727530848s) [noise=true , address=145.79.227.25:4642 , piece_id=2V7SN53OE7KWRTOF4NARPQFVU3PLPCXELRMOVA5ACBR76Q4DWWIQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: ecclient: upload failed (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L, address:145.79.227.25:4642): protocol: write tcp 188.166.225.170:55514->145.79.227.25:4642: use of closed network connection; write tcp 188.166.225.170:55514->145.79.227.25:4642: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55514->145.79.227.25:4642: use of closed network connection Oct 7 16:27:27.265517145 (338h56m12.727609618s) [noise=true , address=145.79.227.31:4809 , piece_id=TYWMH4X57TPHAJ7K5AJTZX6WUXKMP7R3ZOYZGAPMOYMUOQHUXNZQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: ecclient: upload failed (node:1VZgucaa2gRuFhNxARMb7BDS6EGZXKChGPppbFksbPc5we7fTQ, address:145.79.227.31:4809): protocol: write tcp 188.166.225.170:52532->145.79.227.31:4809: use of closed network connection; write tcp 188.166.225.170:52532->145.79.227.31:4809: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52532->145.79.227.31:4809: use of closed network connection Oct 7 16:27:27.265728457 (338h56m12.72782093s) [noise=true , address=64.49.13.139:4479 , piece_id=JEJONPB3JZPDGYRPNDMHS5AIKWC2JULAF4UJPERCBSGFSVKXT6LQ, seg_pos={0 0}, upload=298237]: Done uploading piece. err: ecclient: upload failed (node:12fa8o8SX7mogECREbm3fLwNDTNT4qVGSa8NUwaG1GkNe96FFqw, address:64.49.13.139:4479): protocol: read tcp 188.166.225.170:57546->64.49.13.139:4479: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:27:27.265756060 (338h56m12.727848533s) [seg_pos={0 0}, upload=298237]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Oct 7 16:27:27.512032067 (338h56m12.97412456s) [upload=298237]: Done uploading segments... Oct 7 16:27:27.512067284 (338h56m12.974159767s) [upload=298237]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 1m0.249853969s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [..................................................XXXXXXXXXX] duration: 30.258857643s FAIL (2025-10-07 16:27:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== 38h55m23.872405361s) [upload=298241]: Uploading segments... Oct 7 16:26:38.410436543 (338h55m23.872529026s) [upload=298241]: Got next segment. Inline: false Oct 7 16:26:38.410498030 (338h55m23.872590503s) [upload=298241]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 16:26:38.410503771 (338h55m23.872596244s) [upload=298241]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 16:26:38.665887602 (338h55m24.127980085s) [seg_pos={0 0}, upload=298241]: Begin upload segment... Oct 7 16:26:38.665956082 (338h55m24.128048555s) [seg_pos={0 0}, upload=298241]: Done begin upload segment. Oct 7 16:26:38.665990196 (338h55m24.128082669s) [noise=true , address=145.79.227.2:4114 , piece_id=4NEL6IXQJG7MACSJS7AC6533QY5KFDVAOXUG7N773F23QXXCGU3Q, seg_pos={0 0}, upload=298241]: Uploading piece... Oct 7 16:26:38.666067454 (338h55m24.128159937s) [noise=true , address=145.79.227.2:4113 , piece_id=ZDXJ3NURZLHIPC5PIV4HOVDGLJGE2RQGHUVTIXBLQZWPEMEHVE6A, seg_pos={0 0}, upload=298241]: Uploading piece... Oct 7 16:26:38.666780611 (338h55m24.128873084s) [noise=true , address=45.91.116.12:4225 , piece_id=5LVOD66GAUR2G5RDHXIUSMNHRMZQ7OPVOQKKWFTRPM6QD3JILBUQ, seg_pos={0 0}, upload=298241]: Uploading piece... Oct 7 16:26:38.666932000 (338h55m24.129024503s) [noise=true , address=77.90.31.10:4518 , piece_id=B6IXIITDCXVBMOR3W55LUBPYGSQW3GH3AMP7GBKAFC4HI72CHDHQ, seg_pos={0 0}, upload=298241]: Uploading piece... Oct 7 16:26:38.667316472 (338h55m24.129408955s) [noise=true , address=45.91.116.10:4083 , piece_id=DSZA4YY2PAZXRALVMBNV2XURU2FSAH5FWK7IPHZ4H2KM4C5SMTGQ, seg_pos={0 0}, upload=298241]: Uploading piece... Oct 7 16:26:38.667467039 (338h55m24.129559522s) [noise=true , address=45.91.116.5:4297 , piece_id=RPTYZKFXRHQJWDLW6W25VCECCOKQRCGWUDT4J67KF4D37IDG4HSQ, seg_pos={0 0}, upload=298241]: Uploading piece... Oct 7 16:26:38.667780886 (338h55m24.129873369s) [noise=true , address=45.91.116.12:4226 , piece_id=7ZTZGDBYREUBJJZTMSTACX2KRE2XCWYFHER44WI2WLTO2MX2U5QA, seg_pos={0 0}, upload=298241]: Uploading piece... Oct 7 16:26:38.667807978 (338h55m24.129900451s) [noise=true , address=45.91.116.4:4938 , piece_id=RDYH54A6DRU7URRFUQAPTTARN6XZ4HETTU246OVIVIDSXWOOTJBQ, seg_pos={0 0}, upload=298241]: Uploading piece... Oct 7 16:26:38.668210223 (338h55m24.130302707s) [noise=true , address=77.90.31.10:4520 , piece_id=2J4VKP7IZT2XA5C5OYOG2233ZCISUVR2T36LYL2X7PPLWPVB443Q, seg_pos={0 0}, upload=298241]: Uploading piece... Oct 7 16:26:38.668293663 (338h55m24.130386136s) [noise=true , address=145.79.227.5:4222 , piece_id=TW6GOJN3QBXR7G2RVIYLPWWUE5SJ5O5FY4ZFWZ7IGFI7DI3H2Z3A, seg_pos={0 0}, upload=298241]: Uploading piece... Oct 7 16:26:38.668684918 (338h55m24.130777401s) [noise=true , address=145.79.227.7:4293 , piece_id=NCI3DWVV37VOFEOBHXLVFWL2XUNI34RRK6BOZHDCQZQW2SC5OZLQ, seg_pos={0 0}, upload=298241]: Uploading piece... Oct 7 16:26:38.668761283 (338h55m24.130853766s) [noise=true , address=77.90.31.16:4734 , piece_id=DHGHLEGOKZSHERPIPCLCOBFAUQEKZASQX2AL6MZ6TLX2ZMEBWXBA, seg_pos={0 0}, upload=298241]: Uploading piece... Oct 7 16:26:38.669034924 (338h55m24.131127407s) [noise=true , address=145.79.227.4:4186 , piece_id=CIMST7JGJSL73ZU56SIMCD3HFZMXVBMBSBL47X4ADSYSZK45OFUQ, seg_pos={0 0}, upload=298241]: Uploading piece... Oct 7 16:26:38.669322612 (338h55m24.131415095s) [noise=true , address=45.91.116.8:4048 , piece_id=IDXCB2TE4KYVF5H6SYW6KI7RXIHWL2J4H3BPBPJQBUNSF5XG2OXQ, seg_pos={0 0}, upload=298241]: Uploading piece... Oct 7 16:26:38.669663030 (338h55m24.131755503s) [noise=true , address=45.91.116.14:4189 , piece_id=UPIDZZ2VMFPUISIE2YECH6TV7CPP3NUCCSAWT4APKYPVEZMHHZZA, seg_pos={0 0}, upload=298241]: Uploading piece... Oct 7 16:26:38.669785664 (338h55m24.131878147s) [noise=true , address=145.79.227.16:4910 , piece_id=ZOELL3EWM4Q5R5IS32ZFK64K5TZKFE4TSOKC5ZPUPHDHJJ7RBQNA, seg_pos={0 0}, upload=298241]: Uploading piece... Oct 7 16:26:40.426913142 (338h55m25.889005625s) [upload=298241]: Next returned nil segment Oct 7 16:26:40.426957586 (338h55m25.889050069s) [upload=298241]: Waiting for error group managing segments... Oct 7 16:26:40.768647880 (338h55m26.230740363s) [noise=true , address=45.91.116.8:4048 , piece_id=IDXCB2TE4KYVF5H6SYW6KI7RXIHWL2J4H3BPBPJQBUNSF5XG2OXQ, seg_pos={0 0}, upload=298241]: Done uploading piece. err: <nil> Oct 7 16:26:40.820169717 (338h55m26.2822622s) [noise=true , address=77.90.31.16:4734 , piece_id=DHGHLEGOKZSHERPIPCLCOBFAUQEKZASQX2AL6MZ6TLX2ZMEBWXBA, seg_pos={0 0}, upload=298241]: Done uploading piece. err: <nil> Oct 7 16:26:40.833848134 (338h55m26.295940617s) [noise=true , address=45.91.116.4:4938 , piece_id=RDYH54A6DRU7URRFUQAPTTARN6XZ4HETTU246OVIVIDSXWOOTJBQ, seg_pos={0 0}, upload=298241]: Done uploading piece. err: <nil> Oct 7 16:26:40.834080316 (338h55m26.296172799s) [noise=true , address=45.91.116.12:4226 , piece_id=7ZTZGDBYREUBJJZTMSTACX2KRE2XCWYFHER44WI2WLTO2MX2U5QA, seg_pos={0 0}, upload=298241]: Done uploading piece. err: <nil> Oct 7 16:26:40.846457705 (338h55m26.308550178s) [noise=true , address=45.91.116.10:4083 , piece_id=DSZA4YY2PAZXRALVMBNV2XURU2FSAH5FWK7IPHZ4H2KM4C5SMTGQ, seg_pos={0 0}, upload=298241]: Done uploading piece. err: <nil> Oct 7 16:26:40.864470214 (338h55m26.326562687s) [noise=true , address=45.91.116.12:4225 , piece_id=5LVOD66GAUR2G5RDHXIUSMNHRMZQ7OPVOQKKWFTRPM6QD3JILBUQ, seg_pos={0 0}, upload=298241]: Done uploading piece. err: <nil> Oct 7 16:26:40.892841308 (338h55m26.354933791s) [noise=true , address=45.91.116.14:4189 , piece_id=UPIDZZ2VMFPUISIE2YECH6TV7CPP3NUCCSAWT4APKYPVEZMHHZZA, seg_pos={0 0}, upload=298241]: Done uploading piece. err: <nil> Oct 7 16:26:40.902707425 (338h55m26.364799898s) [noise=true , address=45.91.116.5:4297 , piece_id=RPTYZKFXRHQJWDLW6W25VCECCOKQRCGWUDT4J67KF4D37IDG4HSQ, seg_pos={0 0}, upload=298241]: Done uploading piece. err: <nil> Oct 7 16:26:40.908900337 (338h55m26.37099281s) [noise=true , address=77.90.31.10:4518 , piece_id=B6IXIITDCXVBMOR3W55LUBPYGSQW3GH3AMP7GBKAFC4HI72CHDHQ, seg_pos={0 0}, upload=298241]: Done uploading piece. err: <nil> Oct 7 16:27:05.824022905 (338h55m51.286115388s) [noise=true , address=77.90.31.10:4520 , piece_id=2J4VKP7IZT2XA5C5OYOG2233ZCISUVR2T36LYL2X7PPLWPVB443Q, seg_pos={0 0}, upload=298241]: Done uploading piece. err: <nil> Oct 7 16:27:07.699096105 (338h55m53.161188578s) [noise=true , address=145.79.227.2:4113 , piece_id=ZDXJ3NURZLHIPC5PIV4HOVDGLJGE2RQGHUVTIXBLQZWPEMEHVE6A, seg_pos={0 0}, upload=298241]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: write tcp 188.166.225.170:38848->145.79.227.2:4113: use of closed network connection; write tcp 188.166.225.170:38848->145.79.227.2:4113: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38848->145.79.227.2:4113: use of closed network connection Oct 7 16:27:07.699221073 (338h55m53.161313546s) [noise=true , address=145.79.227.16:4910 , piece_id=ZOELL3EWM4Q5R5IS32ZFK64K5TZKFE4TSOKC5ZPUPHDHJJ7RBQNA, seg_pos={0 0}, upload=298241]: Done uploading piece. err: ecclient: upload failed (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn, address:145.79.227.16:4910): protocol: write tcp 188.166.225.170:36358->145.79.227.16:4910: use of closed network connection; write tcp 188.166.225.170:36358->145.79.227.16:4910: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36358->145.79.227.16:4910: use of closed network connection Oct 7 16:27:07.699477131 (338h55m53.161569614s) [noise=true , address=145.79.227.7:4293 , piece_id=NCI3DWVV37VOFEOBHXLVFWL2XUNI34RRK6BOZHDCQZQW2SC5OZLQ, seg_pos={0 0}, upload=298241]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 188.166.225.170:56006->145.79.227.7:4293: use of closed network connection; write tcp 188.166.225.170:56006->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56006->145.79.227.7:4293: use of closed network connection Oct 7 16:27:07.699947436 (338h55m53.162039919s) [noise=true , address=145.79.227.2:4114 , piece_id=4NEL6IXQJG7MACSJS7AC6533QY5KFDVAOXUG7N773F23QXXCGU3Q, seg_pos={0 0}, upload=298241]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: read tcp 188.166.225.170:36294->145.79.227.2:4114: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:27:07.700140063 (338h55m53.162232546s) [noise=true , address=145.79.227.5:4222 , piece_id=TW6GOJN3QBXR7G2RVIYLPWWUE5SJ5O5FY4ZFWZ7IGFI7DI3H2Z3A, seg_pos={0 0}, upload=298241]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:51000->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:27:07.700567176 (338h55m53.162659659s) [noise=true , address=145.79.227.4:4186 , piece_id=CIMST7JGJSL73ZU56SIMCD3HFZMXVBMBSBL47X4ADSYSZK45OFUQ, seg_pos={0 0}, upload=298241]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: read tcp 188.166.225.170:50202->145.79.227.4:4186: use of closed network connection; context deadline exceeded Oct 7 16:27:07.700643892 (338h55m53.162736375s) [seg_pos={0 0}, upload=298241]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 7 16:27:07.955990571 (338h55m53.418083044s) [upload=298241]: Done uploading segments... Oct 7 16:27:07.956019747 (338h55m53.41811222s) [upload=298241]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 30.258879936s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [...................................................XXXXXXXXX] duration: 30.249898456s FAIL (2025-10-07 16:26:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== 16:26:08.198053724 (338h54m53.660146208s) [noise=true , address=145.79.227.3:4150 , piece_id=SJ6BOSWXP3PLA3TJSK6ADUVKRZIXIDDFVYNLCFDPRCIJVEBSU7QA, seg_pos={0 0}, upload=298234]: Uploading piece... Oct 7 16:26:08.198081437 (338h54m53.660173921s) [noise=true , address=45.91.116.14:4189 , piece_id=65QAJV6356IDJZZHJQF6KLUTPKDWOUEKZFNZ7WMU6UIY2NRRBHEA, seg_pos={0 0}, upload=298234]: Uploading piece... Oct 7 16:26:08.198475347 (338h54m53.66056783s) [noise=true , address=45.91.116.8:4048 , piece_id=6KN6AOOKRJ7NU44CPOEYPVOT34S4HNBKX4CBKFGMFDQRHCGKBTKQ, seg_pos={0 0}, upload=298234]: Uploading piece... Oct 7 16:26:08.198493612 (338h54m53.660586096s) [noise=true , address=145.79.227.14:4838 , piece_id=IZHWQ5Q3DXQUCJO55F6THBJTZB3ECCF74O76JR53MAJ2IIRBPABA, seg_pos={0 0}, upload=298234]: Uploading piece... Oct 7 16:26:08.198889666 (338h54m53.660982149s) [noise=true , address=77.90.31.15:4699 , piece_id=4P5OY3UOLD4CCFXOROLZR3BGD5VI45JRY5BJAXT4HGZD54E2UWVA, seg_pos={0 0}, upload=298234]: Uploading piece... Oct 7 16:26:08.198914193 (338h54m53.661006676s) [noise=true , address=145.79.227.13:4803 , piece_id=76VJ5OSG2WYI6H42FPPCY7OMPLDUERQB4TJWLSOHIA6AAQ3UCCKQ, seg_pos={0 0}, upload=298234]: Uploading piece... Oct 7 16:26:08.199291622 (338h54m53.661384105s) [noise=true , address=145.79.227.13:4804 , piece_id=Y4VHNBNF23DUE32DKJ6YJQYYWSXTUTYO3INRBHYJVU4HXD754DSA, seg_pos={0 0}, upload=298234]: Uploading piece... Oct 7 16:26:08.199340845 (338h54m53.661433328s) [noise=true , address=145.79.227.2:4113 , piece_id=QM5UNBQAHNINTTDRUHUIUK5NJQ22FIOSCBNSGCZWZSX6PQSZ4ZTA, seg_pos={0 0}, upload=298234]: Uploading piece... Oct 7 16:26:08.199711612 (338h54m53.661804095s) [noise=true , address=145.79.227.19:4078 , piece_id=SMIXAPJ6MNIGZ27ACXR5ICJT6TW3JI7PYAIVAUMMGEAFLZ75Z7OQ, seg_pos={0 0}, upload=298234]: Uploading piece... Oct 7 16:26:08.199717713 (338h54m53.661810186s) [noise=true , address=145.79.227.4:4187 , piece_id=EKPWQM75HOCBDZK42WQ3CWHSEP3NEHQTXCCV65B56735Q5YT3MAQ, seg_pos={0 0}, upload=298234]: Uploading piece... Oct 7 16:26:08.200115170 (338h54m53.662207643s) [noise=true , address=145.79.227.15:4876 , piece_id=DL35VB2HEBMFDDVE7WYNJWONTABXDVMG3PIR3TXTWHKXKESEIGMQ, seg_pos={0 0}, upload=298234]: Uploading piece... Oct 7 16:26:08.200126712 (338h54m53.662219185s) [noise=true , address=45.91.116.4:4939 , piece_id=K7I6W62JMZLA53FKAVZ5TCYXLXOTD3DOVCKVORULNTDPFWZWUTPQ, seg_pos={0 0}, upload=298234]: Uploading piece... Oct 7 16:26:08.200528487 (338h54m53.66262098s) [noise=true , address=145.79.227.14:4840 , piece_id=2DMDEBHIQCA7GHNX4H6ECA7KQTWEG6WVIMRL5YVUTZFE2G6FF6JQ, seg_pos={0 0}, upload=298234]: Uploading piece... Oct 7 16:26:09.985609054 (338h54m55.447701537s) [upload=298234]: Next returned nil segment Oct 7 16:26:09.985631517 (338h54m55.447724s) [upload=298234]: Waiting for error group managing segments... Oct 7 16:26:10.319338980 (338h54m55.781431463s) [noise=true , address=77.90.31.12:4589 , piece_id=DZA6AY473MS5ZBLBDUI2WJJZNTVQDOPRHWP6NQTW2ITC2JJREJAQ, seg_pos={0 0}, upload=298234]: Done uploading piece. err: <nil> Oct 7 16:26:10.323460137 (338h54m55.78555262s) [noise=true , address=45.91.116.4:4939 , piece_id=K7I6W62JMZLA53FKAVZ5TCYXLXOTD3DOVCKVORULNTDPFWZWUTPQ, seg_pos={0 0}, upload=298234]: Done uploading piece. err: <nil> Oct 7 16:26:10.343692153 (338h54m55.805784636s) [noise=true , address=77.90.31.15:4699 , piece_id=4P5OY3UOLD4CCFXOROLZR3BGD5VI45JRY5BJAXT4HGZD54E2UWVA, seg_pos={0 0}, upload=298234]: Done uploading piece. err: <nil> Oct 7 16:26:10.366403250 (338h54m55.828495733s) [noise=true , address=45.91.116.9:4263 , piece_id=VPCUGTLTSMGW2PE5M7A3YBDC4IEEJAYMSKYZFOTLYSXO36424RPQ, seg_pos={0 0}, upload=298234]: Done uploading piece. err: <nil> Oct 7 16:26:10.374085729 (338h54m55.836178212s) [noise=true , address=45.91.116.14:4189 , piece_id=65QAJV6356IDJZZHJQF6KLUTPKDWOUEKZFNZ7WMU6UIY2NRRBHEA, seg_pos={0 0}, upload=298234]: Done uploading piece. err: <nil> Oct 7 16:26:10.424927771 (338h54m55.887020244s) [noise=true , address=45.91.116.8:4048 , piece_id=6KN6AOOKRJ7NU44CPOEYPVOT34S4HNBKX4CBKFGMFDQRHCGKBTKQ, seg_pos={0 0}, upload=298234]: Done uploading piece. err: <nil> Oct 7 16:26:37.230603194 (338h55m22.692695677s) [noise=true , address=145.79.227.3:4151 , piece_id=UVJFMPF6HWEA2IPD3JRBBHUD2K6LYITKLGXZ2NWI6D2NOERCH3WQ, seg_pos={0 0}, upload=298234]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:47044->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:47044->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47044->145.79.227.3:4151: use of closed network connection Oct 7 16:26:37.230925870 (338h55m22.693018343s) [noise=true , address=145.79.227.13:4804 , piece_id=Y4VHNBNF23DUE32DKJ6YJQYYWSXTUTYO3INRBHYJVU4HXD754DSA, seg_pos={0 0}, upload=298234]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: write tcp 188.166.225.170:57348->145.79.227.13:4804: use of closed network connection; write tcp 188.166.225.170:57348->145.79.227.13:4804: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57348->145.79.227.13:4804: use of closed network connection Oct 7 16:26:37.230986544 (338h55m22.693079017s) [noise=true , address=145.79.227.2:4113 , piece_id=QM5UNBQAHNINTTDRUHUIUK5NJQ22FIOSCBNSGCZWZSX6PQSZ4ZTA, seg_pos={0 0}, upload=298234]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: write tcp 188.166.225.170:44994->145.79.227.2:4113: use of closed network connection; write tcp 188.166.225.170:44994->145.79.227.2:4113: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44994->145.79.227.2:4113: use of closed network connection Oct 7 16:26:37.231041129 (338h55m22.693133602s) [noise=true , address=145.79.227.15:4876 , piece_id=DL35VB2HEBMFDDVE7WYNJWONTABXDVMG3PIR3TXTWHKXKESEIGMQ, seg_pos={0 0}, upload=298234]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: write tcp 188.166.225.170:39050->145.79.227.15:4876: use of closed network connection; write tcp 188.166.225.170:39050->145.79.227.15:4876: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39050->145.79.227.15:4876: use of closed network connection Oct 7 16:26:37.231211483 (338h55m22.693303956s) [noise=true , address=145.79.227.3:4150 , piece_id=SJ6BOSWXP3PLA3TJSK6ADUVKRZIXIDDFVYNLCFDPRCIJVEBSU7QA, seg_pos={0 0}, upload=298234]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: read tcp 188.166.225.170:39220->145.79.227.3:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:26:37.231289992 (338h55m22.693382465s) [noise=true , address=145.79.227.13:4803 , piece_id=76VJ5OSG2WYI6H42FPPCY7OMPLDUERQB4TJWLSOHIA6AAQ3UCCKQ, seg_pos={0 0}, upload=298234]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: read tcp 188.166.225.170:43024->145.79.227.13:4803: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:26:37.231363112 (338h55m22.693455595s) [noise=true , address=145.79.227.4:4187 , piece_id=EKPWQM75HOCBDZK42WQ3CWHSEP3NEHQTXCCV65B56735Q5YT3MAQ, seg_pos={0 0}, upload=298234]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:48624->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:26:37.231523808 (338h55m22.693616291s) [noise=true , address=145.79.227.14:4840 , piece_id=2DMDEBHIQCA7GHNX4H6ECA7KQTWEG6WVIMRL5YVUTZFE2G6FF6JQ, seg_pos={0 0}, upload=298234]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:41292->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:26:37.231599432 (338h55m22.693691905s) [noise=true , address=145.79.227.19:4078 , piece_id=SMIXAPJ6MNIGZ27ACXR5ICJT6TW3JI7PYAIVAUMMGEAFLZ75Z7OQ, seg_pos={0 0}, upload=298234]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: read tcp 188.166.225.170:37226->145.79.227.19:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:26:37.231707568 (338h55m22.693800051s) [noise=true , address=145.79.227.14:4838 , piece_id=IZHWQ5Q3DXQUCJO55F6THBJTZB3ECCF74O76JR53MAJ2IIRBPABA, seg_pos={0 0}, upload=298234]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:145.79.227.14:4838): protocol: read tcp 188.166.225.170:55598->145.79.227.14:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:26:37.231733497 (338h55m22.69382597s) [seg_pos={0 0}, upload=298234]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Oct 7 16:26:37.478839195 (338h55m22.940931678s) [upload=298234]: Done uploading segments... Oct 7 16:26:37.478873730 (338h55m22.940966223s) [upload=298234]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration: 30.249955474s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 4 out of 60 is failed (threshold=3) [........................................................XXXX] duration: 1m0.25140797s FAIL (2025-10-07 16:26:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== t 7 16:25:27.787837282 (338h54m13.249929755s) [noise=true , address=145.79.227.49:4352 , piece_id=RHYVGCTZNRW7VLMS7ILSWGH2LG5TWG2RHU2FTOGRDD4ZBSVTQVRA, seg_pos={0 0}, upload=298226]: Uploading piece... Oct 7 16:25:27.788232975 (338h54m13.250325458s) [noise=true , address=145.79.227.29:4965 , piece_id=MMKOFQMJVTNMZVGGNTY3OKVFIWPA27UVONJ2RTJC2NRCWS33WFKQ, seg_pos={0 0}, upload=298226]: Uploading piece... Oct 7 16:25:27.788534800 (338h54m13.250627273s) [noise=true , address=77.90.31.12:4602 , piece_id=6ZILS3RBFVPMH7RN4TNVXE4LG2VD6J4QU5OMNHTLWCFU5ZDAQ5XQ, seg_pos={0 0}, upload=298226]: Uploading piece... Oct 7 16:25:27.788874958 (338h54m13.250967431s) [noise=true , address=77.90.31.13:4648 , piece_id=TXGOMWB53DTINLHSCSGWVW6IMGULT563VYVSCDLNGHOSGU6E44BQ, seg_pos={0 0}, upload=298226]: Uploading piece... Oct 7 16:25:27.789321157 (338h54m13.25141363s) [noise=true , address=77.90.31.15:4707 , piece_id=DTYEWGDBR4MRICL676IJMCNTCJ3JRIJNBK7B4UOZ2G5ZTXI2INIA, seg_pos={0 0}, upload=298226]: Uploading piece... Oct 7 16:25:27.789724916 (338h54m13.251817389s) [noise=true , address=45.91.116.9:4285 , piece_id=HHXIHQHJVH4K7RLBH7K675PGL6MTQNHKU4EJGTT2YYIR242HOQQA, seg_pos={0 0}, upload=298226]: Uploading piece... Oct 7 16:25:27.789869992 (338h54m13.251962475s) [noise=true , address=145.79.227.28:4725 , piece_id=6VY2VTORB3E2TJHCYY4OY4EZHPA3TQTRGB63SVS3DWTV6BDNYBCQ, seg_pos={0 0}, upload=298226]: Uploading piece... Oct 7 16:25:27.790101583 (338h54m13.252194056s) [noise=true , address=45.91.116.13:4182 , piece_id=K4SN4DEZUMNNGK6MDWZPKXWIAAMZOXI7HRJHIPPPTULA26TGLJTA, seg_pos={0 0}, upload=298226]: Uploading piece... Oct 7 16:25:27.790252240 (338h54m13.252344723s) [noise=true , address=145.79.227.25:4620 , piece_id=WXXF2DJ5IMA3HGDI457RQFBZBIIEPD2BRLIXD4P73FJKCR2BVRFQ, seg_pos={0 0}, upload=298226]: Uploading piece... Oct 7 16:25:27.790507556 (338h54m13.25260003s) [noise=true , address=77.90.31.21:4890 , piece_id=IUOIZEIPAE56TD4362KHZBAZ7XZ23Y7EVCH4E4BA7V3AJFBH455Q, seg_pos={0 0}, upload=298226]: Uploading piece... Oct 7 16:25:27.790778332 (338h54m13.252870805s) [noise=true , address=145.79.227.40:4081 , piece_id=MLSU3VG7QIFDYSCRKYBA6AHNYQ5C6JJ65WWDMXQSML4NDY76TH7A, seg_pos={0 0}, upload=298226]: Uploading piece... Oct 7 16:25:27.791225122 (338h54m13.253317595s) [noise=true , address=77.90.31.19:4852 , piece_id=HEE4DHFSB6KTGVYMT4BWLYJ6PDLXQ4CPQJ3XF4ZIZFF5BNWFG2QQ, seg_pos={0 0}, upload=298226]: Uploading piece... Oct 7 16:25:27.791980731 (338h54m13.254073204s) [noise=true , address=145.79.227.23:4561 , piece_id=MPQDJW2T3JQKE65UEADDX37ZN7ZJZ2O3FPABT5EP25A4AXS66Y2A, seg_pos={0 0}, upload=298226]: Uploading piece... Oct 7 16:25:27.792431129 (338h54m13.254523612s) [noise=true , address=77.90.31.18:4825 , piece_id=KQAPHRQESKSTAJBWIFVWG76EM7JHQJBYOMJJY5TZLCDC4UFLYWYQ, seg_pos={0 0}, upload=298226]: Uploading piece... Oct 7 16:25:29.386892219 (338h54m14.848984703s) [upload=298226]: Next returned nil segment Oct 7 16:25:29.386912558 (338h54m14.849005041s) [upload=298226]: Waiting for error group managing segments... Oct 7 16:25:29.791136247 (338h54m15.25322872s) [noise=true , address=77.90.31.10:4534 , piece_id=CONFKV2GMQWNHGGW3BA5LEASJWGVW2JCUMEKRHKL4L3PQWP3CXEA, seg_pos={0 0}, upload=298226]: Done uploading piece. err: <nil> Oct 7 16:25:29.806265947 (338h54m15.26835843s) [noise=true , address=45.91.116.9:4285 , piece_id=HHXIHQHJVH4K7RLBH7K675PGL6MTQNHKU4EJGTT2YYIR242HOQQA, seg_pos={0 0}, upload=298226]: Done uploading piece. err: <nil> Oct 7 16:25:29.821316376 (338h54m15.283408859s) [noise=true , address=45.91.116.13:4182 , piece_id=K4SN4DEZUMNNGK6MDWZPKXWIAAMZOXI7HRJHIPPPTULA26TGLJTA, seg_pos={0 0}, upload=298226]: Done uploading piece. err: <nil> Oct 7 16:25:29.835176268 (338h54m15.297268741s) [noise=true , address=77.90.31.18:4825 , piece_id=KQAPHRQESKSTAJBWIFVWG76EM7JHQJBYOMJJY5TZLCDC4UFLYWYQ, seg_pos={0 0}, upload=298226]: Done uploading piece. err: <nil> Oct 7 16:25:29.891282866 (338h54m15.353375339s) [noise=true , address=77.90.31.21:4890 , piece_id=IUOIZEIPAE56TD4362KHZBAZ7XZ23Y7EVCH4E4BA7V3AJFBH455Q, seg_pos={0 0}, upload=298226]: Done uploading piece. err: <nil> Oct 7 16:25:29.892607518 (338h54m15.354700001s) [noise=true , address=77.90.31.19:4852 , piece_id=HEE4DHFSB6KTGVYMT4BWLYJ6PDLXQ4CPQJ3XF4ZIZFF5BNWFG2QQ, seg_pos={0 0}, upload=298226]: Done uploading piece. err: <nil> Oct 7 16:25:29.898446887 (338h54m15.360539371s) [noise=true , address=77.90.31.12:4602 , piece_id=6ZILS3RBFVPMH7RN4TNVXE4LG2VD6J4QU5OMNHTLWCFU5ZDAQ5XQ, seg_pos={0 0}, upload=298226]: Done uploading piece. err: <nil> Oct 7 16:25:29.910572918 (338h54m15.372665411s) [noise=true , address=77.90.31.15:4707 , piece_id=DTYEWGDBR4MRICL676IJMCNTCJ3JRIJNBK7B4UOZ2G5ZTXI2INIA, seg_pos={0 0}, upload=298226]: Done uploading piece. err: <nil> Oct 7 16:25:29.934050574 (338h54m15.396143047s) [noise=true , address=45.91.116.12:4250 , piece_id=UFDWNDW7OMMOD4ZVLVKTMKYB6BUQNVWRJFXZVR4ZMIKODU5GFFGQ, seg_pos={0 0}, upload=298226]: Done uploading piece. err: <nil> Oct 7 16:25:30.669876097 (338h54m16.13196858s) [noise=true , address=77.90.31.13:4648 , piece_id=TXGOMWB53DTINLHSCSGWVW6IMGULT563VYVSCDLNGHOSGU6E44BQ, seg_pos={0 0}, upload=298226]: Done uploading piece. err: <nil> Oct 7 16:26:26.796489967 (338h55m12.25858244s) [noise=true , address=145.79.227.25:4620 , piece_id=WXXF2DJ5IMA3HGDI457RQFBZBIIEPD2BRLIXD4P73FJKCR2BVRFQ, seg_pos={0 0}, upload=298226]: Done uploading piece. err: ecclient: upload failed (node:12QahNthBhqWBPgFFwAbsy5VrEuMxBkcuybmabY43sqBKKrW6ev, address:145.79.227.25:4620): protocol: write tcp 188.166.225.170:57174->145.79.227.25:4620: use of closed network connection; write tcp 188.166.225.170:57174->145.79.227.25:4620: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57174->145.79.227.25:4620: use of closed network connection Oct 7 16:26:26.796562575 (338h55m12.258655058s) [noise=true , address=145.79.227.28:4725 , piece_id=6VY2VTORB3E2TJHCYY4OY4EZHPA3TQTRGB63SVS3DWTV6BDNYBCQ, seg_pos={0 0}, upload=298226]: Done uploading piece. err: ecclient: upload failed (node:12YKLTah3swX14kL82eNogJxd8D8Hjfq7SPjDDQAapDnXmDctP1, address:145.79.227.28:4725): protocol: write tcp 188.166.225.170:36016->145.79.227.28:4725: use of closed network connection; write tcp 188.166.225.170:36016->145.79.227.28:4725: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36016->145.79.227.28:4725: use of closed network connection Oct 7 16:26:26.796684308 (338h55m12.258776801s) [noise=true , address=145.79.227.23:4561 , piece_id=MPQDJW2T3JQKE65UEADDX37ZN7ZJZ2O3FPABT5EP25A4AXS66Y2A, seg_pos={0 0}, upload=298226]: Done uploading piece. err: ecclient: upload failed (node:12NTJdWYbLU6o4MTfyp7iPzJCmWYG288BgdGSN8JDcLyYGhCSkb, address:145.79.227.23:4561): protocol: read tcp 188.166.225.170:37932->145.79.227.23:4561: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:26:26.796765622 (338h55m12.258858095s) [noise=true , address=145.79.227.49:4352 , piece_id=RHYVGCTZNRW7VLMS7ILSWGH2LG5TWG2RHU2FTOGRDD4ZBSVTQVRA, seg_pos={0 0}, upload=298226]: Done uploading piece. err: ecclient: upload failed (node:1RtYD3H9egoiNUbXsxJMWetAHYqjKGtfnGyNLSn6tbugdHaLXi, address:145.79.227.49:4352): protocol: write tcp 188.166.225.170:35974->145.79.227.49:4352: use of closed network connection; write tcp 188.166.225.170:35974->145.79.227.49:4352: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35974->145.79.227.49:4352: use of closed network connection Oct 7 16:26:26.796828282 (338h55m12.258920755s) [noise=true , address=145.79.227.32:4841 , piece_id=Y4TATWZXF3C52SDTIH222F5M64GUETLTXMCB36V4WRXZIAZYIVZA, seg_pos={0 0}, upload=298226]: Done uploading piece. err: ecclient: upload failed (node:1FKz4ioR4bYX3jEHXQAUGeJwhCxzVtXfA3kddFrb84YNpJeRQD, address:145.79.227.32:4841): protocol: read tcp 188.166.225.170:34798->145.79.227.32:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:26:26.796951215 (338h55m12.259043688s) [noise=true , address=145.79.227.20:4443 , piece_id=OTA7TPOELU4SFJGF6LETGMURPPDMCBTZYSXVV3D2LTYOEHDL6A7A, seg_pos={0 0}, upload=298226]: Done uploading piece. err: ecclient: upload failed (node:1rTVUAPUj4PUy8qHuutnB2WYCVpJdiVwfutA6UK4TZoPzvQEUv, address:145.79.227.20:4443): protocol: read tcp 188.166.225.170:33066->145.79.227.20:4443: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:26:26.797032731 (338h55m12.259125214s) [noise=true , address=145.79.227.29:4965 , piece_id=MMKOFQMJVTNMZVGGNTY3OKVFIWPA27UVONJ2RTJC2NRCWS33WFKQ, seg_pos={0 0}, upload=298226]: Done uploading piece. err: ecclient: upload failed (node:1ToFTqjRAWvpRQzf6vyHKDpforPyb4LbDGcCVhRhkwiBGKihnD, address:145.79.227.29:4965): protocol: read tcp 188.166.225.170:58624->145.79.227.29:4965: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:26:26.797051126 (338h55m12.259143609s) [noise=true , address=145.79.227.40:4081 , piece_id=MLSU3VG7QIFDYSCRKYBA6AHNYQ5C6JJ65WWDMXQSML4NDY76TH7A, seg_pos={0 0}, upload=298226]: Done uploading piece. err: ecclient: upload failed (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF, address:145.79.227.40:4081): protocol: read tcp 188.166.225.170:53664->145.79.227.40:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:26:26.797078508 (338h55m12.259170991s) [seg_pos={0 0}, upload=298226]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:26:27.046376981 (338h55m12.508469454s) [upload=298226]: Done uploading segments... Oct 7 16:26:27.046404813 (338h55m12.508497286s) [upload=298226]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 1m0.251423579s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [....................................................XXXXXXXX] duration: 30.249948256s FAIL (2025-10-07 16:25:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== 8h54m2.642179067s) [seg_pos={0 0}, upload=298221]: Done begin upload segment. Oct 7 16:25:17.180121310 (338h54m2.642213793s) [noise=true , address=77.90.31.19:4841 , piece_id=LZ72WCGNPPXTPUQXMORGAFD6QA4IWYWCWXEK2KYQJ2E6SX4Z233Q, seg_pos={0 0}, upload=298221]: Uploading piece... Oct 7 16:25:17.180189430 (338h54m2.642281903s) [noise=true , address=145.79.227.7:4295 , piece_id=QQPI5OUBDAND7JZS6QTQDHWSTCY7PMZ7XMMHFVTX2OTFSQWGXHDA, seg_pos={0 0}, upload=298221]: Uploading piece... Oct 7 16:25:17.180655386 (338h54m2.64274787s) [noise=true , address=45.91.116.12:4226 , piece_id=IJOJJCNH64NPZ67IIZQPYNWJ37PBCRYAGKSEUH35PKSEED3ULT3A, seg_pos={0 0}, upload=298221]: Uploading piece... Oct 7 16:25:17.181038596 (338h54m2.643131079s) [noise=true , address=145.79.227.19:4077 , piece_id=7NKMCV2ADI3E66CXGEKT5KDLGEEPTHW5VBWUJIIWAPQMHFWUONAA, seg_pos={0 0}, upload=298221]: Uploading piece... Oct 7 16:25:17.181555501 (338h54m2.643647984s) [noise=true , address=45.91.116.11:4118 , piece_id=N6LP3DBLWXRFACZLSCRZRUKINRRZ4LF6OHPCHASKO72HAL7DR5SA, seg_pos={0 0}, upload=298221]: Uploading piece... Oct 7 16:25:17.182015566 (338h54m2.644108039s) [noise=true , address=145.79.227.5:4222 , piece_id=APOU4SGNXBISLPSKG6HTBEQ35XASWNXA6CM6XUNMFM3EORHHHC3Q, seg_pos={0 0}, upload=298221]: Uploading piece... Oct 7 16:25:17.182437850 (338h54m2.644530333s) [noise=true , address=45.91.116.5:4299 , piece_id=QGQFYOVIUBQ4FOZSEJFV5NV4AW4D2I5W6UQCFHFUINGY6KM2HPSA, seg_pos={0 0}, upload=298221]: Uploading piece... Oct 7 16:25:17.182852750 (338h54m2.644945234s) [noise=true , address=145.79.227.17:4969 , piece_id=CPIFDPHVLERGX4DR54ON3AIHOWSRQJZ3SLELULCBR3PM5VPWCW5Q, seg_pos={0 0}, upload=298221]: Uploading piece... Oct 7 16:25:17.182863061 (338h54m2.644955544s) [noise=true , address=145.79.227.6:4259 , piece_id=ZDK2HVUCH5RRIBVNEMUNJMD5DGEWX3JJCVYCGXIXYB2YIXXPUBVQ, seg_pos={0 0}, upload=298221]: Uploading piece... Oct 7 16:25:17.183327825 (338h54m2.645420309s) [noise=true , address=45.91.116.13:4154 , piece_id=CUAARYBQFIVP6DKGLWA3OR5EFUXBOW7KFT6EPZVHJ2VSYITD5B7Q, seg_pos={0 0}, upload=298221]: Uploading piece... Oct 7 16:25:17.183346431 (338h54m2.645438914s) [noise=true , address=45.91.116.14:4190 , piece_id=OE3ZXNPPDWHLWIU6PVCIO5GW2CN2LXLG6VJWWRGVHMQRQTVHRUIQ, seg_pos={0 0}, upload=298221]: Uploading piece... Oct 7 16:25:17.183786038 (338h54m2.645878521s) [noise=true , address=77.90.31.15:4697 , piece_id=ALFYXGND2UEEU2HR4IFSCKNU76BVP2J6JQ57BC4MDA7YSBS4HRFQ, seg_pos={0 0}, upload=298221]: Uploading piece... Oct 7 16:25:17.184210065 (338h54m2.646302548s) [noise=true , address=145.79.227.2:4113 , piece_id=HAGHJ4QKQ2VORAXVCT6Q76XUCEDIBWLMDGTKPWC5PQ3B7UQGBIPA, seg_pos={0 0}, upload=298221]: Uploading piece... Oct 7 16:25:17.184660843 (338h54m2.646753437s) [noise=true , address=145.79.227.5:4223 , piece_id=HSOBSVC4PU6YDJ2BQWO3OGU4LLHTP5HNJMT4LQ3T2BYYFRV5FBCQ, seg_pos={0 0}, upload=298221]: Uploading piece... Oct 7 16:25:17.185125619 (338h54m2.647218102s) [noise=true , address=145.79.227.16:4910 , piece_id=F5XEMCQOYGZKEIQ7OZWA4YWBX4DYLP3OXADBE5KF4EMTMVBBG6VA, seg_pos={0 0}, upload=298221]: Uploading piece... Oct 7 16:25:17.186295606 (338h54m2.648388109s) [noise=true , address=145.79.227.13:4804 , piece_id=IPRWP5VUEHSBKCT623GCNZRGPTVB5GZ25PBWSKCRPOB6WQMTHRYA, seg_pos={0 0}, upload=298221]: Uploading piece... Oct 7 16:25:18.988940400 (338h54m4.451032873s) [upload=298221]: Next returned nil segment Oct 7 16:25:18.988962251 (338h54m4.451054724s) [upload=298221]: Waiting for error group managing segments... Oct 7 16:25:19.277964778 (338h54m4.740057261s) [noise=true , address=45.91.116.11:4118 , piece_id=N6LP3DBLWXRFACZLSCRZRUKINRRZ4LF6OHPCHASKO72HAL7DR5SA, seg_pos={0 0}, upload=298221]: Done uploading piece. err: <nil> Oct 7 16:25:19.299738539 (338h54m4.761831022s) [noise=true , address=77.90.31.15:4697 , piece_id=ALFYXGND2UEEU2HR4IFSCKNU76BVP2J6JQ57BC4MDA7YSBS4HRFQ, seg_pos={0 0}, upload=298221]: Done uploading piece. err: <nil> Oct 7 16:25:19.317074800 (338h54m4.779167283s) [noise=true , address=45.91.116.14:4190 , piece_id=OE3ZXNPPDWHLWIU6PVCIO5GW2CN2LXLG6VJWWRGVHMQRQTVHRUIQ, seg_pos={0 0}, upload=298221]: Done uploading piece. err: <nil> Oct 7 16:25:19.334234095 (338h54m4.796326578s) [noise=true , address=45.91.116.12:4226 , piece_id=IJOJJCNH64NPZ67IIZQPYNWJ37PBCRYAGKSEUH35PKSEED3ULT3A, seg_pos={0 0}, upload=298221]: Done uploading piece. err: <nil> Oct 7 16:25:19.386312191 (338h54m4.848404674s) [noise=true , address=77.90.31.19:4841 , piece_id=LZ72WCGNPPXTPUQXMORGAFD6QA4IWYWCWXEK2KYQJ2E6SX4Z233Q, seg_pos={0 0}, upload=298221]: Done uploading piece. err: <nil> Oct 7 16:25:19.406878033 (338h54m4.868970517s) [noise=true , address=45.91.116.5:4299 , piece_id=QGQFYOVIUBQ4FOZSEJFV5NV4AW4D2I5W6UQCFHFUINGY6KM2HPSA, seg_pos={0 0}, upload=298221]: Done uploading piece. err: <nil> Oct 7 16:25:19.489449806 (338h54m4.951542289s) [noise=true , address=45.91.116.13:4154 , piece_id=CUAARYBQFIVP6DKGLWA3OR5EFUXBOW7KFT6EPZVHJ2VSYITD5B7Q, seg_pos={0 0}, upload=298221]: Done uploading piece. err: <nil> Oct 7 16:25:46.203939367 (338h54m31.66603185s) [noise=true , address=145.79.227.16:4910 , piece_id=F5XEMCQOYGZKEIQ7OZWA4YWBX4DYLP3OXADBE5KF4EMTMVBBG6VA, seg_pos={0 0}, upload=298221]: Done uploading piece. err: ecclient: upload failed (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn, address:145.79.227.16:4910): protocol: write tcp 188.166.225.170:59166->145.79.227.16:4910: use of closed network connection; write tcp 188.166.225.170:59166->145.79.227.16:4910: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59166->145.79.227.16:4910: use of closed network connection Oct 7 16:25:46.204168414 (338h54m31.666260887s) [noise=true , address=145.79.227.6:4259 , piece_id=ZDK2HVUCH5RRIBVNEMUNJMD5DGEWX3JJCVYCGXIXYB2YIXXPUBVQ, seg_pos={0 0}, upload=298221]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:49526->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:25:46.204262413 (338h54m31.666354886s) [noise=true , address=145.79.227.5:4223 , piece_id=HSOBSVC4PU6YDJ2BQWO3OGU4LLHTP5HNJMT4LQ3T2BYYFRV5FBCQ, seg_pos={0 0}, upload=298221]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:38382->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:25:46.204360360 (338h54m31.666452843s) [noise=true , address=145.79.227.2:4113 , piece_id=HAGHJ4QKQ2VORAXVCT6Q76XUCEDIBWLMDGTKPWC5PQ3B7UQGBIPA, seg_pos={0 0}, upload=298221]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: read tcp 188.166.225.170:40506->145.79.227.2:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:25:46.204492611 (338h54m31.666585094s) [noise=true , address=145.79.227.13:4804 , piece_id=IPRWP5VUEHSBKCT623GCNZRGPTVB5GZ25PBWSKCRPOB6WQMTHRYA, seg_pos={0 0}, upload=298221]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: read tcp 188.166.225.170:52984->145.79.227.13:4804: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:25:46.204583064 (338h54m31.666675547s) [noise=true , address=145.79.227.7:4295 , piece_id=QQPI5OUBDAND7JZS6QTQDHWSTCY7PMZ7XMMHFVTX2OTFSQWGXHDA, seg_pos={0 0}, upload=298221]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: read tcp 188.166.225.170:60876->145.79.227.7:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:25:46.204671682 (338h54m31.666764155s) [noise=true , address=145.79.227.19:4077 , piece_id=7NKMCV2ADI3E66CXGEKT5KDLGEEPTHW5VBWUJIIWAPQMHFWUONAA, seg_pos={0 0}, upload=298221]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: read tcp 188.166.225.170:33430->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:25:46.204768466 (338h54m31.666860939s) [noise=true , address=145.79.227.5:4222 , piece_id=APOU4SGNXBISLPSKG6HTBEQ35XASWNXA6CM6XUNMFM3EORHHHC3Q, seg_pos={0 0}, upload=298221]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:33284->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:25:46.204861594 (338h54m31.666954067s) [noise=true , address=145.79.227.17:4969 , piece_id=CPIFDPHVLERGX4DR54ON3AIHOWSRQJZ3SLELULCBR3PM5VPWCW5Q, seg_pos={0 0}, upload=298221]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: read tcp 188.166.225.170:43244->145.79.227.17:4969: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:25:46.204885640 (338h54m31.666978123s) [seg_pos={0 0}, upload=298221]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Oct 7 16:25:46.452298782 (338h54m31.914391265s) [upload=298221]: Done uploading segments... Oct 7 16:25:46.452334430 (338h54m31.914426903s) [upload=298221]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 30.249976099s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 1m0.259213946s FAIL (2025-10-07 16:25:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 80229632s) [noise=true , address=77.90.31.18:4817 , piece_id=JSTCHNV5OTJUYSU3P5DX44TZA3HWC4XNM2FGERLPCAEP6RGDPOZA, seg_pos={0 0}, upload=298209]: Uploading piece... Oct 7 16:24:27.318145144 (338h53m12.780237618s) [noise=true , address=145.79.227.28:4731 , piece_id=CVFUIDZESH67IFKFAS2UZ3BDQC3OZU5ZJX4FN2LB3OSV6ZK67CUA, seg_pos={0 0}, upload=298209]: Uploading piece... Oct 7 16:24:27.318562088 (338h53m12.780654572s) [noise=true , address=77.90.31.14:4688 , piece_id=KUNA7N6IYED5Q3WQCIT2FHZVCXMLTPJ7SIUQAXJYD65I527Y3MPA, seg_pos={0 0}, upload=298209]: Uploading piece... Oct 7 16:24:27.318950628 (338h53m12.781043101s) [noise=true , address=145.79.227.25:4629 , piece_id=KV6IDUEO5WRWVP7M4P6EZUS5JW3NPLP3NZJ3OXNRAFDSPCJVQCFQ, seg_pos={0 0}, upload=298209]: Uploading piece... Oct 7 16:24:27.319266640 (338h53m12.781359123s) [noise=true , address=77.90.31.12:4599 , piece_id=AQP7WLX3KH3EQBTEMPN7SNFKDZOERJ4HW7MH7FF7TUFYRELAVLCQ, seg_pos={0 0}, upload=298209]: Uploading piece... Oct 7 16:24:27.319542104 (338h53m12.781634587s) [noise=true , address=45.91.116.8:4075 , piece_id=4X5SB6NGAEXMNTGG43BOWTA4KKHDQRP2SUK4XKP3OSWM2JJJAD3Q, seg_pos={0 0}, upload=298209]: Uploading piece... Oct 7 16:24:27.319849330 (338h53m12.781941803s) [noise=true , address=45.91.116.10:4097 , piece_id=6POGMJKORDNXSYL47V7U6I6OG4PBPZDGY6DR5SES6CONKLC644TQ, seg_pos={0 0}, upload=298209]: Uploading piece... Oct 7 16:24:27.320683408 (338h53m12.782775891s) [noise=true , address=45.91.116.9:4265 , piece_id=LXSUZPK36ERUBVVNXXWXRK6MRPIYJKITKMAIEVGX64GA2XXDTFAQ, seg_pos={0 0}, upload=298209]: Uploading piece... Oct 7 16:24:27.321038824 (338h53m12.783131307s) [noise=true , address=145.79.227.18:4012 , piece_id=NQI2KE2MKDJMPCR4GCNLNXIVQMPB7QGXCQESE3PYOLB2RZM2ULYQ, seg_pos={0 0}, upload=298209]: Uploading piece... Oct 7 16:24:27.321526102 (338h53m12.783618575s) [noise=true , address=77.90.31.10:4526 , piece_id=ROTGVYLDIG2BNXYDKXFI3BK3PKUNDIOVWJEPT2JUWHAVFOIR7C3Q, seg_pos={0 0}, upload=298209]: Uploading piece... Oct 7 16:24:27.321863183 (338h53m12.783955657s) [noise=true , address=77.90.31.21:4894 , piece_id=2AYO773X3QKEXN2W3GNNTCRICYBWECHN7C4IK7Q4GZM7P5GDVUFQ, seg_pos={0 0}, upload=298209]: Uploading piece... Oct 7 16:24:27.322147656 (338h53m12.784240139s) [noise=true , address=45.91.116.5:4317 , piece_id=OAMYBPG2YJZOQYGEXQWA3RQ7ECDS45YYNNDT5ULDD4UFYHOZENHQ, seg_pos={0 0}, upload=298209]: Uploading piece... Oct 7 16:24:27.322250622 (338h53m12.784343105s) [noise=true , address=145.79.227.30:4781 , piece_id=UGWEUMFQVVDTST3K35KDMWR325RST6ADRAIE4GJHRR3FPNJEEICQ, seg_pos={0 0}, upload=298209]: Uploading piece... Oct 7 16:24:27.322652888 (338h53m12.784745371s) [noise=true , address=77.90.31.13:4638 , piece_id=XM4UULJ2P6BF4LVWNBYURAG4YSZ4JAC72HQQ7UCPRQ4MTJGMQDZQ, seg_pos={0 0}, upload=298209]: Uploading piece... Oct 7 16:24:27.323074841 (338h53m12.785167324s) [noise=true , address=45.91.116.13:4176 , piece_id=UR6WTF2PNNIGS6FFYMKVDPRMOY5WJP3VAJM37AEJFM2ERQUYMR5A, seg_pos={0 0}, upload=298209]: Uploading piece... Oct 7 16:24:27.323447932 (338h53m12.785540405s) [noise=true , address=45.91.116.12:4238 , piece_id=E6APNLDYNJQJ3TIFL3DMUIFJGQOCGNWL6L6FC5G6FXGJKSSSXJNQ, seg_pos={0 0}, upload=298209]: Uploading piece... Oct 7 16:24:27.323839447 (338h53m12.78593194s) [noise=true , address=145.79.227.24:4609 , piece_id=SOWVXEC4CRAFFXF673UWGM6MSDZLABG6MXBHRQWGABNBSFHLA4VQ, seg_pos={0 0}, upload=298209]: Uploading piece... Oct 7 16:24:27.324196667 (338h53m12.78628914s) [noise=true , address=45.91.116.10:4092 , piece_id=3KXAQOKLBPJYF6OAVNAFOVCBYH2N3OQXRFHPKA5MKOY3COLKOPLQ, seg_pos={0 0}, upload=298209]: Uploading piece... Oct 7 16:24:28.847210419 (338h53m14.309302902s) [upload=298209]: Next returned nil segment Oct 7 16:24:28.847234634 (338h53m14.309327117s) [upload=298209]: Waiting for error group managing segments... Oct 7 16:24:29.242414152 (338h53m14.704506625s) [noise=true , address=77.90.31.18:4817 , piece_id=JSTCHNV5OTJUYSU3P5DX44TZA3HWC4XNM2FGERLPCAEP6RGDPOZA, seg_pos={0 0}, upload=298209]: Done uploading piece. err: <nil> Oct 7 16:24:29.268131102 (338h53m14.730223575s) [noise=true , address=77.90.31.12:4599 , piece_id=AQP7WLX3KH3EQBTEMPN7SNFKDZOERJ4HW7MH7FF7TUFYRELAVLCQ, seg_pos={0 0}, upload=298209]: Done uploading piece. err: <nil> Oct 7 16:24:29.278396490 (338h53m14.740488973s) [noise=true , address=77.90.31.21:4894 , piece_id=2AYO773X3QKEXN2W3GNNTCRICYBWECHN7C4IK7Q4GZM7P5GDVUFQ, seg_pos={0 0}, upload=298209]: Done uploading piece. err: <nil> Oct 7 16:24:29.291809099 (338h53m14.753901592s) [noise=true , address=45.91.116.10:4097 , piece_id=6POGMJKORDNXSYL47V7U6I6OG4PBPZDGY6DR5SES6CONKLC644TQ, seg_pos={0 0}, upload=298209]: Done uploading piece. err: <nil> Oct 7 16:24:29.310543083 (338h53m14.772635556s) [noise=true , address=77.90.31.14:4688 , piece_id=KUNA7N6IYED5Q3WQCIT2FHZVCXMLTPJ7SIUQAXJYD65I527Y3MPA, seg_pos={0 0}, upload=298209]: Done uploading piece. err: <nil> Oct 7 16:24:29.344991509 (338h53m14.807083992s) [noise=true , address=77.90.31.10:4526 , piece_id=ROTGVYLDIG2BNXYDKXFI3BK3PKUNDIOVWJEPT2JUWHAVFOIR7C3Q, seg_pos={0 0}, upload=298209]: Done uploading piece. err: <nil> Oct 7 16:24:29.345864441 (338h53m14.807956924s) [noise=true , address=45.91.116.10:4092 , piece_id=3KXAQOKLBPJYF6OAVNAFOVCBYH2N3OQXRFHPKA5MKOY3COLKOPLQ, seg_pos={0 0}, upload=298209]: Done uploading piece. err: <nil> Oct 7 16:24:29.397862164 (338h53m14.859954647s) [noise=true , address=45.91.116.13:4176 , piece_id=UR6WTF2PNNIGS6FFYMKVDPRMOY5WJP3VAJM37AEJFM2ERQUYMR5A, seg_pos={0 0}, upload=298209]: Done uploading piece. err: <nil> Oct 7 16:24:29.402681411 (338h53m14.864773894s) [noise=true , address=45.91.116.5:4317 , piece_id=OAMYBPG2YJZOQYGEXQWA3RQ7ECDS45YYNNDT5ULDD4UFYHOZENHQ, seg_pos={0 0}, upload=298209]: Done uploading piece. err: <nil> Oct 7 16:24:29.409068033 (338h53m14.871160516s) [noise=true , address=45.91.116.12:4238 , piece_id=E6APNLDYNJQJ3TIFL3DMUIFJGQOCGNWL6L6FC5G6FXGJKSSSXJNQ, seg_pos={0 0}, upload=298209]: Done uploading piece. err: <nil> Oct 7 16:24:29.410329976 (338h53m14.872422459s) [noise=true , address=45.91.116.8:4075 , piece_id=4X5SB6NGAEXMNTGG43BOWTA4KKHDQRP2SUK4XKP3OSWM2JJJAD3Q, seg_pos={0 0}, upload=298209]: Done uploading piece. err: <nil> Oct 7 16:24:29.474716931 (338h53m14.936809404s) [noise=true , address=45.91.116.9:4265 , piece_id=LXSUZPK36ERUBVVNXXWXRK6MRPIYJKITKMAIEVGX64GA2XXDTFAQ, seg_pos={0 0}, upload=298209]: Done uploading piece. err: <nil> Oct 7 16:24:29.538152624 (338h53m15.000245107s) [noise=true , address=77.90.31.13:4638 , piece_id=XM4UULJ2P6BF4LVWNBYURAG4YSZ4JAC72HQQ7UCPRQ4MTJGMQDZQ, seg_pos={0 0}, upload=298209]: Done uploading piece. err: <nil> Oct 7 16:25:26.328794294 (338h54m11.790886777s) [noise=true , address=145.79.227.24:4609 , piece_id=SOWVXEC4CRAFFXF673UWGM6MSDZLABG6MXBHRQWGABNBSFHLA4VQ, seg_pos={0 0}, upload=298209]: Done uploading piece. err: ecclient: upload failed (node:12amujuu3Q56TUCgLoyfNLK2KYvkdhWAXJSCJMD1h5hNbNsunbP, address:145.79.227.24:4609): protocol: write tcp 188.166.225.170:51806->145.79.227.24:4609: use of closed network connection; write tcp 188.166.225.170:51806->145.79.227.24:4609: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51806->145.79.227.24:4609: use of closed network connection Oct 7 16:25:26.328904594 (338h54m11.790997077s) [noise=true , address=145.79.227.28:4731 , piece_id=CVFUIDZESH67IFKFAS2UZ3BDQC3OZU5ZJX4FN2LB3OSV6ZK67CUA, seg_pos={0 0}, upload=298209]: Done uploading piece. err: ecclient: upload failed (node:12NQzTwVYQa6ZzxAHQm1apkwWnqJstTnAJQyHKhBzC2jTN9kEVK, address:145.79.227.28:4731): protocol: write tcp 188.166.225.170:59186->145.79.227.28:4731: use of closed network connection; write tcp 188.166.225.170:59186->145.79.227.28:4731: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59186->145.79.227.28:4731: use of closed network connection Oct 7 16:25:26.328983985 (338h54m11.791076468s) [noise=true , address=145.79.227.25:4629 , piece_id=KV6IDUEO5WRWVP7M4P6EZUS5JW3NPLP3NZJ3OXNRAFDSPCJVQCFQ, seg_pos={0 0}, upload=298209]: Done uploading piece. err: ecclient: upload failed (node:1uxMhTiH446Ku7h1PutqVh7fSCzwKHR7oypYBzGWELLNP7ojf6, address:145.79.227.25:4629): protocol: write tcp 188.166.225.170:42422->145.79.227.25:4629: use of closed network connection; write tcp 188.166.225.170:42422->145.79.227.25:4629: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42422->145.79.227.25:4629: use of closed network connection Oct 7 16:25:26.329336707 (338h54m11.79142921s) [noise=true , address=145.79.227.18:4012 , piece_id=NQI2KE2MKDJMPCR4GCNLNXIVQMPB7QGXCQESE3PYOLB2RZM2ULYQ, seg_pos={0 0}, upload=298209]: Done uploading piece. err: ecclient: upload failed (node:15gHkND99Ksp8TdyAbAvMUymRoLDyqvbdcy9Y3Hjhpb8zTpCHi, address:145.79.227.18:4012): protocol: read tcp 188.166.225.170:60672->145.79.227.18:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:25:26.329615257 (338h54m11.79170775s) [noise=true , address=145.79.227.30:4781 , piece_id=UGWEUMFQVVDTST3K35KDMWR325RST6ADRAIE4GJHRR3FPNJEEICQ, seg_pos={0 0}, upload=298209]: Done uploading piece. err: ecclient: upload failed (node:1QhCkTzSogXFKLmFV4wQUcALhvm9YhCSQudLxSrvQWmepheiFi, address:145.79.227.30:4781): protocol: read tcp 188.166.225.170:53292->145.79.227.30:4781: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:25:26.329646216 (338h54m11.791738699s) [seg_pos={0 0}, upload=298209]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Oct 7 16:25:26.586289585 (338h54m12.048382068s) [upload=298209]: Done uploading segments... Oct 7 16:25:26.586320073 (338h54m12.048412546s) [upload=298209]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.259240397s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [.....................................................XXXXXXX] duration: 30.260878047s FAIL (2025-10-07 16:25:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Oct 7 16:24:45.091001451 (338h53m30.553093934s) [upload=298211]: Starting upload Oct 7 16:24:45.091096282 (338h53m30.553188765s) [upload=298211]: Done starting upload Oct 7 16:24:45.091377938 (338h53m30.553470431s) [upload=298211]: Uploading segments... Oct 7 16:24:45.091425930 (338h53m30.553518423s) [upload=298211]: Got next segment. Inline: false Oct 7 16:24:45.091459684 (338h53m30.553552167s) [upload=298211]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 16:24:45.091465555 (338h53m30.553558038s) [upload=298211]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 16:24:45.355651555 (338h53m30.817744028s) [seg_pos={0 0}, upload=298211]: Begin upload segment... Oct 7 16:24:45.355718733 (338h53m30.817811216s) [seg_pos={0 0}, upload=298211]: Done begin upload segment. Oct 7 16:24:45.355774219 (338h53m30.817866702s) [noise=true , address=45.91.116.9:4262 , piece_id=ZB3IWJRKDICCFXCUN54WMSMG3UR244GQBP22AULJZQWTMYEOLSDQ, seg_pos={0 0}, upload=298211]: Uploading piece... Oct 7 16:24:45.355883266 (338h53m30.817975749s) [noise=true , address=45.91.116.4:4939 , piece_id=LJ5MD5M6FNUUQZQU3AY5S4I2C5NWFH5YUWTZV2UR6SS6V3BCMPBQ, seg_pos={0 0}, upload=298211]: Uploading piece... Oct 7 16:24:45.355911791 (338h53m30.818004304s) [noise=true , address=145.79.227.2:4115 , piece_id=ROVRVWASFS64RWD5UH5UNWRTSYD4PJIZWNLCY22DBT36K6FCO43A, seg_pos={0 0}, upload=298211]: Uploading piece... Oct 7 16:24:45.356491665 (338h53m30.818584148s) [noise=true , address=45.91.116.14:4191 , piece_id=NVWBXBR3BNM3OWX7EMRFZITBPYWQD22N2VCELXFPODRT3JNTDYIQ, seg_pos={0 0}, upload=298211]: Uploading piece... Oct 7 16:24:45.356884162 (338h53m30.818976645s) [noise=true , address=45.91.116.13:4155 , piece_id=GWRSIQE3HHU4NQEERGHS4OSAJB6G52CP6FC5VUBA6ZK6WKBLQQZA, seg_pos={0 0}, upload=298211]: Uploading piece... Oct 7 16:24:45.357474807 (338h53m30.81956729s) [noise=true , address=45.91.116.11:4118 , piece_id=RU3OBMSX37NLKG5KI5WXE6NYLIMPSBYTLMFRK32CMATZWQLHNHMA, seg_pos={0 0}, upload=298211]: Uploading piece... Oct 7 16:24:45.357955362 (338h53m30.820047845s) [noise=true , address=77.90.31.15:4698 , piece_id=NQYPOBL4OXJQUNHDNTNPXWUXI2PIXAKTL32HC7OPKKGFR47R7PFQ, seg_pos={0 0}, upload=298211]: Uploading piece... Oct 7 16:24:45.358376434 (338h53m30.820468917s) [noise=true , address=145.79.227.16:4910 , piece_id=UXX47ZWEQXNDLK2J6P57VBWVJVWMSIGN4BBETRUV6CHTZTIYWLKQ, seg_pos={0 0}, upload=298211]: Uploading piece... Oct 7 16:24:45.358863191 (338h53m30.820955674s) [noise=true , address=145.79.227.17:4969 , piece_id=KGYU7KUL5G7WXALORZVAKUF4SBES6GDUCNEUL5VWCLPXWVWUGIOQ, seg_pos={0 0}, upload=298211]: Uploading piece... Oct 7 16:24:45.359927948 (338h53m30.822020421s) [noise=true , address=145.79.227.12:4767 , piece_id=SKOXMHTUL7DN47GCCQGUSDLULAW44CRY7Y2LFI5BRQI6TZOVBI4A, seg_pos={0 0}, upload=298211]: Uploading piece... Oct 7 16:24:45.360325906 (338h53m30.822418389s) [noise=true , address=145.79.227.3:4150 , piece_id=D2EHYKU4DXI3MRTT4MQY7355T66T7IXFON56SKJTR2TVVGCIO7XA, seg_pos={0 0}, upload=298211]: Uploading piece... Oct 7 16:24:45.361319137 (338h53m30.82341162s) [noise=true , address=45.91.116.4:4940 , piece_id=T63C3HTQXMHIR6CV52CPQGIN63GP4NQXBQAFTFOQDJQYQC67DL3Q, seg_pos={0 0}, upload=298211]: Uploading piece... Oct 7 16:24:45.366746291 (338h53m30.828838764s) [noise=true , address=45.91.116.6:4975 , piece_id=D62DFXRJ7XRWWAIJRT2JOYUNGJMDLWJCPEIXXDEV2ZSRDNEOFZWQ, seg_pos={0 0}, upload=298211]: Uploading piece... Oct 7 16:24:45.368243532 (338h53m30.830336015s) [noise=true , address=145.79.227.7:4293 , piece_id=FVVPS5QNRUMW6RZAXD3A6NDAETE4PSR3BEMJKJTQLUT6SSZBG74A, seg_pos={0 0}, upload=298211]: Uploading piece... Oct 7 16:24:45.369659048 (338h53m30.831751531s) [noise=true , address=77.90.31.13:4627 , piece_id=736YIEUIFCJEY3M5G4FEDJXUBT72BTZZFAF36K5JW3TMW6VNQQWA, seg_pos={0 0}, upload=298211]: Uploading piece... Oct 7 16:24:45.371541603 (338h53m30.833634076s) [noise=true , address=77.90.31.15:4699 , piece_id=QMFGS2NRQD5PVFTBI7LGU4D7EAES5XRJPVLVFDJLKQOVNCQQSA3Q, seg_pos={0 0}, upload=298211]: Uploading piece... Oct 7 16:24:47.066171996 (338h53m32.528264469s) [upload=298211]: Next returned nil segment Oct 7 16:24:47.066505310 (338h53m32.528597783s) [upload=298211]: Waiting for error group managing segments... Oct 7 16:24:47.441674744 (338h53m32.903767217s) [noise=true , address=45.91.116.13:4155 , piece_id=GWRSIQE3HHU4NQEERGHS4OSAJB6G52CP6FC5VUBA6ZK6WKBLQQZA, seg_pos={0 0}, upload=298211]: Done uploading piece. err: <nil> Oct 7 16:24:47.467659354 (338h53m32.929751837s) [noise=true , address=45.91.116.14:4191 , piece_id=NVWBXBR3BNM3OWX7EMRFZITBPYWQD22N2VCELXFPODRT3JNTDYIQ, seg_pos={0 0}, upload=298211]: Done uploading piece. err: <nil> Oct 7 16:24:47.478306949 (338h53m32.940399432s) [noise=true , address=45.91.116.6:4975 , piece_id=D62DFXRJ7XRWWAIJRT2JOYUNGJMDLWJCPEIXXDEV2ZSRDNEOFZWQ, seg_pos={0 0}, upload=298211]: Done uploading piece. err: <nil> Oct 7 16:24:47.543283036 (338h53m33.005375519s) [noise=true , address=45.91.116.4:4940 , piece_id=T63C3HTQXMHIR6CV52CPQGIN63GP4NQXBQAFTFOQDJQYQC67DL3Q, seg_pos={0 0}, upload=298211]: Done uploading piece. err: <nil> Oct 7 16:24:47.551719380 (338h53m33.013811863s) [noise=true , address=45.91.116.11:4118 , piece_id=RU3OBMSX37NLKG5KI5WXE6NYLIMPSBYTLMFRK32CMATZWQLHNHMA, seg_pos={0 0}, upload=298211]: Done uploading piece. err: <nil> Oct 7 16:24:47.590342697 (338h53m33.05243518s) [noise=true , address=77.90.31.15:4699 , piece_id=QMFGS2NRQD5PVFTBI7LGU4D7EAES5XRJPVLVFDJLKQOVNCQQSA3Q, seg_pos={0 0}, upload=298211]: Done uploading piece. err: <nil> Oct 7 16:24:47.624444062 (338h53m33.086536545s) [noise=true , address=77.90.31.15:4698 , piece_id=NQYPOBL4OXJQUNHDNTNPXWUXI2PIXAKTL32HC7OPKKGFR47R7PFQ, seg_pos={0 0}, upload=298211]: Done uploading piece. err: <nil> Oct 7 16:24:47.650411228 (338h53m33.112503711s) [noise=true , address=77.90.31.13:4627 , piece_id=736YIEUIFCJEY3M5G4FEDJXUBT72BTZZFAF36K5JW3TMW6VNQQWA, seg_pos={0 0}, upload=298211]: Done uploading piece. err: <nil> Oct 7 16:24:47.723895116 (338h53m33.185987609s) [noise=true , address=45.91.116.9:4262 , piece_id=ZB3IWJRKDICCFXCUN54WMSMG3UR244GQBP22AULJZQWTMYEOLSDQ, seg_pos={0 0}, upload=298211]: Done uploading piece. err: <nil> Oct 7 16:24:49.090023288 (338h53m34.552115761s) [noise=true , address=45.91.116.4:4939 , piece_id=LJ5MD5M6FNUUQZQU3AY5S4I2C5NWFH5YUWTZV2UR6SS6V3BCMPBQ, seg_pos={0 0}, upload=298211]: Done uploading piece. err: <nil> Oct 7 16:25:14.347657155 (338h53m59.809749628s) [noise=true , address=145.79.227.17:4969 , piece_id=KGYU7KUL5G7WXALORZVAKUF4SBES6GDUCNEUL5VWCLPXWVWUGIOQ, seg_pos={0 0}, upload=298211]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: write tcp 188.166.225.170:54752->145.79.227.17:4969: use of closed network connection; write tcp 188.166.225.170:54752->145.79.227.17:4969: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54752->145.79.227.17:4969: use of closed network connection Oct 7 16:25:14.347875520 (338h53m59.809967993s) [noise=true , address=145.79.227.16:4910 , piece_id=UXX47ZWEQXNDLK2J6P57VBWVJVWMSIGN4BBETRUV6CHTZTIYWLKQ, seg_pos={0 0}, upload=298211]: Done uploading piece. err: ecclient: upload failed (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn, address:145.79.227.16:4910): protocol: read tcp 188.166.225.170:36466->145.79.227.16:4910: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:25:14.348014274 (338h53m59.810106758s) [noise=true , address=145.79.227.12:4767 , piece_id=SKOXMHTUL7DN47GCCQGUSDLULAW44CRY7Y2LFI5BRQI6TZOVBI4A, seg_pos={0 0}, upload=298211]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: read tcp 188.166.225.170:56946->145.79.227.12:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:25:14.348241647 (338h53m59.81033414s) [noise=true , address=145.79.227.7:4293 , piece_id=FVVPS5QNRUMW6RZAXD3A6NDAETE4PSR3BEMJKJTQLUT6SSZBG74A, seg_pos={0 0}, upload=298211]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: read tcp 188.166.225.170:58402->145.79.227.7:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:25:14.348418413 (338h53m59.810510907s) [noise=true , address=145.79.227.3:4150 , piece_id=D2EHYKU4DXI3MRTT4MQY7355T66T7IXFON56SKJTR2TVVGCIO7XA, seg_pos={0 0}, upload=298211]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: read tcp 188.166.225.170:37964->145.79.227.3:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:25:14.348548511 (338h53m59.810640994s) [noise=true , address=145.79.227.2:4115 , piece_id=ROVRVWASFS64RWD5UH5UNWRTSYD4PJIZWNLCY22DBT36K6FCO43A, seg_pos={0 0}, upload=298211]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 188.166.225.170:45410->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:25:14.348575393 (338h53m59.810667876s) [seg_pos={0 0}, upload=298211]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 7 16:25:14.606946482 (338h54m0.069038975s) [upload=298211]: Done uploading segments... Oct 7 16:25:14.606980366 (338h54m0.069072849s) [upload=298211]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 30.260895018s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [......................................................XXXXXX] duration: 30.28103406s FAIL (2025-10-07 16:24:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== 33Q5EGGA, seg_pos={0 0}, upload=298206]: Uploading piece... Oct 7 16:24:14.911347147 (338h53m0.37343963s) [noise=true , address=145.79.227.2:4114 , piece_id=CNFB24UZF2WXCMMQVG6GJLD26BA5W66FH2JUCMVWQUK6YCBQJGFA, seg_pos={0 0}, upload=298206]: Uploading piece... Oct 7 16:24:14.911674360 (338h53m0.373766843s) [noise=true , address=45.91.116.4:4939 , piece_id=5K47YCQI6J3RZ36MDT4BRMMMCIVX52NBFIDLRC3JRR3BYQEUHSKQ, seg_pos={0 0}, upload=298206]: Uploading piece... Oct 7 16:24:14.911997835 (338h53m0.374090318s) [noise=true , address=77.90.31.16:4735 , piece_id=XAOJ7EN75LTCI6Y6UY5SO4UGXMZYMRHCICCYOIICRL6AWKBFAE6A, seg_pos={0 0}, upload=298206]: Uploading piece... Oct 7 16:24:14.912308337 (338h53m0.37440081s) [noise=true , address=145.79.227.5:4223 , piece_id=CAFFBAYJ4TEZO7S64LIE5HXYCDRZFNX2ZNYWDGPWTNNJ6TQDJV5Q, seg_pos={0 0}, upload=298206]: Uploading piece... Oct 7 16:24:14.912649927 (338h53m0.3747424s) [noise=true , address=77.90.31.10:4520 , piece_id=EUTO6R3GRK3OKER74O6CS3N6M23V4LRAKP5Q7OKF6EUPVT6WO5NA, seg_pos={0 0}, upload=298206]: Uploading piece... Oct 7 16:24:14.913039369 (338h53m0.375131842s) [noise=true , address=45.91.116.9:4263 , piece_id=TY3WPWHWZ63WA6R7IT3SCRCN6APQYVM7V2L2ATIMKXZZ7KNPWGEA, seg_pos={0 0}, upload=298206]: Uploading piece... Oct 7 16:24:14.913588374 (338h53m0.375680857s) [noise=true , address=145.79.227.12:4767 , piece_id=AKE563UTALEJDWNBCIYSEWPCOW6GR7FR7W2CFUKGYYIVQ2S3TK6Q, seg_pos={0 0}, upload=298206]: Uploading piece... Oct 7 16:24:14.914959555 (338h53m0.377052038s) [noise=true , address=145.79.227.19:4077 , piece_id=REW3ZH57FK6CPDVAYABY2M32VLM4PY6VAEL7S4USOOIMX3YOLXSA, seg_pos={0 0}, upload=298206]: Uploading piece... Oct 7 16:24:14.916348239 (338h53m0.378440712s) [noise=true , address=77.90.31.14:4661 , piece_id=PZGGCWC2GEHIK2BZBLYB3POC7BL56VLAOIP2OKYLKHTUVWAYI6XA, seg_pos={0 0}, upload=298206]: Uploading piece... Oct 7 16:24:14.917655699 (338h53m0.379748212s) [noise=true , address=145.79.227.13:4802 , piece_id=3AQO6WKMNYUSVPUV6C55CD2BAEPRCWRLZGKTL3LPJF5HES6L77MQ, seg_pos={0 0}, upload=298206]: Uploading piece... Oct 7 16:24:14.919345025 (338h53m0.381437509s) [noise=true , address=45.91.116.14:4191 , piece_id=WONOGWED7L2C7ZSSPHEDUP3DTFNGOUBTZCXMCMYAZ4HNQALADQOA, seg_pos={0 0}, upload=298206]: Uploading piece... Oct 7 16:24:14.924789103 (338h53m0.386881586s) [noise=true , address=77.90.31.19:4843 , piece_id=TCB6MG7BU6DJVZTQUSUBVNJIB6K2OZFJ4IAQI4MLHYHZSUS2ZKUA, seg_pos={0 0}, upload=298206]: Uploading piece... Oct 7 16:24:14.928177094 (338h53m0.390269577s) [noise=true , address=145.79.227.18:4007 , piece_id=M4KYUOPCKFDNHEYELHLCT5WYXCOLP74OAYI6K2OTTK7OTFH6PCDA, seg_pos={0 0}, upload=298206]: Uploading piece... Oct 7 16:24:14.930573236 (338h53m0.39266576s) [noise=true , address=145.79.227.17:4969 , piece_id=CDXYHSQT4YTUBUWILYS52UXY3XCE76DQAKHPLQPFNCLMMJZYVF3A, seg_pos={0 0}, upload=298206]: Uploading piece... Oct 7 16:24:16.599970900 (338h53m2.062063373s) [upload=298206]: Next returned nil segment Oct 7 16:24:16.599990578 (338h53m2.062083051s) [upload=298206]: Waiting for error group managing segments... Oct 7 16:24:17.003637499 (338h53m2.465729982s) [noise=true , address=77.90.31.16:4735 , piece_id=XAOJ7EN75LTCI6Y6UY5SO4UGXMZYMRHCICCYOIICRL6AWKBFAE6A, seg_pos={0 0}, upload=298206]: Done uploading piece. err: <nil> Oct 7 16:24:17.003822832 (338h53m2.465915315s) [noise=true , address=45.91.116.9:4263 , piece_id=TY3WPWHWZ63WA6R7IT3SCRCN6APQYVM7V2L2ATIMKXZZ7KNPWGEA, seg_pos={0 0}, upload=298206]: Done uploading piece. err: <nil> Oct 7 16:24:17.018444655 (338h53m2.480537128s) [noise=true , address=45.91.116.11:4119 , piece_id=SQFQZZDICFPFZJFHQ5FNWLRTR6CUHGB6XGDL25J6DUGA7PIZPEWA, seg_pos={0 0}, upload=298206]: Done uploading piece. err: <nil> Oct 7 16:24:17.019479575 (338h53m2.481572058s) [noise=true , address=45.91.116.14:4191 , piece_id=WONOGWED7L2C7ZSSPHEDUP3DTFNGOUBTZCXMCMYAZ4HNQALADQOA, seg_pos={0 0}, upload=298206]: Done uploading piece. err: <nil> Oct 7 16:24:17.037310489 (338h53m2.499402972s) [noise=true , address=77.90.31.19:4843 , piece_id=TCB6MG7BU6DJVZTQUSUBVNJIB6K2OZFJ4IAQI4MLHYHZSUS2ZKUA, seg_pos={0 0}, upload=298206]: Done uploading piece. err: <nil> Oct 7 16:24:17.046776845 (338h53m2.508869328s) [noise=true , address=77.90.31.10:4520 , piece_id=EUTO6R3GRK3OKER74O6CS3N6M23V4LRAKP5Q7OKF6EUPVT6WO5NA, seg_pos={0 0}, upload=298206]: Done uploading piece. err: <nil> Oct 7 16:24:17.085597386 (338h53m2.54768987s) [noise=true , address=77.90.31.14:4661 , piece_id=PZGGCWC2GEHIK2BZBLYB3POC7BL56VLAOIP2OKYLKHTUVWAYI6XA, seg_pos={0 0}, upload=298206]: Done uploading piece. err: <nil> Oct 7 16:24:17.132926661 (338h53m2.595019144s) [noise=true , address=45.91.116.4:4939 , piece_id=5K47YCQI6J3RZ36MDT4BRMMMCIVX52NBFIDLRC3JRR3BYQEUHSKQ, seg_pos={0 0}, upload=298206]: Done uploading piece. err: <nil> Oct 7 16:24:43.846398186 (338h53m29.308490669s) [noise=true , address=145.79.227.17:4969 , piece_id=CDXYHSQT4YTUBUWILYS52UXY3XCE76DQAKHPLQPFNCLMMJZYVF3A, seg_pos={0 0}, upload=298206]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: write tcp 188.166.225.170:38606->145.79.227.17:4969: use of closed network connection; write tcp 188.166.225.170:38606->145.79.227.17:4969: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38606->145.79.227.17:4969: use of closed network connection Oct 7 16:24:43.846524707 (338h53m29.3086172s) [noise=true , address=145.79.227.19:4077 , piece_id=REW3ZH57FK6CPDVAYABY2M32VLM4PY6VAEL7S4USOOIMX3YOLXSA, seg_pos={0 0}, upload=298206]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: read tcp 188.166.225.170:34294->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:24:43.846607745 (338h53m29.308700238s) [noise=true , address=145.79.227.4:4185 , piece_id=KCTEVZMKZYFPSXFNXG5AQ2MJO6ZIQOYBBK65FXHSTGXD33Q5EGGA, seg_pos={0 0}, upload=298206]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40958->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40958->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40958->145.79.227.4:4185: use of closed network connection Oct 7 16:24:43.846621370 (338h53m29.308713853s) [noise=true , address=145.79.227.2:4114 , piece_id=CNFB24UZF2WXCMMQVG6GJLD26BA5W66FH2JUCMVWQUK6YCBQJGFA, seg_pos={0 0}, upload=298206]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54340->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54340->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54340->145.79.227.2:4114: use of closed network connection Oct 7 16:24:43.846710961 (338h53m29.308803444s) [noise=true , address=145.79.227.5:4223 , piece_id=CAFFBAYJ4TEZO7S64LIE5HXYCDRZFNX2ZNYWDGPWTNNJ6TQDJV5Q, seg_pos={0 0}, upload=298206]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:53348->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:53348->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53348->145.79.227.5:4223: use of closed network connection Oct 7 16:24:43.846798218 (338h53m29.308890721s) [noise=true , address=145.79.227.18:4007 , piece_id=M4KYUOPCKFDNHEYELHLCT5WYXCOLP74OAYI6K2OTTK7OTFH6PCDA, seg_pos={0 0}, upload=298206]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:32846->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:32846->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32846->145.79.227.18:4007: use of closed network connection Oct 7 16:24:43.846854304 (338h53m29.308946787s) [noise=true , address=145.79.227.12:4767 , piece_id=AKE563UTALEJDWNBCIYSEWPCOW6GR7FR7W2CFUKGYYIVQ2S3TK6Q, seg_pos={0 0}, upload=298206]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: read tcp 188.166.225.170:53670->145.79.227.12:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:24:43.846908067 (338h53m29.30900055s) [noise=true , address=145.79.227.13:4802 , piece_id=3AQO6WKMNYUSVPUV6C55CD2BAEPRCWRLZGKTL3LPJF5HES6L77MQ, seg_pos={0 0}, upload=298206]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 188.166.225.170:58910->145.79.227.13:4802: use of closed network connection; write tcp 188.166.225.170:58910->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58910->145.79.227.13:4802: use of closed network connection Oct 7 16:24:43.846957200 (338h53m29.309049683s) [seg_pos={0 0}, upload=298206]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Oct 7 16:24:44.125430748 (338h53m29.587523221s) [upload=298206]: Done uploading segments... Oct 7 16:24:44.125459944 (338h53m29.587552417s) [upload=298206]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 30.281050801s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 1m0.256284464s FAIL (2025-10-07 16:24:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== UOKNAAY5BX44PA6XVBQPIY7XPUDKNINODOSLUIF5RGJ77WOA, seg_pos={0 0}, upload=298193]: Uploading piece... Oct 7 16:23:26.807271454 (338h52m12.269363937s) [noise=true , address=45.91.116.10:4095 , piece_id=5WU5NJ7BW2PA53WCH5JELFPSQHASH5IWHFH6UDFDINWYKF7D3OGA, seg_pos={0 0}, upload=298193]: Uploading piece... Oct 7 16:23:26.807487455 (338h52m12.269579938s) [noise=true , address=145.79.227.26:4659 , piece_id=ZHYQYYKKDIPCV4OOAPLFVMXSOML4PUBAQMLHOHOTQTXFXNJGKB6Q, seg_pos={0 0}, upload=298193]: Uploading piece... Oct 7 16:23:26.807730868 (338h52m12.269823351s) [noise=true , address=145.79.227.5:4236 , piece_id=TXJ6Z343CWWCZ65ECE637HO7YTX33BZPRHSKSB6QYNPLI6D3R3NA, seg_pos={0 0}, upload=298193]: Uploading piece... Oct 7 16:23:26.808288059 (338h52m12.270380542s) [noise=true , address=145.79.227.39:4021 , piece_id=FJ7GX4Z3MEF6I7EMAQCLGSESJCBCDBIQXGUGYYEZUDCTISUGCHBA, seg_pos={0 0}, upload=298193]: Uploading piece... Oct 7 16:23:26.808665127 (338h52m12.27075761s) [noise=true , address=145.79.227.27:4701 , piece_id=VDCDEWAZDJJOVOLNDMXUMBISJB4GGBZFIR4OWSN4ECPCXMKHV77Q, seg_pos={0 0}, upload=298193]: Uploading piece... Oct 7 16:23:26.809076671 (338h52m12.271169154s) [noise=true , address=64.49.13.140:4506 , piece_id=E4FUBHVRIZC3TTMAOFL5FAK4W7A3JBFLLVPVMRRLCP7TXH6SJDUQ, seg_pos={0 0}, upload=298193]: Uploading piece... Oct 7 16:23:26.809496911 (338h52m12.271589384s) [noise=true , address=77.90.31.21:4888 , piece_id=QGJHRRIIZPHTGTUJPK7ZKSMCG2S67OOERGRQJX4WK63OSAWHQBTA, seg_pos={0 0}, upload=298193]: Uploading piece... Oct 7 16:23:26.809935897 (338h52m12.27202838s) [noise=true , address=77.90.31.18:4814 , piece_id=ARV63PBFZUXCFENPTWLPVADPICKKD4KSO6JVSQXYENLCJ5MPBACA, seg_pos={0 0}, upload=298193]: Uploading piece... Oct 7 16:23:26.810270083 (338h52m12.272362556s) [noise=true , address=45.91.116.4:4950 , piece_id=EBYHPED2OBFIJQUHTKWHQOVVQRK25NVSTHYMMMYTHXH3FWFJPJTQ, seg_pos={0 0}, upload=298193]: Uploading piece... Oct 7 16:23:26.810567088 (338h52m12.272659572s) [noise=true , address=77.90.31.19:4861 , piece_id=I4VUDCJGZYPRYN7ZJM5QHC4RXQNSZT6XXH46A44Z7UF2L2LWX2ZQ, seg_pos={0 0}, upload=298193]: Uploading piece... Oct 7 16:23:26.810912857 (338h52m12.27300533s) [noise=true , address=45.91.116.13:4183 , piece_id=EPWZ2FZYLO7ABEQPNRPHX4AAF23I4EEPJCQTVIRYXS2JTEO3YACA, seg_pos={0 0}, upload=298193]: Uploading piece... Oct 7 16:23:26.811147674 (338h52m12.273240147s) [noise=true , address=77.90.31.10:4534 , piece_id=I73Q3MT2JDTYULNSL54UCPI4XH4OTLK4VPUISZDVMRPJCVSUITZQ, seg_pos={0 0}, upload=298193]: Uploading piece... Oct 7 16:23:26.811595157 (338h52m12.27368764s) [noise=true , address=45.91.116.11:4143 , piece_id=7JDN5DHFN4LKINIQQIVOTYYJC334CYFO2HKLHVHN3FP7YF7GH7DA, seg_pos={0 0}, upload=298193]: Uploading piece... Oct 7 16:23:26.812001060 (338h52m12.274093543s) [noise=true , address=77.90.31.17:4785 , piece_id=PKT6XLR7K4TSWOEUCWIZPCP6PVZ65MVKTZ7BDZCY2JOYSJ4NPCTQ, seg_pos={0 0}, upload=298193]: Uploading piece... Oct 7 16:23:26.812235716 (338h52m12.274328199s) [noise=true , address=145.79.227.23:4551 , piece_id=CW6XDSLS4WP5GPEXYXGPN4NW6GL4IM2TVP3I535QM3D5T7VRJO5Q, seg_pos={0 0}, upload=298193]: Uploading piece... Oct 7 16:23:26.812645877 (338h52m12.27473836s) [noise=true , address=77.90.31.12:4607 , piece_id=MMYYTS55WV7MNGROZKSB6GZ7XHCM5GV3UADTBMXG2LPUOCUISVCA, seg_pos={0 0}, upload=298193]: Uploading piece... Oct 7 16:23:28.174904568 (338h52m13.636997042s) [upload=298193]: Next returned nil segment Oct 7 16:23:28.174929857 (338h52m13.63702234s) [upload=298193]: Waiting for error group managing segments... Oct 7 16:23:28.581556091 (338h52m14.043648574s) [noise=true , address=64.49.13.140:4506 , piece_id=E4FUBHVRIZC3TTMAOFL5FAK4W7A3JBFLLVPVMRRLCP7TXH6SJDUQ, seg_pos={0 0}, upload=298193]: Done uploading piece. err: <nil> Oct 7 16:23:28.747121950 (338h52m14.209214433s) [noise=true , address=45.91.116.4:4950 , piece_id=EBYHPED2OBFIJQUHTKWHQOVVQRK25NVSTHYMMMYTHXH3FWFJPJTQ, seg_pos={0 0}, upload=298193]: Done uploading piece. err: <nil> Oct 7 16:23:28.753360691 (338h52m14.215453174s) [noise=true , address=45.91.116.14:4206 , piece_id=6PM7UOKNAAY5BX44PA6XVBQPIY7XPUDKNINODOSLUIF5RGJ77WOA, seg_pos={0 0}, upload=298193]: Done uploading piece. err: <nil> Oct 7 16:23:28.808691180 (338h52m14.270783663s) [noise=true , address=77.90.31.18:4814 , piece_id=ARV63PBFZUXCFENPTWLPVADPICKKD4KSO6JVSQXYENLCJ5MPBACA, seg_pos={0 0}, upload=298193]: Done uploading piece. err: <nil> Oct 7 16:23:28.813390198 (338h52m14.275482681s) [noise=true , address=45.91.116.13:4183 , piece_id=EPWZ2FZYLO7ABEQPNRPHX4AAF23I4EEPJCQTVIRYXS2JTEO3YACA, seg_pos={0 0}, upload=298193]: Done uploading piece. err: <nil> Oct 7 16:23:28.848389232 (338h52m14.310481716s) [noise=true , address=77.90.31.12:4607 , piece_id=MMYYTS55WV7MNGROZKSB6GZ7XHCM5GV3UADTBMXG2LPUOCUISVCA, seg_pos={0 0}, upload=298193]: Done uploading piece. err: <nil> Oct 7 16:23:28.865057854 (338h52m14.327150337s) [noise=true , address=45.91.116.11:4143 , piece_id=7JDN5DHFN4LKINIQQIVOTYYJC334CYFO2HKLHVHN3FP7YF7GH7DA, seg_pos={0 0}, upload=298193]: Done uploading piece. err: <nil> Oct 7 16:23:28.869474834 (338h52m14.331567317s) [noise=true , address=77.90.31.19:4861 , piece_id=I4VUDCJGZYPRYN7ZJM5QHC4RXQNSZT6XXH46A44Z7UF2L2LWX2ZQ, seg_pos={0 0}, upload=298193]: Done uploading piece. err: <nil> Oct 7 16:23:28.872179945 (338h52m14.334272418s) [noise=true , address=77.90.31.17:4785 , piece_id=PKT6XLR7K4TSWOEUCWIZPCP6PVZ65MVKTZ7BDZCY2JOYSJ4NPCTQ, seg_pos={0 0}, upload=298193]: Done uploading piece. err: <nil> Oct 7 16:23:28.887899498 (338h52m14.349991971s) [noise=true , address=77.90.31.10:4534 , piece_id=I73Q3MT2JDTYULNSL54UCPI4XH4OTLK4VPUISZDVMRPJCVSUITZQ, seg_pos={0 0}, upload=298193]: Done uploading piece. err: <nil> Oct 7 16:23:28.945402384 (338h52m14.407494867s) [noise=true , address=45.91.116.10:4095 , piece_id=5WU5NJ7BW2PA53WCH5JELFPSQHASH5IWHFH6UDFDINWYKF7D3OGA, seg_pos={0 0}, upload=298193]: Done uploading piece. err: <nil> Oct 7 16:23:28.981401814 (338h52m14.443494297s) [noise=true , address=77.90.31.21:4888 , piece_id=QGJHRRIIZPHTGTUJPK7ZKSMCG2S67OOERGRQJX4WK63OSAWHQBTA, seg_pos={0 0}, upload=298193]: Done uploading piece. err: <nil> Oct 7 16:23:30.134053906 (338h52m15.596146389s) [noise=true , address=77.90.31.14:4681 , piece_id=R5EP5UNF7PNFV4WIQ3YPMTDZKQTOK32FIDUSUOQWZEYL6VLPDRIA, seg_pos={0 0}, upload=298193]: Done uploading piece. err: <nil> Oct 7 16:24:25.855676234 (338h53m11.317768717s) [noise=true , address=145.79.227.26:4659 , piece_id=ZHYQYYKKDIPCV4OOAPLFVMXSOML4PUBAQMLHOHOTQTXFXNJGKB6Q, seg_pos={0 0}, upload=298193]: Done uploading piece. err: ecclient: upload failed (node:12UBuWLogtN8mv4nwXDpzGdQtbKDz1EfVENSjXC54QdFp2fJg99, address:145.79.227.26:4659): protocol: write tcp 188.166.225.170:35148->145.79.227.26:4659: use of closed network connection; write tcp 188.166.225.170:35148->145.79.227.26:4659: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35148->145.79.227.26:4659: use of closed network connection Oct 7 16:24:25.855692715 (338h53m11.317785188s) [noise=true , address=145.79.227.27:4701 , piece_id=VDCDEWAZDJJOVOLNDMXUMBISJB4GGBZFIR4OWSN4ECPCXMKHV77Q, seg_pos={0 0}, upload=298193]: Done uploading piece. err: ecclient: upload failed (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ, address:145.79.227.27:4701): protocol: write tcp 188.166.225.170:53836->145.79.227.27:4701: use of closed network connection; write tcp 188.166.225.170:53836->145.79.227.27:4701: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53836->145.79.227.27:4701: use of closed network connection Oct 7 16:24:25.855811772 (338h53m11.317904246s) [noise=true , address=145.79.227.5:4236 , piece_id=TXJ6Z343CWWCZ65ECE637HO7YTX33BZPRHSKSB6QYNPLI6D3R3NA, seg_pos={0 0}, upload=298193]: Done uploading piece. err: ecclient: upload failed (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj, address:145.79.227.5:4236): protocol: write tcp 188.166.225.170:35694->145.79.227.5:4236: use of closed network connection; write tcp 188.166.225.170:35694->145.79.227.5:4236: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35694->145.79.227.5:4236: use of closed network connection Oct 7 16:24:25.855860264 (338h53m11.317952747s) [noise=true , address=145.79.227.23:4551 , piece_id=CW6XDSLS4WP5GPEXYXGPN4NW6GL4IM2TVP3I535QM3D5T7VRJO5Q, seg_pos={0 0}, upload=298193]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: write tcp 188.166.225.170:56452->145.79.227.23:4551: use of closed network connection; write tcp 188.166.225.170:56452->145.79.227.23:4551: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56452->145.79.227.23:4551: use of closed network connection Oct 7 16:24:25.855915670 (338h53m11.318008163s) [noise=true , address=145.79.227.39:4021 , piece_id=FJ7GX4Z3MEF6I7EMAQCLGSESJCBCDBIQXGUGYYEZUDCTISUGCHBA, seg_pos={0 0}, upload=298193]: Done uploading piece. err: ecclient: upload failed (node:1nz7Gxp4YTWuB1JDnjE5Q9BfVUUvyZ4SMBbZrxVQHrSUvcJbAQ, address:145.79.227.39:4021): protocol: write tcp 188.166.225.170:58514->145.79.227.39:4021: use of closed network connection; write tcp 188.166.225.170:58514->145.79.227.39:4021: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58514->145.79.227.39:4021: use of closed network connection Oct 7 16:24:25.855960045 (338h53m11.318052518s) [seg_pos={0 0}, upload=298193]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Oct 7 16:24:26.110282503 (338h53m11.572374976s) [upload=298193]: Done uploading segments... Oct 7 16:24:26.110315445 (338h53m11.572407928s) [upload=298193]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.256316625s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......................................................XXXXX] duration: 30.250056878s FAIL (2025-10-07 16:24:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Oct 7 16:23:44.075188460 (338h52m29.537280943s) [upload=298197]: Starting upload Oct 7 16:23:44.075284903 (338h52m29.537377387s) [upload=298197]: Done starting upload Oct 7 16:23:44.075338756 (338h52m29.53743123s) [upload=298197]: Uploading segments... Oct 7 16:23:44.075473212 (338h52m29.537565685s) [upload=298197]: Got next segment. Inline: false Oct 7 16:23:44.075516014 (338h52m29.537608497s) [upload=298197]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 16:23:44.075524139 (338h52m29.537616612s) [upload=298197]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 16:23:44.327363871 (338h52m29.789456364s) [seg_pos={0 0}, upload=298197]: Begin upload segment... Oct 7 16:23:44.327433584 (338h52m29.789526067s) [seg_pos={0 0}, upload=298197]: Done begin upload segment. Oct 7 16:23:44.327463691 (338h52m29.789556174s) [noise=true , address=45.91.116.13:4153 , piece_id=NA3MQG6E6WNDXNVHMA5ERMQQFIBCA2WCFKAXUS45HI4T5A5HQACQ, seg_pos={0 0}, upload=298197]: Uploading piece... Oct 7 16:23:44.327577028 (338h52m29.789669511s) [noise=true , address=45.91.116.7:4009 , piece_id=KB5U3S3T5TTXT6BUFTQ4NZWXUDMFWE2BU7CLTS7D3LJ5JOLYKVRQ, seg_pos={0 0}, upload=298197]: Uploading piece... Oct 7 16:23:44.328170448 (338h52m29.790262921s) [noise=true , address=45.91.116.14:4190 , piece_id=JTLQSBR267XVH7AKE5XPBRLRX4WYP3CXOKLCGPFFCVZCZSDYVIEA, seg_pos={0 0}, upload=298197]: Uploading piece... Oct 7 16:23:44.328536304 (338h52m29.790628787s) [noise=true , address=77.90.31.16:4735 , piece_id=GOJT3UDPO37N4AORJ5S5TSYDKCBKVEM6QOF3Z6XHHRFDDHDQ3W5A, seg_pos={0 0}, upload=298197]: Uploading piece... Oct 7 16:23:44.328550481 (338h52m29.790642964s) [noise=true , address=145.79.227.3:4151 , piece_id=NT5BDNNQFNHGLPQNFX2QSGLDHHKLXZ7TTJJLWNKOSR6KITI2C3NQ, seg_pos={0 0}, upload=298197]: Uploading piece... Oct 7 16:23:44.328880068 (338h52m29.790972552s) [noise=true , address=45.91.116.12:4225 , piece_id=JWKFX4F5LFHDYQ66EQL7V56KF6ESESDGMJCXOH7KFV7Y3OPUJNLA, seg_pos={0 0}, upload=298197]: Uploading piece... Oct 7 16:23:44.329360714 (338h52m29.791453187s) [noise=true , address=145.79.227.5:4223 , piece_id=SA6HYVUVQXRD5LL6NGLNHYTMJV7ZQALPIHW5NHW4E7RAJP2F3GTA, seg_pos={0 0}, upload=298197]: Uploading piece... Oct 7 16:23:44.329459953 (338h52m29.791552436s) [noise=true , address=145.79.227.18:4005 , piece_id=OTUX55AI5E2HUSNWYO7JIWGRQVRK62FFOYRUZ2N7JZILYMLKNRIA, seg_pos={0 0}, upload=298197]: Uploading piece... Oct 7 16:23:44.329871156 (338h52m29.791963629s) [noise=true , address=145.79.227.16:4912 , piece_id=VPVZUWLCXNDL6GIUYIXWNIYDUG5WPBHLYWS57J6CXWW2MR6ZHVYQ, seg_pos={0 0}, upload=298197]: Uploading piece... Oct 7 16:23:44.329995192 (338h52m29.792087685s) [noise=true , address=45.91.116.4:4939 , piece_id=QEO2HKZRDSLWHNS65ZMV62IIWKM7WCG62NLTINDTJHDQ5FY2U7PQ, seg_pos={0 0}, upload=298197]: Uploading piece... Oct 7 16:23:44.330209440 (338h52m29.792301913s) [noise=true , address=45.91.116.9:4262 , piece_id=J2MKO26DIOUPRKCB2LNCWTPEXGPA3UJSQBS7VIUCEW54I7H2RB4A, seg_pos={0 0}, upload=298197]: Uploading piece... Oct 7 16:23:44.330565908 (338h52m29.792658381s) [noise=true , address=45.91.116.8:4048 , piece_id=OIT2TNPNPNR4ZGZF66ILFDLIVDKPTZEJWD77GLUAEK6CQJ2SRJ6Q, seg_pos={0 0}, upload=298197]: Uploading piece... Oct 7 16:23:44.331621419 (338h52m29.793713892s) [noise=true , address=45.91.116.6:4975 , piece_id=TYTU6BADL2XN622ABDLSRZLWSLP3NVXRYUEGGZ5IFMB63SFKSZ7Q, seg_pos={0 0}, upload=298197]: Uploading piece... Oct 7 16:23:44.331643911 (338h52m29.793736394s) [noise=true , address=77.90.31.15:4697 , piece_id=JKJL5YOCQUUJGYI732R7IUHD4QGBMRYEF4TDBGZQ4AKY5ABMCABQ, seg_pos={0 0}, upload=298197]: Uploading piece... Oct 7 16:23:44.332098718 (338h52m29.794191191s) [noise=true , address=77.90.31.13:4627 , piece_id=H42A2KWXM65KMJDC5EOKZ3CD7ENRAFG4JKPUZJAU2KPWPWDSV6CA, seg_pos={0 0}, upload=298197]: Uploading piece... Oct 7 16:23:44.333062232 (338h52m29.795154715s) [noise=true , address=145.79.227.19:4077 , piece_id=N2KX4E65F7WV2RUENPHJL7XXC4ZVJOKOQRNSFKLPLD2B7QIFZOFA, seg_pos={0 0}, upload=298197]: Uploading piece... Oct 7 16:23:46.143849939 (338h52m31.605942412s) [upload=298197]: Next returned nil segment Oct 7 16:23:46.143869888 (338h52m31.605962361s) [upload=298197]: Waiting for error group managing segments... Oct 7 16:23:46.431359994 (338h52m31.893452467s) [noise=true , address=45.91.116.14:4190 , piece_id=JTLQSBR267XVH7AKE5XPBRLRX4WYP3CXOKLCGPFFCVZCZSDYVIEA, seg_pos={0 0}, upload=298197]: Done uploading piece. err: <nil> Oct 7 16:23:46.442116306 (338h52m31.904208779s) [noise=true , address=77.90.31.15:4697 , piece_id=JKJL5YOCQUUJGYI732R7IUHD4QGBMRYEF4TDBGZQ4AKY5ABMCABQ, seg_pos={0 0}, upload=298197]: Done uploading piece. err: <nil> Oct 7 16:23:46.456014511 (338h52m31.918106984s) [noise=true , address=77.90.31.16:4735 , piece_id=GOJT3UDPO37N4AORJ5S5TSYDKCBKVEM6QOF3Z6XHHRFDDHDQ3W5A, seg_pos={0 0}, upload=298197]: Done uploading piece. err: <nil> Oct 7 16:23:46.456467964 (338h52m31.918560437s) [noise=true , address=45.91.116.12:4225 , piece_id=JWKFX4F5LFHDYQ66EQL7V56KF6ESESDGMJCXOH7KFV7Y3OPUJNLA, seg_pos={0 0}, upload=298197]: Done uploading piece. err: <nil> Oct 7 16:23:46.463374094 (338h52m31.925466577s) [noise=true , address=45.91.116.8:4048 , piece_id=OIT2TNPNPNR4ZGZF66ILFDLIVDKPTZEJWD77GLUAEK6CQJ2SRJ6Q, seg_pos={0 0}, upload=298197]: Done uploading piece. err: <nil> Oct 7 16:23:46.487168163 (338h52m31.949260636s) [noise=true , address=45.91.116.6:4975 , piece_id=TYTU6BADL2XN622ABDLSRZLWSLP3NVXRYUEGGZ5IFMB63SFKSZ7Q, seg_pos={0 0}, upload=298197]: Done uploading piece. err: <nil> Oct 7 16:23:46.500982940 (338h52m31.963075413s) [noise=true , address=45.91.116.4:4939 , piece_id=QEO2HKZRDSLWHNS65ZMV62IIWKM7WCG62NLTINDTJHDQ5FY2U7PQ, seg_pos={0 0}, upload=298197]: Done uploading piece. err: <nil> Oct 7 16:23:46.543515599 (338h52m32.005608083s) [noise=true , address=45.91.116.9:4262 , piece_id=J2MKO26DIOUPRKCB2LNCWTPEXGPA3UJSQBS7VIUCEW54I7H2RB4A, seg_pos={0 0}, upload=298197]: Done uploading piece. err: <nil> Oct 7 16:23:46.551804203 (338h52m32.013896686s) [noise=true , address=45.91.116.13:4153 , piece_id=NA3MQG6E6WNDXNVHMA5ERMQQFIBCA2WCFKAXUS45HI4T5A5HQACQ, seg_pos={0 0}, upload=298197]: Done uploading piece. err: <nil> Oct 7 16:23:46.637623829 (338h52m32.099716302s) [noise=true , address=45.91.116.7:4009 , piece_id=KB5U3S3T5TTXT6BUFTQ4NZWXUDMFWE2BU7CLTS7D3LJ5JOLYKVRQ, seg_pos={0 0}, upload=298197]: Done uploading piece. err: <nil> Oct 7 16:23:46.656682070 (338h52m32.118774543s) [noise=true , address=77.90.31.13:4627 , piece_id=H42A2KWXM65KMJDC5EOKZ3CD7ENRAFG4JKPUZJAU2KPWPWDSV6CA, seg_pos={0 0}, upload=298197]: Done uploading piece. err: <nil> Oct 7 16:24:13.367368927 (338h52m58.82946142s) [noise=true , address=145.79.227.19:4077 , piece_id=N2KX4E65F7WV2RUENPHJL7XXC4ZVJOKOQRNSFKLPLD2B7QIFZOFA, seg_pos={0 0}, upload=298197]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:58744->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:58744->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58744->145.79.227.19:4077: use of closed network connection Oct 7 16:24:13.367500859 (338h52m58.829593352s) [noise=true , address=145.79.227.18:4005 , piece_id=OTUX55AI5E2HUSNWYO7JIWGRQVRK62FFOYRUZ2N7JZILYMLKNRIA, seg_pos={0 0}, upload=298197]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: write tcp 188.166.225.170:42242->145.79.227.18:4005: use of closed network connection; write tcp 188.166.225.170:42242->145.79.227.18:4005: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42242->145.79.227.18:4005: use of closed network connection Oct 7 16:24:13.367538240 (338h52m58.829630723s) [noise=true , address=145.79.227.3:4151 , piece_id=NT5BDNNQFNHGLPQNFX2QSGLDHHKLXZ7TTJJLWNKOSR6KITI2C3NQ, seg_pos={0 0}, upload=298197]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:35886->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:35886->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35886->145.79.227.3:4151: use of closed network connection Oct 7 16:24:13.367672215 (338h52m58.829764708s) [noise=true , address=145.79.227.5:4223 , piece_id=SA6HYVUVQXRD5LL6NGLNHYTMJV7ZQALPIHW5NHW4E7RAJP2F3GTA, seg_pos={0 0}, upload=298197]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:55806->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:24:13.367809005 (338h52m58.829901488s) [noise=true , address=145.79.227.16:4912 , piece_id=VPVZUWLCXNDL6GIUYIXWNIYDUG5WPBHLYWS57J6CXWW2MR6ZHVYQ, seg_pos={0 0}, upload=298197]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: read tcp 188.166.225.170:48732->145.79.227.16:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Oct 7 16:24:13.367874319 (338h52m58.829966812s) [seg_pos={0 0}, upload=298197]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 16:24:13.615907372 (338h52m59.077999865s) [upload=298197]: Done uploading segments... Oct 7 16:24:13.615943260 (338h52m59.078035743s) [upload=298197]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 30.250076715s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [........................................................XXXX] duration: 30.247380087s FAIL (2025-10-07 16:23:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Oct 7 16:23:13.608389807 (338h51m59.07048229s) [upload=298190]: Starting upload Oct 7 16:23:13.608502593 (338h51m59.070595076s) [upload=298190]: Done starting upload Oct 7 16:23:13.608638862 (338h51m59.070731345s) [upload=298190]: Uploading segments... Oct 7 16:23:13.608792104 (338h51m59.070884587s) [upload=298190]: Got next segment. Inline: false Oct 7 16:23:13.608853260 (338h51m59.070945733s) [upload=298190]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 16:23:13.608859672 (338h51m59.070952145s) [upload=298190]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 16:23:13.856699848 (338h51m59.318792321s) [seg_pos={0 0}, upload=298190]: Begin upload segment... Oct 7 16:23:13.856762748 (338h51m59.318855231s) [seg_pos={0 0}, upload=298190]: Done begin upload segment. Oct 7 16:23:13.856797224 (338h51m59.318889707s) [noise=true , address=77.90.31.11:4555 , piece_id=QDUAVKNJZKD4CHR7YHRT6TGXHKCWXBDYTEPWTUG3F6MCDF6WJ7MQ, seg_pos={0 0}, upload=298190]: Uploading piece... Oct 7 16:23:13.856806832 (338h51m59.318899325s) [noise=true , address=45.91.116.13:4154 , piece_id=BG7ZVX6PX7GEF2FSPWF3SYSQ7VM3FNPX52H66O5EPMLDZGPMKSRA, seg_pos={0 0}, upload=298190]: Uploading piece... Oct 7 16:23:13.857541180 (338h51m59.319633663s) [noise=true , address=45.91.116.11:4119 , piece_id=CYK5QYVCISK67VQSTX5FYZD5YXV5HLABDXIEDPEEDIIUZGZ5YPEA, seg_pos={0 0}, upload=298190]: Uploading piece... Oct 7 16:23:13.857555859 (338h51m59.319648342s) [noise=true , address=145.79.227.4:4185 , piece_id=G5DTOTV227YMF3XXP5D2FU6QMXS5V7EG5ZTPZOEBOQRUDQQDYGKA, seg_pos={0 0}, upload=298190]: Uploading piece... Oct 7 16:23:13.857981479 (338h51m59.320073952s) [noise=true , address=145.79.227.13:4804 , piece_id=M4XLKUQCSCBTSRM35OHTLXC4RSZJRE7LHW6QTSVUF54LKJQFZM3A, seg_pos={0 0}, upload=298190]: Uploading piece... Oct 7 16:23:13.858034058 (338h51m59.320126551s) [noise=true , address=77.90.31.17:4772 , piece_id=DVA4ASVUPBZZB2EMVCVNC64JDLLM6RCWN5F54IEL6JTB4B2EVKRA, seg_pos={0 0}, upload=298190]: Uploading piece... Oct 7 16:23:13.858310294 (338h51m59.320402767s) [noise=true , address=45.91.116.5:4299 , piece_id=ALBA2FG27MRJ6PG4X7IECU2I5ZXGNRDUPKJXHUAIH3VZKATCERGA, seg_pos={0 0}, upload=298190]: Uploading piece... Oct 7 16:23:13.858536476 (338h51m59.320628959s) [noise=true , address=145.79.227.16:4911 , piece_id=S2YTGYAZWYCGIN3J7CLXNF7XFJWJ2WN42BETAB5TFEWQUKKPWDCQ, seg_pos={0 0}, upload=298190]: Uploading piece... Oct 7 16:23:13.858635895 (338h51m59.320728378s) [noise=true , address=77.90.31.14:4663 , piece_id=UBMEG54XYYH7POB6MROVKOBB5NA6IALR4EDXFM6X4BTC2ZDWY3DQ, seg_pos={0 0}, upload=298190]: Uploading piece... Oct 7 16:23:13.858976965 (338h51m59.321069438s) [noise=true , address=45.91.116.7:4009 , piece_id=KZ2PSAH7KF2KDWIKDNB2WXOI522BTZKO2LBDVLDR6HPTTWIRDXVA, seg_pos={0 0}, upload=298190]: Uploading piece... Oct 7 16:23:13.859076503 (338h51m59.321168986s) [noise=true , address=45.91.116.4:4940 , piece_id=UELYZAAWLLQXTVFZPCRYBM2ZYGTWJFLJK2C7HM7ZXGVJRCDG7UKA, seg_pos={0 0}, upload=298190]: Uploading piece... Oct 7 16:23:13.859716713 (338h51m59.321809186s) [noise=true , address=45.91.116.11:4117 , piece_id=O4IYMUKO3UJUEEQQWLS4TVXXB5XOSJOSIJTYS26PTAZQ7TSLPEOQ, seg_pos={0 0}, upload=298190]: Uploading piece... Oct 7 16:23:13.860241893 (338h51m59.322334366s) [noise=true , address=77.90.31.10:4518 , piece_id=KH7J3BWCQF2LCZGZ5YAJLZIOVUTXU2KULTVCOMFZEYFVOT26R7IA, seg_pos={0 0}, upload=298190]: Uploading piece... Oct 7 16:23:13.860312077 (338h51m59.32240456s) [noise=true , address=145.79.227.14:4840 , piece_id=3XSJYYDQPD5BICDKYKTQMW2D2XHNONRDKWRRYUURCKPLHLVBUKYQ, seg_pos={0 0}, upload=298190]: Uploading piece... Oct 7 16:23:13.860771261 (338h51m59.322863734s) [noise=true , address=145.79.227.4:4187 , piece_id=KL2VKQVEMYIBAD6O6AL6VQA2BX7DZJBLB2FGPT7DFJ3F2S2IL2NQ, seg_pos={0 0}, upload=298190]: Uploading piece... Oct 7 16:23:13.861065742 (338h51m59.323158225s) [noise=true , address=77.90.31.16:4735 , piece_id=OZHKNJI56AEIJ4EFZCCXIA2PVX6DDCBFROOEMYO2MUOHJ4URAE3A, seg_pos={0 0}, upload=298190]: Uploading piece... Oct 7 16:23:15.634750768 (338h52m1.096843251s) [upload=298190]: Next returned nil segment Oct 7 16:23:15.634777379 (338h52m1.096869872s) [upload=298190]: Waiting for error group managing segments... Oct 7 16:23:15.922331838 (338h52m1.384424321s) [noise=true , address=45.91.116.4:4940 , piece_id=UELYZAAWLLQXTVFZPCRYBM2ZYGTWJFLJK2C7HM7ZXGVJRCDG7UKA, seg_pos={0 0}, upload=298190]: Done uploading piece. err: <nil> Oct 7 16:23:15.929297402 (338h52m1.391389875s) [noise=true , address=45.91.116.5:4299 , piece_id=ALBA2FG27MRJ6PG4X7IECU2I5ZXGNRDUPKJXHUAIH3VZKATCERGA, seg_pos={0 0}, upload=298190]: Done uploading piece. err: <nil> Oct 7 16:23:15.948893838 (338h52m1.410986311s) [noise=true , address=77.90.31.16:4735 , piece_id=OZHKNJI56AEIJ4EFZCCXIA2PVX6DDCBFROOEMYO2MUOHJ4URAE3A, seg_pos={0 0}, upload=298190]: Done uploading piece. err: <nil> Oct 7 16:23:15.966028234 (338h52m1.428120717s) [noise=true , address=45.91.116.11:4119 , piece_id=CYK5QYVCISK67VQSTX5FYZD5YXV5HLABDXIEDPEEDIIUZGZ5YPEA, seg_pos={0 0}, upload=298190]: Done uploading piece. err: <nil> Oct 7 16:23:15.988255980 (338h52m1.450348453s) [noise=true , address=45.91.116.13:4154 , piece_id=BG7ZVX6PX7GEF2FSPWF3SYSQ7VM3FNPX52H66O5EPMLDZGPMKSRA, seg_pos={0 0}, upload=298190]: Done uploading piece. err: <nil> Oct 7 16:23:16.005424272 (338h52m1.467516775s) [noise=true , address=45.91.116.11:4117 , piece_id=O4IYMUKO3UJUEEQQWLS4TVXXB5XOSJOSIJTYS26PTAZQ7TSLPEOQ, seg_pos={0 0}, upload=298190]: Done uploading piece. err: <nil> Oct 7 16:23:16.016367470 (338h52m1.478459953s) [noise=true , address=77.90.31.10:4518 , piece_id=KH7J3BWCQF2LCZGZ5YAJLZIOVUTXU2KULTVCOMFZEYFVOT26R7IA, seg_pos={0 0}, upload=298190]: Done uploading piece. err: <nil> Oct 7 16:23:16.111412423 (338h52m1.573504906s) [noise=true , address=77.90.31.17:4772 , piece_id=DVA4ASVUPBZZB2EMVCVNC64JDLLM6RCWN5F54IEL6JTB4B2EVKRA, seg_pos={0 0}, upload=298190]: Done uploading piece. err: <nil> Oct 7 16:23:16.131555820 (338h52m1.593648303s) [noise=true , address=45.91.116.7:4009 , piece_id=KZ2PSAH7KF2KDWIKDNB2WXOI522BTZKO2LBDVLDR6HPTTWIRDXVA, seg_pos={0 0}, upload=298190]: Done uploading piece. err: <nil> Oct 7 16:23:16.784882700 (338h52m2.246975184s) [noise=true , address=77.90.31.14:4663 , piece_id=UBMEG54XYYH7POB6MROVKOBB5NA6IALR4EDXFM6X4BTC2ZDWY3DQ, seg_pos={0 0}, upload=298190]: Done uploading piece. err: <nil> Oct 7 16:23:16.983765181 (338h52m2.445857654s) [noise=true , address=77.90.31.11:4555 , piece_id=QDUAVKNJZKD4CHR7YHRT6TGXHKCWXBDYTEPWTUG3F6MCDF6WJ7MQ, seg_pos={0 0}, upload=298190]: Done uploading piece. err: <nil> Oct 7 16:23:42.910264600 (338h52m28.372357073s) [noise=true , address=145.79.227.4:4187 , piece_id=KL2VKQVEMYIBAD6O6AL6VQA2BX7DZJBLB2FGPT7DFJ3F2S2IL2NQ, seg_pos={0 0}, upload=298190]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: write tcp 188.166.225.170:56544->145.79.227.4:4187: use of closed network connection; write tcp 188.166.225.170:56544->145.79.227.4:4187: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56544->145.79.227.4:4187: use of closed network connection Oct 7 16:23:42.910375922 (338h52m28.372468395s) [noise=true , address=145.79.227.13:4804 , piece_id=M4XLKUQCSCBTSRM35OHTLXC4RSZJRE7LHW6QTSVUF54LKJQFZM3A, seg_pos={0 0}, upload=298190]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: write tcp 188.166.225.170:53902->145.79.227.13:4804: use of closed network connection; write tcp 188.166.225.170:53902->145.79.227.13:4804: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53902->145.79.227.13:4804: use of closed network connection Oct 7 16:23:42.910567237 (338h52m28.37265973s) [noise=true , address=145.79.227.4:4185 , piece_id=G5DTOTV227YMF3XXP5D2FU6QMXS5V7EG5ZTPZOEBOQRUDQQDYGKA, seg_pos={0 0}, upload=298190]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: read tcp 188.166.225.170:53020->145.79.227.4:4185: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:23:42.910581473 (338h52m28.372673946s) [noise=true , address=145.79.227.14:4840 , piece_id=3XSJYYDQPD5BICDKYKTQMW2D2XHNONRDKWRRYUURCKPLHLVBUKYQ, seg_pos={0 0}, upload=298190]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:52678->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:23:42.910765955 (338h52m28.372858428s) [noise=true , address=145.79.227.16:4911 , piece_id=S2YTGYAZWYCGIN3J7CLXNF7XFJWJ2WN42BETAB5TFEWQUKKPWDCQ, seg_pos={0 0}, upload=298190]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: read tcp 188.166.225.170:36030->145.79.227.16:4911: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:23:42.910789479 (338h52m28.372881952s) [seg_pos={0 0}, upload=298190]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 16:23:43.155820366 (338h52m28.617912839s) [upload=298190]: Done uploading segments... Oct 7 16:23:43.155859931 (338h52m28.617952414s) [upload=298190]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 30.247410374s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.246987075s FAIL (2025-10-07 16:23:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== m11.765445495s) [noise=true , address=45.91.116.5:4330 , piece_id=R57SJPMQXWHP3Q6IWPP6CX7USAXD4YYQO43LMAMMNJAHZMJGHU3A, seg_pos={0 0}, upload=298178]: Uploading piece... Oct 7 16:22:26.303783382 (338h51m11.765875865s) [noise=true , address=77.90.31.13:4635 , piece_id=VZN645FZGM37CLSEP6I747SASYXY65JAWN33BNEOBA7AWTX6TTBA, seg_pos={0 0}, upload=298178]: Uploading piece... Oct 7 16:22:26.304176150 (338h51m11.766268633s) [noise=true , address=77.90.31.19:4856 , piece_id=JMLB4P2FETK4F526YWJWZJTOOTBSWAJ7W5S4M3IGL4VJ3IZSA6XA, seg_pos={0 0}, upload=298178]: Uploading piece... Oct 7 16:22:26.304605407 (338h51m11.76669788s) [noise=true , address=45.91.116.12:4234 , piece_id=3SA5TIU655HY3673O24MWCG5EFFUXXLEUKVTJ6RZX3J7KIDZP64A, seg_pos={0 0}, upload=298178]: Uploading piece... Oct 7 16:22:26.305012763 (338h51m11.767105246s) [noise=true , address=77.90.31.17:4786 , piece_id=GCG53AEWHPJEPJUOGTCEFGCZXDXWGRWFBPXNPGZR2OCVJEETGJHQ, seg_pos={0 0}, upload=298178]: Uploading piece... Oct 7 16:22:26.305535328 (338h51m11.767627811s) [noise=true , address=77.90.31.12:4624 , piece_id=UYCRZAJBXORSKPR27TMFXMUHYDYBG2RIARLXCALX57IABB2DW5AQ, seg_pos={0 0}, upload=298178]: Uploading piece... Oct 7 16:22:26.306017386 (338h51m11.768109869s) [noise=true , address=45.91.116.10:4112 , piece_id=4ERWVJNJ6ATQQ4AUPSBQ75AKQPNWV3L6L35KJIW3HBFDPRIAOF3A, seg_pos={0 0}, upload=298178]: Uploading piece... Oct 7 16:22:26.306432266 (338h51m11.768524759s) [noise=true , address=145.79.227.22:4525 , piece_id=IAFKHJF47HLS26I7M4CL6JBA6V7KH42BMCIIT3YB5SI6K2MLEFMQ, seg_pos={0 0}, upload=298178]: Uploading piece... Oct 7 16:22:26.307521881 (338h51m11.769614364s) [noise=true , address=77.90.31.16:4767 , piece_id=GWWKTX2GSMYKB3CELAQUX6TP6VKUQLLC6MOCOEEEMFKWTZER6WEQ, seg_pos={0 0}, upload=298178]: Uploading piece... Oct 7 16:22:26.308099481 (338h51m11.770191954s) [noise=true , address=77.90.31.10:4526 , piece_id=ZGYAUYWJIHPQWVFOVYYENPFVBGYCLXCHQOA6XYOYGWOYNQ7LISAA, seg_pos={0 0}, upload=298178]: Uploading piece... Oct 7 16:22:26.308845301 (338h51m11.770937784s) [noise=true , address=145.79.227.43:4179 , piece_id=L3DNEXRTVSVLEO6W3V6754AAN5A7OB42CO2NFRCMWN7SQMESEYLQ, seg_pos={0 0}, upload=298178]: Uploading piece... Oct 7 16:22:26.309402902 (338h51m11.771495385s) [noise=true , address=145.79.227.31:4802 , piece_id=JAFA42WLAAFGVF6VJXSM5EMB3SN5WINZSXCRPILV2RRGL3RO7CEA, seg_pos={0 0}, upload=298178]: Uploading piece... Oct 7 16:22:26.310888682 (338h51m11.772981155s) [noise=true , address=45.91.116.9:4286 , piece_id=6X6B3TGDDUEOBXWKLUVNPNMSCYELGFIKGHYQR6EI2F3D5KIQCNQA, seg_pos={0 0}, upload=298178]: Uploading piece... Oct 7 16:22:26.312244103 (338h51m11.774336576s) [noise=true , address=45.91.116.14:4212 , piece_id=FHGZAJNUWM4MDZBW6ICFNKHQCQWS73JLK3AORWRTOPS5WBXR2LXA, seg_pos={0 0}, upload=298178]: Uploading piece... Oct 7 16:22:26.313693853 (338h51m11.775786336s) [noise=true , address=145.79.227.44:4225 , piece_id=PS77R5A5E6RDQQU6DYSRSPCNZGWV25H77JAUCVISRHVK75RJFUQA, seg_pos={0 0}, upload=298178]: Uploading piece... Oct 7 16:22:26.315198449 (338h51m11.777290922s) [noise=true , address=145.79.227.16:4917 , piece_id=QM2CPLYQL2GTTPWSENNLMUQPHK3MHQ6AGSMVZMOA7VILQFJWDVEQ, seg_pos={0 0}, upload=298178]: Uploading piece... Oct 7 16:22:27.914888145 (338h51m13.376980618s) [upload=298178]: Next returned nil segment Oct 7 16:22:27.914909094 (338h51m13.377001577s) [upload=298178]: Waiting for error group managing segments... Oct 7 16:22:28.294519065 (338h51m13.756611548s) [noise=true , address=45.91.116.5:4330 , piece_id=R57SJPMQXWHP3Q6IWPP6CX7USAXD4YYQO43LMAMMNJAHZMJGHU3A, seg_pos={0 0}, upload=298178]: Done uploading piece. err: <nil> Oct 7 16:22:28.303599256 (338h51m13.765691739s) [noise=true , address=45.91.116.9:4286 , piece_id=6X6B3TGDDUEOBXWKLUVNPNMSCYELGFIKGHYQR6EI2F3D5KIQCNQA, seg_pos={0 0}, upload=298178]: Done uploading piece. err: <nil> Oct 7 16:22:28.324520593 (338h51m13.786613076s) [noise=true , address=77.90.31.17:4786 , piece_id=GCG53AEWHPJEPJUOGTCEFGCZXDXWGRWFBPXNPGZR2OCVJEETGJHQ, seg_pos={0 0}, upload=298178]: Done uploading piece. err: <nil> Oct 7 16:22:28.349183156 (338h51m13.811275639s) [noise=true , address=77.90.31.12:4624 , piece_id=UYCRZAJBXORSKPR27TMFXMUHYDYBG2RIARLXCALX57IABB2DW5AQ, seg_pos={0 0}, upload=298178]: Done uploading piece. err: <nil> Oct 7 16:22:28.358246443 (338h51m13.820338926s) [noise=true , address=77.90.31.15:4732 , piece_id=3KATZXWEA2RLVHXGNW4R74QESELE3FK4W7M6TT2XZTMKPXABM65A, seg_pos={0 0}, upload=298178]: Done uploading piece. err: <nil> Oct 7 16:22:28.388028675 (338h51m13.850121158s) [noise=true , address=77.90.31.19:4856 , piece_id=JMLB4P2FETK4F526YWJWZJTOOTBSWAJ7W5S4M3IGL4VJ3IZSA6XA, seg_pos={0 0}, upload=298178]: Done uploading piece. err: <nil> Oct 7 16:22:28.407634388 (338h51m13.869726871s) [noise=true , address=77.90.31.13:4635 , piece_id=VZN645FZGM37CLSEP6I747SASYXY65JAWN33BNEOBA7AWTX6TTBA, seg_pos={0 0}, upload=298178]: Done uploading piece. err: <nil> Oct 7 16:22:28.416171705 (338h51m13.878264188s) [noise=true , address=77.90.31.16:4767 , piece_id=GWWKTX2GSMYKB3CELAQUX6TP6VKUQLLC6MOCOEEEMFKWTZER6WEQ, seg_pos={0 0}, upload=298178]: Done uploading piece. err: <nil> Oct 7 16:22:28.422418980 (338h51m13.884511464s) [noise=true , address=77.90.31.10:4526 , piece_id=ZGYAUYWJIHPQWVFOVYYENPFVBGYCLXCHQOA6XYOYGWOYNQ7LISAA, seg_pos={0 0}, upload=298178]: Done uploading piece. err: <nil> Oct 7 16:22:28.534042473 (338h51m13.996134956s) [noise=true , address=45.91.116.10:4112 , piece_id=4ERWVJNJ6ATQQ4AUPSBQ75AKQPNWV3L6L35KJIW3HBFDPRIAOF3A, seg_pos={0 0}, upload=298178]: Done uploading piece. err: <nil> Oct 7 16:22:29.113054353 (338h51m14.575146826s) [noise=true , address=45.91.116.14:4212 , piece_id=FHGZAJNUWM4MDZBW6ICFNKHQCQWS73JLK3AORWRTOPS5WBXR2LXA, seg_pos={0 0}, upload=298178]: Done uploading piece. err: <nil> Oct 7 16:22:29.375631029 (338h51m14.837723512s) [noise=true , address=45.91.116.12:4234 , piece_id=3SA5TIU655HY3673O24MWCG5EFFUXXLEUKVTJ6RZX3J7KIDZP64A, seg_pos={0 0}, upload=298178]: Done uploading piece. err: <nil> Oct 7 16:23:25.358408111 (338h52m10.820500584s) [noise=true , address=145.79.227.52:4461 , piece_id=X3SIGSFOMVLY7OVODL7KURZYC6ZVPUZP5DFPG4XMU3EDSDWSTHLQ, seg_pos={0 0}, upload=298178]: Done uploading piece. err: ecclient: upload failed (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA, address:145.79.227.52:4461): protocol: write tcp 188.166.225.170:53512->145.79.227.52:4461: use of closed network connection; write tcp 188.166.225.170:53512->145.79.227.52:4461: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53512->145.79.227.52:4461: use of closed network connection Oct 7 16:23:25.358445682 (338h52m10.820538175s) [noise=true , address=145.79.227.44:4225 , piece_id=PS77R5A5E6RDQQU6DYSRSPCNZGWV25H77JAUCVISRHVK75RJFUQA, seg_pos={0 0}, upload=298178]: Done uploading piece. err: ecclient: upload failed (node:12HoBC3rCo4dTHYKsXZJNfSETHzkihdGfATJe46LdWM3DXVRdtR, address:145.79.227.44:4225): protocol: write tcp 188.166.225.170:39782->145.79.227.44:4225: use of closed network connection; write tcp 188.166.225.170:39782->145.79.227.44:4225: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39782->145.79.227.44:4225: use of closed network connection Oct 7 16:23:25.358525714 (338h52m10.820618198s) [noise=true , address=145.79.227.16:4917 , piece_id=QM2CPLYQL2GTTPWSENNLMUQPHK3MHQ6AGSMVZMOA7VILQFJWDVEQ, seg_pos={0 0}, upload=298178]: Done uploading piece. err: ecclient: upload failed (node:1VaqXNoBYjwbbE9xhAoLzDuxZMdBPSm2aMw7bYm4qZqiEGp5CV, address:145.79.227.16:4917): protocol: write tcp 188.166.225.170:56442->145.79.227.16:4917: use of closed network connection; write tcp 188.166.225.170:56442->145.79.227.16:4917: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56442->145.79.227.16:4917: use of closed network connection Oct 7 16:23:25.358612219 (338h52m10.820704702s) [noise=true , address=145.79.227.31:4802 , piece_id=JAFA42WLAAFGVF6VJXSM5EMB3SN5WINZSXCRPILV2RRGL3RO7CEA, seg_pos={0 0}, upload=298178]: Done uploading piece. err: ecclient: upload failed (node:1iMEuZv8uHpYjTqP9JVpznKPPdEyyy4xMTsgVUGMuCjZkV4cri, address:145.79.227.31:4802): protocol: write tcp 188.166.225.170:60548->145.79.227.31:4802: use of closed network connection; write tcp 188.166.225.170:60548->145.79.227.31:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60548->145.79.227.31:4802: use of closed network connection Oct 7 16:23:25.358683154 (338h52m10.820775627s) [noise=true , address=145.79.227.43:4179 , piece_id=L3DNEXRTVSVLEO6W3V6754AAN5A7OB42CO2NFRCMWN7SQMESEYLQ, seg_pos={0 0}, upload=298178]: Done uploading piece. err: ecclient: upload failed (node:12gh7eXJMeRFyjBP2e9ZyTQVVE1mMoMFfSkQ9ssfxJyqG63C4gP, address:145.79.227.43:4179): protocol: read tcp 188.166.225.170:47292->145.79.227.43:4179: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:23:25.358782293 (338h52m10.820874776s) [noise=true , address=145.79.227.22:4525 , piece_id=IAFKHJF47HLS26I7M4CL6JBA6V7KH42BMCIIT3YB5SI6K2MLEFMQ, seg_pos={0 0}, upload=298178]: Done uploading piece. err: ecclient: upload failed (node:12Yx3qg5NAW8iAw56mkwALjkkhyFF5feKgTZxcTG31RxBsubh5A, address:145.79.227.22:4525): protocol: read tcp 188.166.225.170:55688->145.79.227.22:4525: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:23:25.358810436 (338h52m10.82090292s) [seg_pos={0 0}, upload=298178]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Oct 7 16:23:25.603874154 (338h52m11.065966637s) [upload=298178]: Done uploading segments... Oct 7 16:23:25.603908570 (338h52m11.066001063s) [upload=298178]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 1m0.247014587s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 30.255816203s FAIL (2025-10-07 16:22:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Oct 7 16:21:59.422602403 (338h50m44.884694876s) [upload=298175]: Starting upload Oct 7 16:21:59.422674581 (338h50m44.884767054s) [upload=298175]: Done starting upload Oct 7 16:21:59.422818224 (338h50m44.884910717s) [upload=298175]: Uploading segments... Oct 7 16:21:59.422994540 (338h50m44.885087023s) [upload=298175]: Got next segment. Inline: false Oct 7 16:21:59.423065715 (338h50m44.885158208s) [upload=298175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 16:21:59.423073209 (338h50m44.885165692s) [upload=298175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 16:21:59.672383645 (338h50m45.134476118s) [seg_pos={0 0}, upload=298175]: Begin upload segment... Oct 7 16:21:59.672438248 (338h50m45.134530721s) [seg_pos={0 0}, upload=298175]: Done begin upload segment. Oct 7 16:21:59.672463426 (338h50m45.134555899s) [noise=true , address=45.91.116.8:4047 , piece_id=KTDWWRCIBLJ2DB73E7RLZMZIQGAKHHVUYCX3DBT62KFGXS3EIWLA, seg_pos={0 0}, upload=298175]: Uploading piece... Oct 7 16:21:59.672487172 (338h50m45.134579645s) [noise=true , address=45.91.116.4:4937 , piece_id=RPJIJX7ZP2XJ5CVHBKRS6Q5ADBSX3K3S6AUAZTDNAJANXRRYDRFA, seg_pos={0 0}, upload=298175]: Uploading piece... Oct 7 16:21:59.674701478 (338h50m45.136793961s) [noise=true , address=77.90.31.10:4517 , piece_id=URD23U34NU2A4KUYXQJSUCPCSOL6JUNYP6XFBDAMLS2MNMF3QOQQ, seg_pos={0 0}, upload=298175]: Uploading piece... Oct 7 16:21:59.674713882 (338h50m45.136806365s) [noise=true , address=45.91.116.5:4298 , piece_id=LFXCQ55JGA4ZZ3VPABDDF6F2SV354GYP7KKIX4Y4C2ZWLEJU7PEA, seg_pos={0 0}, upload=298175]: Uploading piece... Oct 7 16:21:59.675089978 (338h50m45.137182451s) [noise=true , address=77.90.31.16:4733 , piece_id=75DP4DBIL4WI44YD465VBIFYQWBVR4CKXU2EWGJB5QGFYQFSQKUA, seg_pos={0 0}, upload=298175]: Uploading piece... Oct 7 16:21:59.675275090 (338h50m45.137367573s) [noise=true , address=45.91.116.4:4939 , piece_id=5OQPEDWPFVI5U3N5EEAY7IOUPHIENTHHDU6RC7YB2I56J4KOVDVA, seg_pos={0 0}, upload=298175]: Uploading piece... Oct 7 16:21:59.675528993 (338h50m45.137621467s) [noise=true , address=145.79.227.18:4005 , piece_id=HJOJRZ6AYSWWRMLEK2LOK5HTAES4SCAHWW4IYCKL3J3HA3BKPUOA, seg_pos={0 0}, upload=298175]: Uploading piece... Oct 7 16:21:59.675803927 (338h50m45.13789641s) [noise=true , address=145.79.227.6:4258 , piece_id=CYGVWCSYVTFFLELV3NTSXMPJDRGB2TNNIZ4HF2DAUD5YIWAC2Q6A, seg_pos={0 0}, upload=298175]: Uploading piece... Oct 7 16:21:59.675861848 (338h50m45.137954321s) [noise=true , address=145.79.227.19:4077 , piece_id=XPC52NSYDSQDDV3YTFHSNXJXYKMIRPGK5Y4PHWL5W2MTPPZLH4RQ, seg_pos={0 0}, upload=298175]: Uploading piece... Oct 7 16:21:59.676163381 (338h50m45.138255854s) [noise=true , address=145.79.227.6:4259 , piece_id=RIL76GET7UZP5ILSOBG5BSWN4HAA3UHOBM7HJSJIRO353BUIJDKQ, seg_pos={0 0}, upload=298175]: Uploading piece... Oct 7 16:21:59.676382189 (338h50m45.138474672s) [noise=true , address=45.91.116.14:4191 , piece_id=HTDGBLK3YSPNV5SQAUVTFWFSMWBOVI6XBIWZROXLONEIDWPNSQDA, seg_pos={0 0}, upload=298175]: Uploading piece... Oct 7 16:21:59.676469084 (338h50m45.138561567s) [noise=true , address=45.91.116.12:4226 , piece_id=QKI6IJT6PJN663MXRFLV6AVFSR74WOP5NXEZRESWYXL33OUDV5JA, seg_pos={0 0}, upload=298175]: Uploading piece... Oct 7 16:21:59.676795355 (338h50m45.138887839s) [noise=true , address=45.91.116.6:4973 , piece_id=SVWFSNBI7DK5R2RCBDT6Q4A3ITD5ZW6D5O6QNBAHXBVNGCFVWCFQ, seg_pos={0 0}, upload=298175]: Uploading piece... Oct 7 16:21:59.677010265 (338h50m45.139102748s) [noise=true , address=45.91.116.6:4975 , piece_id=CHPNX5IA24Q26JNOFE6NDXUJTT4Y6MJWFBPULXKKNDLOL7FQGMZQ, seg_pos={0 0}, upload=298175]: Uploading piece... Oct 7 16:21:59.677460382 (338h50m45.139552865s) [noise=true , address=45.91.116.13:4155 , piece_id=IO6BRM66NRDRKTSJQ2DJUEHM4UQCKHTMPIC26GYMSVODWRQUBSKQ, seg_pos={0 0}, upload=298175]: Uploading piece... Oct 7 16:21:59.677630977 (338h50m45.13972346s) [noise=true , address=77.90.31.17:4771 , piece_id=4GRG7TZDGNN3W54ZFUNASINOUU26WZHET67V2WMLCEBKWDHJOWBA, seg_pos={0 0}, upload=298175]: Uploading piece... Oct 7 16:22:01.479736381 (338h50m46.941828884s) [upload=298175]: Next returned nil segment Oct 7 16:22:01.479769524 (338h50m46.941862007s) [upload=298175]: Waiting for error group managing segments... Oct 7 16:22:01.806187476 (338h50m47.268279959s) [noise=true , address=45.91.116.8:4047 , piece_id=KTDWWRCIBLJ2DB73E7RLZMZIQGAKHHVUYCX3DBT62KFGXS3EIWLA, seg_pos={0 0}, upload=298175]: Done uploading piece. err: <nil> Oct 7 16:22:01.815203514 (338h50m47.277295997s) [noise=true , address=45.91.116.5:4298 , piece_id=LFXCQ55JGA4ZZ3VPABDDF6F2SV354GYP7KKIX4Y4C2ZWLEJU7PEA, seg_pos={0 0}, upload=298175]: Done uploading piece. err: <nil> Oct 7 16:22:01.815347047 (338h50m47.277439601s) [noise=true , address=45.91.116.6:4975 , piece_id=CHPNX5IA24Q26JNOFE6NDXUJTT4Y6MJWFBPULXKKNDLOL7FQGMZQ, seg_pos={0 0}, upload=298175]: Done uploading piece. err: <nil> Oct 7 16:22:01.827479029 (338h50m47.289571512s) [noise=true , address=45.91.116.4:4939 , piece_id=5OQPEDWPFVI5U3N5EEAY7IOUPHIENTHHDU6RC7YB2I56J4KOVDVA, seg_pos={0 0}, upload=298175]: Done uploading piece. err: <nil> Oct 7 16:22:01.868404610 (338h50m47.330497103s) [noise=true , address=45.91.116.13:4155 , piece_id=IO6BRM66NRDRKTSJQ2DJUEHM4UQCKHTMPIC26GYMSVODWRQUBSKQ, seg_pos={0 0}, upload=298175]: Done uploading piece. err: <nil> Oct 7 16:22:01.880971810 (338h50m47.343064293s) [noise=true , address=45.91.116.14:4191 , piece_id=HTDGBLK3YSPNV5SQAUVTFWFSMWBOVI6XBIWZROXLONEIDWPNSQDA, seg_pos={0 0}, upload=298175]: Done uploading piece. err: <nil> Oct 7 16:22:01.884078966 (338h50m47.346171449s) [noise=true , address=45.91.116.6:4973 , piece_id=SVWFSNBI7DK5R2RCBDT6Q4A3ITD5ZW6D5O6QNBAHXBVNGCFVWCFQ, seg_pos={0 0}, upload=298175]: Done uploading piece. err: <nil> Oct 7 16:22:01.915089186 (338h50m47.377181669s) [noise=true , address=77.90.31.16:4733 , piece_id=75DP4DBIL4WI44YD465VBIFYQWBVR4CKXU2EWGJB5QGFYQFSQKUA, seg_pos={0 0}, upload=298175]: Done uploading piece. err: <nil> Oct 7 16:22:01.915642740 (338h50m47.377735224s) [noise=true , address=77.90.31.17:4771 , piece_id=4GRG7TZDGNN3W54ZFUNASINOUU26WZHET67V2WMLCEBKWDHJOWBA, seg_pos={0 0}, upload=298175]: Done uploading piece. err: <nil> Oct 7 16:22:01.946627350 (338h50m47.408719844s) [noise=true , address=45.91.116.4:4937 , piece_id=RPJIJX7ZP2XJ5CVHBKRS6Q5ADBSX3K3S6AUAZTDNAJANXRRYDRFA, seg_pos={0 0}, upload=298175]: Done uploading piece. err: <nil> Oct 7 16:22:02.030155754 (338h50m47.492248237s) [noise=true , address=77.90.31.10:4517 , piece_id=URD23U34NU2A4KUYXQJSUCPCSOL6JUNYP6XFBDAMLS2MNMF3QOQQ, seg_pos={0 0}, upload=298175]: Done uploading piece. err: <nil> Oct 7 16:22:02.036001566 (338h50m47.498094049s) [noise=true , address=45.91.116.12:4226 , piece_id=QKI6IJT6PJN663MXRFLV6AVFSR74WOP5NXEZRESWYXL33OUDV5JA, seg_pos={0 0}, upload=298175]: Done uploading piece. err: <nil> Oct 7 16:22:28.726372096 (338h51m14.188464589s) [noise=true , address=145.79.227.18:4005 , piece_id=HJOJRZ6AYSWWRMLEK2LOK5HTAES4SCAHWW4IYCKL3J3HA3BKPUOA, seg_pos={0 0}, upload=298175]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: read tcp 188.166.225.170:34410->145.79.227.18:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:22:28.726448451 (338h51m14.188540934s) [noise=true , address=145.79.227.19:4077 , piece_id=XPC52NSYDSQDDV3YTFHSNXJXYKMIRPGK5Y4PHWL5W2MTPPZLH4RQ, seg_pos={0 0}, upload=298175]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:60042->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:60042->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60042->145.79.227.19:4077: use of closed network connection Oct 7 16:22:28.726625458 (338h51m14.188717941s) [noise=true , address=145.79.227.6:4259 , piece_id=RIL76GET7UZP5ILSOBG5BSWN4HAA3UHOBM7HJSJIRO353BUIJDKQ, seg_pos={0 0}, upload=298175]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: read tcp 188.166.225.170:51352->145.79.227.6:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:22:28.726835017 (338h51m14.18892751s) [noise=true , address=145.79.227.6:4258 , piece_id=CYGVWCSYVTFFLELV3NTSXMPJDRGB2TNNIZ4HF2DAUD5YIWAC2Q6A, seg_pos={0 0}, upload=298175]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: read tcp 188.166.225.170:56904->145.79.227.6:4258: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:22:28.726893068 (338h51m14.188985551s) [seg_pos={0 0}, upload=298175]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Oct 7 16:22:28.979717824 (338h51m14.441810307s) [upload=298175]: Done uploading segments... Oct 7 16:22:28.979766528 (338h51m14.441859001s) [upload=298175]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.255967341s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 30.254403978s FAIL (2025-10-07 16:21:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== _id=PZWS3IZJX4ZLYYGRAVBEOFUYVIA3KZPECTGIR3EHIIQZFLFREHLQ, seg_pos={0 0}, upload=298158]: Uploading piece... Oct 7 16:20:52.675212631 (338h49m38.137305115s) [noise=true , address=145.79.227.18:4006 , piece_id=VSMDFIHEHKGUGDYTF2IJWADGWLKCELU3PKBWIK2IQGACNYREJZ2A, seg_pos={0 0}, upload=298158]: Uploading piece... Oct 7 16:20:52.675468999 (338h49m38.137561472s) [noise=true , address=145.79.227.19:4079 , piece_id=ZUSJEQRMQ5BSX6GAKKIJHRPKEGTHJPWZVD7MOJ4IWB52QAY3RSIA, seg_pos={0 0}, upload=298158]: Uploading piece... Oct 7 16:20:52.675684910 (338h49m38.137777393s) [noise=true , address=77.90.31.19:4842 , piece_id=N4GPU2TFFMDHMDJJCLUM5TUS4JE2MXZ2ASEEXGKNQ6ZQT5D5X6IQ, seg_pos={0 0}, upload=298158]: Uploading piece... Oct 7 16:20:52.676106734 (338h49m38.138199217s) [noise=true , address=145.79.227.7:4293 , piece_id=B4VQTQOTGT6LBEQUCAXTU62MZWRASEHMX2HATVJD5RXAVWHFUJBQ, seg_pos={0 0}, upload=298158]: Uploading piece... Oct 7 16:20:52.676527295 (338h49m38.138619778s) [noise=true , address=145.79.227.15:4875 , piece_id=HSOCA6GMB6IUEKC7ED2UMB56JIGIAWWTK6AFIWJCOHXLCTHMAFJQ, seg_pos={0 0}, upload=298158]: Uploading piece... Oct 7 16:20:52.676995145 (338h49m38.139087629s) [noise=true , address=45.91.116.12:4227 , piece_id=GXAJ6DFBLNG23N3U2TWBKSCSZM7PV53XHU3VRRFGF4A6GRKVFDHA, seg_pos={0 0}, upload=298158]: Uploading piece... Oct 7 16:20:52.677679449 (338h49m38.139771922s) [noise=true , address=145.79.227.4:4187 , piece_id=P4FQCQDYO7J5EJYWCW55KJS54A5I4MOWDIYDMWJW4KPN2ELTEKFQ, seg_pos={0 0}, upload=298158]: Uploading piece... Oct 7 16:20:52.678215169 (338h49m38.140307652s) [noise=true , address=145.79.227.14:4837 , piece_id=BPK2IKXTZLVY2G4LR6K7WFXJ5N5B3LWDABLNGHS22X6QK6E47U7A, seg_pos={0 0}, upload=298158]: Uploading piece... Oct 7 16:20:52.678756400 (338h49m38.140848883s) [noise=true , address=145.79.227.13:4801 , piece_id=44ECRHUCJX3U77LGNI6EPEAKEMN74QCDKTLUILV2S2XYBUEPPO5A, seg_pos={0 0}, upload=298158]: Uploading piece... Oct 7 16:20:52.682349171 (338h49m38.144441654s) [noise=true , address=145.79.227.17:4971 , piece_id=CVSRRQZLASO6MFAXFQPKWJTM6JGJLZ4F65UNLMX6QNUYOMJXTSCA, seg_pos={0 0}, upload=298158]: Uploading piece... Oct 7 16:20:54.494503951 (338h49m39.956596434s) [upload=298158]: Next returned nil segment Oct 7 16:20:54.494529560 (338h49m39.956622043s) [upload=298158]: Waiting for error group managing segments... Oct 7 16:20:54.804636704 (338h49m40.266729177s) [noise=true , address=45.91.116.6:4975 , piece_id=ASEGCEFUILTTPK2OO3CDVXFGYNTQ7X2Y4VU3PJVJTBQC4EOZK6JA, seg_pos={0 0}, upload=298158]: Done uploading piece. err: <nil> Oct 7 16:20:54.852464237 (338h49m40.31455671s) [noise=true , address=77.90.31.19:4842 , piece_id=N4GPU2TFFMDHMDJJCLUM5TUS4JE2MXZ2ASEEXGKNQ6ZQT5D5X6IQ, seg_pos={0 0}, upload=298158]: Done uploading piece. err: <nil> Oct 7 16:20:56.031525635 (338h49m41.493618118s) [noise=true , address=45.91.116.12:4227 , piece_id=GXAJ6DFBLNG23N3U2TWBKSCSZM7PV53XHU3VRRFGF4A6GRKVFDHA, seg_pos={0 0}, upload=298158]: Done uploading piece. err: <nil> Oct 7 16:21:21.689348450 (338h50m7.151440943s) [noise=true , address=145.79.227.6:4258 , piece_id=NCVR4ZLT3K7KVMO2OAFSBUMKXXBGSIRDWSOJDO3SPLLG4MNQP4HQ, seg_pos={0 0}, upload=298158]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:40634->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:40634->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40634->145.79.227.6:4258: use of closed network connection Oct 7 16:21:21.689670443 (338h50m7.151762916s) [noise=true , address=145.79.227.4:4187 , piece_id=P4FQCQDYO7J5EJYWCW55KJS54A5I4MOWDIYDMWJW4KPN2ELTEKFQ, seg_pos={0 0}, upload=298158]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:54536->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:21:21.689764432 (338h50m7.151856915s) [noise=true , address=145.79.227.18:4007 , piece_id=MXXGXPTHQBNSQL3SEPXYJRDZ52V6TVWLO6DPQY4KGSMXZH43L3QQ, seg_pos={0 0}, upload=298158]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: read tcp 188.166.225.170:53294->145.79.227.18:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:21:21.689902304 (338h50m7.151994797s) [noise=true , address=145.79.227.3:4150 , piece_id=PZWS3IZJX4ZLYYGRAVBEOFUYVIA3KZPECTGIR3EHIIQZFLFREHLQ, seg_pos={0 0}, upload=298158]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:47350->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:47350->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47350->145.79.227.3:4150: use of closed network connection Oct 7 16:21:21.689998618 (338h50m7.152091101s) [noise=true , address=145.79.227.19:4079 , piece_id=ZUSJEQRMQ5BSX6GAKKIJHRPKEGTHJPWZVD7MOJ4IWB52QAY3RSIA, seg_pos={0 0}, upload=298158]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: read tcp 188.166.225.170:34662->145.79.227.19:4079: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:21:21.690220770 (338h50m7.152313264s) [noise=true , address=145.79.227.7:4293 , piece_id=B4VQTQOTGT6LBEQUCAXTU62MZWRASEHMX2HATVJD5RXAVWHFUJBQ, seg_pos={0 0}, upload=298158]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: read tcp 188.166.225.170:38438->145.79.227.7:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:21:21.690383531 (338h50m7.152476004s) [noise=true , address=145.79.227.19:4077 , piece_id=OKC323P2TLN35ZBUINGKQ36QNIPXE3KBQ3UZUMKV2UDLC3BEVPGA, seg_pos={0 0}, upload=298158]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: read tcp 188.166.225.170:46736->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:21:21.690422234 (338h50m7.152514727s) [noise=true , address=145.79.227.13:4801 , piece_id=44ECRHUCJX3U77LGNI6EPEAKEMN74QCDKTLUILV2S2XYBUEPPO5A, seg_pos={0 0}, upload=298158]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: read tcp 188.166.225.170:54036->145.79.227.13:4801: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:21:21.690600624 (338h50m7.152693107s) [noise=true , address=145.79.227.17:4971 , piece_id=CVSRRQZLASO6MFAXFQPKWJTM6JGJLZ4F65UNLMX6QNUYOMJXTSCA, seg_pos={0 0}, upload=298158]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: read tcp 188.166.225.170:40886->145.79.227.17:4971: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:21:21.690658104 (338h50m7.152750587s) [noise=true , address=145.79.227.18:4006 , piece_id=VSMDFIHEHKGUGDYTF2IJWADGWLKCELU3PKBWIK2IQGACNYREJZ2A, seg_pos={0 0}, upload=298158]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: read tcp 188.166.225.170:38066->145.79.227.18:4006: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:21:21.690807498 (338h50m7.152899981s) [noise=true , address=145.79.227.15:4875 , piece_id=HSOCA6GMB6IUEKC7ED2UMB56JIGIAWWTK6AFIWJCOHXLCTHMAFJQ, seg_pos={0 0}, upload=298158]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: read tcp 188.166.225.170:50776->145.79.227.15:4875: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:21:21.690951322 (338h50m7.153043795s) [noise=true , address=145.79.227.14:4837 , piece_id=BPK2IKXTZLVY2G4LR6K7WFXJ5N5B3LWDABLNGHS22X6QK6E47U7A, seg_pos={0 0}, upload=298158]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: read tcp 188.166.225.170:53298->145.79.227.14:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:21:21.690996619 (338h50m7.153089102s) [noise=true , address=145.79.227.11:4730 , piece_id=5R4EVZEKU6UH6WWDQ3BHALOLGNE4MEA3YWR7OSD6D4Y2CB4HL3FQ, seg_pos={0 0}, upload=298158]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: read tcp 188.166.225.170:34780->145.79.227.11:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:21:21.691022126 (338h50m7.153114599s) [seg_pos={0 0}, upload=298158]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Oct 7 16:21:21.942022138 (338h50m7.404114631s) [upload=298158]: Done uploading segments... Oct 7 16:21:21.942053127 (338h50m7.404145611s) [upload=298158]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 30.25442038s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.258885312s FAIL (2025-10-07 16:20:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== t segment. Inline: false Oct 7 16:20:21.916665458 (338h49m7.378757941s) [upload=298152]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 16:20:21.916671189 (338h49m7.378763672s) [upload=298152]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 16:20:22.194376043 (338h49m7.656468526s) [seg_pos={0 0}, upload=298152]: Begin upload segment... Oct 7 16:20:22.194435075 (338h49m7.656527558s) [seg_pos={0 0}, upload=298152]: Done begin upload segment. Oct 7 16:20:22.194469912 (338h49m7.656562425s) [noise=true , address=45.91.116.14:4189 , piece_id=45Y4SSMXXDS5JM6PXMVAG7P3XZTFVZY3TZDTUPUC2M4VENMTJRGA, seg_pos={0 0}, upload=298152]: Uploading piece... Oct 7 16:20:22.200011494 (338h49m7.662103977s) [noise=true , address=145.79.227.5:4223 , piece_id=Q5QIF3IBIAUO5GULJZRZ4LLHWVBOYJHVOYY3H7LOTGUAKEAT3TFA, seg_pos={0 0}, upload=298152]: Uploading piece... Oct 7 16:20:22.200608260 (338h49m7.662700733s) [noise=true , address=145.79.227.13:4801 , piece_id=S6GIHVV5STBWNYH7KFVMSP2GWWQOAC3ZJP7IMECXTJZCG3AWX4DA, seg_pos={0 0}, upload=298152]: Uploading piece... Oct 7 16:20:22.201020304 (338h49m7.663112788s) [noise=true , address=77.90.31.14:4661 , piece_id=IXSVX5I6OCV3E34OQOW5UPJFEMSPHJ6M3NL3UC6XHL3PVMNW6UGQ, seg_pos={0 0}, upload=298152]: Uploading piece... Oct 7 16:20:22.201466895 (338h49m7.663559378s) [noise=true , address=45.91.116.11:4119 , piece_id=NVC25LRNIJ5VZUYZSNESKAUYOVWI7LSXQMIBPCVW777B43DPNYUQ, seg_pos={0 0}, upload=298152]: Uploading piece... Oct 7 16:20:22.201904208 (338h49m7.663996691s) [noise=true , address=145.79.227.6:4258 , piece_id=F3P2P4TJAHEYIRYN6C4CRIVUR5GCLDWLSX2FDR74C5ZILYHQOVIQ, seg_pos={0 0}, upload=298152]: Uploading piece... Oct 7 16:20:22.202236981 (338h49m7.664329454s) [noise=true , address=145.79.227.18:4007 , piece_id=ACLGMW4WRK4NU66PSCAHQ25MNC4HL6T4DL4GBKQM5PFHJUZL3ODQ, seg_pos={0 0}, upload=298152]: Uploading piece... Oct 7 16:20:22.202585846 (338h49m7.664678329s) [noise=true , address=77.90.31.12:4590 , piece_id=V6ZOVKVTETNWCD6LEWT6NEEUEYGPEMU243TBND7ZRXA3DAH2ILMQ, seg_pos={0 0}, upload=298152]: Uploading piece... Oct 7 16:20:22.203166021 (338h49m7.665258504s) [noise=true , address=77.90.31.21:4878 , piece_id=S6H7HWBXAZAKUSV2PULWWJA6665I2M5DKFVQKY2U5SIKNIW35QRA, seg_pos={0 0}, upload=298152]: Uploading piece... Oct 7 16:20:22.203613373 (338h49m7.665705856s) [noise=true , address=145.79.227.3:4151 , piece_id=HLYDOVIWR4SSVF5ECK74ZDQZ77YNHGE7RF24F3C5F33RZYFXYIPQ, seg_pos={0 0}, upload=298152]: Uploading piece... Oct 7 16:20:22.205675219 (338h49m7.667767702s) [noise=true , address=45.91.116.9:4263 , piece_id=NNYT6TK72AXVOXDVSWB7LGGU6X7HBK5XHW5SIFSAFTLPI3NWADWA, seg_pos={0 0}, upload=298152]: Uploading piece... Oct 7 16:20:22.207519981 (338h49m7.669612494s) [noise=true , address=45.91.116.5:4299 , piece_id=UMFIANLCPIG6FDWTTLUFOG6NVDDPCYZEWINBKDSDOQCTKCOMEB2Q, seg_pos={0 0}, upload=298152]: Uploading piece... Oct 7 16:20:22.216060674 (338h49m7.678153187s) [noise=true , address=77.90.31.16:4734 , piece_id=ECK56ZF6TG7ZBCBL353ZDBJAGZIGGPRMWKKNND6IRE64WT2TMI6Q, seg_pos={0 0}, upload=298152]: Uploading piece... Oct 7 16:20:22.218165001 (338h49m7.680257485s) [noise=true , address=45.91.116.10:4082 , piece_id=E2NF27TA7VRXYN4CHYVENHUS7IFEVY6DMY4ULLAO3OWHG4QHMFJA, seg_pos={0 0}, upload=298152]: Uploading piece... Oct 7 16:20:22.227880361 (338h49m7.689972844s) [noise=true , address=145.79.227.11:4729 , piece_id=BH4V3GVKC5SI7M6FOCJ7DYVVRIJ77I3EGNDC6PD3UG45RRY4EI2A, seg_pos={0 0}, upload=298152]: Uploading piece... Oct 7 16:20:22.229696058 (338h49m7.691788571s) [noise=true , address=145.79.227.2:4114 , piece_id=DTOP6ZOP6NXOSKFZQ7HBP3QBESKDP44SZSUHPXHJ4NI6COJNIQ2A, seg_pos={0 0}, upload=298152]: Uploading piece... Oct 7 16:20:24.047175389 (338h49m9.509267872s) [upload=298152]: Next returned nil segment Oct 7 16:20:24.047195217 (338h49m9.5092877s) [upload=298152]: Waiting for error group managing segments... Oct 7 16:20:24.345956757 (338h49m9.80804923s) [noise=true , address=45.91.116.14:4189 , piece_id=45Y4SSMXXDS5JM6PXMVAG7P3XZTFVZY3TZDTUPUC2M4VENMTJRGA, seg_pos={0 0}, upload=298152]: Done uploading piece. err: <nil> Oct 7 16:20:24.346207784 (338h49m9.808300267s) [noise=true , address=77.90.31.21:4878 , piece_id=S6H7HWBXAZAKUSV2PULWWJA6665I2M5DKFVQKY2U5SIKNIW35QRA, seg_pos={0 0}, upload=298152]: Done uploading piece. err: <nil> Oct 7 16:20:24.346394029 (338h49m9.808486502s) [noise=true , address=77.90.31.16:4734 , piece_id=ECK56ZF6TG7ZBCBL353ZDBJAGZIGGPRMWKKNND6IRE64WT2TMI6Q, seg_pos={0 0}, upload=298152]: Done uploading piece. err: <nil> Oct 7 16:20:24.404426805 (338h49m9.866519288s) [noise=true , address=45.91.116.11:4119 , piece_id=NVC25LRNIJ5VZUYZSNESKAUYOVWI7LSXQMIBPCVW777B43DPNYUQ, seg_pos={0 0}, upload=298152]: Done uploading piece. err: <nil> Oct 7 16:20:24.431928855 (338h49m9.894021338s) [noise=true , address=77.90.31.14:4661 , piece_id=IXSVX5I6OCV3E34OQOW5UPJFEMSPHJ6M3NL3UC6XHL3PVMNW6UGQ, seg_pos={0 0}, upload=298152]: Done uploading piece. err: <nil> Oct 7 16:20:24.444411924 (338h49m9.906504407s) [noise=true , address=45.91.116.9:4263 , piece_id=NNYT6TK72AXVOXDVSWB7LGGU6X7HBK5XHW5SIFSAFTLPI3NWADWA, seg_pos={0 0}, upload=298152]: Done uploading piece. err: <nil> Oct 7 16:20:24.460836390 (338h49m9.922928873s) [noise=true , address=45.91.116.10:4082 , piece_id=E2NF27TA7VRXYN4CHYVENHUS7IFEVY6DMY4ULLAO3OWHG4QHMFJA, seg_pos={0 0}, upload=298152]: Done uploading piece. err: <nil> Oct 7 16:20:24.578278502 (338h49m10.040370986s) [noise=true , address=45.91.116.5:4299 , piece_id=UMFIANLCPIG6FDWTTLUFOG6NVDDPCYZEWINBKDSDOQCTKCOMEB2Q, seg_pos={0 0}, upload=298152]: Done uploading piece. err: <nil> Oct 7 16:20:24.609357182 (338h49m10.071449665s) [noise=true , address=77.90.31.12:4590 , piece_id=V6ZOVKVTETNWCD6LEWT6NEEUEYGPEMU243TBND7ZRXA3DAH2ILMQ, seg_pos={0 0}, upload=298152]: Done uploading piece. err: <nil> Oct 7 16:20:51.211180643 (338h49m36.673273126s) [noise=true , address=145.79.227.6:4258 , piece_id=F3P2P4TJAHEYIRYN6C4CRIVUR5GCLDWLSX2FDR74C5ZILYHQOVIQ, seg_pos={0 0}, upload=298152]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:54050->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:54050->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54050->145.79.227.6:4258: use of closed network connection Oct 7 16:20:51.211265424 (338h49m36.673357907s) [noise=true , address=145.79.227.13:4801 , piece_id=S6GIHVV5STBWNYH7KFVMSP2GWWQOAC3ZJP7IMECXTJZCG3AWX4DA, seg_pos={0 0}, upload=298152]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: read tcp 188.166.225.170:56168->145.79.227.13:4801: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:20:51.211398658 (338h49m36.673491151s) [noise=true , address=145.79.227.18:4007 , piece_id=ACLGMW4WRK4NU66PSCAHQ25MNC4HL6T4DL4GBKQM5PFHJUZL3ODQ, seg_pos={0 0}, upload=298152]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:38624->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:38624->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38624->145.79.227.18:4007: use of closed network connection Oct 7 16:20:51.211475664 (338h49m36.673568167s) [noise=true , address=145.79.227.3:4151 , piece_id=HLYDOVIWR4SSVF5ECK74ZDQZ77YNHGE7RF24F3C5F33RZYFXYIPQ, seg_pos={0 0}, upload=298152]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: read tcp 188.166.225.170:59634->145.79.227.3:4151: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:20:51.211553452 (338h49m36.673645925s) [noise=true , address=145.79.227.2:4114 , piece_id=DTOP6ZOP6NXOSKFZQ7HBP3QBESKDP44SZSUHPXHJ4NI6COJNIQ2A, seg_pos={0 0}, upload=298152]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: read tcp 188.166.225.170:48024->145.79.227.2:4114: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:20:51.211629517 (338h49m36.673722s) [noise=true , address=145.79.227.11:4729 , piece_id=BH4V3GVKC5SI7M6FOCJ7DYVVRIJ77I3EGNDC6PD3UG45RRY4EI2A, seg_pos={0 0}, upload=298152]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: read tcp 188.166.225.170:40604->145.79.227.11:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:20:51.211727563 (338h49m36.673820047s) [noise=true , address=145.79.227.5:4223 , piece_id=Q5QIF3IBIAUO5GULJZRZ4LLHWVBOYJHVOYY3H7LOTGUAKEAT3TFA, seg_pos={0 0}, upload=298152]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: read tcp 188.166.225.170:33974->145.79.227.5:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 7 16:20:51.211750748 (338h49m36.673843231s) [seg_pos={0 0}, upload=298152]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:20:51.468057046 (338h49m36.930149529s) [upload=298152]: Done uploading segments... Oct 7 16:20:51.468085470 (338h49m36.930177943s) [upload=298152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 30.258907192s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.117024263s FAIL (2025-10-07 15:31:12 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 6.117061093s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.385324068s FAIL (2025-10-07 15:30:53 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 6.385359263s core uplink us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)