Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [.XXXXX.XXXXXXXXX............................................] duration: 6.348538537s FAIL (2025-10-07 17:09:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 6.348572914s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 18 out of 60 is failed (threshold=3) [XXXXXXXXXXX.XXXXXXX.........................................] duration: 5.933571895s FAIL (2025-10-07 17:08:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.933609708s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [..XXXXX.XXXXXXXXX...........................................] duration: 6.051125169s FAIL (2025-10-07 17:08:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 6.051158382s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 19 out of 60 is failed (threshold=3) [XXXXXXXXXXXX.XXXXXXX........................................] duration: 6.073067573s FAIL (2025-10-07 17:08:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.073150953s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [...XXXXX.XXXXXXXXX..........................................] duration: 5.73071812s FAIL (2025-10-07 17:07:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.730753778s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 20 out of 60 is failed (threshold=3) [XXXXXXXXXXXXX.XXXXXXX.......................................] duration: 6.018101187s FAIL (2025-10-07 17:07:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.018133248s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [....XXXXX.XXXXXXXXX.........................................] duration: 5.970741242s FAIL (2025-10-07 17:06:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.970769798s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 21 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXX.XXXXXXX......................................] duration: 6.117633928s FAIL (2025-10-07 17:06:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.117659888s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [.....XXXXX.XXXXXXXXX........................................] duration: 5.887825165s FAIL (2025-10-07 17:06:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.887894658s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 22 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXX.XXXXXXX.....................................] duration: 6.134984085s FAIL (2025-10-07 17:05:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.13501795s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [......XXXXX.XXXXXXXXX.......................................] duration: 5.951541242s FAIL (2025-10-07 17:05:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.951575627s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 23 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXX.XXXXXXX....................................] duration: 6.162624939s FAIL (2025-10-07 17:05:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.162652369s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [.......XXXXX.XXXXXXXXX......................................] duration: 5.947100428s FAIL (2025-10-07 17:04:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.947125797s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXX.XXXXXXX...................................] duration: 6.25846534s FAIL (2025-10-07 17:04:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.258518261s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [........XXXXX.XXXXXXXXX.....................................] duration: 5.852537542s FAIL (2025-10-07 17:03:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.852570506s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [.XXXXXXXXXXXXXXXXX.XXXXXXX..................................] duration: 6.145613312s FAIL (2025-10-07 17:03:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.145652949s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [.........XXXXX.XXXXXXXXX....................................] duration: 6.097763488s FAIL (2025-10-07 17:03:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 6.097798777s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [..XXXXXXXXXXXXXXXXX.XXXXXXX.................................] duration: 6.374672689s FAIL (2025-10-07 17:02:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.374708829s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [..........XXXXX.XXXXXXXXX...................................] duration: 6.164538922s FAIL (2025-10-07 17:02:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 6.164565942s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [...XXXXXXXXXXXXXXXXX.XXXXXXX................................] duration: 6.288023694s FAIL (2025-10-07 17:01:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.288059552s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [...........XXXXX.XXXXXXXXX..................................] duration: 6.098467598s FAIL (2025-10-07 17:01:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 6.098507804s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [....XXXXXXXXXXXXXXXXX.XXXXXXX...............................] duration: 6.109884308s FAIL (2025-10-07 17:01:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.109915698s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [............XXXXX.XXXXXXXXX.................................] duration: 6.036216572s FAIL (2025-10-07 17:00:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 6.036248022s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [.....XXXXXXXXXXXXXXXXX.XXXXXXX..............................] duration: 5.979154827s FAIL (2025-10-07 17:00:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.979190285s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [......XXXXXXXXXXXXXXXXX.XXXXXXX.............................] duration: 6.013717272s FAIL (2025-10-07 16:59:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.013750667s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [.............XXXXX.XXXXXXXXX................................] duration: 5.905543059s FAIL (2025-10-07 16:59:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.905578897s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [.......XXXXXXXXXXXXXXXXX.XXXXXXX............................] duration: 6.189595686s FAIL (2025-10-07 16:59:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.189644178s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [..............XXXXX.XXXXXXXXX...............................] duration: 5.944565859s FAIL (2025-10-07 16:58:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.944600245s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [........XXXXXXXXXXXXXXXXX.XXXXXXX...........................] duration: 5.960036628s FAIL (2025-10-07 16:58:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.960061254s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [...............XXXXX.XXXXXXXXX..............................] duration: 5.784330552s FAIL (2025-10-07 16:57:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.784363284s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [.........XXXXXXXXXXXXXXXXX.XXXXXXX..........................] duration: 6.046030642s FAIL (2025-10-07 16:57:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.046082991s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [................XXXXX.XXXXXXXXX.............................] duration: 5.769504086s FAIL (2025-10-07 16:57:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.769533562s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [..........XXXXXXXXXXXXXXXXX.XXXXXXX.........................] duration: 6.033680812s FAIL (2025-10-07 16:56:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.033712073s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [.................XXXXX.XXXXXXXXX............................] duration: 5.861009883s FAIL (2025-10-07 16:56:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.861033136s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [...........XXXXXXXXXXXXXXXXX.XXXXXXX........................] duration: 6.2089046s FAIL (2025-10-07 16:56:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.208959705s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [..................XXXXX.XXXXXXXXX...........................] duration: 5.908629802s FAIL (2025-10-07 16:55:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.908688324s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [............XXXXXXXXXXXXXXXXX.XXXXXXX.......................] duration: 6.087294721s FAIL (2025-10-07 16:55:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.087336469s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [...................XXXXX.XXXXXXXXX..........................] duration: 6.001206528s FAIL (2025-10-07 16:55:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 6.001342729s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [....................XXXXX.XXXXXXXXX.........................] duration: 6.023761204s FAIL (2025-10-07 16:54:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 6.02379126s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [.............XXXXXXXXXXXXXXXXX.XXXXXXX......................] duration: 6.244354258s FAIL (2025-10-07 16:54:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.244393774s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [.....................XXXXX.XXXXXXXXX........................] duration: 6.038041515s FAIL (2025-10-07 16:53:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 6.038068085s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [......................XXXXX.XXXXXXXXX.......................] duration: 5.772879493s FAIL (2025-10-07 16:53:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 5.772912796s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [..............XXXXXXXXXXXXXXXXX.XXXXXXX.....................] duration: 6.677586779s FAIL (2025-10-07 16:53:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.677616134s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [.......................XXXXX.XXXXXXXXX......................] duration: 6.007010813s FAIL (2025-10-07 16:52:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 6.007038625s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [...............XXXXXXXXXXXXXXXXX.XXXXXXX....................] duration: 6.37218691s FAIL (2025-10-07 16:52:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.372221715s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [................XXXXXXXXXXXXXXXXX.XXXXXXX...................] duration: 7.289655859s FAIL (2025-10-07 16:52:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 7.289690424s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [........................XXXXX.XXXXXXXXX.....................] duration: 6.247544353s FAIL (2025-10-07 16:51:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 6.247577947s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [.................XXXXXXXXXXXXXXXXX.XXXXXXX..................] duration: 6.266903862s FAIL (2025-10-07 16:51:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.266976851s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 14 out of 60 is failed (threshold=3) [.........................XXXXX.XXXXXXXXX....................] duration: 6.736089992s FAIL (2025-10-07 16:51:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 40 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210538234 (339h5m43.672630707s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.210879595 (339h5m43.672972078s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211265199 (339h5m43.673357672s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.211644772 (339h5m43.673737255s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212714248 (339h5m43.674806732s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.212971488 (339h5m43.675063971s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214311270 (339h5m43.676403743s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.214378808 (339h5m43.676471291s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215585355 (339h5m43.677677838s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.215658565 (339h5m43.677751038s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:58.216983408 (339h5m43.679075881s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Uploading piece... Oct 7 16:36:59.777611637 (339h5m45.23970412s) [upload=298389]: Next returned nil segment Oct 7 16:36:59.777633357 (339h5m45.239725832s) [upload=298389]: Waiting for error group managing segments... Oct 7 16:37:00.187029508 (339h5m45.649121991s) [noise=true , address=45.91.116.8:4073 , piece_id=NM67YPQNGEQ24WMEJ4SD745PSAPAGC5RDJCBKG3VG6FTPQV5XLFA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.234957121 (339h5m45.697049604s) [noise=true , address=45.91.116.10:4097 , piece_id=KCUDS67BOLLMZODZQ4DTIBGZNRFDE6P5A3PVTJQCMOJAJ22DLJFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.248544875 (339h5m45.710637359s) [noise=true , address=45.91.116.9:4269 , piece_id=XEF33NANT7QEMX2JVWHFNDGY2NRSM3E3SZCSCL54D2LV2DHODI3Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.251828618 (339h5m45.713921101s) [noise=true , address=77.90.31.12:4624 , piece_id=HZL2I5G4GSLOLPUAMYQL6TLVBNEEYFE55YPLXDETQT4HXQ4DJRHQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.252621598 (339h5m45.714714081s) [noise=true , address=45.91.116.8:4046 , piece_id=GOKRVPHT7EVA33SIGDVZ2YUVSW6FKBEAUK5LGBGQCZ3TYXDQK27A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.259245511 (339h5m45.721337994s) [noise=true , address=77.90.31.10:4533 , piece_id=GLGKJHKZ43WLHKM2FKB6AX4NLUSXMCUZBSUGFXW4SVRGF7AVYZ4A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.270016091 (339h5m45.732108574s) [noise=true , address=45.91.116.13:4181 , piece_id=VAE57IFIMXMF3JHSJOV5LGURRLMRSDM5W6YWVRK4KD5HQRBNPC2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.278685859 (339h5m45.740778342s) [noise=true , address=45.91.116.7:4027 , piece_id=VALORMPGXTH656AFIFUKWTMOIXRRGKN7Y3SWNUB2OY5ESIPSNNUA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.293886895 (339h5m45.755979368s) [noise=true , address=45.91.116.5:4317 , piece_id=EK4T3PAZFNR2FB6XXHHPOLQXTD3HZYXFYUXZOHLKIMGIUJ4PLI4Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:00.341911484 (339h5m45.804003967s) [noise=true , address=77.90.31.16:4741 , piece_id=DAEXIJZGKYXSIU5H7JISKJY5FAHEUIYAH2VTUX4BWXO43RVHHKNA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: <nil> Oct 7 16:37:57.244681422 (339h6m42.706773905s) [noise=true , address=145.79.227.23:4574 , piece_id=LJWG2QBCIKQCJTW5GACDI6YL5FRLMBAA37KCMJEDT2NJKX44WMCQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV, address:145.79.227.23:4574): protocol: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40270->145.79.227.23:4574: use of closed network connection Oct 7 16:37:57.244789257 (339h6m42.70688173s) [noise=true , address=145.79.227.50:4377 , piece_id=INQRPFN5DNSJNYJ6EU52MOY6CC5N46ZKJK7TUMRX6P6K7YQNEW2A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49108->145.79.227.50:4377: use of closed network connection Oct 7 16:37:57.244817371 (339h6m42.706909854s) [noise=true , address=145.79.227.33:4896 , piece_id=YW6EJHBZ4P2BLKSOWPVDUQK6AHTWU7UYWHDM5J6IXHA3VBH5GKFQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:145.79.227.33:4896): protocol: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44586->145.79.227.33:4896: use of closed network connection Oct 7 16:37:57.244901350 (339h6m42.706993833s) [noise=true , address=145.79.227.34:4937 , piece_id=SQRVGYBRZIQXTCLPDJ32A2A6OMT4R4NMXQ6VMAHEPDT7VORS6MJQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1LKrFThdW3jJpG6dRZLUaxLXTa5Wy27yQ8PGUEqjvBWfFoRB94, address:145.79.227.34:4937): protocol: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36724->145.79.227.34:4937: use of closed network connection Oct 7 16:37:57.244912932 (339h6m42.707005415s) [noise=true , address=145.79.227.42:4140 , piece_id=HFRKKBY6WTUXHVMSXGTA64GJSZ2EPAFWEQ4JTAUOT3ZOTCGDLE7A, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL, address:145.79.227.42:4140): protocol: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58214->145.79.227.42:4140: use of closed network connection Oct 7 16:37:57.244979669 (339h6m42.707072142s) [noise=true , address=145.79.227.41:4114 , piece_id=QRZ7DBF5SEWYIIJZDT5WE4S7AZIZKWAFLYGMO5DUUULVXNGMGCUQ, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:145.79.227.41:4114): protocol: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->145.79.227.41:4114: use of closed network connection Oct 7 16:37:57.244995931 (339h6m42.707088414s) [noise=true , address=145.79.227.25:4621 , piece_id=6HEHE3C7KRO7MDL7VJT6OKQV6KVCZ5L4E6VB2POV4MDFRZOHV4PA, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:12VY2FEQWX4WPXwgMVBKoANFgqFd1npRBUG8pfQKWVB6gJw96AS, address:145.79.227.25:4621): protocol: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37054->145.79.227.25:4621: use of closed network connection Oct 7 16:37:57.245345276 (339h6m42.707437759s) [noise=true , address=145.79.227.38:4001 , piece_id=2HC4L7BCU5FD5AJXB2S3KFKQJ7FKFWBOCE4NK3IZ7R724KEAZD5Q, seg_pos={0 0}, upload=298389]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:145.79.227.38:4001): protocol: read tcp 188.166.225.170:44060->145.79.227.38:4001: use of closed network connection; context deadline exceeded Oct 7 16:37:57.245373590 (339h6m42.707466063s) [seg_pos={0 0}, upload=298389]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 7 16:37:57.485726708 (339h6m42.947819191s) [upload=298389]: Done uploading segments... Oct 7 16:37:57.485755113 (339h6m42.947847586s) [upload=298389]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 6.736119099s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [..................XXXXXXXXXXXXXXXXX.XXXXXXX.................] duration: 6.291713942s FAIL (2025-10-07 16:50:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 89747938s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.528424960 (339h5m59.990517443s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529039220 (339h5m59.991131703s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529621989 (339h5m59.991714472s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.529746456 (339h5m59.991838929s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530216641 (339h5m59.992309124s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530491164 (339h5m59.992583647s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.530816284 (339h5m59.992908757s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531401988 (339h5m59.993494471s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.531951876 (339h5m59.994044349s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532453010 (339h5m59.994545483s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.532909830 (339h5m59.995002313s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.534584739 (339h5m59.996677222s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.542652722 (339h6m0.004745195s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.544179159 (339h6m0.006271642s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:14.545929121 (339h6m0.008021594s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Uploading piece... Oct 7 16:37:16.173533526 (339h6m1.635626009s) [upload=298393]: Next returned nil segment Oct 7 16:37:16.173596717 (339h6m1.63568923s) [upload=298393]: Waiting for error group managing segments... Oct 7 16:37:16.576949057 (339h6m2.03904154s) [noise=true , address=45.91.116.14:4189 , piece_id=IHV3MMZ2HX4CTKTYLIFUULGXWSG2RCAHQR34B255XOMXRKNFHCDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.611441678 (339h6m2.073534151s) [noise=true , address=45.91.116.4:4940 , piece_id=SIBIGA5AAEQLT36UIHJNSL7G7RKNP3SQPNBWHG2D46WF4FESQREQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.646455811 (339h6m2.108548284s) [noise=true , address=45.91.116.8:4048 , piece_id=NRPPE4HR4VC5T5NZJZ2WM2RS43SUEHMTSIP4XKIQJDNEKDAPX5OA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679862655 (339h6m2.141955138s) [noise=true , address=77.90.31.10:4520 , piece_id=JGPDKKWOXJICJNTAZLJTS6AF3OWULB3BM7B5BR2M4SGEBDMDXL6A, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.679943579 (339h6m2.142036062s) [noise=true , address=77.90.31.18:4806 , piece_id=LFWCFSTRDCWG647GZ52SOJD56J2JRGDNBBI65DFCCEL3PYO57XDA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.697034002 (339h6m2.159126485s) [noise=true , address=77.90.31.19:4843 , piece_id=LROZMKUSB4FCZ75E2BRLWFH4C4VQK6MLBJK6LNQSE2H3ME3PBPPA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.710569226 (339h6m2.172661699s) [noise=true , address=77.90.31.15:4698 , piece_id=G3S3QX3CONDWUMDFP36LFACV4PDHGJKJHOAJPFNFSE2DNUGNZOZQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.721550616 (339h6m2.183643099s) [noise=true , address=77.90.31.14:4663 , piece_id=T3LARUBOWJNBQH6NVJ6UIQMVBTBELJ6XM3MDRV3FFQSCIU62HTAQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:16.767164143 (339h6m2.229256616s) [noise=true , address=45.91.116.10:4083 , piece_id=OYJZKR3RUNGYIQNKNKYWNZ4BHNEOP4E5VUHU6ZIYTBEPNDSXY4DQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: <nil> Oct 7 16:37:43.567377968 (339h6m29.029470451s) [noise=true , address=145.79.227.11:4732 , piece_id=CAWQRFLWRUWESNNCBHHYUSQJPGD4JFALM4CXQOYOJXEPSOJIGYBQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52386->145.79.227.11:4732: use of closed network connection Oct 7 16:37:43.567453413 (339h6m29.029545896s) [noise=true , address=145.79.227.18:4006 , piece_id=JPVRRS5U3G3WHOWZUR4JRDDUC3NBSMUZGOTE7REF4IMXLD6OMHXQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42618->145.79.227.18:4006: use of closed network connection Oct 7 16:37:43.567535268 (339h6m29.029627751s) [noise=true , address=145.79.227.15:4875 , piece_id=PACBSK3M5EFO44REE4ACRSU7OMSKI5PRG6AR7EAOVBMBVQSKLVNQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54784->145.79.227.15:4875: use of closed network connection Oct 7 16:37:43.567602146 (339h6m29.029694629s) [noise=true , address=145.79.227.4:4185 , piece_id=4A5DZQQWPDYAFFNHBBYP3T3UN2XSKNGWJQ3EQ2OC2MW6E27IJ5SQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.4:4185: use of closed network connection Oct 7 16:37:43.567650718 (339h6m29.029743201s) [noise=true , address=145.79.227.19:4077 , piece_id=AP2BWDBJFY3FCAULHEQM7ZNC2ES7J3H2LS7QXER5OS46GMF2TPMQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34948->145.79.227.19:4077: use of closed network connection Oct 7 16:37:43.567708218 (339h6m29.029800691s) [noise=true , address=145.79.227.7:4295 , piece_id=JDI7HMAJET5CINHHE64MOLIPYCY7QVI2EWH3LLVZ3YAT5QVZXHFQ, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58880->145.79.227.7:4295: use of closed network connection Oct 7 16:37:43.568093752 (339h6m29.030186245s) [noise=true , address=145.79.227.14:4840 , piece_id=W3QTBI7HY6MML4KR2AQIZN6V3WJWTOQ76VVAGDPWFFTENTIWEZHA, seg_pos={0 0}, upload=298393]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:54326->145.79.227.14:4840: use of closed network connection; context deadline exceeded Oct 7 16:37:43.568132746 (339h6m29.030225229s) [seg_pos={0 0}, upload=298393]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 7 16:37:43.813925743 (339h6m29.276018226s) [upload=298393]: Done uploading segments... Oct 7 16:37:43.813962183 (339h6m29.276054666s) [upload=298393]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.291748809s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)